-- Logs begin at Mon 2022-07-11 13:52:47 UTC, end at Mon 2022-07-11 16:23:12 UTC. -- Jul 11 14:28:19.896673 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 14:28:19.904013 n-d-master-1 devstack@keystone.service[80977]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:28:19 2022] *** Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: nodename: n-d-master-1 Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: machine: x86_64 Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: clock source: unix Jul 11 14:28:19.906040 n-d-master-1 devstack@keystone.service[80977]: pcre jit disabled Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: detected number of CPU cores: 4 Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: current working directory: / Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: your processes number limit is 47680 Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: your memory page size is 4096 bytes Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: detected max file descriptor number: 2048 Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: lock engine: pthread robust mutexes Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: thunder lock: enabled Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 14:28:19.906531 n-d-master-1 devstack@keystone.service[80977]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:28:19.952773 n-d-master-1 devstack@keystone.service[80977]: Python main interpreter initialized at 0x55f3108b79c0 Jul 11 14:28:19.952773 n-d-master-1 devstack@keystone.service[80977]: python threads support enabled Jul 11 14:28:19.952773 n-d-master-1 devstack@keystone.service[80977]: your server socket listen backlog is limited to 100 connections Jul 11 14:28:19.952773 n-d-master-1 devstack@keystone.service[80977]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:28:19.953171 n-d-master-1 devstack@keystone.service[80977]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:28:19.953297 n-d-master-1 devstack@keystone.service[80977]: *** Operational MODE: preforking *** Jul 11 14:28:19.953888 n-d-master-1 devstack@keystone.service[80977]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:28:19.953888 n-d-master-1 devstack@keystone.service[80977]: spawned uWSGI master process (pid: 80977) Jul 11 14:28:19.954102 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 11 14:28:19.956672 n-d-master-1 devstack@keystone.service[80977]: spawned uWSGI worker 1 (pid: 80989, cores: 1) Jul 11 14:28:19.956672 n-d-master-1 devstack@keystone.service[80977]: spawned uWSGI worker 2 (pid: 80990, cores: 1) Jul 11 14:28:19.956672 n-d-master-1 devstack@keystone.service[80977]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:28:25.487700 n-d-master-1 devstack@keystone.service[80989]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:28:25.487700 n-d-master-1 devstack@keystone.service[80989]: from cryptography.utils import int_from_bytes Jul 11 14:28:25.488529 n-d-master-1 devstack@keystone.service[80989]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:28:25.488529 n-d-master-1 devstack@keystone.service[80989]: from cryptography.utils import int_from_bytes Jul 11 14:28:25.490093 n-d-master-1 devstack@keystone.service[80990]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:28:25.490093 n-d-master-1 devstack@keystone.service[80990]: from cryptography.utils import int_from_bytes Jul 11 14:28:25.490596 n-d-master-1 devstack@keystone.service[80990]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:28:25.490596 n-d-master-1 devstack@keystone.service[80990]: from cryptography.utils import int_from_bytes Jul 11 14:28:25.536827 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:28:25.537006 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:28:25.537195 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] command line args: [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:28:25.537464 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:28:25.537642 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ================================================================================ {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:28:25.537807 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:28:25.537897 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] admin_token = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.538030 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:28:25.538117 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] config_dir = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.538251 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] command line args: [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:28:25.538332 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.538467 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] config_source = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.538617 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:28:25.538699 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] debug = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.538800 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ================================================================================ {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:28:25.538878 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539110 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] admin_token = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539227 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539305 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] config_dir = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539398 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539476 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539631 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539720 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] config_source = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539835 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] debug = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.539940 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540043 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540184 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540289 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540392 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_config_append = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540488 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540589 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540589 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_dir = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540783 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540880 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_file = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.540982 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541078 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541202 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541279 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541404 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_config_append = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541404 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541626 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541706 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_dir = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541822 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.541900 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_file = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542024 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542102 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542224 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542307 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542378 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542530 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542623 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542759 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542848 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.542965 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543087 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543164 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543288 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543370 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543442 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543556 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543668 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543781 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.543916 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544001 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544188 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544273 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544447 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544691 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544773 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544888 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] publish_errors = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.544963 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545089 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545193 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545307 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545485 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545701 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545791 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545887 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] publish_errors = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.545974 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546128 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546207 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] standard_threads = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546361 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546450 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546557 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546633 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546802 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.546932 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547007 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] use_journal = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547076 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547146 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] use_json = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547257 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] standard_threads = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547343 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] use_stderr = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547460 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] use_syslog = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547544 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547690 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547769 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547886 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.547964 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.548065 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] use_journal = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.548167 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.548245 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] use_json = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.548402 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] use_stderr = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.548486 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.548570 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] use_syslog = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.548648 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.548794 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:28:25.548878 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549046 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549131 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549284 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549364 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549542 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549620 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549781 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.549865 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550025 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550110 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550259 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550337 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550521 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550607 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550753 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550840 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.550986 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551065 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551232 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551316 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551478 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551558 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551715 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551803 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.551969 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552104 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552334 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552474 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552564 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552701 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552779 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552850 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.552929 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553002 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553156 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553236 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553406 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553499 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553649 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553728 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553877 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.553954 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554107 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554185 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554337 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554416 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554594 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554676 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554847 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.554925 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555092 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555173 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555325 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555402 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555557 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555641 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555792 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.555873 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556038 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556116 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556277 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556363 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556511 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556589 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556743 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556821 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.556975 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.557060 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.557761 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.557854 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.557995 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558080 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558227 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558377 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558458 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558579 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558707 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558795 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.558937 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559024 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559168 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559247 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559398 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559478 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559631 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559718 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559859 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.559937 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560092 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560169 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560327 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560414 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560558 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560635 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560796 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.560873 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561024 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561109 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561256 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561341 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561491 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561615 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561723 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561873 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.561961 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562114 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562193 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562355 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562435 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562620 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562704 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.562861 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563000 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563102 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563235 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563328 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563498 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563579 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563739 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563823 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.563971 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564051 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564218 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564298 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564457 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564536 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564720 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564801 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.564956 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565047 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565187 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565271 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565424 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565504 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565662 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565757 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565895 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.565974 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566136 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566236 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566384 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566474 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566653 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566738 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566892 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.566991 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.567126 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.567205 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.567363 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.567692 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.567867 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.567937 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568102 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568172 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568335 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568409 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568572 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568641 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568807 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.568952 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569061 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569208 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569286 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569404 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569489 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569564 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569708 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569791 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.569967 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570044 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570237 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570324 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570423 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570523 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570685 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570801 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.570931 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571063 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571214 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571292 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571410 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571492 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571597 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571673 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571828 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.571909 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572059 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572139 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572290 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572412 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572525 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572613 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572755 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.572863 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.573602 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.573767 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.573868 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.573943 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574075 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.external = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574239 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574373 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574569 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574717 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574786 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574862 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.574941 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575053 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.password = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575148 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575288 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] auth.token = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575379 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.external = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575527 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575615 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575763 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.575843 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576010 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576103 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576242 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576322 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.password = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576481 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] auth.token = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576562 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576723 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576811 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.576952 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577032 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577189 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577268 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577417 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577504 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577667 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577748 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577911 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.577991 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578142 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578229 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578382 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578463 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578640 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578722 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578889 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.578980 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579138 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579333 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579414 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579576 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579656 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579827 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.579908 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580092 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580181 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580348 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580429 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580586 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580671 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580840 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.580920 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581123 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581203 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581359 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581440 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581596 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581675 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581844 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.581923 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582090 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582172 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582322 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582403 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582591 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582676 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582819 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.582902 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583065 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583143 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583297 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583376 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583546 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583619 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583779 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.583861 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584028 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584110 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584266 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584350 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584509 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584590 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584746 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584824 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.584975 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585051 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585217 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585297 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585464 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585543 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585695 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585777 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.585933 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586021 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586166 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586253 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586415 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586509 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586667 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586747 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586899 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.586991 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587130 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587210 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587375 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587455 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587604 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587691 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587833 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.587914 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588063 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588143 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588310 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588398 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588587 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588754 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588851 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.588932 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589067 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589161 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589299 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589380 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589535 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589615 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589766 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.589855 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590002 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590083 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590244 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590324 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590477 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590590 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590730 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590811 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.590965 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591044 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591205 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591293 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591447 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591527 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591680 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591759 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.591913 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592000 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592159 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592238 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592389 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592468 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592624 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592712 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592852 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.592932 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593089 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593168 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593320 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593408 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593558 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593638 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593788 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.593868 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594020 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594112 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594254 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594332 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594516 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594606 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594752 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594884 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.594969 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595114 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595219 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595369 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595449 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595651 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595733 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.595911 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596028 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596147 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596290 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596379 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596545 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596632 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596798 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.596879 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597038 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597126 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597276 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597357 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597513 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597596 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597747 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597836 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.597989 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598073 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598225 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598303 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598462 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598655 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598732 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598803 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.598974 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599054 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599221 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599304 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599457 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599537 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599688 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599768 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.599924 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600006 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600159 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600239 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600396 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600476 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600624 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600705 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600869 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.600948 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601105 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601183 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601339 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601421 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601573 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601655 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601806 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.601886 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602051 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602132 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602297 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602379 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602555 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602639 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602796 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.602878 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603029 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603108 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603261 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603339 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603497 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603577 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603732 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603811 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.603986 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604066 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604237 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604319 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604465 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604543 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604698 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604777 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.604935 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605016 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605169 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605247 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605407 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605487 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605655 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605737 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605892 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.605972 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606122 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606201 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606360 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606442 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606623 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606692 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606869 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.606949 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607105 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607187 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607348 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607484 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607581 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] role.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607656 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607806 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] role.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.607889 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608027 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608108 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608276 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608356 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608523 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608606 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608770 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.608849 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609006 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] role.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609086 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609248 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609330 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] role.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609678 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609754 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609827 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609900 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.609981 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610057 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610184 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610265 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610428 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610587 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610680 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610756 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.610933 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611012 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611179 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611339 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611417 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611616 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611697 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611849 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.611928 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612099 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612182 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612346 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612428 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612590 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612686 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.612837 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613018 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613099 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613256 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613336 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613506 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613595 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613764 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613845 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.613992 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614071 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614225 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614314 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614455 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614556 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614736 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614816 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.614988 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615080 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615235 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615315 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615469 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615548 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615700 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615787 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.615929 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616008 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616160 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616239 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616396 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616480 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616642 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616722 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616878 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.616957 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617110 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617191 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617342 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617422 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617577 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617657 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617812 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.617894 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618060 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618140 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618303 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618382 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618558 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618643 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618801 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.618883 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.619037 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.619116 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.619279 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.619360 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.619522 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620242 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620329 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620402 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620514 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620598 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620755 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620834 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.620989 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621068 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.connection = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621235 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621325 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621484 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621567 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621713 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621793 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.621954 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622034 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622187 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622268 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622422 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622517 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.connection = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622681 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622847 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.622986 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623111 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623191 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623323 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623404 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623572 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623652 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623809 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.623892 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624045 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624125 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624276 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624355 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624509 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624590 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624737 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624817 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.624975 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.625054 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.625211 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.625292 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.625366 n-d-master-1 devstack@keystone.service[80989]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:28:25.625439 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.625677 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.625913 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.626156 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.626386 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.626653 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.626891 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:28:25.627061 n-d-master-1 devstack@keystone.service[80990]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:28:25.657524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.657760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.657958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.658349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.658612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.658837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.667936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.668537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.696994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.697226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.697533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.697792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.750823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.839669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.875611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.875845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.892042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.892276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.942294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.942808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.943048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.943207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.943366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.943492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.943662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.943927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.944157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.944380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.944602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.945069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.969934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.970737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.982274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.982545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.995390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.995622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.995850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.996073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.996296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.996507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.996723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80990) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.997023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.997259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.997480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.997696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.997914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.998124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:25.998336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80989) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:28:26.014966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.015122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:28:26.015307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.015441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.015597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:28:26.015702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:28:26.015849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:28:26.016161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.016935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.017095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.027823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.028848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.036871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.037064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.040199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.040365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.040477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.040646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.040760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.040931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.041884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.042983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.043124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.043280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.070149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.070351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.071827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.072006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.072165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.072316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.077417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.077580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.077716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.077859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.077994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.078125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.085396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.085604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.085716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.085889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.090709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.090915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.091002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.091203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.091302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.091492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.091575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.091769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.091852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.092830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.111212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.111496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.111670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.111950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.116020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.116545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.120160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.120454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.120882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.121177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.125529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.126295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.129102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.129908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.132991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.133291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.133533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.133615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.133835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.133930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.134123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.134204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.134402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.134533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.134711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.134989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.154084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.154369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.154638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.154747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.154917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.154997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.155185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.155456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.162876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.163620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.164594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.164872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.165477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.165755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.168142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.168429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.168709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.168988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.169072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.169263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.169362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.169578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.169856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.170144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.183061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.183338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.183617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.183895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.183977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.184172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.184253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.184452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.184535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.184734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.184824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.185014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.185300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.185576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.203599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.206276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.206902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.210605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.211974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.212490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.214223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.214615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.214912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.217955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.221036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.222536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.224204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.224460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.224845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.225245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.227538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.228583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.228583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.228583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.237000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.237963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.238260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.238649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.238975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.242841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.243120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.243411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.243700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.247877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80989) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.248208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.248488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.248710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.248985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.249284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.249560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.249835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.251489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.251895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.252190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.252470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.252760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.253046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80989) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.253990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.254293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.254602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.263243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80990) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:28:26.263526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.263807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.264085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.264356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.264640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.264916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.265238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.265579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.265865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.266140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.266415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.266712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.267001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80990) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:28:26.291630 n-d-master-1 devstack@keystone.service[80989]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f3108b79c0 pid: 80989 (default app) Jul 11 14:28:26.295201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b74a-e084-4a09-a593-db65bedaebc5 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:26.295503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b74a-e084-4a09-a593-db65bedaebc5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:26.295792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b74a-e084-4a09-a593-db65bedaebc5 None None] PATH_INFO: `/v3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:26.300054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Mon Jul 11 14:28:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:26.304910 n-d-master-1 devstack@keystone.service[80990]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f3108b79c0 pid: 80990 (default app) Jul 11 14:28:34.510011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:34.510720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:34.510720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:34.512002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:34.520456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:34.521031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:34.521031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:34.590483 n-d-master-1 devstack@keystone.service[80990]: INFO dbcounter [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] Registered counter for database keystone Jul 11 14:28:34.612646 n-d-master-1 devstack@keystone.service[80990]: DEBUG oslo_db.sqlalchemy.engines [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:28:34.619720 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writer thread running {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:28:34.808596 n-d-master-1 devstack@keystone.service[80990]: DEBUG passlib.handlers.bcrypt [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80990) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:28:34.808925 n-d-master-1 devstack@keystone.service[80990]: DEBUG passlib.handlers.bcrypt [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80990) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:28:34.865505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:34.867252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:34.995781 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:28:35.192872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:35.263880 n-d-master-1 devstack@keystone.service[80989]: INFO dbcounter [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] Registered counter for database keystone Jul 11 14:28:35.283073 n-d-master-1 devstack@keystone.service[80989]: DEBUG oslo_db.sqlalchemy.engines [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:28:35.290064 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writer thread running {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:28:35.410710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc383-9d8d-42e6-8099-b8edf6b06c42 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:35.415060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:35.415725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.416008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.416785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.425029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:35.477397 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:28:35.477645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c2d2-ebdd-4717-b2e5-201e1fd39c9f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:35.489737 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1324 bytes} [Mon Jul 11 14:28:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:28:35.496356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:35.513633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9cea-7726-49ab-91d4-13d3fdf8b44c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:35.518039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:35.519194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.519486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.519765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] PATH_INFO: `/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.521310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] RBAC: Authorizing `identity:get_project(project_id=9ef8c4b1c0304eae9ff050142c12cb98)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:35.572448 n-d-master-1 devstack@keystone.service[80990]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:28:35.572813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723a96d-86c6-4ee1-963a-62e4214085ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:35.577507 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2/5] 10.222.0.77 () {56 vars in 1207 bytes} [Mon Jul 11 14:28:35 2022] GET /identity/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:37.631451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9e220-2fbb-42d3-b6fa-11bfdf20dc94 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:37.632261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9e220-2fbb-42d3-b6fa-11bfdf20dc94 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:37.632261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9e220-2fbb-42d3-b6fa-11bfdf20dc94 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:37.636880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4/6] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:37.642944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:37.643704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:37.643704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:37.667881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:37.669435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:37.677416 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:28:37.700929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9e220-2fbb-42d3-b6fa-11bfdf20dc94 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:37.713618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9e220-2fbb-42d3-b6fa-11bfdf20dc94 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:37.717972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f99583-db55-4252-a022-587da5b67ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:37.718655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99583-db55-4252-a022-587da5b67ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:37.718942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99583-db55-4252-a022-587da5b67ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:37.719215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99583-db55-4252-a022-587da5b67ebe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:37.727380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f99583-db55-4252-a022-587da5b67ebe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:37.730779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f99583-db55-4252-a022-587da5b67ebe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:37.740250 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1324 bytes} [Mon Jul 11 14:28:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:28:37.746888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:37.757331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072723e-cc5b-454a-a9d9-6bb58f03d219 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:37.762076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdbba2-e57e-472b-bbb8-ae3dcb53ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:37.762988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbba2-e57e-472b-bbb8-ae3dcb53ebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:37.763274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbba2-e57e-472b-bbb8-ae3dcb53ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:37.763549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbba2-e57e-472b-bbb8-ae3dcb53ebe9 admin admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:37.764987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdbba2-e57e-472b-bbb8-ae3dcb53ebe9 admin admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:37.766887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdbba2-e57e-472b-bbb8-ae3dcb53ebe9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:37.768505 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4/9] 10.222.0.77 () {56 vars in 1198 bytes} [Mon Jul 11 14:28:37 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:39.973308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eef501-2d94-4787-b849-68b80279a8aa None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:39.973849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eef501-2d94-4787-b849-68b80279a8aa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:39.973849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eef501-2d94-4787-b849-68b80279a8aa None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:39.975575 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:39.981704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:39.982150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:39.982281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:39.982871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2aae5-b9b2-4052-ad74-14af56eea831 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:39.983165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2aae5-b9b2-4052-ad74-14af56eea831 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:39.983445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2aae5-b9b2-4052-ad74-14af56eea831 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:39.984749 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 7/11] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:39.990437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:39.991179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:39.991470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:39.999458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:40.000661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:40.031478 n-d-master-1 devstack@keystone.service[80989]: DEBUG passlib.handlers.bcrypt [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80989) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:28:40.032059 n-d-master-1 devstack@keystone.service[80989]: DEBUG passlib.handlers.bcrypt [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80989) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:28:40.078680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:40.080290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:40.085971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 5/12] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:40.109560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.133388 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.184472 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 8/13] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:40.206431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.212840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549673-b023-44c1-aa96-cb02d5bd566a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.247249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.247972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.248260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.248538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.260258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:40.271551 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:40.272529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:28:40.273556 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 6/14] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:40.279340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.317022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb13e4d-6dd6-4316-a6c8-db9849afff16 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.319766 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.357357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.358266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.358589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.358874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.363332 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.384329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1192d47-f8b3-44b8-aea9-615eacca9be4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.422415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.423635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.423870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.424194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.425038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:40.425377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.427235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.435503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.437052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.440371 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 7/15] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:40.446212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.538806 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 9/16] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:28:40.544334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.545707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874165ae-002a-4c7c-9fd5-03c12420556d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.547287 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.581506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.582374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.582696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.582978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.584199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.585662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.587323 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 8/17] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:40.593287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.607644 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.643894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d444f7-fcf0-42e6-9844-6076b9aaa395 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.679512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.680324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.680621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.680889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.697819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96000a-0ebf-4484-86ac-f5641814aefc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.700818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.702316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:40.723450 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:40.724327 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:40.725121 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:40.725121 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:40.725121 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:40.725121 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:28:40.725121 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:40.731056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.734139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.735043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.735334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.735616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.736816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.738272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.739926 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:40.746182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:40.790185 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.829673 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:40.841854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371d4d6-4cae-4ed3-b8f0-375de81a1784 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.849186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b983b2e-86cd-44f2-beb0-c9766bc01764 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:40.877279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.877949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.878234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.878541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.879278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:40.879595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.880990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdcd35-b9ae-424e-8f90-65361921a3fa None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.884077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:40.884735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:40.885022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:40.885304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:40.886140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.domain.id=default, user.id=99da4aa360e0445583e1621d96997686) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:40.886455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:40.887908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841714-e941-4d0d-9d27-0333d708ac59 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:40.894709 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 10/20] 10.222.0.77 () {56 vars in 1322 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/role_assignments?user.id=99da4aa360e0445583e1621d96997686&scope.domain.id=default&role.id=70eee5d669654151b878064c431c4f7b => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:40.898796 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 11/21] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:43.004605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1830a5-5e8a-4ffe-af15-01d37a07c742 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.005124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1830a5-5e8a-4ffe-af15-01d37a07c742 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.005453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1830a5-5e8a-4ffe-af15-01d37a07c742 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.007003 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 11/22] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:43.013255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.013708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.014002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.032064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:43.033398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:43.139869 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 12/23] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:43.174852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1830a5-5e8a-4ffe-af15-01d37a07c742 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:43.309600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1830a5-5e8a-4ffe-af15-01d37a07c742 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:43.356712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:43.357518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.357805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.358079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.372875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:43.380730 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:43.381616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:28:43.382383 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 12/24] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:43.388260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:43.445886 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:43.506169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422468c4-1af1-4121-b4c6-19e6ef37e32c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:43.542566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:43.543246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.543530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.543800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.544551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:43.544854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:43.546238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffe4d1-ab8d-4f02-9e0f-dbf66d701862 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:43.561228 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 13/25] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:43.567068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:43.571978 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:43.694144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b613c5f-97b4-4b27-8822-66b9527c7337 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:43.738210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:43.739190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.739474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.739746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.741066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:43.742756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdcea-93de-4108-b9df-1bbd8a577107 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.743042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdcea-93de-4108-b9df-1bbd8a577107 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.743316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdcea-93de-4108-b9df-1bbd8a577107 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.745248 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 14/26] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:43.746749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:43.748409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 13/27] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:43 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:43.750725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.751009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.751287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.757233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:43.776582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:43.777928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:43.891151 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:43.905384 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 15/28] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:43.937266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8b55-bc22-4780-87ca-92bd9941e838 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:43.954454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.028831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.030653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.030653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.030653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.040233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.049824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.060388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 14/29] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:44.071542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.074836 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:44.264738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fc9c-a97e-43ed-85db-7461bc4c20bf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.352451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fcf2c-aca1-4285-a9ee-4294c385bd03 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.396276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4d09-27e9-4572-bec6-18f2b28e1970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.397346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4d09-27e9-4572-bec6-18f2b28e1970 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.397722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4d09-27e9-4572-bec6-18f2b28e1970 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.398009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4d09-27e9-4572-bec6-18f2b28e1970 None admin] PATH_INFO: `/v3/domains/default/users/99da4aa360e0445583e1621d96997686/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.400048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4d09-27e9-4572-bec6-18f2b28e1970 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99da4aa360e0445583e1621d96997686, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.402207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4d09-27e9-4572-bec6-18f2b28e1970 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.403935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d332-fad6-446a-a5c9-3508d56633a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.404619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d332-fad6-446a-a5c9-3508d56633a2 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.404909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d332-fad6-446a-a5c9-3508d56633a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.405186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d332-fad6-446a-a5c9-3508d56633a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.405951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d332-fad6-446a-a5c9-3508d56633a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.407739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d332-fad6-446a-a5c9-3508d56633a2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.421343 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:44.550894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 15/30] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Jul 11 14:28:44 2022] PUT /identity/v3/domains/default/users/99da4aa360e0445583e1621d96997686/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:44.553005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb956d-b864-4ad3-a59b-2cb7f19db11c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.553553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb956d-b864-4ad3-a59b-2cb7f19db11c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.554055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb956d-b864-4ad3-a59b-2cb7f19db11c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.560425 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 16/31] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:44.576963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df8668-175c-46d3-9791-83a340b02082 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.577567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df8668-175c-46d3-9791-83a340b02082 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.578171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df8668-175c-46d3-9791-83a340b02082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.627805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-76df8668-175c-46d3-9791-83a340b02082 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:44.629508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-76df8668-175c-46d3-9791-83a340b02082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:44.668024 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 16/32] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Jul 11 14:28:43 2022] POST /identity/v3/roles => generated 225 bytes in 714 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:44.672545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c417-9c66-47eb-95fb-51f3492b450e None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.673499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c417-9c66-47eb-95fb-51f3492b450e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.673981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c417-9c66-47eb-95fb-51f3492b450e None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.676822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 17/33] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:44.688821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.689547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.690032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.722619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:44.725214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:44.874863 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 17/34] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:44.904928 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 18/35] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:44.945013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df8668-175c-46d3-9791-83a340b02082 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.955569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:45.007552 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:45.117814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df8668-175c-46d3-9791-83a340b02082 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:45.151023 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:45.156917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:45.157892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.158311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.158715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.160074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014d3da-fbd8-4561-8fce-e45589bb2a69 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:45.170786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:45.172570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:45.194152 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:45.195038 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:45.196057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:45.196057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:45.196057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:45.196057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:28:45.197635 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 18/36] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:45.203543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:45.246753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86010-02f6-49b1-9720-f3144cfa10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:45.247473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86010-02f6-49b1-9720-f3144cfa10a0 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.247833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86010-02f6-49b1-9720-f3144cfa10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.248113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86010-02f6-49b1-9720-f3144cfa10a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.249001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86010-02f6-49b1-9720-f3144cfa10a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:45.250573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86010-02f6-49b1-9720-f3144cfa10a0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:45.269648 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 19/37] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Jul 11 14:28:44 2022] POST /identity/v3/roles => generated 219 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:45.271730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d833-8b9c-4f73-ac6c-e72ddc40307e None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.272307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d833-8b9c-4f73-ac6c-e72ddc40307e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.272908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d833-8b9c-4f73-ac6c-e72ddc40307e None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.279198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 20/38] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:45.282743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.283848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.284368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.307042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:45.309317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:45.344963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61506b-8f45-47fe-86f6-3db2e62bd8f3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:45.416344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:45.417465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.418028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.418579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.419713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:45.420289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:45.422035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:45.429112 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 21/39] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:45.457726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 19/40] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:45.463760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:45.472736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:45.498964 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:45.528859 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:45.603606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6799c9-dfa9-45e5-a43c-0961f2f8fe63 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:45.654809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880cb76-ad78-4d36-b858-f957c3c32963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:45.654809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880cb76-ad78-4d36-b858-f957c3c32963 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.654809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880cb76-ad78-4d36-b858-f957c3c32963 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.654809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880cb76-ad78-4d36-b858-f957c3c32963 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.655535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880cb76-ad78-4d36-b858-f957c3c32963 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:45.657059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880cb76-ad78-4d36-b858-f957c3c32963 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:45.695765 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 22/41] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:45 2022] POST /identity/v3/projects => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:45.695765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a152-dccd-47f6-969c-ca2bbe503437 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.695765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a152-dccd-47f6-969c-ca2bbe503437 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.695765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a152-dccd-47f6-969c-ca2bbe503437 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.695765 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 23/42] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:45.702332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.702656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.702944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.723164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fdddb-7fee-4688-9120-b9b4b5f36590 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:45.725351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:45.727936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:45.771141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:45.771928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:45.772225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:45.772784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:45.773581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:45.775045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:45.801878 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 20/43] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Jul 11 14:28:45 2022] POST /identity/v3/roles => generated 223 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:45.823815 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:45.826878 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 24/44] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:45.855002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:45.976469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685399b-1611-49a4-a21f-c248791e9f05 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:45.978021 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:46.019027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb2c65-ea01-4f4f-ad71-3ce66257d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:46.019842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2c65-ea01-4f4f-ad71-3ce66257d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:46.020172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2c65-ea01-4f4f-ad71-3ce66257d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:46.020458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2c65-ea01-4f4f-ad71-3ce66257d6b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:46.021679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb2c65-ea01-4f4f-ad71-3ce66257d6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:46.023197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb2c65-ea01-4f4f-ad71-3ce66257d6b4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:46.024857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 21/45] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:46.030428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:46.136135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabad41-28b0-4244-ab39-b51f2333ecac None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:46.171054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7d41b-500c-4664-9f74-80549630e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:46.171731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7d41b-500c-4664-9f74-80549630e1f9 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:46.171997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7d41b-500c-4664-9f74-80549630e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:46.172281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7d41b-500c-4664-9f74-80549630e1f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:46.172998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7d41b-500c-4664-9f74-80549630e1f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:46.174465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7d41b-500c-4664-9f74-80549630e1f9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:46.200684 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 25/46] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:46 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:47.042533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22a034-06bc-4412-aebb-353b3f748682 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.043236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22a034-06bc-4412-aebb-353b3f748682 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.043236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22a034-06bc-4412-aebb-353b3f748682 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.045047 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 22/47] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:47.050365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.050750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.051104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.069637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:47.070879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:47.123035 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.145094 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 26/48] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:47.168090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22a034-06bc-4412-aebb-353b3f748682 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.270161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22a034-06bc-4412-aebb-353b3f748682 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.303951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.304665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.304955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.305240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.317584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:47.325793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:47.326714 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:28:47.327487 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 23/49] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:47.333066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.434764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73994394-984b-4948-ad54-b6d4b25a89c4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.485282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.485956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.486243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.486552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.487316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:47.487628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.489030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.498145 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 27/50] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:47.503760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.536275 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.607073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e77a1-7740-46a8-8fdb-9b4906378763 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.640063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.640925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.641213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.641490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.642698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.644162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.645797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 24/51] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:47.651886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.699516 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.752066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304ba49-189f-4eea-9b9b-5160b7c115fa None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.894451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c00e2e-4d79-4002-aea1-f37e510aed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.895276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00e2e-4d79-4002-aea1-f37e510aed26 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.895559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00e2e-4d79-4002-aea1-f37e510aed26 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.895837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00e2e-4d79-4002-aea1-f37e510aed26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.897016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c00e2e-4d79-4002-aea1-f37e510aed26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.898464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c00e2e-4d79-4002-aea1-f37e510aed26 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.900360 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 28/52] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:47.905925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:48.005537 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:48.010315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347c02-b3b6-4edf-ba8c-f911341dce80 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:48.049024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:48.049745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:48.049978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:48.050257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:48.051144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.domain.id=default, user.id=99da4aa360e0445583e1621d96997686) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:48.051459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:48.052955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d988-1143-46e8-9df2-174db06b0692 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:48.060137 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 25/53] 10.222.0.77 () {56 vars in 1322 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/role_assignments?user.id=99da4aa360e0445583e1621d96997686&scope.domain.id=default&role.id=70eee5d669654151b878064c431c4f7b => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:48.255080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20209af2-646d-4da8-8f19-2b2d533b1886 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:48.255264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20209af2-646d-4da8-8f19-2b2d533b1886 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:48.255554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20209af2-646d-4da8-8f19-2b2d533b1886 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:48.256944 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 29/54] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:48.262970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:48.263271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:48.263558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:48.281874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:48.283121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:48.350594 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 26/55] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:48.373640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20209af2-646d-4da8-8f19-2b2d533b1886 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:48.474455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20209af2-646d-4da8-8f19-2b2d533b1886 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:48.487502 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:48.508900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e6adb-4f5b-43f9-a9d4-ffebb52ee865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:48.509618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6adb-4f5b-43f9-a9d4-ffebb52ee865 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:48.510429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6adb-4f5b-43f9-a9d4-ffebb52ee865 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:48.510733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6adb-4f5b-43f9-a9d4-ffebb52ee865 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:48.511904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e6adb-4f5b-43f9-a9d4-ffebb52ee865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:48.513340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e6adb-4f5b-43f9-a9d4-ffebb52ee865 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:48.515011 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 30/56] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:48.520953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:48.609008 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:48.619074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35232ec4-4d93-4eb2-8705-c391951bd23a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:48.653038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7492d28-5470-4e55-bf67-0c6d3d2e3117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:48.654025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7492d28-5470-4e55-bf67-0c6d3d2e3117 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:48.654313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7492d28-5470-4e55-bf67-0c6d3d2e3117 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:48.654622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7492d28-5470-4e55-bf67-0c6d3d2e3117 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:48.655366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7492d28-5470-4e55-bf67-0c6d3d2e3117 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:48.656877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7492d28-5470-4e55-bf67-0c6d3d2e3117 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:48.687975 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 27/57] 10.222.0.77 () {60 vars in 1140 bytes} [Mon Jul 11 14:28:48 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:50.752910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b542-c6ed-451b-a2e7-97872e880ec1 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.753463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b542-c6ed-451b-a2e7-97872e880ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.753463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b542-c6ed-451b-a2e7-97872e880ec1 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.754894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 31/58] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:50.760640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.761055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.761299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.779983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:50.781258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:50.854571 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 28/59] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:50.879782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b542-c6ed-451b-a2e7-97872e880ec1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:50.981623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b542-c6ed-451b-a2e7-97872e880ec1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:51.014590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26725bd1-6c97-43de-ae6c-d6117e25d35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:51.015291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26725bd1-6c97-43de-ae6c-d6117e25d35a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:51.015578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26725bd1-6c97-43de-ae6c-d6117e25d35a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:51.015855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26725bd1-6c97-43de-ae6c-d6117e25d35a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:51.017038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26725bd1-6c97-43de-ae6c-d6117e25d35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:51.018487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26725bd1-6c97-43de-ae6c-d6117e25d35a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:51.020140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 32/60] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:51.026320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:51.103275 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:51.128535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340babc3-392f-4b7d-b7da-5529e8dfe1cf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:51.162036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ac9c6-bd28-421e-b450-4a630d6ef45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:51.162731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ac9c6-bd28-421e-b450-4a630d6ef45c None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:51.163024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ac9c6-bd28-421e-b450-4a630d6ef45c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:51.163309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ac9c6-bd28-421e-b450-4a630d6ef45c None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:51.164034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ac9c6-bd28-421e-b450-4a630d6ef45c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:51.165505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ac9c6-bd28-421e-b450-4a630d6ef45c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:51.192616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 29/61] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:28:51 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:54.477135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d57de-c18b-4764-92cc-505fbddd4527 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.478148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d57de-c18b-4764-92cc-505fbddd4527 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.479381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d57de-c18b-4764-92cc-505fbddd4527 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.480957 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 33/62] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:54.486459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa08b00-aacb-47ba-b0b4-fd355087d196 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.486924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa08b00-aacb-47ba-b0b4-fd355087d196 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.487125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa08b00-aacb-47ba-b0b4-fd355087d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.511180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2aa08b00-aacb-47ba-b0b4-fd355087d196 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:54.512415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2aa08b00-aacb-47ba-b0b4-fd355087d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:54.552279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf884f-83c3-4606-81e4-a739146c5384 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.552279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf884f-83c3-4606-81e4-a739146c5384 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.552279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf884f-83c3-4606-81e4-a739146c5384 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.552279 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 34/63] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:54.558583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.559098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.559577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.594627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:54.595864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:54.622921 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 30/64] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:54.642059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc6d31-059b-48a7-be26-2715ceca005c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.642355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc6d31-059b-48a7-be26-2715ceca005c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.642675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc6d31-059b-48a7-be26-2715ceca005c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.644884 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 31/65] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:54.656089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.656662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.657162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.666981 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:54.679331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:54.681121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:54.693431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 35/66] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:54.694570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:54.755186 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:54.768116 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 32/67] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:28:54.768968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:54.823399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc8ea-7bc4-42d9-a541-cfda315763f0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:54.860993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1e8ef-7461-4d55-abeb-a856b4a81e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:54.861807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1e8ef-7461-4d55-abeb-a856b4a81e2f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.862101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1e8ef-7461-4d55-abeb-a856b4a81e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.862384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1e8ef-7461-4d55-abeb-a856b4a81e2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.875113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1e8ef-7461-4d55-abeb-a856b4a81e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:54.880019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798dac6-7b12-4e4a-8c52-1638e6c80877 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0eb1e8ef-7461-4d55-abeb-a856b4a81e2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:54.884371 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:54.885350 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:28:54.886111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:28:54.890890 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 36/68] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:54.892163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040225-6c63-4a49-9e6e-2013784af50b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.892458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040225-6c63-4a49-9e6e-2013784af50b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.892746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040225-6c63-4a49-9e6e-2013784af50b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.894066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 37/69] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:54.898893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040225-6c63-4a49-9e6e-2013784af50b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:54.918430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:54.919376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:54.919783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:54.920189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:54.932111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:54.940350 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:54.941199 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:54.941995 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:28:54.943367 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:54.946762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 33/70] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:54.948219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.002725 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.009132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040225-6c63-4a49-9e6e-2013784af50b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.047523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2d66d-9377-4fb9-a209-213af73d720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.048339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2d66d-9377-4fb9-a209-213af73d720e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.048792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2d66d-9377-4fb9-a209-213af73d720e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.049248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2d66d-9377-4fb9-a209-213af73d720e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.060781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2d66d-9377-4fb9-a209-213af73d720e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:55.066551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04b7e-fcc4-411d-8008-747c7ac5cb97 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2bd2d66d-9377-4fb9-a209-213af73d720e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:55.069536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:55.070739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:28:55.071703 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:28:55.074252 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 38/71] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:28:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:55.075650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.076067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.076491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.094601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:55.095816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:55.110770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.111457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.111743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.112038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.112811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:55.113132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.114575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.124181 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 34/72] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:28:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.125223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.179075 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 39/73] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:55.180431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.218114 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.233889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb22b-6e00-4612-8322-6fb60fc7e2d7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.248333 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.271130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930476a-370c-4045-9474-f630774ab786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.271728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930476a-370c-4045-9474-f630774ab786 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.272018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930476a-370c-4045-9474-f630774ab786 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.272301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930476a-370c-4045-9474-f630774ab786 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.273060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930476a-370c-4045-9474-f630774ab786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:55.273374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930476a-370c-4045-9474-f630774ab786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.274800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930476a-370c-4045-9474-f630774ab786 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.283334 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 35/74] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.284120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930476a-370c-4045-9474-f630774ab786 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.296117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189b02c-18ad-46b9-bd98-77c434e025e7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.330971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.331643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.331930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.332211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.332961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:55.333395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.334700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdffe2c-ecec-453c-938b-d3d3abe9c0bf None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.342842 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 40/75] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.344100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ec53-cbac-4955-bba3-50350154e8a4 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.344394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ec53-cbac-4955-bba3-50350154e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.344676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ec53-cbac-4955-bba3-50350154e8a4 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.346088 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 41/76] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:55.346649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ec53-cbac-4955-bba3-50350154e8a4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.386479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930476a-370c-4045-9474-f630774ab786 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.421011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.421922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.422212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.422531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.437877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.439418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.441103 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.441227 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 36/77] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.441915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.457307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ec53-cbac-4955-bba3-50350154e8a4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.480446 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.491289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.492100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.492398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.492678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.503435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:55.512132 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:55.512965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:28:55.513736 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 42/78] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:55.514349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.558431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43afd3a-2e02-474a-bd6e-3750b778e15f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.604979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77181ae1-fefa-4a3f-8df7-854c4a76b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.605944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77181ae1-fefa-4a3f-8df7-854c4a76b396 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.606255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77181ae1-fefa-4a3f-8df7-854c4a76b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.606622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77181ae1-fefa-4a3f-8df7-854c4a76b396 None admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.608023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77181ae1-fefa-4a3f-8df7-854c4a76b396 None admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.609599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77181ae1-fefa-4a3f-8df7-854c4a76b396 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.615840 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 37/79] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.615840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.615840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.615840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.630641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c266db-63cb-4fb7-a356-799380cbe4d9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.631255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:55.632476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:55.670211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.671132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.671419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.671698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.673169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.674669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.676534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 43/80] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.677090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.696952 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.707283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 38/81] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:55.708139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.739405 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.788419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554b19-a5a8-477a-83fb-db0900b914d4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.809857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d0a61-cb3e-4fd2-a801-d15705a57ffd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.822670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.823328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.823610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.823889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.844369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.845043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.845328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.845607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:55.846358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:55.846697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.848096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.856893 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 39/82] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:55.857736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:55.896267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:55.897753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:55.916402 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.950177 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:55.959880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d30d-e1b1-4577-8604-e427619a1a45 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:55.993194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:55.993849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:55.994760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:55.995044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.000477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 44/83] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:28:56.001344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.068376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.069777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.100428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976190a6-77df-460d-b444-1d45c74d06f0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.118903 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.135610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.136272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.136554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.136836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.160096 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.170810 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 40/84] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:28:56.171661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.207736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.209219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.277386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abebf36-9158-4ec0-b561-77740ccbe3c2 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.316250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.317084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.317667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.317667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.320846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.321760 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 45/85] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:28:56.322741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.327183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.329049 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 41/86] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:56.329851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.344065 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.393514 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.431819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3d1f5-5fdc-4886-bedd-f09b479e41f7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.438665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf7c1-8e2f-44e3-8f22-887fc1639df5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.469505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.470396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.470731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.471033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.472313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.473801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.475608 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 46/87] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:56.475760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.476428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.476536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.476918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.477089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.479625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.481118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.482933 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 42/88] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:56.483722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.567705 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.584739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11586cf-b10e-4c7c-83bf-cb7838a48e18 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.586486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6e33-9c51-496c-b7ed-276aa6ce10ce None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.613883 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.620138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.621018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.621311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.621599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.622814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.623085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.623951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.624246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.624343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.624530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.625723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.625987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 47/89] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:56.626765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.627211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.633924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 43/90] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:56.633924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.734483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a8933-e841-4fb2-b122-7f4266e754a9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.735110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921ddcf-b811-4e59-a0d9-8cc6a2e3394b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.768390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.768787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.769072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.769363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.769498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.769650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.769769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.769991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.770378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.771871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.797706 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 48/91] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:28:56 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:56.798587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.839013 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.840220 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.849068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.851145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.937367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6c592-26a3-4d98-97c1-d026874db23b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.970155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 44/92] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:28:56.970985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.989707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.990385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.990858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.991142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.992308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=cf3043f1a63b4881b1c42ef97ac8f852) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:56.992631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.994827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:57.004674 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 49/93] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/role_assignments?user.id=cf3043f1a63b4881b1c42ef97ac8f852&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=26950413237349fdbc8f22b4a35296e3 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:57.005334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:57.096656 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:57.104442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0d48-a370-43bf-8cad-600152a093a0 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:57.126447 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:57.161787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:57.162903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:57.163488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:57.163952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:57.165416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=99da4aa360e0445583e1621d96997686) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:57.166142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:57.167939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:57.168317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef802c-85ae-461f-adfd-fb43ac14ad33 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:57.175894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 45/94] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:56 2022] GET /identity/v3/role_assignments?user.id=99da4aa360e0445583e1621d96997686&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:57.176616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:57.218444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:57.219261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:57.219561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:57.219842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:57.220710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] RBAC: Adding query filter params (role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=cf3043f1a63b4881b1c42ef97ac8f852) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:57.221030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:57.223572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:57.229460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 50/95] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:57 2022] GET /identity/v3/role_assignments?user.id=cf3043f1a63b4881b1c42ef97ac8f852&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:57.324693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408579-b64b-4644-9e15-2ac5ee1722f4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:57.365772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec552ee-d27c-43b9-97da-4400bf849828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:57.366593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec552ee-d27c-43b9-97da-4400bf849828 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:57.366891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec552ee-d27c-43b9-97da-4400bf849828 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:57.367172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec552ee-d27c-43b9-97da-4400bf849828 None admin] PATH_INFO: `/v3/projects/b75162468ec44bafbafaa4a32fc51cc6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:57.368563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec552ee-d27c-43b9-97da-4400bf849828 None admin] RBAC: Authorizing `identity:get_project(project_id=b75162468ec44bafbafaa4a32fc51cc6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:57.370158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec552ee-d27c-43b9-97da-4400bf849828 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:57.372049 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 46/96] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:57 2022] GET /identity/v3/projects/b75162468ec44bafbafaa4a32fc51cc6 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:57.378253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:57.535637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe87420-1b88-4f2a-b002-5743a27fc331 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:57.584227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:57.585017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:57.585211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:57.585469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:57.586323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=b75162468ec44bafbafaa4a32fc51cc6, user.id=cf3043f1a63b4881b1c42ef97ac8f852) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:57.586673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:57.588671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f928b-4d92-4861-addf-0df6bd306b7f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:57.597105 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 51/97] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:57 2022] GET /identity/v3/role_assignments?user.id=cf3043f1a63b4881b1c42ef97ac8f852&scope.project.id=b75162468ec44bafbafaa4a32fc51cc6&role.id=26950413237349fdbc8f22b4a35296e3 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:59.540600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4eee-0678-440a-bd6e-ee0d910e9f72 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:59.541665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4eee-0678-440a-bd6e-ee0d910e9f72 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:59.541665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4eee-0678-440a-bd6e-ee0d910e9f72 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:59.543357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 47/98] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:59.548465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac780-7452-421a-b1c7-8cfe1db9748d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:59.548884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac780-7452-421a-b1c7-8cfe1db9748d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:59.549054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac780-7452-421a-b1c7-8cfe1db9748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:59.556361 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:59.575850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b21ac780-7452-421a-b1c7-8cfe1db9748d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:59.577070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b21ac780-7452-421a-b1c7-8cfe1db9748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:59.665192 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 52/99] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:28:59.710243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4eee-0678-440a-bd6e-ee0d910e9f72 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:59.758531 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:59.819443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7a9d-ba26-455c-8947-ee077660f9ab None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:59.819731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7a9d-ba26-455c-8947-ee077660f9ab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:59.819932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7a9d-ba26-455c-8947-ee077660f9ab None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:59.821328 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 53/100] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:59.827738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:59.828290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:59.828588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:59.860125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:59.862114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:59.876345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4eee-0678-440a-bd6e-ee0d910e9f72 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:59.951328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:59.952522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:59.953018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:59.953494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:59.978820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:59.986966 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:59.987897 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:28:59.988644 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:28:59.998222 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 48/101] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:00.004444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.021263 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 54/102] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:00.080352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.166683 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:00.167999 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:00.196438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b7c3-2928-431d-b857-0e93819236a1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.239252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cd226-7fbd-4244-99c0-7f4e132d1023 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.266745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.267809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.268294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.268799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.269756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:00.270261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:00.273163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256086b-2977-4e39-be0e-f025edf0c043 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:00.291657 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 49/103] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:00.295419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa939e-7977-4a70-bbef-5c410c9e6ef8 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.298075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa939e-7977-4a70-bbef-5c410c9e6ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.298628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa939e-7977-4a70-bbef-5c410c9e6ef8 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.300928 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 50/104] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:00.303611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa939e-7977-4a70-bbef-5c410c9e6ef8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.319113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37e55-9d94-4f54-a07f-4d7f56550aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.320284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37e55-9d94-4f54-a07f-4d7f56550aac None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.320826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37e55-9d94-4f54-a07f-4d7f56550aac None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.321323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37e55-9d94-4f54-a07f-4d7f56550aac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.335303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d37e55-9d94-4f54-a07f-4d7f56550aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b4d37e55-9d94-4f54-a07f-4d7f56550aac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:00.343938 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:00.344806 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:00.345551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:00.347939 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 55/105] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:00.349451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.349965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.354525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.374843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:00.376477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:00.460666 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 56/106] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:00.462118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.462224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa939e-7977-4a70-bbef-5c410c9e6ef8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.499486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d59a-7aa3-48d6-afe1-a752fb19b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.500519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d59a-7aa3-48d6-afe1-a752fb19b025 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.500814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d59a-7aa3-48d6-afe1-a752fb19b025 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.501098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d59a-7aa3-48d6-afe1-a752fb19b025 None admin] PATH_INFO: `/v3/users/d4cc4ab4ab174c3caf213171f04a67a0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.519569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d59a-7aa3-48d6-afe1-a752fb19b025 None admin] RBAC: Authorizing `identity:get_user(user_id=d4cc4ab4ab174c3caf213171f04a67a0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:00.521645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d59a-7aa3-48d6-afe1-a752fb19b025 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:00.523839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 51/107] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/users/d4cc4ab4ab174c3caf213171f04a67a0 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:00.526691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfdbe8-ab4b-4cc9-98df-34895f7f6f3e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.527043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfdbe8-ab4b-4cc9-98df-34895f7f6f3e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.527332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfdbe8-ab4b-4cc9-98df-34895f7f6f3e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.529377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 52/108] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:00.534467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfdbe8-ab4b-4cc9-98df-34895f7f6f3e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.537877 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:00.550973 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:00.597875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2edd-1ac1-4119-a9d4-5d95f426a7f5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.637737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.638648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.638809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.638997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.639765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:00.640077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:00.641482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:00.650533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 57/109] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:00.657092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.677681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfdbe8-ab4b-4cc9-98df-34895f7f6f3e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.730437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78940c5-9329-4067-a0f1-7877bf1ef675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.731650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78940c5-9329-4067-a0f1-7877bf1ef675 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.731950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78940c5-9329-4067-a0f1-7877bf1ef675 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.732233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78940c5-9329-4067-a0f1-7877bf1ef675 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.733614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78940c5-9329-4067-a0f1-7877bf1ef675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:00.735252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78940c5-9329-4067-a0f1-7877bf1ef675 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:00.737172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 53/110] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:00.740382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.741028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.741537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.762517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:00.763764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:00.771240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e69a5-c698-4f5b-899a-292c6d885313 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.789405 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:00.816667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.817413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.817706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.818273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.839132 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 54/111] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:00.840305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:00.849782 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:00.907389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:00.908873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:00.953775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad36728-e959-492f-8cee-e2775d570348 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:00.989466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b63775-0ae5-4f5a-a799-5bf553ae0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:00.990349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b63775-0ae5-4f5a-a799-5bf553ae0896 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.990667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b63775-0ae5-4f5a-a799-5bf553ae0896 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.990955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b63775-0ae5-4f5a-a799-5bf553ae0896 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.992182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b63775-0ae5-4f5a-a799-5bf553ae0896 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:00.993671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b63775-0ae5-4f5a-a799-5bf553ae0896 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:00.995924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 55/112] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:00.997298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb835-c38b-4168-a43c-59f47370ebcc None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:00.997598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb835-c38b-4168-a43c-59f47370ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:00.997882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb835-c38b-4168-a43c-59f47370ebcc None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:00.999163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 56/113] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:00.999860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cb835-c38b-4168-a43c-59f47370ebcc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.018240 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 58/114] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:01.019143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.034530 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.085605 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.111920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cb835-c38b-4168-a43c-59f47370ebcc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.121032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b295b-18cf-4711-900c-6563a8e7825f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.148887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.149560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.149852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.150170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.150928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.152402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.154892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961bc76-218b-41db-949e-3f0a45792be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.155693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961bc76-218b-41db-949e-3f0a45792be7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.155983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961bc76-218b-41db-949e-3f0a45792be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.156270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961bc76-218b-41db-949e-3f0a45792be7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.167170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961bc76-218b-41db-949e-3f0a45792be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a961bc76-218b-41db-949e-3f0a45792be7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:01.175471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:01.176481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:01.183536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 59/115] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:01.184190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 57/116] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:29:00 2022] POST /identity/v3/projects => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:01.184258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd223c-14de-4234-88bb-a585ce6c9d6a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.184258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd223c-14de-4234-88bb-a585ce6c9d6a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.184371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.184442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd223c-14de-4234-88bb-a585ce6c9d6a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.184442 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 60/117] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:01.184442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.184442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.184442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.204680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:01.206029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:01.282160 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 61/118] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:01.283066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.292625 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.328171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71b26-c602-4120-a896-0ff181e82a0d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.361765 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.375922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.376727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.377124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.377306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.379371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.380894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.382806 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 58/119] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:01.383652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.423662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b275c54-58e6-420a-84ae-109a953ee9be None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.470235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2c718-a643-4184-b3b5-50100d21ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.471183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2c718-a643-4184-b3b5-50100d21ca50 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.471476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2c718-a643-4184-b3b5-50100d21ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.471759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2c718-a643-4184-b3b5-50100d21ca50 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.473093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2c718-a643-4184-b3b5-50100d21ca50 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.475368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2c718-a643-4184-b3b5-50100d21ca50 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.477908 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 62/120] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:01.483266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.483266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.483266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.500234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:01.501480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:01.506194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666ac29-8afa-44d1-b00a-73160bdaebc6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.546124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.546861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.547158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.547445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.548220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:01.548540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.549968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.559698 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 59/121] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:01.561319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.598536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 63/122] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:01.598536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.598536 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.629404 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.682515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7180df-cef7-4308-8f70-d7b4ad3b99ba None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.721858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.722708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.723045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.723142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ed691-d645-48fc-a5de-53a3fac7559b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.723348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.734780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:01.742904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:01.743773 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:01.744532 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 60/123] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:01.745164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.766404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.767352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.767638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.767925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13/users/cf3043f1a63b4881b1c42ef97ac8f852/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.769987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] RBAC: Authorizing `identity:create_grant(project_id=df86fc30458d40578b75a53394e16a13, user_id=cf3043f1a63b4881b1c42ef97ac8f852, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.771603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.788781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 64/124] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:01 2022] PUT /identity/v3/projects/df86fc30458d40578b75a53394e16a13/users/cf3043f1a63b4881b1c42ef97ac8f852/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:01.789634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.880608 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.909120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9c492-b818-47a2-82c1-68bc344514c8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.934149 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.937820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988ac6-99ea-4ef5-8178-7cd33dc2c78e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.961759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.962424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.962824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.963093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.964418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] RBAC: Adding query filter params (role.id=16cec8ca9d37466d8bf8300bc0907bde, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=d4cc4ab4ab174c3caf213171f04a67a0) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:01.964418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.965737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.973123 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 61/125] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/role_assignments?user.id=d4cc4ab4ab174c3caf213171f04a67a0&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=16cec8ca9d37466d8bf8300bc0907bde => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:01.974653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.987232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.988175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.988468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.988750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.990191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.991819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.994691 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 65/126] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:01.995432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.148471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783bd35-3111-4ff3-addb-0897f51f757c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.155880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e1e0-1e10-4ff9-91b2-fabe7363390d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.190339 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:02.199421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.200401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.200845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.201267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.202189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:02.203447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:02.205146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:02.217674 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 66/127] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:02.219354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.232205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.233019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.233309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.233837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.249362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:02.258276 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:02.259272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:02.260431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 62/128] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:02.261590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.317325 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:02.362994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2318c-7ee7-432f-8596-f7830925a4a0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.407565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.408936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.409782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.410287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.412546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:02.414269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:02.416826 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 67/129] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:02 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:02.417869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.449148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b002a1f-6a1a-4350-a6f6-1fe28cfab555 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.495169 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:02.524376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.525312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.525607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.525928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.531351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:02.532886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:02.534690 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 63/130] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:02 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:02.535513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.547043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56363ba9-e694-4f87-8e35-a38097139742 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.590325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.591655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.594959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.595477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.596460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:02.597006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:02.600295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:02.620620 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 68/131] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:02.621497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.764639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1821aa-b728-4d6f-bd07-d88479cf50d8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.772558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39b215-b4c0-4d93-a40a-d674817e9954 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:02.786436 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:02.793478 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:02.806554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.807803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.808294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.808786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.810367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:02.812137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:02.814432 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 69/132] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:02 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:02.815505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:02.859509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:02.862360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:02.865529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:02.866068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13/users/99da4aa360e0445583e1621d96997686/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:02.868723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] RBAC: Authorizing `identity:create_grant(project_id=df86fc30458d40578b75a53394e16a13, user_id=99da4aa360e0445583e1621d96997686, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:02.870634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:02.889544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 64/133] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:02 2022] PUT /identity/v3/projects/df86fc30458d40578b75a53394e16a13/users/99da4aa360e0445583e1621d96997686/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:02.890807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:03.032319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e85a-91c5-4e8f-8d87-7188f1b41208 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:03.094187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:03.095677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.096158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.096645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.098209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:03.100196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:03.102390 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 70/134] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:02 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:03.108439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:03.115408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde89be3-e917-48a0-817b-5d605524f745 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:03.194137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:03.195590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.196089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.196561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13/users/cf3043f1a63b4881b1c42ef97ac8f852/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.199263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] RBAC: Authorizing `identity:create_grant(project_id=df86fc30458d40578b75a53394e16a13, user_id=cf3043f1a63b4881b1c42ef97ac8f852, role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:03.202586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:03.225566 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 65/135] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:02 2022] PUT /identity/v3/projects/df86fc30458d40578b75a53394e16a13/users/cf3043f1a63b4881b1c42ef97ac8f852/roles/f3798a3824ee40189ce3ab7045b9621e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:03.234943 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:03.287962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a334-4037-4699-bee4-e400b4531ef7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:03.338350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece831a-dca0-4e78-b351-68c2fa23b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:03.339659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece831a-dca0-4e78-b351-68c2fa23b129 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.340154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece831a-dca0-4e78-b351-68c2fa23b129 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.340607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece831a-dca0-4e78-b351-68c2fa23b129 None admin] PATH_INFO: `/v3/projects/b75162468ec44bafbafaa4a32fc51cc6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.342686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece831a-dca0-4e78-b351-68c2fa23b129 None admin] RBAC: Authorizing `identity:get_project(project_id=b75162468ec44bafbafaa4a32fc51cc6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:03.344270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece831a-dca0-4e78-b351-68c2fa23b129 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:03.346348 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 71/136] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:03 2022] GET /identity/v3/projects/b75162468ec44bafbafaa4a32fc51cc6 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:03.352452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:03.399233 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:03.505437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422956-cb15-4395-8819-717332c4ca7f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:03.562870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f154c-9b82-448b-9159-3c1f4f74a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:03.564332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f154c-9b82-448b-9159-3c1f4f74a387 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.564808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f154c-9b82-448b-9159-3c1f4f74a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.565304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f154c-9b82-448b-9159-3c1f4f74a387 None admin] PATH_INFO: `/v3/projects/b75162468ec44bafbafaa4a32fc51cc6/users/cf3043f1a63b4881b1c42ef97ac8f852/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.572743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f154c-9b82-448b-9159-3c1f4f74a387 None admin] RBAC: Authorizing `identity:create_grant(project_id=b75162468ec44bafbafaa4a32fc51cc6, user_id=cf3043f1a63b4881b1c42ef97ac8f852, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:03.574237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f154c-9b82-448b-9159-3c1f4f74a387 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:03.593129 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 66/137] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:03 2022] PUT /identity/v3/projects/b75162468ec44bafbafaa4a32fc51cc6/users/cf3043f1a63b4881b1c42ef97ac8f852/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:03.707442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5caab-027f-45aa-8188-ae3937118b47 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.708184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5caab-027f-45aa-8188-ae3937118b47 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.708184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5caab-027f-45aa-8188-ae3937118b47 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.709642 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 72/138] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:03.717196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.717496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.717783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.737003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:03.738225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:03.833377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 67/139] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:03.878355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5caab-027f-45aa-8188-ae3937118b47 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.012177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5caab-027f-45aa-8188-ae3937118b47 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:04.046106 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:04.055726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22527b7-d9f6-491e-929b-cc84909ce378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:04.056550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22527b7-d9f6-491e-929b-cc84909ce378 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.056839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22527b7-d9f6-491e-929b-cc84909ce378 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.057123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22527b7-d9f6-491e-929b-cc84909ce378 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.063672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22527b7-d9f6-491e-929b-cc84909ce378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:04.065303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22527b7-d9f6-491e-929b-cc84909ce378 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:04.067497 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 73/140] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:04.073860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.102935 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:04.227233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb743c-4b92-40d8-aa50-7f1f98864adc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:04.273892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f74f4-5815-4ad2-8c65-868de37c1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:04.274943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f74f4-5815-4ad2-8c65-868de37c1a3b None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.275918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f74f4-5815-4ad2-8c65-868de37c1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.276389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f74f4-5815-4ad2-8c65-868de37c1a3b None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.277317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f74f4-5815-4ad2-8c65-868de37c1a3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:04.279048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f74f4-5815-4ad2-8c65-868de37c1a3b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:04.309928 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 68/141] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:04 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:04.794388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001febba-5d10-4a96-ae12-edbf35521e6b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.794950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001febba-5d10-4a96-ae12-edbf35521e6b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.795026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001febba-5d10-4a96-ae12-edbf35521e6b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.796380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 74/142] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:04.802762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.803054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.803339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.827834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:04.829746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:04.879902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c25c6-802d-4fae-b25c-9996a62729ae None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.880203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c25c6-802d-4fae-b25c-9996a62729ae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.880454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c25c6-802d-4fae-b25c-9996a62729ae None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.881839 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 75/143] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:04.900216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.900503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.900793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.922209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 69/144] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:04.935724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:04.937738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:05.019622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.023777 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:05.048777 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 76/145] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:05.131690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.174608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc5789-b5d4-416a-a8ca-7a763e44f1b8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:05.212941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:05.213765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:05.214056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:05.214440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:05.227025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:05.237515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:05.238681 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:05.240270 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 70/146] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:05.245241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.306175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb535-559d-49be-a0ba-ae973d2e901e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:05.316677 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:05.355945 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:05.361865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f3585-3a41-4454-a1a0-53e98e53765a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:05.380336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:05.381163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:05.381452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:05.381729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:05.402977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:05.404176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:05.404669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:05.405158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:05.406162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:05.406704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:05.408336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:05.408743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:05.417957 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:05.418984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:05.419753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:05.421603 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 71/147] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:05.422727 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 77/148] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:05.428713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.429454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.611355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc046a1d-677d-4c0f-bd8e-b6234bd0bab1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:05.670029 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:05.695223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:05.696270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:05.696760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:05.696901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b5196-2d02-44e0-b7be-8b8847cc6217 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:05.697414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:05.698696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:05.699216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:05.700833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:05.721837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 72/149] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:05.727023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.769753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571381-eb61-4c38-a983-439633283691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:05.771234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571381-eb61-4c38-a983-439633283691 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:05.771529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571381-eb61-4c38-a983-439633283691 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:05.771810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571381-eb61-4c38-a983-439633283691 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:05.775826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571381-eb61-4c38-a983-439633283691 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:05.777702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571381-eb61-4c38-a983-439633283691 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:05.781399 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 78/150] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:05.787228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571381-eb61-4c38-a983-439633283691 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:05.923822 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:05.950310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6728d6-9bf4-4979-978a-99307142f98f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:06.011427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:06.012426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.012725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.013015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] PATH_INFO: `/v3/users/d4cc4ab4ab174c3caf213171f04a67a0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.014597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] RBAC: Authorizing `identity:get_user(user_id=d4cc4ab4ab174c3caf213171f04a67a0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:06.016126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:06.018171 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 73/151] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/users/d4cc4ab4ab174c3caf213171f04a67a0 => generated 289 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:06.027178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:06.036274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571381-eb61-4c38-a983-439633283691 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:06.097864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:06.098950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.099385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.099828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.167735 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:06.254269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:06.254434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2a4d-f0cc-4b6e-aeb5-add292d66f1a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:06.255718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:06.324167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:06.325043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.325470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.325749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.327023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:06.328511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:06.330245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 74/152] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:06 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:06.336962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:06.370330 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:06.483360 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 79/153] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:06.488955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:06.534920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62f5e-2d33-4329-9aeb-e1bafdb3f6d7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:06.578215 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:06.600468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669de8af-6489-4d1a-9268-41325994c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:06.601369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de8af-6489-4d1a-9268-41325994c1f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.601657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de8af-6489-4d1a-9268-41325994c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.601935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de8af-6489-4d1a-9268-41325994c1f9 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13/users/d4cc4ab4ab174c3caf213171f04a67a0/roles/16cec8ca9d37466d8bf8300bc0907bde` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.604030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669de8af-6489-4d1a-9268-41325994c1f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=df86fc30458d40578b75a53394e16a13, user_id=d4cc4ab4ab174c3caf213171f04a67a0, role_id=16cec8ca9d37466d8bf8300bc0907bde)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:06.605519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669de8af-6489-4d1a-9268-41325994c1f9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:06.629968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 75/154] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:06 2022] PUT /identity/v3/projects/df86fc30458d40578b75a53394e16a13/users/d4cc4ab4ab174c3caf213171f04a67a0/roles/16cec8ca9d37466d8bf8300bc0907bde => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:06.676010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fe010-cf30-432a-8d22-1e293ad063f2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:06.706031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75bb7a-cc61-4f91-b28d-c7ea2bf87612 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.706394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75bb7a-cc61-4f91-b28d-c7ea2bf87612 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.706740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75bb7a-cc61-4f91-b28d-c7ea2bf87612 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.708443 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 76/155] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:06.714250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a311630-2215-4808-9597-312b27dd0751 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.714572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a311630-2215-4808-9597-312b27dd0751 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.714874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a311630-2215-4808-9597-312b27dd0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.726229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:06.727151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.727435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.727712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.730190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:06.731731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:06.733774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 80/156] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:06 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:06.739657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:06.763514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0a311630-2215-4808-9597-312b27dd0751 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:06.764819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0a311630-2215-4808-9597-312b27dd0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:06.774564 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:06.916395 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 77/157] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 14:29:06.933963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0267-fd27-42b0-8b25-92640764e3e6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:06.980256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a311630-2215-4808-9597-312b27dd0751 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:06.981682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:06.982735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:06.983244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:06.983729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:06.984783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=cf3043f1a63b4881b1c42ef97ac8f852) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:06.985322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:06.987017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe281-f86e-4ce2-99de-718a1675f646 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:06.994175 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 81/158] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:06 2022] GET /identity/v3/role_assignments?user.id=cf3043f1a63b4881b1c42ef97ac8f852&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=26950413237349fdbc8f22b4a35296e3 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:07.148164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a311630-2215-4808-9597-312b27dd0751 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.167299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4bc8c-224f-4e54-b0eb-71bf9f3ac362 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.167887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4bc8c-224f-4e54-b0eb-71bf9f3ac362 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.168386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4bc8c-224f-4e54-b0eb-71bf9f3ac362 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.170182 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 82/159] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:07.174617 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.178782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757e3d-2c4d-4834-bcae-6e5c4af78c55 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.179469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757e3d-2c4d-4834-bcae-6e5c4af78c55 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.179934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757e3d-2c4d-4834-bcae-6e5c4af78c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.214535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.214535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.214535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.214535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.219324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fd757e3d-2c4d-4834-bcae-6e5c4af78c55 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:07.228870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd757e3d-2c4d-4834-bcae-6e5c4af78c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:07.243605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:07.251728 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:07.252898 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 78/160] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:07.263329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.347206 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 83/161] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:07.348998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360b24-67a2-483b-b6f4-fd7225189a19 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.349460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360b24-67a2-483b-b6f4-fd7225189a19 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.350066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360b24-67a2-483b-b6f4-fd7225189a19 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.355920 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 84/162] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:07.364042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.364593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.365161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.389517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:07.391049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:07.402635 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.471374 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 85/163] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:07.472532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.540798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f1dd-0821-43f7-a91c-ff39d068ad5b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.600167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318828-f700-4929-ad18-bcc2e4b3e1fb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.637179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.638278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.638595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.638877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.639791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:07.639975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:07.641399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:07.659820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.664040 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 79/164] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:07.665433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.666519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.666989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.669708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.703101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:07.723347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:07.724343 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:07.725245 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:07.728702 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 86/165] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:07.732592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.743086 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.772766 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.861512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec59a-18ec-4bd0-9b77-5eb4bdec1ceb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.911904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.913749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.914421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.918055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c78c-1cec-4035-9ee0-7d30ea943a7e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.918802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] PATH_INFO: `/v3/users/99da4aa360e0445583e1621d96997686` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.920953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] RBAC: Authorizing `identity:get_user(user_id=99da4aa360e0445583e1621d96997686)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:07.925439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:07.928523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 87/166] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/users/99da4aa360e0445583e1621d96997686 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:07.940174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.003886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:08.004601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:08.004894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:08.005246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:08.036575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:08.046683 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:08.048548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:08.050060 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 80/167] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:08.055996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.086534 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:08.119529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca764a3-2b30-4043-bf3b-ade260a0e7bb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:08.164294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:08.165363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:08.166511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:08.166998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:08.168610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:08.169170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:08.171017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:08.184780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 88/168] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:08.186720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.355961 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:08.370686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9fab8-e64d-4d6d-abbb-6f9dc362fff1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:08.410230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc3c9-f034-4d95-91fc-6487c744b41a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:08.470090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:08.471304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:08.471794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:08.472290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:08.473259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:08.473785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:08.475433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:08.482829 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:08.487201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:08.487882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:08.488178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:08.488469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:08.491344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 89/169] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:08.493381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.656770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7fc03-1b5e-49b3-85f1-f728f00e0e94 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:08.658479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:08.660244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:08.758119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:08.759068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:08.759909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:08.760188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:08.761548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:08.763110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:08.770927 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 90/170] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:08 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:08.774524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.863583 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:08.870694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 81/171] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 824 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:08.871688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.929351 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:08.972727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae501e-0d45-4d4e-bc64-dda4c0e4d2b2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:09.026725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:09.027618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.027902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.028179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] PATH_INFO: `/v3/users/cf3043f1a63b4881b1c42ef97ac8f852` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.029393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] RBAC: Authorizing `identity:get_user(user_id=cf3043f1a63b4881b1c42ef97ac8f852)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:09.030890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:09.032549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 91/172] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:08 2022] GET /identity/v3/users/cf3043f1a63b4881b1c42ef97ac8f852 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:09.033322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:09.042732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221901f7-cc43-4e58-88ba-ae6a8f1871a6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:09.088214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e864201-b305-46e4-b7ce-f325df1c6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:09.089399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e864201-b305-46e4-b7ce-f325df1c6cfe None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.089931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e864201-b305-46e4-b7ce-f325df1c6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.090461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e864201-b305-46e4-b7ce-f325df1c6cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.159040 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:09.167090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e864201-b305-46e4-b7ce-f325df1c6cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:09.169196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e864201-b305-46e4-b7ce-f325df1c6cfe None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:09.280377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 82/173] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:09.281700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085296-cd4f-4360-a20a-9d6ce5b70c45 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.281993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085296-cd4f-4360-a20a-9d6ce5b70c45 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.282277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085296-cd4f-4360-a20a-9d6ce5b70c45 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.284144 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 83/174] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:09.284900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085296-cd4f-4360-a20a-9d6ce5b70c45 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:09.328637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211318a-6cab-4f33-92dd-cfe035879a1f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:09.420943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085296-cd4f-4360-a20a-9d6ce5b70c45 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:09.426947 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:09.439114 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:09.450555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a225fa-9706-4e2f-b0b1-3b275b298bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:09.451481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a225fa-9706-4e2f-b0b1-3b275b298bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.451777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a225fa-9706-4e2f-b0b1-3b275b298bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.458525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a225fa-9706-4e2f-b0b1-3b275b298bd5 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.458525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a225fa-9706-4e2f-b0b1-3b275b298bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:09.459053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a225fa-9706-4e2f-b0b1-3b275b298bd5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:09.467946 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 92/175] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:09 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:09.470528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.471037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.471516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.472962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:09.473632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.473922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.474200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.494273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:09.495784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:09.564844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:09.566366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:09.608337 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 93/176] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:09.609477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:09.711536 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:09.730556 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 84/177] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:09.730556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:09.756246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d6a6-a517-4247-9a28-43242f97e277 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:09.794947 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:09.807542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1685e0-da11-4832-9b21-74ac539566e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:09.808733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1685e0-da11-4832-9b21-74ac539566e1 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.809146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1685e0-da11-4832-9b21-74ac539566e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.809609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1685e0-da11-4832-9b21-74ac539566e1 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.811592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1685e0-da11-4832-9b21-74ac539566e1 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:09.813464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1685e0-da11-4832-9b21-74ac539566e1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:09.815768 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 94/178] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:09 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:09.821045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e610ea-987d-4ad9-843f-ae018e6da4c5 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.821857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e610ea-987d-4ad9-843f-ae018e6da4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.822442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e610ea-987d-4ad9-843f-ae018e6da4c5 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.824625 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 95/179] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:09.825915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e610ea-987d-4ad9-843f-ae018e6da4c5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:09.869372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396f9bf-8a93-490d-a9b5-13f101394dae None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:09.906342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:09.907033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.907320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.907596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.908470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=99da4aa360e0445583e1621d96997686) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:09.908775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:09.910433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e22ee-27b4-4926-a3fc-7038cac06374 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:09.918154 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 85/180] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:09 2022] GET /identity/v3/role_assignments?user.id=99da4aa360e0445583e1621d96997686&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:09.919775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f62d0-950c-44e0-90e5-528434dca11d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:09.919885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f62d0-950c-44e0-90e5-528434dca11d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:09.920080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f62d0-950c-44e0-90e5-528434dca11d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:09.921354 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 86/181] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:09.922073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f62d0-950c-44e0-90e5-528434dca11d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:09.955609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e610ea-987d-4ad9-843f-ae018e6da4c5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.006468 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.017397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.018835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.019330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.019774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.033964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:10.042150 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:10.043360 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:10.044171 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 96/182] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:10.044828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.078989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f62d0-950c-44e0-90e5-528434dca11d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.145520 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.151635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7763f09-ffc9-46fc-ac97-699795fb81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.153662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7763f09-ffc9-46fc-ac97-699795fb81cd None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.153662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7763f09-ffc9-46fc-ac97-699795fb81cd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.153905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7763f09-ffc9-46fc-ac97-699795fb81cd None admin] PATH_INFO: `/v3/projects/b75162468ec44bafbafaa4a32fc51cc6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.156610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7763f09-ffc9-46fc-ac97-699795fb81cd None admin] RBAC: Authorizing `identity:get_project(project_id=b75162468ec44bafbafaa4a32fc51cc6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.159101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7763f09-ffc9-46fc-ac97-699795fb81cd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.161296 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 87/183] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:09 2022] GET /identity/v3/projects/b75162468ec44bafbafaa4a32fc51cc6 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.162382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.162681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.163378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.189058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:10.190666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:10.213389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0b65-cc15-4d28-bcc0-a15df57de5fe None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.252944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.253610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.253902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.254187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.255468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] RBAC: Adding query filter params (role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=cf3043f1a63b4881b1c42ef97ac8f852) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:10.255468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.256888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf4ff-8195-40bf-840d-453abfb9ce16 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.263678 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 97/184] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/role_assignments?user.id=cf3043f1a63b4881b1c42ef97ac8f852&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.264961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da002710-9a33-4f5f-915a-fb44b75906bc None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.265255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da002710-9a33-4f5f-915a-fb44b75906bc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.265531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da002710-9a33-4f5f-915a-fb44b75906bc None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.266834 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 98/185] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:10.267967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.268253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.268531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.279397 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 88/186] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:10.280302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.304524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:10.305793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:10.364899 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.400217 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 99/187] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:10.401052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.430374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6c55-da44-4c8a-889e-27c25619ab97 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.468451 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.477660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.478641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.479078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.479665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.480782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:10.482542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.482542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed299-1f86-471e-81dc-1e97a5119107 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.492365 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 89/188] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.494361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.494710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.494986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.516421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:10.517805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:10.544263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ab6a-f92a-4e50-aba1-4189cd977dcd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.582771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.583753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.584043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.584262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.585102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=b75162468ec44bafbafaa4a32fc51cc6, user.id=cf3043f1a63b4881b1c42ef97ac8f852) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:10.585411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.586892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.593170 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 100/189] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/role_assignments?user.id=cf3043f1a63b4881b1c42ef97ac8f852&scope.project.id=b75162468ec44bafbafaa4a32fc51cc6&role.id=26950413237349fdbc8f22b4a35296e3 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.593976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.604076 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 90/190] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:10.605102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.675628 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.722937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317da06-c9f7-46ea-a1a7-89d4e2671fa0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.741020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e0bcf-e70b-499d-8f81-e0193df4856b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.741858 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.761976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.762808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.763094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.763367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.764560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.766017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.767856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 101/191] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.768945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.781097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.781926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.782221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.782530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.795067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:10.804324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:10.805264 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:10.806355 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 91/192] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:10.807054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.892042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca4cb-7a5e-462c-b090-988a7fa464ce None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.914645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130190ba-0086-4b67-8207-fbfcd86bff22 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.925432 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.927292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.928588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.928926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.929203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] PATH_INFO: `/v3/users/9b1a61a30abe4848a875a13ba41ba4f2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.945560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1a61a30abe4848a875a13ba41ba4f2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.947611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.949326 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 102/193] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/users/9b1a61a30abe4848a875a13ba41ba4f2 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.950078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.951459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.952264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.952595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.952832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.964538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:10.972279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:10.973205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:10.974006 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 92/194] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:10.975262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.996076 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.056704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe3e2-3be3-431a-a158-0b92a64dc3c5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.081016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc602daf-1c87-4485-91dc-eadf302cdf3c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.091542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.092231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.092516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.092794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.093579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.095050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.117692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 103/195] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:10 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:11.119199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.119688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.120372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.120693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.121008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.121781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:11.122089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.123580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.133293 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 93/196] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:11.134247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.172043 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.256511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c583a4-5fc0-4aec-a853-a260f23a574c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.258533 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.263705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27846010-6dc1-4f3c-80a2-0cf85b88349d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.308284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.309016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.309297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.309569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.312709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.313396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.313684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.313963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.314832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:11.315183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.316781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.327614 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 94/197] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:11.328327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.394881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.396534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.485009 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.492995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaefb0-fc62-43e6-b119-70a5ada65a86 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.528363 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.534522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.535283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 104/198] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:11.536144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.536499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.536785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] PATH_INFO: `/v3/users/9b1a61a30abe4848a875a13ba41ba4f2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.537113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.538117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1a61a30abe4848a875a13ba41ba4f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.539693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.543277 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 95/199] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/users/9b1a61a30abe4848a875a13ba41ba4f2 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:11.547453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.653458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63031e-ad10-4904-9878-b4103e59d337 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.672739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e10b7-88d1-4c2b-b171-978ce4ad4da5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.701630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.702554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.702845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.703125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] PATH_INFO: `/v3/users/d4cc4ab4ab174c3caf213171f04a67a0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.704381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] RBAC: Authorizing `identity:get_user(user_id=d4cc4ab4ab174c3caf213171f04a67a0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.705872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.707900 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 105/200] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/users/d4cc4ab4ab174c3caf213171f04a67a0 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:11.708776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.733407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.735584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.736195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.736938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.739186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.741398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.745000 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 96/201] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:11.746511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.791369 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.793464 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.837210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc0461-4ebb-4ce6-9cba-a4c77bbca196 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.901490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.902168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.902478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.902763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.903521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676089-aee7-4aa9-b0fd-7de96960294b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.950262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.951416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.951932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.952530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.998250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.000330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.039557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.042320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.086941 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:12.092310 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:12.138816 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 106/202] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:12.140124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:12.187591 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 97/203] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:12.188934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:12.282427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9893a1-be6e-4710-9d14-fb710472cc72 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:12.328223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:12.328818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:12.329122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:12.329640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:12.330535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=9b1a61a30abe4848a875a13ba41ba4f2) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:12.330842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.332036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd2294-0521-419e-abab-64d17c06a28a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:12.332325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.346540 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 107/204] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:12 2022] GET /identity/v3/role_assignments?user.id=9b1a61a30abe4848a875a13ba41ba4f2&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:12.346540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:12.422057 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:12.445412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:12.448213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:12.449850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:12.450698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:12.452753 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:12.457238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.463075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.466767 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 98/205] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:12 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:12.473710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:12.594936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c96a3-90a0-40e8-8901-2bad04e849c2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:12.637317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:12.638246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:12.638667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:12.638987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:12.639917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06f2df-0549-4d52-8e1c-b865e984a921 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:12.640283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.641920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.644048 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 108/206] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:12 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:12.651584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:12.697308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:12.698034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:12.698329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:12.698634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:12.699491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] RBAC: Adding query filter params (role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=9b1a61a30abe4848a875a13ba41ba4f2) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:12.699808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.701402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc3485-5b9f-4c2e-9e88-a17ce858bdaa None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.714199 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 99/207] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:12 2022] GET /identity/v3/role_assignments?user.id=9b1a61a30abe4848a875a13ba41ba4f2&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:12.766636 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:12.770833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03454046-d7d6-47b8-bdaa-a5b4a80091ca None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:12.810200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:12.810918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:12.811383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:12.811666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:12.812541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] RBAC: Adding query filter params (role.id=16cec8ca9d37466d8bf8300bc0907bde, scope.project.id=df86fc30458d40578b75a53394e16a13, user.id=d4cc4ab4ab174c3caf213171f04a67a0) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:12.812862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:12.814345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef180e-19a5-4d44-bad0-8164b4f20ce5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:12.822371 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 109/208] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:12 2022] GET /identity/v3/role_assignments?user.id=d4cc4ab4ab174c3caf213171f04a67a0&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=16cec8ca9d37466d8bf8300bc0907bde => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:13.681689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c4ec-3469-4dce-948d-37667fbfae7a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:13.682393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c4ec-3469-4dce-948d-37667fbfae7a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:13.682393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c4ec-3469-4dce-948d-37667fbfae7a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:13.683664 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 100/209] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:13.689256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:13.690011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:13.690011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:13.701145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89db1-b6ce-4a38-ad68-04331fc25f9b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:13.702063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89db1-b6ce-4a38-ad68-04331fc25f9b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:13.702903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89db1-b6ce-4a38-ad68-04331fc25f9b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:13.706147 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 101/210] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:13.708995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:13.710627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:13.713991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:13.714601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:13.715078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:13.737261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:13.738913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:13.794676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 110/211] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:13.817607 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:13.819886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:13.829829 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 102/212] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:13.858356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:13.964869 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:13.981210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b9f54-e5f2-4bfa-805f-611b8d185b5b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:14.003528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c0c03-a010-4875-b4c8-f5e0c38e828d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:14.032120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:14.033190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.033500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.033846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.035259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:14.036930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:14.039279 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 111/213] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:14.044770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:14.052566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:14.053732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.054194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.054681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.072575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:14.083939 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:14.084911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:14.086123 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 103/214] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:14.094053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:14.170074 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:14.179979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1486e4-e82d-480b-9335-f0b5341b00f3 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:14.223733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:14.224897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.225450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.225904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.226888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:14.228730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:14.239093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d285c81-93a8-4f5c-9b42-a30ba58ed3aa None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:14.253166 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 112/215] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:14 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:29:14.284553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:14.285252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.285537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.285813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.286619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:14.286979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:14.288436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:14.304339 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 104/216] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:14.306460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:14.331153 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:14.436441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fc121-f4a4-4be0-9022-d6458eb61c1d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:14.475301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bf601-d555-4fba-aa57-56152bbc9adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:14.476641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bf601-d555-4fba-aa57-56152bbc9adc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.477122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bf601-d555-4fba-aa57-56152bbc9adc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.477588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bf601-d555-4fba-aa57-56152bbc9adc None admin] PATH_INFO: `/v3/users/222452725957481e8eef8380a72e75ff` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.494899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bf601-d555-4fba-aa57-56152bbc9adc None admin] RBAC: Authorizing `identity:get_user(user_id=222452725957481e8eef8380a72e75ff)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:14.496734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bf601-d555-4fba-aa57-56152bbc9adc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:14.499117 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 113/217] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:14 2022] GET /identity/v3/users/222452725957481e8eef8380a72e75ff => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:14.506897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:14.635836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3073e-f8c3-4566-9607-6c831fe536ec None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:14.651204 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:14.677912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:14.679041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.679570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.680052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.757649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:14.759991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:14.813421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309bf5-45b5-427f-a1a3-5e11bd811e22 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.813929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309bf5-45b5-427f-a1a3-5e11bd811e22 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.814003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309bf5-45b5-427f-a1a3-5e11bd811e22 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.815452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 114/218] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:14.822261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:14.823301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:14.823301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:14.845057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:14.847174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:14.887835 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 105/219] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:14.895807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:14.924123 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:14.934040 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 115/220] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:14.961015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:14.965786 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:15.082757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eabe1-2061-47fb-b7d3-eed839cafb47 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.117751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c18c-b68a-48a3-bf6d-35c6c2c72923 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.121968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.122805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.123092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.123377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.135112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:15.143466 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:15.144385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:15.145194 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 116/221] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:15.151435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.154614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.155490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.155781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.156062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.157290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:15.158926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:15.160991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 106/222] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:14 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:15.171042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.240098 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:15.259761 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:15.280162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d6383-72e7-4517-bd13-92d7eb863fa3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.300850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac195243-17e8-40a7-875f-afafccf1c6a9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.322270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.322882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.323172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.323451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.324300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=222452725957481e8eef8380a72e75ff) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:15.324617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:15.326783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88dd2-3112-45b4-a017-0581864e3180 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:15.334970 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 107/223] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/role_assignments?user.id=222452725957481e8eef8380a72e75ff&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=26950413237349fdbc8f22b4a35296e3 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:15.336460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c0988-9047-4922-9dd6-06735221e098 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.336880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c0988-9047-4922-9dd6-06735221e098 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.337332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c0988-9047-4922-9dd6-06735221e098 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.343006 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 108/224] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:15.352076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.352323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.352407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.352668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.354137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.354685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.355221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.356211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:15.356736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:15.358469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:15.370021 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 117/225] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:15.378524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.395986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:15.397232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:15.528058 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 109/226] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:15.554982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.604654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41098d1-6f99-4336-ae73-6c54843289cb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.645972 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:15.669769 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:15.676357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9acc97-1add-420a-9218-6c6c07f6a30f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.714127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.714965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.715255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.715535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.723224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.724122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.724438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.724862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] PATH_INFO: `/v3/users/9b1a61a30abe4848a875a13ba41ba4f2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.726610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:15.731241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1a61a30abe4848a875a13ba41ba4f2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:15.732714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:15.734373 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 118/227] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/users/9b1a61a30abe4848a875a13ba41ba4f2 => generated 283 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:15.735279 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:15.736132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:15.736925 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 110/228] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:15.742103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.742327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.914974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bed4dc-2945-4835-b03f-feecfb10c04e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.940997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3748cf-ef34-4a9b-8fd0-e022a6d37bf5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:15.952182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.952861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.953148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.953425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.954185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:15.954508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:15.956030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:15.958604 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:15.974972 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 111/229] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:15.987545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:15.994448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:15.995354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:15.995640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:15.995917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:15.997371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:15.998945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:16.000898 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 119/230] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:16.006385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:16.100271 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:16.141549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1870-7bf5-4f47-8d92-6bfb02f8f81a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:16.160282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d523-e674-499f-962f-2908cc90f0e7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:16.199325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:16.200578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:16.201082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:16.201560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f/users/9b1a61a30abe4848a875a13ba41ba4f2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:16.203938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] RBAC: Authorizing `identity:create_grant(project_id=d6df55bd486c472bb359330a7952e55f, user_id=9b1a61a30abe4848a875a13ba41ba4f2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:16.205588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:16.206764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:16.207647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:16.207938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:16.208220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] PATH_INFO: `/v3/users/9b1a61a30abe4848a875a13ba41ba4f2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:16.209549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1a61a30abe4848a875a13ba41ba4f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:16.211174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:16.214728 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 112/231] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:15 2022] GET /identity/v3/users/9b1a61a30abe4848a875a13ba41ba4f2 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:16.228251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:16.237130 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 120/232] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:16 2022] PUT /identity/v3/projects/d6df55bd486c472bb359330a7952e55f/users/9b1a61a30abe4848a875a13ba41ba4f2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:29:16.306829 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:16.343566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25386-ce99-43de-9406-e8074ba37475 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:16.380826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ecb03-1345-4603-9dff-29c2b3ffea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:16.381865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ecb03-1345-4603-9dff-29c2b3ffea6b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:16.382258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ecb03-1345-4603-9dff-29c2b3ffea6b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:16.382680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ecb03-1345-4603-9dff-29c2b3ffea6b None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:16.384103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ecb03-1345-4603-9dff-29c2b3ffea6b None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:16.386188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ecb03-1345-4603-9dff-29c2b3ffea6b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:16.388177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 113/233] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:16 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:16.394004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:16.504658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253f8b2-1783-494d-9159-826a49ee2deb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:16.529489 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:16.548864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7f26e-9a58-403d-84c1-6297dfc7794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:16.549976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f26e-9a58-403d-84c1-6297dfc7794a None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:16.550361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f26e-9a58-403d-84c1-6297dfc7794a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:16.550770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f26e-9a58-403d-84c1-6297dfc7794a None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f/users/9b1a61a30abe4848a875a13ba41ba4f2/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:16.558347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f26e-9a58-403d-84c1-6297dfc7794a None admin] RBAC: Authorizing `identity:create_grant(project_id=d6df55bd486c472bb359330a7952e55f, user_id=9b1a61a30abe4848a875a13ba41ba4f2, role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:16.559995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f26e-9a58-403d-84c1-6297dfc7794a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:16.581411 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 121/234] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:16 2022] PUT /identity/v3/projects/d6df55bd486c472bb359330a7952e55f/users/9b1a61a30abe4848a875a13ba41ba4f2/roles/f3798a3824ee40189ce3ab7045b9621e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:16.949858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e414b2-a75d-4b8a-bd5d-9f15f85a7f7b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:16.950414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e414b2-a75d-4b8a-bd5d-9f15f85a7f7b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:16.950414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e414b2-a75d-4b8a-bd5d-9f15f85a7f7b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:16.952166 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 114/235] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:16.959882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393405-302c-4d15-b386-40aac0aa92a7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:16.960367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393405-302c-4d15-b386-40aac0aa92a7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:16.960742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393405-302c-4d15-b386-40aac0aa92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:16.988387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9b393405-302c-4d15-b386-40aac0aa92a7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:16.989607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9b393405-302c-4d15-b386-40aac0aa92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:17.091670 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 122/236] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:17.144026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e414b2-a75d-4b8a-bd5d-9f15f85a7f7b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:17.188765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75675-7a89-46b6-8414-039146a394e2 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.189401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75675-7a89-46b6-8414-039146a394e2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.189920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75675-7a89-46b6-8414-039146a394e2 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.191776 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 123/237] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:17.198435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.199056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.199541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.228348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:17.229730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:17.404898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e414b2-a75d-4b8a-bd5d-9f15f85a7f7b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:17.410800 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 124/238] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:17.475149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:17.480985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:17.482900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.483508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.484052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.495957 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:17.520959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:17.548670 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:17.550203 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:17.551650 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:17.557561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 115/239] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:17.564770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:17.629989 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:17.765081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fe73-c4ca-4c47-908a-3054c7aa67fc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:17.803096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9840aa-0301-428c-aab2-eed6b728d43d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:17.834186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215378ac-e672-4ef4-b69a-1b73ca46110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:17.835311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215378ac-e672-4ef4-b69a-1b73ca46110a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.835618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215378ac-e672-4ef4-b69a-1b73ca46110a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.836070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215378ac-e672-4ef4-b69a-1b73ca46110a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.839459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215378ac-e672-4ef4-b69a-1b73ca46110a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:17.842583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215378ac-e672-4ef4-b69a-1b73ca46110a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:17.851896 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 125/240] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:17.851896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacaebe-9ffb-4a51-aba1-f45da53a43c1 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.851896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacaebe-9ffb-4a51-aba1-f45da53a43c1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.851896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacaebe-9ffb-4a51-aba1-f45da53a43c1 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.856032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 126/241] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:17.859787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacaebe-9ffb-4a51-aba1-f45da53a43c1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:17.878329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:17.879790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.880299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.880781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.881764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:17.882288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:17.884452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7eadcb-9fea-411f-b102-63759adfa720 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:17.901209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 116/242] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:17.903029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.903596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.904105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.926022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:17.928105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:18.006733 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:18.035664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacaebe-9ffb-4a51-aba1-f45da53a43c1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:18.048881 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 117/243] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:18.050832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:18.072037 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:18.130772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:18.132313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:18.132908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:18.133490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:18.134934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:18.137551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:18.179758 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 127/244] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:17 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:18.182380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:18.243185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf7470-c18e-47b7-805e-cc9dc8efc57e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:18.337610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:18.339737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:18.340569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:18.341329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] PATH_INFO: `/v3/users/de04026782b14cf9990e1d769a47f215` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:18.387892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] RBAC: Authorizing `identity:get_user(user_id=de04026782b14cf9990e1d769a47f215)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:18.390942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:18.394767 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 118/245] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:18 2022] GET /identity/v3/users/de04026782b14cf9990e1d769a47f215 => generated 297 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:18.407161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:18.417479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becb86a-d092-4680-a8e6-29a1ebe29dd0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:18.495945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:18.496766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:18.497049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:18.497320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:18.518898 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:18.521984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:18.538528 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:18.540314 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:18.542002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 128/246] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:18.554201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:18.624485 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:18.701943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935f8f-115b-4ede-b33d-b02e1422a006 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:18.782678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:18.784329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:18.785125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:18.785980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:18.786161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df8c0-3dbc-4336-9d01-52648c0e7e7f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:18.845588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:18.846674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:18.847114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:18.847481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:18.848752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:18.849227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:18.852751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:18.867886 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 129/247] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:18.878915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:18.935033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:18.938006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:19.024371 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:19.032855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea7a4-1134-4310-9c11-e404cd528e62 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:19.035178 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:19.077171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:19.078785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:19.079269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:19.079737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] PATH_INFO: `/v3/users/222452725957481e8eef8380a72e75ff` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:19.081369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] RBAC: Authorizing `identity:get_user(user_id=222452725957481e8eef8380a72e75ff)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:19.083675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:19.085656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 130/248] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:18 2022] GET /identity/v3/users/222452725957481e8eef8380a72e75ff => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:19.093769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:19.163730 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 119/249] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:29:19.173447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:19.397403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ae71-ef0e-4e29-a414-b65a5e889a4b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:19.417219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514e147-8735-4ca6-af3c-e6a801a1f395 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:19.478890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb130a59-b4c5-49dd-84f8-bd606d68d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:19.481720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb130a59-b4c5-49dd-84f8-bd606d68d1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:19.482630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb130a59-b4c5-49dd-84f8-bd606d68d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:19.483435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb130a59-b4c5-49dd-84f8-bd606d68d1b0 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:19.487365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb130a59-b4c5-49dd-84f8-bd606d68d1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:19.490640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb130a59-b4c5-49dd-84f8-bd606d68d1b0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:19.497972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 131/250] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:19 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:19.504665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8cdc3-5d82-40ce-af64-05771fe90824 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:19.505616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8cdc3-5d82-40ce-af64-05771fe90824 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:19.506373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8cdc3-5d82-40ce-af64-05771fe90824 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:19.510836 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 132/251] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:19.516511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8cdc3-5d82-40ce-af64-05771fe90824 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:19.540541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a4f2c-3e85-40bc-922d-8d29e481a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:19.540541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a4f2c-3e85-40bc-922d-8d29e481a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:19.540541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a4f2c-3e85-40bc-922d-8d29e481a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:19.540541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a4f2c-3e85-40bc-922d-8d29e481a4a0 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:19.541175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a4f2c-3e85-40bc-922d-8d29e481a4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:19.542389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a4f2c-3e85-40bc-922d-8d29e481a4a0 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:19.552754 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 120/252] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:19 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:19.553825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:19.554119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:19.554403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:19.587586 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:19.604553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:19.605481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:19.620819 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:19.755117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8cdc3-5d82-40ce-af64-05771fe90824 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:19.805121 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 121/253] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:19.806087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:19.827685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:19.829787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:19.830710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:19.831538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f/users/222452725957481e8eef8380a72e75ff/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:19.836016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] RBAC: Authorizing `identity:create_grant(project_id=d6df55bd486c472bb359330a7952e55f, user_id=222452725957481e8eef8380a72e75ff, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:19.839519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:19.863870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 133/254] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:19 2022] PUT /identity/v3/projects/d6df55bd486c472bb359330a7952e55f/users/222452725957481e8eef8380a72e75ff/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:29:19.870663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:20.157964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a45d-742b-4875-a7ac-6dcad143baf9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:20.201490 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:20.240634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:20.241831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.242334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.242852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.244947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] RBAC: Adding query filter params (role.id=16cec8ca9d37466d8bf8300bc0907bde, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=de04026782b14cf9990e1d769a47f215) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:20.245504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:20.247511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7748e-7f3c-43b3-bda4-7fd7a227eecf None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:20.248199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:20.270139 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 122/255] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:19 2022] GET /identity/v3/role_assignments?user.id=de04026782b14cf9990e1d769a47f215&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=16cec8ca9d37466d8bf8300bc0907bde => generated 259 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:20.320139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8c911-2cfd-43b5-b10f-2739dcd06496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:20.321537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c911-2cfd-43b5-b10f-2739dcd06496 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.322060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c911-2cfd-43b5-b10f-2739dcd06496 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.322613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c911-2cfd-43b5-b10f-2739dcd06496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.344743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c911-2cfd-43b5-b10f-2739dcd06496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-bab8c911-2cfd-43b5-b10f-2739dcd06496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:20.361236 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:20.362984 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:20.364508 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 134/256] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:20.373575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:20.391422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345fcc-d79e-413e-9fb1-82b467824387 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.391868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345fcc-d79e-413e-9fb1-82b467824387 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.392369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345fcc-d79e-413e-9fb1-82b467824387 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.395444 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 135/257] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:20.402846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d71f51-da19-4572-b216-584c1628c319 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.403355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d71f51-da19-4572-b216-584c1628c319 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.403848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d71f51-da19-4572-b216-584c1628c319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.407971 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:20.464787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-32d71f51-da19-4572-b216-584c1628c319 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:20.467132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-32d71f51-da19-4572-b216-584c1628c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:20.617847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5620a-894a-4a45-bd02-45414d34a758 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:20.679748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:20.680917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.681380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.681846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.683372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:20.683897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:20.686479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:20.709988 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 123/258] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:20.711831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:20.726924 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 136/259] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:20.799142 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:20.809529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d71f51-da19-4572-b216-584c1628c319 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:20.857100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65da96f-2b5c-4cb2-96c1-26e30ab1ca15 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:20.961639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:20.963699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.964213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.964690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] PATH_INFO: `/v3/users/9b1a61a30abe4848a875a13ba41ba4f2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.971321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1a61a30abe4848a875a13ba41ba4f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:20.974135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:20.978328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 124/260] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:20 2022] GET /identity/v3/users/9b1a61a30abe4848a875a13ba41ba4f2 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:21.002476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.099096 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.190869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d71f51-da19-4572-b216-584c1628c319 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.303586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6068-1570-4a92-b1b4-993e6f14af56 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.341022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.343727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.344692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.345571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.385245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:21.418533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.419103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.419631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.420122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:21.420458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:21.422539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:21.424320 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:21.429919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 137/261] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 621 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:21.440671 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.464321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.704466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:21.707090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:21.767623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f39b-c321-49ee-84c7-3e9d53ee17c0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.838684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.839763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.840265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.840743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.841789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:21.842323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:21.844030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:21.850701 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.867668 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 138/262] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:21.875801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.069334 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 125/263] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1067 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:22.075860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.223855 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.233322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59abac-07c4-471c-b675-3a01705a3577 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.367718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.370042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.370590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.371074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] PATH_INFO: `/v3/users/9b1a61a30abe4848a875a13ba41ba4f2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.378533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1a61a30abe4848a875a13ba41ba4f2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.378766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f6ab4-df20-4e92-af9c-94f1b63a092b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.381086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.387110 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 139/264] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/users/9b1a61a30abe4848a875a13ba41ba4f2 => generated 283 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:22.395710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.436971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.438452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.441500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.442022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.449127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.449309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.452597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 126/265] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:22.466099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.586464 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.703398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621448-7025-48ab-ae6c-7e5f9984b9f9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.745796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.747547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.748128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.748610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.842665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a056ea-0fc7-4932-a7ad-7c4097e67c4f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.850200 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.890628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.893376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.950724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.952817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.953595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.954485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.956289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=9b1a61a30abe4848a875a13ba41ba4f2) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:22.957174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.960586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05852c-3861-4d45-97ec-b38947330a70 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.974963 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 127/266] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/role_assignments?user.id=9b1a61a30abe4848a875a13ba41ba4f2&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:22.977826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8468-1c75-4ec8-a4a7-64545bcc97fb None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.978555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8468-1c75-4ec8-a4a7-64545bcc97fb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.980066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8468-1c75-4ec8-a4a7-64545bcc97fb None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.983485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 128/267] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:22.993520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c81-609b-4c65-b90f-5690b67cbd82 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.994313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c81-609b-4c65-b90f-5690b67cbd82 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.995036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c81-609b-4c65-b90f-5690b67cbd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.031264 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:23.067679 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 140/268] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:29:23.074386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bc973c81-609b-4c65-b90f-5690b67cbd82 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:23.074386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc973c81-609b-4c65-b90f-5690b67cbd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:23.075867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:23.199926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54c29b-d0be-46a4-9926-83073ed073cc None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:23.246412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3915f-e757-40d5-9eaf-f9645e095910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:23.248499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3915f-e757-40d5-9eaf-f9645e095910 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.249128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3915f-e757-40d5-9eaf-f9645e095910 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.249645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3915f-e757-40d5-9eaf-f9645e095910 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.251284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3915f-e757-40d5-9eaf-f9645e095910 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:23.253025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3915f-e757-40d5-9eaf-f9645e095910 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:23.255444 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 141/269] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:23 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:23.262304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8032-6e2c-4eb5-a171-cff24f3547fa None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.263901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8032-6e2c-4eb5-a171-cff24f3547fa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.264427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8032-6e2c-4eb5-a171-cff24f3547fa None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.266717 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 142/270] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:23.267736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff8032-6e2c-4eb5-a171-cff24f3547fa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:23.315297 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:23.382845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 129/271] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:23.385644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.389582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.393643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.427614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:23.429729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff8032-6e2c-4eb5-a171-cff24f3547fa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:23.434245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:23.485216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:23.486543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.487069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.487595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.488691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] RBAC: Adding query filter params (role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=9b1a61a30abe4848a875a13ba41ba4f2) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:23.489470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:23.491674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:23.500595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 143/272] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:23 2022] GET /identity/v3/role_assignments?user.id=9b1a61a30abe4848a875a13ba41ba4f2&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:23.502125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:23.649385 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 130/273] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:23.732436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:23.768328 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:23.781406 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:23.792446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedfe04-047d-4029-a45a-150dd75ec72b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:23.862553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:23.866023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.866913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.867705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.870802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:23.871886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ab311-2d29-4dac-ad56-e020b374a00f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:23.874090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:23.877921 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 144/274] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:23.887634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:23.921279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:23.922590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.923030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.923458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.938158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:23.949135 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:23.950194 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:23.951164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:23.953403 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 131/275] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:23.963812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:24.094330 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:24.105100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10e18-cd51-48b6-9388-8faed21d16e4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:24.107431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f8214-dcd2-495c-8be6-98eba75e6c80 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:24.153531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:24.154929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.155436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.155921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.157126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:24.158090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:24.160262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:24.178086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:24.178383 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 132/276] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:24.178539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.178539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.178539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.178539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:24.178539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:24.184024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:24.206529 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 145/277] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:23 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:29:24.340561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768353-57d2-459a-b9c3-736cfa0a988f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:24.386285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed72d43-50e1-4e01-be6d-99e9ece4f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:24.388251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72d43-50e1-4e01-be6d-99e9ece4f124 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.388773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72d43-50e1-4e01-be6d-99e9ece4f124 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.389259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72d43-50e1-4e01-be6d-99e9ece4f124 None admin] PATH_INFO: `/v3/users/fdbd436947a94904b87148f475909c8d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.406993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed72d43-50e1-4e01-be6d-99e9ece4f124 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbd436947a94904b87148f475909c8d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:24.409013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed72d43-50e1-4e01-be6d-99e9ece4f124 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:24.411955 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 133/278] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:24 2022] GET /identity/v3/users/fdbd436947a94904b87148f475909c8d => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:24.419012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:24.455402 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:24.501306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a371db-97e0-4fd3-9fa9-502622162bc2 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.502279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a371db-97e0-4fd3-9fa9-502622162bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.503099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a371db-97e0-4fd3-9fa9-502622162bc2 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.507437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 134/279] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:24.515537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.516333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.520192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.547296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:24.548829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:24.551513 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:24.603720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60660-0629-4279-8a77-3aac89e1027e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:24.667672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:24.668754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.669268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.669756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.670703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 135/280] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:24.671175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, user.id=fdbd436947a94904b87148f475909c8d, scope.system=all) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:24.671743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:24.673267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:24.680069 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 146/281] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Jul 11 14:29:24 2022] GET /identity/v3/role_assignments?user.id=fdbd436947a94904b87148f475909c8d&scope.system=all&role.id=26950413237349fdbc8f22b4a35296e3 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:24.708456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:24.911654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6d54f-57fc-48c5-9cd4-ecda7f9c098a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:24.979685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fece0-e68b-4b3c-9a85-5ba27b6b260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:24.980987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fece0-e68b-4b3c-9a85-5ba27b6b260e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:24.981440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fece0-e68b-4b3c-9a85-5ba27b6b260e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:24.981889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fece0-e68b-4b3c-9a85-5ba27b6b260e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:24.993597 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:24.997370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fece0-e68b-4b3c-9a85-5ba27b6b260e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-9c3fece0-e68b-4b3c-9a85-5ba27b6b260e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:25.006320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:25.007826 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:25.009545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 136/282] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:25.019947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.122800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4310-910c-4284-9de2-ce06741badda None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.123369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4310-910c-4284-9de2-ce06741badda None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.124011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4310-910c-4284-9de2-ce06741badda None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.127130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 137/283] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:25.137572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.138355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.139071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.179153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:25.180756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:25.185443 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:25.216014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9f30-9329-4d81-8fb9-aafc763cd347 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.280747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.289665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.290538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.291234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.292931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:25.293752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:25.296695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:25.322746 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 147/284] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:25.336498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.418042 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 138/285] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:25.454769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.523958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dbe47-d53c-4e2c-8f90-9741c61d46cd None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.594050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.595355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.595734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.596093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] PATH_INFO: `/v3/users/222452725957481e8eef8380a72e75ff` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.602674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] RBAC: Authorizing `identity:get_user(user_id=222452725957481e8eef8380a72e75ff)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:25.605585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:25.609642 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 148/286] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/users/222452725957481e8eef8380a72e75ff => generated 297 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:25.616922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.683112 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:25.699368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17447fc-1ba1-434b-91d5-3e57c1778f24 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.764513 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:25.769801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.770928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.771386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.771815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.785859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:25.796602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:25.797671 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:25.798632 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:25.801145 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 139/287] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:25.813737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.906763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f948c6-8b61-4b52-80bb-79afb3dd373d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.977001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.978565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.979262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.980002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.098243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd88d15-eae5-48b1-a09d-da75c7335fc4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.109465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.111298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.137016 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.232370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.233507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.234212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.234938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.236535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:26.237445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.249285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.255306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 149/288] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:29:26.265500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.282279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 140/289] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:26.292636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.448964 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.559744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80858a7d-b802-49b6-b8b6-39efd72bf50d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.568770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aad16-b3c5-4eb4-927b-ee34f215e10f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.602550 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.622769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.624730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.625405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.626060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] PATH_INFO: `/v3/users/de04026782b14cf9990e1d769a47f215` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.628484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] RBAC: Authorizing `identity:get_user(user_id=de04026782b14cf9990e1d769a47f215)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.631313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.635408 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 141/290] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/users/de04026782b14cf9990e1d769a47f215 => generated 297 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:26.643905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.652207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.653589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.654067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.657386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.665124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.668457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.672648 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 150/291] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:26.684820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.899085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55280dc-a26b-4f1d-a547-6bc365a3c271 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.919852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d9451-b500-461c-b035-885980cd0a04 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.957251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.957931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.958222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.958534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.959434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=222452725957481e8eef8380a72e75ff) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:26.959751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.961331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.967575 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.970123 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 151/292] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/role_assignments?user.id=222452725957481e8eef8380a72e75ff&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=26950413237349fdbc8f22b4a35296e3 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:27.007180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81178a6-1ef3-4eff-854b-aa0e0300c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:27.008085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81178a6-1ef3-4eff-854b-aa0e0300c68d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.008381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81178a6-1ef3-4eff-854b-aa0e0300c68d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.008686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81178a6-1ef3-4eff-854b-aa0e0300c68d None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.015561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81178a6-1ef3-4eff-854b-aa0e0300c68d None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:27.017122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81178a6-1ef3-4eff-854b-aa0e0300c68d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:27.019382 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 142/293] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:27.026517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:27.135425 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:27.247066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870faa-9d31-4808-87ac-e1127fb780d2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:27.324055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfbfcd-b467-4af0-99a8-4093edaf3234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:27.325494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfbfcd-b467-4af0-99a8-4093edaf3234 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.325963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfbfcd-b467-4af0-99a8-4093edaf3234 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.326439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfbfcd-b467-4af0-99a8-4093edaf3234 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f/users/de04026782b14cf9990e1d769a47f215/roles/16cec8ca9d37466d8bf8300bc0907bde` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.329722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfbfcd-b467-4af0-99a8-4093edaf3234 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6df55bd486c472bb359330a7952e55f, user_id=de04026782b14cf9990e1d769a47f215, role_id=16cec8ca9d37466d8bf8300bc0907bde)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:27.332106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfbfcd-b467-4af0-99a8-4093edaf3234 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:27.356846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 152/294] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:27 2022] PUT /identity/v3/projects/d6df55bd486c472bb359330a7952e55f/users/de04026782b14cf9990e1d769a47f215/roles/16cec8ca9d37466d8bf8300bc0907bde => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:29:27.733042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b60dc-ef09-4054-95ef-3ac08659ae29 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.736984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b60dc-ef09-4054-95ef-3ac08659ae29 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.736984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b60dc-ef09-4054-95ef-3ac08659ae29 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.736984 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 143/295] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:27.749942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51016e-b3c1-40b1-8a62-5d0d98d0f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.751461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51016e-b3c1-40b1-8a62-5d0d98d0f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.751978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51016e-b3c1-40b1-8a62-5d0d98d0f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.776392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9a51016e-b3c1-40b1-8a62-5d0d98d0f8e8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:27.778154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9a51016e-b3c1-40b1-8a62-5d0d98d0f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:27.867304 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 153/296] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:27.893028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b60dc-ef09-4054-95ef-3ac08659ae29 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:27.969054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0c353-02de-4edd-b9c1-33e28ffef7ea None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.969283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0c353-02de-4edd-b9c1-33e28ffef7ea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.969764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0c353-02de-4edd-b9c1-33e28ffef7ea None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.972504 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 154/297] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:27.980958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.981284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.981609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.013979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:28.015931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:28.045946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b60dc-ef09-4054-95ef-3ac08659ae29 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:28.083215 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:28.099450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:28.100935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.102278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.102825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.129845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:28.139272 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:28.140985 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:28.142486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 144/298] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:28.148202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:28.154317 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 155/299] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:28.183248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:28.219536 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:28.300976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5b3c-bc84-4516-8a07-bd2a327702e8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:28.355187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:28.355889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.356176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.356453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.357425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:28.357738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:28.359700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:28.377349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 145/300] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:28.378948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:28.381057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da4af-b710-4a1b-b5d4-b54b99bedc42 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:28.427183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:28.428321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.429331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.429962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.433099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:28.434934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:28.448269 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 156/301] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:28.456581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:28.536841 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:28.551548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534e96-b385-4dfa-8319-3c5adfc5c361 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:28.569517 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:28.615557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c977da-a6a6-4368-b261-a232548b670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:28.616569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c977da-a6a6-4368-b261-a232548b670f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.616873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c977da-a6a6-4368-b261-a232548b670f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.617158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c977da-a6a6-4368-b261-a232548b670f None admin] PATH_INFO: `/v3/users/ba2bd7a6320b4f659829c9c513db7fa5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.647331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c977da-a6a6-4368-b261-a232548b670f None admin] RBAC: Authorizing `identity:get_user(user_id=ba2bd7a6320b4f659829c9c513db7fa5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:28.651111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c977da-a6a6-4368-b261-a232548b670f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:28.654892 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 146/302] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:28 2022] GET /identity/v3/users/ba2bd7a6320b4f659829c9c513db7fa5 => generated 293 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:28.657681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79d7d-2947-42ee-9103-c94c7c78040a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.658200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79d7d-2947-42ee-9103-c94c7c78040a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.659034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79d7d-2947-42ee-9103-c94c7c78040a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.666571 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 147/303] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:28.666571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79d7d-2947-42ee-9103-c94c7c78040a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:28.682449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70827-9265-4fb1-9254-55fe2c04dbde None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:28.736520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ab2a8-b556-4961-96f9-27ceafd4869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:28.737376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ab2a8-b556-4961-96f9-27ceafd4869d None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.737789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ab2a8-b556-4961-96f9-27ceafd4869d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.738244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ab2a8-b556-4961-96f9-27ceafd4869d None admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.739126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ab2a8-b556-4961-96f9-27ceafd4869d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:28.741230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ab2a8-b556-4961-96f9-27ceafd4869d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:28.770532 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 157/304] 10.222.0.77 () {60 vars in 1134 bytes} [Mon Jul 11 14:29:28 2022] POST /identity/v3/groups => generated 229 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:29:28.770532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.770532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.770532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.792545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:28.793938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:28.888247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79d7d-2947-42ee-9103-c94c7c78040a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:28.930120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 158/305] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:28.959394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:28.960514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:28.961082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:28.961712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:28.963447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] RBAC: Adding query filter params (role.id=16cec8ca9d37466d8bf8300bc0907bde, user.id=ba2bd7a6320b4f659829c9c513db7fa5, scope.system=all) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:28.964149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:28.966887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:28.969279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:28.982719 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 148/306] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Jul 11 14:29:28 2022] GET /identity/v3/role_assignments?user.id=ba2bd7a6320b4f659829c9c513db7fa5&scope.system=all&role.id=16cec8ca9d37466d8bf8300bc0907bde => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:29.011421 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:29.172146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a08849-901f-4fe8-abab-15dfe2260015 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:29.232311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:29.233661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.234162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.234696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.255361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:29.266998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:29.267965 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:29.268771 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:29.269578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 159/307] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:29.275266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:29.309858 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:29.410529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de89e3-2a9b-452a-9e0a-c1aaff47072e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:29.468611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:29.469628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.470084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.470570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.471891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:29.472405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:29.474803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:29.491770 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 149/308] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:29.500220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:29.636859 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:29.667772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fdbf0-90b8-41e2-83a6-b44d386a0ac6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:29.727141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc4dba-59fc-4544-9555-40eebf141c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:29.729678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc4dba-59fc-4544-9555-40eebf141c6f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.730487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc4dba-59fc-4544-9555-40eebf141c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.731298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc4dba-59fc-4544-9555-40eebf141c6f None admin] PATH_INFO: `/v3/users/fdbd436947a94904b87148f475909c8d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.733727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc4dba-59fc-4544-9555-40eebf141c6f None admin] RBAC: Authorizing `identity:get_user(user_id=fdbd436947a94904b87148f475909c8d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:29.736769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc4dba-59fc-4544-9555-40eebf141c6f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:29.740761 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 160/309] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:29 2022] GET /identity/v3/users/fdbd436947a94904b87148f475909c8d => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:29.750288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:29.902964 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:29.919179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa3c09-8c37-4a9c-a3db-0f42d31c1b3d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:29.987466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138aa31-efe7-40b5-a5a8-39368997fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:29.988930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138aa31-efe7-40b5-a5a8-39368997fb75 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.989452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138aa31-efe7-40b5-a5a8-39368997fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.989972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138aa31-efe7-40b5-a5a8-39368997fb75 None admin] PATH_INFO: `/v3/system/users/fdbd436947a94904b87148f475909c8d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.994168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138aa31-efe7-40b5-a5a8-39368997fb75 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fdbd436947a94904b87148f475909c8d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:29.996901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138aa31-efe7-40b5-a5a8-39368997fb75 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.012434 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 150/310] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Jul 11 14:29:29 2022] PUT /identity/v3/system/users/fdbd436947a94904b87148f475909c8d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:29:30.300842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff380-dc57-42e3-ac09-9b6dce316578 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.301338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff380-dc57-42e3-ac09-9b6dce316578 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.301338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff380-dc57-42e3-ac09-9b6dce316578 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.303000 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 161/311] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:30.309876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.310209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.310792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.330872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:30.332421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:30.435356 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 151/312] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:30.461875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff380-dc57-42e3-ac09-9b6dce316578 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.642951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff380-dc57-42e3-ac09-9b6dce316578 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.694534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.695860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.696452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.697002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.712566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:30.724086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:30.725112 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:30.725904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:30.727206 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 162/313] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:30.735720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.879830 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:30.899979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e05ea9-f06e-4ffa-9621-77f43222c4a9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.942997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.944127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.944465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.944611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.945451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:30.945864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:30.947867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.959069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 152/314] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:30.967133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.992469 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.128812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af4bd-9a22-441f-9876-2cc4f33da05b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.171591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.185582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.185582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.185582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] PATH_INFO: `/v3/users/de04026782b14cf9990e1d769a47f215` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.187114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] RBAC: Authorizing `identity:get_user(user_id=de04026782b14cf9990e1d769a47f215)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.189193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.192787 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 163/315] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/users/de04026782b14cf9990e1d769a47f215 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:31.203187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.404438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb49c9-7a2b-46c4-8889-bbfe83fc3619 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.473424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a590aa-87e9-43a0-997b-8730e8a3ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.474435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a590aa-87e9-43a0-997b-8730e8a3ebc2 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.474946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a590aa-87e9-43a0-997b-8730e8a3ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.475412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a590aa-87e9-43a0-997b-8730e8a3ebc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.511114 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.601252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a590aa-87e9-43a0-997b-8730e8a3ebc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.603485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a590aa-87e9-43a0-997b-8730e8a3ebc2 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.771439 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 153/316] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:31.779481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.914436 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.947118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d644-736b-43e9-91b1-d2ecba4070ef None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.969971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91c040-5100-4f7e-97f7-2456649e2b11 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.970968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91c040-5100-4f7e-97f7-2456649e2b11 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.971249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91c040-5100-4f7e-97f7-2456649e2b11 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.972911 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 154/317] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:31.980511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5ad6-16d9-4061-8928-e3e40d0e203b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.981157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5ad6-16d9-4061-8928-e3e40d0e203b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.981643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5ad6-16d9-4061-8928-e3e40d0e203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.000051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4ecc5ad6-16d9-4061-8928-e3e40d0e203b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:32.001636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ecc5ad6-16d9-4061-8928-e3e40d0e203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:32.010656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.012324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.012749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.013156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.015090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:32.017613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.021603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 164/318] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:32.031468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.079142 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:32.130898 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 155/319] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:32.143076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135736f-f85e-40b1-ab53-a4efc284f125 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.143596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135736f-f85e-40b1-ab53-a4efc284f125 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.144016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135736f-f85e-40b1-ab53-a4efc284f125 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.146202 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 156/320] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:32.154095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.154485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.155067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.177847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:32.179095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:32.207839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51d1a-94af-4917-a3d2-084a0780f940 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:32.265560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.266383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.266832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.267287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.268615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] RBAC: Adding query filter params (role.id=16cec8ca9d37466d8bf8300bc0907bde, scope.project.id=d6df55bd486c472bb359330a7952e55f, user.id=de04026782b14cf9990e1d769a47f215) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:32.269072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:32.271064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.283548 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 165/321] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:32 2022] GET /identity/v3/role_assignments?user.id=de04026782b14cf9990e1d769a47f215&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=16cec8ca9d37466d8bf8300bc0907bde => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:32.285184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.289281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 157/322] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:32.314979 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:32.322333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.478932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb89f8b-563c-49e3-bc65-6550dc3b6363 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:32.513074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242d96a-9430-468b-a356-c8b5da09b419 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:32.535388 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:32.542340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.545092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.546058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.546910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.569565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:32.586032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.587199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.587723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.588219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:32.590104 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:32.592106 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:32.593906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:32.595242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:32.595242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.595622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 158/323] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:32.598032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 166/324] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:32.602890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.605576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.749752 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:32.799714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b722-a1ca-4280-b08c-4362b0547bdd None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:32.803950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbb270-0c7a-4ae8-bff9-dce5eb85d209 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:32.847890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.848911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.849455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.849936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.851237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:32.853138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.853969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.854270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.854607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.855003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.855989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:32.856494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:32.858189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e8ab3-cb8b-4912-8cb5-64cea78712bd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.871739 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 167/325] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:32.872235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942493d-7100-479b-8da2-35637ada13c4 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.872533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942493d-7100-479b-8da2-35637ada13c4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.872801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942493d-7100-479b-8da2-35637ada13c4 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.874317 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 168/326] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:32.879974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.880261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.880672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.887168 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 159/327] 10.222.0.77 () {60 vars in 1134 bytes} [Mon Jul 11 14:29:32 2022] POST /identity/v3/groups => generated 226 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:32.888081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.903213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:32.905013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:32.956300 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:33.027776 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 169/328] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:33.066865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:33.085447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338baaf9-384f-4b7b-a216-a88a98260928 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:33.150151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:33.152472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:33.152930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:33.153577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] PATH_INFO: `/v3/users/ba2bd7a6320b4f659829c9c513db7fa5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:33.155686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] RBAC: Authorizing `identity:get_user(user_id=ba2bd7a6320b4f659829c9c513db7fa5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:33.158042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:33.161713 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 160/329] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:32 2022] GET /identity/v3/users/ba2bd7a6320b4f659829c9c513db7fa5 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:33.168803 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:33.171890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:33.248649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e230-0474-4a2f-aa78-ce72654c63c2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:33.327059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:33.327973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:33.328289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:33.328567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:33.350402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:33.364910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:33.366786 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:33.368345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:33.371000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6d41-cf7d-431c-a407-52a1ef152bdc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:33.372698 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 170/330] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:33.374287 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:33.379917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:33.446959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:33.448543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:33.449017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:33.449582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] PATH_INFO: `/v3/system/users/ba2bd7a6320b4f659829c9c513db7fa5/roles/16cec8ca9d37466d8bf8300bc0907bde` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:33.452739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba2bd7a6320b4f659829c9c513db7fa5, role_id=16cec8ca9d37466d8bf8300bc0907bde)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:33.455534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:33.467518 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 161/331] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Jul 11 14:29:33 2022] PUT /identity/v3/system/users/ba2bd7a6320b4f659829c9c513db7fa5/roles/16cec8ca9d37466d8bf8300bc0907bde => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:33.630144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cfd74-e07b-4993-b087-560520a83bc7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:33.679157 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:33.699755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:33.701175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:33.701715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:33.702364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:33.703833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:33.704512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:33.707930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:33.726733 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 171/332] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:33.734207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:33.888794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e27ee-c39e-4cd9-9534-f471b09d980d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:33.949519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc97c-b53c-4156-b1a1-68945a775904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:33.950984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc97c-b53c-4156-b1a1-68945a775904 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:33.951337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc97c-b53c-4156-b1a1-68945a775904 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:33.951881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc97c-b53c-4156-b1a1-68945a775904 None admin] PATH_INFO: `/v3/users/fdbd436947a94904b87148f475909c8d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:33.954157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fc97c-b53c-4156-b1a1-68945a775904 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbd436947a94904b87148f475909c8d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:33.959221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fc97c-b53c-4156-b1a1-68945a775904 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:33.963464 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 162/333] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:33 2022] GET /identity/v3/users/fdbd436947a94904b87148f475909c8d => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:33.971848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:34.124664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b772eb-3209-4554-a963-2e3927c49d37 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:34.178197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:34.179360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:34.179798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:34.180292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:34.181726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] RBAC: Adding query filter params (role.id=26950413237349fdbc8f22b4a35296e3, user.id=fdbd436947a94904b87148f475909c8d, scope.system=all) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:34.182485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:34.184404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef1e65-b1f8-46f5-ac9b-1738be8e095d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:34.202684 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 172/334] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Jul 11 14:29:33 2022] GET /identity/v3/role_assignments?user.id=fdbd436947a94904b87148f475909c8d&scope.system=all&role.id=26950413237349fdbc8f22b4a35296e3 => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:35.890464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843964b-772e-4881-8808-66c5137cbbb7 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.891617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843964b-772e-4881-8808-66c5137cbbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.892162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843964b-772e-4881-8808-66c5137cbbb7 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.894527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 163/335] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:35.901425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.902397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.902862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.932291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:35.933532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:35.998488 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:36.079155 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 173/336] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:36.126103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843964b-772e-4881-8808-66c5137cbbb7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.192429 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:36.336980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843964b-772e-4881-8808-66c5137cbbb7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.398691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d779-92cf-4a0d-a133-45c659def734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.400081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d779-92cf-4a0d-a133-45c659def734 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.400579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d779-92cf-4a0d-a133-45c659def734 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.401078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d779-92cf-4a0d-a133-45c659def734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.422014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1d779-92cf-4a0d-a133-45c659def734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-bad1d779-92cf-4a0d-a133-45c659def734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:36.437057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:36.438037 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:36.438854 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:36.439979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 164/337] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:36.448364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.689350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6b76f-2786-4ffb-8ed2-98e2d4df6b3c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.695311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac35b1-4668-4fbb-8556-48d960f9dc11 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.695737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac35b1-4668-4fbb-8556-48d960f9dc11 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.696225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac35b1-4668-4fbb-8556-48d960f9dc11 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.698789 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 165/338] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:36.704217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.704517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.704799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.751773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:36.753032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:36.765274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.765975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.766260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.766556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.767377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:36.767690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:36.769084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.795055 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 174/339] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:36.804998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.904178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 166/340] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:36.943095 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:36.956712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:37.056548 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:37.061137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec786b54-ad22-4280-b903-3358446c4895 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:37.106633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48211aca-9720-489f-a79d-172148ff9ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:37.107586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211aca-9720-489f-a79d-172148ff9ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.108032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211aca-9720-489f-a79d-172148ff9ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.108463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211aca-9720-489f-a79d-172148ff9ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.242157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d647e72-8470-4348-b7ed-f7aa47fc0f65 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:37.286739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48211aca-9720-489f-a79d-172148ff9ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:37.289202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48211aca-9720-489f-a79d-172148ff9ea3 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:37.320111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259472-bacf-4c6e-8a83-8a3ddd2951e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:37.321433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259472-bacf-4c6e-8a83-8a3ddd2951e1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.321902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259472-bacf-4c6e-8a83-8a3ddd2951e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.325951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259472-bacf-4c6e-8a83-8a3ddd2951e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.351701 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:37.357559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b259472-bacf-4c6e-8a83-8a3ddd2951e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-3b259472-bacf-4c6e-8a83-8a3ddd2951e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:37.383120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:37.385002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:37.387327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:37.391908 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 167/341] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:37.397723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9853c-6b92-45db-9281-261d9e41d3a6 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.398744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9853c-6b92-45db-9281-261d9e41d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.400130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9853c-6b92-45db-9281-261d9e41d3a6 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.402584 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 168/342] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:37.406429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9853c-6b92-45db-9281-261d9e41d3a6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:37.509883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 175/343] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:37.511169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733c36f-9d52-42f9-8fc8-048ba12867ae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.511455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733c36f-9d52-42f9-8fc8-048ba12867ae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.511721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733c36f-9d52-42f9-8fc8-048ba12867ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.537877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e733c36f-9d52-42f9-8fc8-048ba12867ae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:37.539878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e733c36f-9d52-42f9-8fc8-048ba12867ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:37.541268 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:37.569240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9853c-6b92-45db-9281-261d9e41d3a6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:37.636165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:37.637031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.637470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.637874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.638918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:37.639355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:37.641357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82552ad2-58d5-45c5-92be-a4a75a8c1877 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:37.658281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 169/344] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:37.659821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb31f5-0898-4f91-b5ee-666c33fbd22f None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.660121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb31f5-0898-4f91-b5ee-666c33fbd22f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.660405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb31f5-0898-4f91-b5ee-666c33fbd22f None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.662915 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 170/345] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:37.663924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb31f5-0898-4f91-b5ee-666c33fbd22f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:37.670694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 176/346] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:37.672148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.672428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.672749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.721423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:37.723573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:37.821880 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:37.831345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 177/347] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:37.832865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:37.928237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb31f5-0898-4f91-b5ee-666c33fbd22f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:37.975825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:37.976715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:37.977028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:37.977311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:37.978625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:37.980121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:37.982536 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 171/348] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:37 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:37.986193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:38.010352 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:38.016165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57071245-442a-4df3-a3b2-bacc70b9935b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.072586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:38.073587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.074140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.074669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.119517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae79c28-8291-41a1-b05e-07abca6048e9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.150335 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:38.159833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:38.161866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:38.165868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:38.167021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.167515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.167982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.186853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:38.195467 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:38.197646 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 172/349] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:38.203335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:38.348256 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:38.383098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899f33-4ed9-446a-b451-32b6b1e1299f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.390135 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 178/350] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:38.391416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:38.451963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:38.452895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.453266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.453558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.468996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:38.478022 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:38.479875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:38.481477 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 173/351] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:38.482854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:38.571528 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:38.582845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be0f0-b88f-499d-a015-b39e0f11c3dc None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.643006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0b81e-08d8-47dc-9663-84678c05cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:38.644636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b81e-08d8-47dc-9663-84678c05cccc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.645154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b81e-08d8-47dc-9663-84678c05cccc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.646009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b81e-08d8-47dc-9663-84678c05cccc None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.654756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0b81e-08d8-47dc-9663-84678c05cccc None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:38.656548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0b81e-08d8-47dc-9663-84678c05cccc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:38.660434 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 179/352] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:38 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:38.660434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c764d-3b49-40ec-b677-f5211a05963c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.661020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c764d-3b49-40ec-b677-f5211a05963c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.662657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c764d-3b49-40ec-b677-f5211a05963c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.668578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 180/353] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:38.669565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c764d-3b49-40ec-b677-f5211a05963c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:38.697932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca934a-f8c6-444c-97fa-36a653c217bb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.749847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:38.751023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.751474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.751912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.753050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:38.753589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:38.755592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:38.763857 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:38.773259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 174/354] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:38.774736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:38.840736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c764d-3b49-40ec-b677-f5211a05963c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.895293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b345c1-301b-4822-a94c-a34e5fd419e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:38.896367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b345c1-301b-4822-a94c-a34e5fd419e2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.896518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b345c1-301b-4822-a94c-a34e5fd419e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.896686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b345c1-301b-4822-a94c-a34e5fd419e2 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.898038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b345c1-301b-4822-a94c-a34e5fd419e2 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:38.899590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b345c1-301b-4822-a94c-a34e5fd419e2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:38.901464 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 181/355] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:38 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:38.902831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a07175-f890-44e7-9188-dfd5ab04f8a3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.903128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a07175-f890-44e7-9188-dfd5ab04f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.903412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a07175-f890-44e7-9188-dfd5ab04f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.921999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-89a07175-f890-44e7-9188-dfd5ab04f8a3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:38.923278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-89a07175-f890-44e7-9188-dfd5ab04f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:38.940150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828dd1-5e13-4d54-a3cf-d870d496954a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:38.965612 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.003278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.003976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.004316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.004836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.006104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:39.006421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.008079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.019915 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 175/356] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:39.020800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.044555 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 182/357] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:39.047341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439e58-6a29-4d74-abb8-96fa6120b916 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.048295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439e58-6a29-4d74-abb8-96fa6120b916 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.048854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439e58-6a29-4d74-abb8-96fa6120b916 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.053206 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 183/358] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:39.053621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439e58-6a29-4d74-abb8-96fa6120b916 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.127373 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.194299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0868-8fb9-4e90-be4c-1ae7ff92f864 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.236200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439e58-6a29-4d74-abb8-96fa6120b916 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.256944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.256944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.256944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.256944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.257420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=df86fc30458d40578b75a53394e16a13) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:39.257659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.259760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.268055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 176/359] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=26950413237349fdbc8f22b4a35296e3 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:39.269155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.315473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.316462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.316797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.317049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] PATH_INFO: `/v3/users/ba2bd7a6320b4f659829c9c513db7fa5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.318747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] RBAC: Authorizing `identity:get_user(user_id=ba2bd7a6320b4f659829c9c513db7fa5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.320808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.324711 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 184/360] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/users/ba2bd7a6320b4f659829c9c513db7fa5 => generated 293 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:39.324711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.372033 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.492908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de4f5-233c-4aa1-9ab3-1500960e0de6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.501794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed56801-cc08-4feb-97f1-189f9b8919d6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.529099 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.544778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.545614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.545932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.546419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.547055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c8b1d-5ad8-4386-a8bf-52f118fe9d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.549529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c8b1d-5ad8-4386-a8bf-52f118fe9d55 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.549821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c8b1d-5ad8-4386-a8bf-52f118fe9d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.550187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c8b1d-5ad8-4386-a8bf-52f118fe9d55 None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.552076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c8b1d-5ad8-4386-a8bf-52f118fe9d55 None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.554241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c8b1d-5ad8-4386-a8bf-52f118fe9d55 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.560262 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 177/361] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:39.563460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.563971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.564485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.599761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:39.601343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:39.656325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.659190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.709537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 178/362] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:39.710870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.714349 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.822955 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 185/363] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:39.824064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.899805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecc248-f163-481f-a7b6-fee7fbc6e4e1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.943513 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.971292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.973011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.974823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.975121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.997677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:40.009953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddbdc3-70cb-4fa5-9562-e38385d4b323 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:40.011960 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:40.013003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:40.013953 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 179/364] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:40.015653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.060136 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.069398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.071226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.071728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.072192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.073157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] RBAC: Adding query filter params (role.id=16cec8ca9d37466d8bf8300bc0907bde, user.id=ba2bd7a6320b4f659829c9c513db7fa5, scope.system=all) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:40.073525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.075499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.095950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 186/365] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/role_assignments?user.id=ba2bd7a6320b4f659829c9c513db7fa5&scope.system=all&role.id=16cec8ca9d37466d8bf8300bc0907bde => generated 510 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.097905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.201929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d76a7-28ae-4e27-b7f3-0e17999aa018 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.260020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.260963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.261355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.261787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.262689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=df86fc30458d40578b75a53394e16a13) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:40.263035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.265014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.271893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a87f1-95e2-45b4-b301-36d6fb07803b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.273606 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 180/366] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.275209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.358562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.359405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.359826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.360115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.378828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:40.390087 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:40.391818 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 187/367] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:40.393437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.395878 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.477967 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.484321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf441b-3015-414e-9c72-e033b32bc0e8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.544200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.545546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.545879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.546389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.548763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.551482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.553819 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 181/368] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.554674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.580230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612b27-13d5-452e-a2c9-f4eed6de69d4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.660805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.661556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.661845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.662125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.662939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:40.663254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.665228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.678523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 188/369] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.678523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.751627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc63f-7887-4531-aa84-0bf202f095d5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.777616 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.832912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.835418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.836502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.837439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.840397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:40.841886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.848410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.873464 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 182/370] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.875826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.879365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956762f5-14d8-470e-b17d-5d84ff19cc20 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.890188 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.949204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.950525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.952404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.952723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.954111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.956226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.958791 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 189/371] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.960152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:41.056036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd145f-beae-4124-a122-b60a3a012f0b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:41.112528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:41.112528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:41.112528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:41.112528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:41.168540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e37c-fcc9-4938-80f9-2bc48989a108 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:41.175528 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:41.216219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:41.217827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:41.234695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:41.236326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:41.237031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:41.237513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:41.328717 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:41.391454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:41.393806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:41.418691 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 183/372] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:41.418691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:41.524974 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:41.554381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53e738-c37b-499b-aa6f-31ef00a04ad7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:41.563009 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 190/373] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:41.564345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:41.603526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:41.604355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:41.604739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:41.605707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:41.606077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=d6df55bd486c472bb359330a7952e55f) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:41.606506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:41.608161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:41.614894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 184/374] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:41 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=26950413237349fdbc8f22b4a35296e3 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:41.616046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:41.695498 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:41.728464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c11b4-9c72-4c11-9a7e-0416738dbc21 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:41.767064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb734206-98e7-4777-b0aa-8132136bd7d9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:41.778807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:41.780033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:41.780498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:41.780974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:41.782604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:41.788579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:41.792232 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 191/375] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:41 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:41.803903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:41.840451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:41.841771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:41.842163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:41.842471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] PATH_INFO: `/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:41.846687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] RBAC: Authorizing `identity:get_project(project_id=9ef8c4b1c0304eae9ff050142c12cb98)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:41.849532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:41.851485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 185/376] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:41 2022] GET /identity/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:41.857941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:41.888808 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:41.982980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1c21-0748-4585-af04-4516a1417dc9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:42.025465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:42.026609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.026887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.027206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.028565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:42.030088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:42.032094 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 192/377] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:41 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:42.041496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:42.066975 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:42.106034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812a74-b39a-438f-95e5-4bc68fde2d29 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:42.187332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230861-fe39-4621-ad9e-ae4098deef1d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:42.215896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc110d-bb9d-427b-82f6-7148fb20dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:42.216783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc110d-bb9d-427b-82f6-7148fb20dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.217073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc110d-bb9d-427b-82f6-7148fb20dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.217368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc110d-bb9d-427b-82f6-7148fb20dbe8 None admin] PATH_INFO: `/v3/groups/826418e46fd242be8ec08f445174999b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.234002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11919436-58de-486b-ada4-a402413f361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:42.234856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11919436-58de-486b-ada4-a402413f361b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.235208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11919436-58de-486b-ada4-a402413f361b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.235532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11919436-58de-486b-ada4-a402413f361b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.236631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11919436-58de-486b-ada4-a402413f361b None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=d6df55bd486c472bb359330a7952e55f) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:42.237227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11919436-58de-486b-ada4-a402413f361b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:42.240013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11919436-58de-486b-ada4-a402413f361b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:42.247448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc110d-bb9d-427b-82f6-7148fb20dbe8 None admin] RBAC: Authorizing `identity:get_group(group_id=826418e46fd242be8ec08f445174999b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:42.249038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc110d-bb9d-427b-82f6-7148fb20dbe8 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:42.250175 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 193/378] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:42 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:42.251161 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 186/379] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:41 2022] GET /identity/v3/groups/826418e46fd242be8ec08f445174999b => generated 229 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:42.257805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11919436-58de-486b-ada4-a402413f361b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:42.387653 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:42.408666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f9aa-6be7-499a-a39e-831f586c3ee2 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.409734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f9aa-6be7-499a-a39e-831f586c3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.410774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f9aa-6be7-499a-a39e-831f586c3ee2 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.413639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 187/380] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:42.416534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11919436-58de-486b-ada4-a402413f361b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:42.420658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.421132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.421613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.464748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:42.466013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:42.484123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:42.484818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.485100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.485371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.486238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] RBAC: Adding query filter params (group.id=826418e46fd242be8ec08f445174999b, role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=9ef8c4b1c0304eae9ff050142c12cb98) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:42.486575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:42.488442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:42.502443 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 194/381] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:42 2022] GET /identity/v3/role_assignments?group.id=826418e46fd242be8ec08f445174999b&scope.project.id=9ef8c4b1c0304eae9ff050142c12cb98&role.id=70eee5d669654151b878064c431c4f7b => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:42.597193 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 188/382] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:42.666717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:42.790912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3840-a8eb-4ba0-8bad-56d82dcc52c7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:42.838838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:42.840029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.840534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.841012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.856501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:42.862208 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:42.867423 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:42.869266 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:42.870428 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 195/383] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:42.882966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:42.885410 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.098582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3207aca-5534-4bc2-83be-9d17593fbe89 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.174208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.175088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.175376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.175677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.176516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:43.176830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.178295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55bd1f-2ebd-4b30-9af3-9b3eb8356bee None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.192230 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 189/384] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:43.199336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.351791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87545a2-6f00-45c1-b4ed-21150a33642b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.352134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87545a2-6f00-45c1-b4ed-21150a33642b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.352702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87545a2-6f00-45c1-b4ed-21150a33642b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.354924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 190/385] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:43.372123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.372899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.373400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.400389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d660ac-872a-492e-b35f-68d9f2833b8b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.409054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:43.411308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:43.473631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.475204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.476549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.477094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.483474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.485256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.487736 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 196/386] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:43.494784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.529051 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.551170 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 191/387] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:43.622031 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.622729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.663314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586590da-d3ab-4245-aa34-1062fdfd7d9e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.715283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.716544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.717061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.717581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.719237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.720930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.723437 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 197/388] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:43.729600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.808651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d19ba-d285-4ed3-9089-f5ec6575d09f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.855859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.857361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.858011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.858888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.875765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:43.889072 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:43.890229 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:43.891499 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:43.895451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 192/389] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:43.903166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.002238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34b7f-770c-426e-948f-796ad2e680a0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.037168 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.049184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.050617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.051120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.051666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13/groups/352fae71dfc44ae186f09bda01641c8c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.068606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] RBAC: Authorizing `identity:create_grant(project_id=df86fc30458d40578b75a53394e16a13, group_id=352fae71dfc44ae186f09bda01641c8c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.072823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.081553 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.115813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 198/390] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Jul 11 14:29:43 2022] PUT /identity/v3/projects/df86fc30458d40578b75a53394e16a13/groups/352fae71dfc44ae186f09bda01641c8c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:29:44.166187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001f93-a86b-4e86-8374-f316b35a5cf4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.225952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.227046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.227437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.227809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.229395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:44.229881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.232034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.244412 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 193/391] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:44.250692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.416441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df661b36-5381-4b31-aa4b-c50fcc9c6351 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.460426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.461937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.462613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.463138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.464939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.466914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.469283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 199/392] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:44.475561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.666915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816205fc-ca2b-475c-a797-a3f324aefced None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.687381 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.709252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64021d-93e2-4e59-be44-005308389026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.710932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64021d-93e2-4e59-be44-005308389026 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.711474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64021d-93e2-4e59-be44-005308389026 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.711945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64021d-93e2-4e59-be44-005308389026 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.714267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64021d-93e2-4e59-be44-005308389026 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.716941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64021d-93e2-4e59-be44-005308389026 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.720191 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 194/393] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:44.728557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.853098 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.952599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2a1c-32ce-4e0c-ac9d-8d1778c72e3b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:45.083407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcfa94-65c3-4b1c-8c72-40ca6d263818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:45.084333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcfa94-65c3-4b1c-8c72-40ca6d263818 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.084616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcfa94-65c3-4b1c-8c72-40ca6d263818 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.084890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcfa94-65c3-4b1c-8c72-40ca6d263818 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13/groups/352fae71dfc44ae186f09bda01641c8c/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.088079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcfa94-65c3-4b1c-8c72-40ca6d263818 None admin] RBAC: Authorizing `identity:create_grant(project_id=df86fc30458d40578b75a53394e16a13, group_id=352fae71dfc44ae186f09bda01641c8c, role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:45.089551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcfa94-65c3-4b1c-8c72-40ca6d263818 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:45.113329 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 200/394] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Jul 11 14:29:44 2022] PUT /identity/v3/projects/df86fc30458d40578b75a53394e16a13/groups/352fae71dfc44ae186f09bda01641c8c/roles/f3798a3824ee40189ce3ab7045b9621e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:45.152304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25f9a-b737-4ea7-a610-782e93355ffd None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.152619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25f9a-b737-4ea7-a610-782e93355ffd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.152930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25f9a-b737-4ea7-a610-782e93355ffd None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.154368 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 195/395] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:45.173884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78977e-baba-4947-9dea-21bb72338d5f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.174605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78977e-baba-4947-9dea-21bb72338d5f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.175092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78977e-baba-4947-9dea-21bb72338d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.220096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9a78977e-baba-4947-9dea-21bb72338d5f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:45.221659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9a78977e-baba-4947-9dea-21bb72338d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:45.394669 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 201/396] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:45.494328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25f9a-b737-4ea7-a610-782e93355ffd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:45.677923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25a19-1e92-4f92-bf58-a261a4a28020 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.679014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25a19-1e92-4f92-bf58-a261a4a28020 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.679458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25a19-1e92-4f92-bf58-a261a4a28020 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.680433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25f9a-b737-4ea7-a610-782e93355ffd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:45.682758 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 202/397] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:45.687263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efb3e3-5c69-44ed-9d87-37aec113fe8f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.687872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efb3e3-5c69-44ed-9d87-37aec113fe8f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.688521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efb3e3-5c69-44ed-9d87-37aec113fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.712061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-49efb3e3-5c69-44ed-9d87-37aec113fe8f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:45.714312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-49efb3e3-5c69-44ed-9d87-37aec113fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:45.747087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51628e0e-ee0e-4861-9b91-ab8d5d341bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:45.748823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628e0e-ee0e-4861-9b91-ab8d5d341bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.749455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628e0e-ee0e-4861-9b91-ab8d5d341bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.750254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628e0e-ee0e-4861-9b91-ab8d5d341bd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.767386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51628e0e-ee0e-4861-9b91-ab8d5d341bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-51628e0e-ee0e-4861-9b91-ab8d5d341bd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:45.776289 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:45.777724 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:45.778962 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:45.780742 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 196/398] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:45.786520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13144aa7-d31f-4e6c-8fa9-cbb62dde1bb6 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.786520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13144aa7-d31f-4e6c-8fa9-cbb62dde1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.786520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13144aa7-d31f-4e6c-8fa9-cbb62dde1bb6 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.786520 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 197/399] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:45.790879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13144aa7-d31f-4e6c-8fa9-cbb62dde1bb6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:45.806848 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:45.838657 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 203/400] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:45.844864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.845627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.846279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.856910 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:45.895937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:45.899156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:45.924677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13144aa7-d31f-4e6c-8fa9-cbb62dde1bb6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:45.966362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:45.967083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:45.967369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:45.967643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:45.968528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:45.968848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:45.970306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:45.988341 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 198/401] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:45.988341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.046243 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 204/402] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:46.046541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.182092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa735c-066f-4b15-81ca-8bee0573ef9b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:46.200766 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:46.211929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8082887-f932-40a7-8d94-52f77626dbbb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:46.237605 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:46.274387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:46.276458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.277079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.277668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.278792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:46.280155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.280597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.281140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.283137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:46.285811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:46.288837 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 205/403] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:46 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:46.290101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.303407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:46.316913 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:46.319069 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:46.320548 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:46.324281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 199/404] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:46.325501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.501383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f651f-7782-40b6-b68f-a50dbad4cc22 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:46.515665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049e4b-0c4b-4087-9ca0-742af04724f5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:46.560994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:46.562417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.562940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.563483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.571335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:46.572929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.574020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.574599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.576871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:46.579717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:46.580096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:46.588536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:46.589484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:46.590342 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:46.590983 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 200/405] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:46 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:46.593145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.593364 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 206/406] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:46.594342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.658998 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:46.661657 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:46.744645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d6b6-f4b9-4785-8a6c-3ee61f8ab736 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:46.795017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:46.797163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.798202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.798953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f/groups/352fae71dfc44ae186f09bda01641c8c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.803622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] RBAC: Authorizing `identity:create_grant(project_id=d6df55bd486c472bb359330a7952e55f, group_id=352fae71dfc44ae186f09bda01641c8c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:46.804317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17902f3-c340-4e11-968f-bd14b56e1377 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:46.807426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:46.832895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 207/407] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Jul 11 14:29:46 2022] PUT /identity/v3/projects/d6df55bd486c472bb359330a7952e55f/groups/352fae71dfc44ae186f09bda01641c8c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:46.835385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:46.879455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:46.880666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.881227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.881783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.883320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:46.883836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:46.885498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332fa96-ac4f-46b9-abfc-257ef68e29ae None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:46.902799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 201/408] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:46.904714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280ea2b-f4bf-453f-a093-bec5a5dceddf None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:46.905051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280ea2b-f4bf-453f-a093-bec5a5dceddf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:46.905470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280ea2b-f4bf-453f-a093-bec5a5dceddf None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:46.912932 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 202/409] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:46.914718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280ea2b-f4bf-453f-a093-bec5a5dceddf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.027465 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.032356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7b81-947a-47ed-b8a7-84e2893a090b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.076686 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.091144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280ea2b-f4bf-453f-a093-bec5a5dceddf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.108498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.109717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.110220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.110823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.112342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:47.112895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.115661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eeb0d-dfd6-4a28-80f6-4e0c4484f5a8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.132886 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 208/410] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.135182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.135731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.136170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.152456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.153333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.153626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.153910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.155321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.156870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.160011 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 203/411] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:46 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.166374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:47.166756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.168479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:47.292142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 209/412] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:47.293494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.349642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e140ff-18bd-454d-a678-07aec64536fd None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.397226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.398090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.398375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.399207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] PATH_INFO: `/v3/groups/826418e46fd242be8ec08f445174999b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.401162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] RBAC: Authorizing `identity:get_group(group_id=826418e46fd242be8ec08f445174999b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.402897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.405418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 204/413] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/groups/826418e46fd242be8ec08f445174999b => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.407004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.459764 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.476382 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.493506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d497046-c77d-4494-8f8d-91431ed6eb8b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.547944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.548853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8f1be-7f49-4be9-8b18-16daab58c7a1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.551211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.551934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.552529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.554829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.557595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.568445 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 210/414] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.570123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.588948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.589858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.590218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.590609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.603113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:47.611766 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:47.613230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:47.614119 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 205/415] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:47.614857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.708163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e1ba-1735-4dda-8299-ba768b6e9dfc None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.734358 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.749612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228b7ae-0d7c-41e3-a864-f33a5845fbf8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.760130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.761819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.762182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.762609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] PATH_INFO: `/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.765372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] RBAC: Authorizing `identity:get_project(project_id=9ef8c4b1c0304eae9ff050142c12cb98)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.768599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.777761 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 211/416] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.777761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.814381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.816365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.816838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.817317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f/groups/352fae71dfc44ae186f09bda01641c8c/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.821736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6df55bd486c472bb359330a7952e55f, group_id=352fae71dfc44ae186f09bda01641c8c, role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.823782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.829998 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.851488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 206/417] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Jul 11 14:29:47 2022] PUT /identity/v3/projects/d6df55bd486c472bb359330a7952e55f/groups/352fae71dfc44ae186f09bda01641c8c/roles/f3798a3824ee40189ce3ab7045b9621e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:47.853587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:48.048778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed718deb-cb2f-4f46-98d2-155629cad166 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:48.103796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:48.104862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.105340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.105985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.108065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:48.108630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:48.109851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd6a3b-2b8b-4803-af59-79d9dfc18657 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:48.110612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:48.131602 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 212/418] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:48.137812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:48.164461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d0c2c-a9a8-4f11-92e5-8570f1261a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:48.165832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d0c2c-a9a8-4f11-92e5-8570f1261a87 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.166263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d0c2c-a9a8-4f11-92e5-8570f1261a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.169343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d0c2c-a9a8-4f11-92e5-8570f1261a87 None admin] PATH_INFO: `/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98/groups/826418e46fd242be8ec08f445174999b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.169509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d0c2c-a9a8-4f11-92e5-8570f1261a87 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ef8c4b1c0304eae9ff050142c12cb98, group_id=826418e46fd242be8ec08f445174999b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:48.175468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d0c2c-a9a8-4f11-92e5-8570f1261a87 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:48.199367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 207/419] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Jul 11 14:29:47 2022] PUT /identity/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98/groups/826418e46fd242be8ec08f445174999b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:48.272930 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:48.286919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c0c2-6306-408d-93a9-a46cea0c205f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:48.330681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:48.331653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.332042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.332424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.428481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85476-5eb1-443d-8ed2-a69c83f93a94 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.428849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85476-5eb1-443d-8ed2-a69c83f93a94 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.429144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85476-5eb1-443d-8ed2-a69c83f93a94 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.431668 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 208/420] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:48.432793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:48.435725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:48.469235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.469637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.469859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.515818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:48.517103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:48.526211 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:48.587963 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:48.605330 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 213/421] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:48.612950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:48.638697 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 209/422] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:48.672254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:48.833196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fe915-4382-43c2-801a-9bb188cd8661 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:48.878393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4127c0-feef-4a90-9930-021020cfd92f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:48.912638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:48.913709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.913998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.914427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.915856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:48.917705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:48.924005 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 214/423] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:48 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:48.929974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:48.965660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:48.966480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:48.966781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:48.967055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:48.989433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:49.000648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:49.001679 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:49.002599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:49.003239 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 210/424] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:49.012525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:49.023026 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.099970 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.193589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ab3ca-d97f-40b8-a3a7-3fabcbe18e76 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:49.262120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:49.265195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.266443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.269032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.272166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:49.277356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:49.284751 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 215/425] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:48 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:49.296790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:49.314584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f25c-72f6-4790-8118-0c97e39f0c40 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:49.364844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:49.366535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.366535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.366535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.367843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:49.370541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:49.370541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:49.385041 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 211/426] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:49.386413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:49.469432 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.517502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e825cd-9270-4e95-b31c-df7d3c3db2d0 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:49.551994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44cd1-5f08-47d7-a7e1-64a839c37d5b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:49.560865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:49.561535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.561825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.562115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.593651 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.611105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:49.612724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.613495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.614257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.616514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=df86fc30458d40578b75a53394e16a13) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:49.617945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:49.620956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872f5d-dda0-4345-b7a6-304478b9d8a9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:49.638849 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 216/427] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:49 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=26950413237349fdbc8f22b4a35296e3 => generated 611 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:49.641944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656fa73-05a1-4b55-859f-f9fb0295169a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.647293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656fa73-05a1-4b55-859f-f9fb0295169a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.647852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:49.649866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656fa73-05a1-4b55-859f-f9fb0295169a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.650114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:49.653192 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 217/428] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:49.659751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.660417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.660953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.716402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:49.718246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:49.738403 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.794053 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 212/429] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:49.795614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:49.908865 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 218/430] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:49.922524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce071f9-2bda-4d4f-90ac-28d16fb09aea None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:49.948638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:49.972857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:49.974485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.975648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.975952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] PATH_INFO: `/v3/projects/df86fc30458d40578b75a53394e16a13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.978255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] RBAC: Authorizing `identity:get_project(project_id=df86fc30458d40578b75a53394e16a13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:49.980034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:49.989326 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 213/431] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:49 2022] GET /identity/v3/projects/df86fc30458d40578b75a53394e16a13 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:49.993318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:50.061953 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:50.158620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6bb6-b3c9-43f8-bca3-2d218afeed52 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:50.190852 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:50.191286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db44ec-d118-4b4e-bb2c-9c9f4ffaa86f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:50.215090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:50.216227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.216712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.217099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.233122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:50.241640 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:50.244231 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:50.245971 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 219/432] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:50.249046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:50.250144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:50.251296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.252013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.252713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.255420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:50.258410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:50.266795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 214/433] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:49 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:50.272671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:50.422682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2330a-958e-434e-9942-726dcf57cdda None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:50.440163 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:50.446570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c96d9d-3ff2-4d9f-9150-0b5dff524cbf None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:50.483580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:50.485155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.485759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.486393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.488032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:50.488704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:50.492410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:50.500672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:50.501646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.502167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.502713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.503751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=df86fc30458d40578b75a53394e16a13) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:50.504250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:50.505897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62e80-2e1c-46b3-a5fa-54e118b6099a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:50.518528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 220/435] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:50.518734 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 215/435] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:50 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=df86fc30458d40578b75a53394e16a13&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:50.520998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:50.611220 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:50.653091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2a41a-8d32-442f-9dbe-cba736a38064 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.653865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2a41a-8d32-442f-9dbe-cba736a38064 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.653865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2a41a-8d32-442f-9dbe-cba736a38064 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.655617 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 216/436] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:50.661217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.661527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.661911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.687282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:50.689588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:50.725488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7da8c-dc5e-4af1-b035-d642e49388ff None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:50.783758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:50.783758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:50.783758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:50.783758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:50.839199 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 217/437] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:50.864474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:50.884403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:50.885987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:50.938550 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.004295 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.011509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd6329-1499-43ed-9abd-9bcbdd267716 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.031628 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 221/438] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:51.044443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.066830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.068646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.069153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.070344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.090433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:51.099873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:51.101488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:51.103274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 218/439] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:51.109006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.231757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4542b-179b-4c78-bdca-b2daa941e032 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.234444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723104fc-32e8-4daa-9e9a-621f62a48038 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.273387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaae1d-8d00-40f3-81de-5beb203ac1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.274901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaae1d-8d00-40f3-81de-5beb203ac1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.275178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaae1d-8d00-40f3-81de-5beb203ac1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.275449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaae1d-8d00-40f3-81de-5beb203ac1c8 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.276707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaae1d-8d00-40f3-81de-5beb203ac1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:51.278166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaae1d-8d00-40f3-81de-5beb203ac1c8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:51.279591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.286535 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 222/440] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:51.286824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.286824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.286824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.287223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0002b-6cf0-4fe7-99fb-b01d1947831d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.287353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:51.287499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0002b-6cf0-4fe7-99fb-b01d1947831d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.287637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:51.287927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0002b-6cf0-4fe7-99fb-b01d1947831d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.287927 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 223/441] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:51.288172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:51.290466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.290797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.291117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.301004 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 219/442] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:51.302056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.312515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:51.314091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:51.317827 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.328293 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.406442 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 224/443] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:51.407757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.437480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514957-f16a-4d57-a151-ccb223bce735 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.488992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.489855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.490141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.490420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.491700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:51.493241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:51.494974 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 220/444] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:51.495822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.567446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dde61-58f4-4191-94f8-04b07c5cd34d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.612378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.613248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.613798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.614083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.625957 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.636085 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.656122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc1f2-8e42-467d-84e8-ac458155dba5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.711615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.712573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.712994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.713275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.724877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:51.726550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:51.729448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:51.739723 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:51.741429 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 221/445] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:51.743130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.877298 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 225/446] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:51.877949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.889165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539aab8-3fa5-4d27-a373-6599b465869f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:51.930618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:51.931285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.931573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.932007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.932702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=26950413237349fdbc8f22b4a35296e3, scope.project.id=d6df55bd486c472bb359330a7952e55f) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:51.933069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:51.934536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:51.941283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 222/447] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=26950413237349fdbc8f22b4a35296e3 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:51.942297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:51.943555 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:51.959811 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.044238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647e07-21ad-4746-ae83-9bc910c9cb50 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.113511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.114876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.115418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.115919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.117669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:52.118222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.120945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.129699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85225f-ff7e-43c5-a570-e95a0a902aa7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.140782 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 226/448] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:52.142557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.187370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.188395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.188729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.188994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] PATH_INFO: `/v3/projects/d6df55bd486c472bb359330a7952e55f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.193674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] RBAC: Authorizing `identity:get_project(project_id=d6df55bd486c472bb359330a7952e55f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.193674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.196105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 223/449] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/projects/d6df55bd486c472bb359330a7952e55f => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:52.202804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.300691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb329-7e36-4b97-8dd9-171b6e160821 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.302797 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.361712 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.368599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.369273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.369560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.369837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.396191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca308ec2-57ae-4e16-94ac-21aafb0c8c11 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.456418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.457316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.457564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.457844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] PATH_INFO: `/v3/groups/352fae71dfc44ae186f09bda01641c8c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.459765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] RBAC: Authorizing `identity:get_group(group_id=352fae71dfc44ae186f09bda01641c8c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.461984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.463847 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 224/450] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/groups/352fae71dfc44ae186f09bda01641c8c => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:52.470329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.479163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.481190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.607255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebeca8-22ef-4177-a752-7856db83ea89 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.623777 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 227/451] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:29:52.630422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.633930 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.656265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.656853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.657141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.657419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.658304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] RBAC: Adding query filter params (group.id=352fae71dfc44ae186f09bda01641c8c, role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=d6df55bd486c472bb359330a7952e55f) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:52.658718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.660277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.669010 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 225/452] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/role_assignments?group.id=352fae71dfc44ae186f09bda01641c8c&scope.project.id=d6df55bd486c472bb359330a7952e55f&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:52.768505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b881-f862-42ca-a100-1e6cd909215d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.822916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.823849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.824133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.824413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] PATH_INFO: `/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.825841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] RBAC: Authorizing `identity:get_project(project_id=9ef8c4b1c0304eae9ff050142c12cb98)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.827563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.829548 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 228/453] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/projects/9ef8c4b1c0304eae9ff050142c12cb98 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:52.836030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.850118 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.992751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3d65d-6c8d-471c-86db-ed19402d4b6e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:53.041506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c17ee-45c7-490b-99fa-2039478ce37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:53.043160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c17ee-45c7-490b-99fa-2039478ce37e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:53.043681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c17ee-45c7-490b-99fa-2039478ce37e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:53.044171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c17ee-45c7-490b-99fa-2039478ce37e None admin] PATH_INFO: `/v3/groups/826418e46fd242be8ec08f445174999b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:53.046633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c17ee-45c7-490b-99fa-2039478ce37e None admin] RBAC: Authorizing `identity:get_group(group_id=826418e46fd242be8ec08f445174999b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:53.048403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c17ee-45c7-490b-99fa-2039478ce37e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:53.053277 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 226/454] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/groups/826418e46fd242be8ec08f445174999b => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:53.061602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:53.155345 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:53.201498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419999f7-9105-4585-ab96-66392e0bcbde None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:53.238783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:53.239450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:53.239774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:53.240097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:53.241029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] RBAC: Adding query filter params (group.id=826418e46fd242be8ec08f445174999b, role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=9ef8c4b1c0304eae9ff050142c12cb98) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:53.241385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:53.243559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0776-b887-420f-997a-c2eb337ce12e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:53.250130 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 229/455] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Jul 11 14:29:53 2022] GET /identity/v3/role_assignments?group.id=826418e46fd242be8ec08f445174999b&scope.project.id=9ef8c4b1c0304eae9ff050142c12cb98&role.id=70eee5d669654151b878064c431c4f7b => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:56.942819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c5cee-7f21-4ec2-8e66-75839cf4318d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:56.943846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c5cee-7f21-4ec2-8e66-75839cf4318d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:56.943846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c5cee-7f21-4ec2-8e66-75839cf4318d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:56.945398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 227/456] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:56.951021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:56.951739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:56.951739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:56.969966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b093-0995-42ce-b0c4-d55364738098 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:56.970659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b093-0995-42ce-b0c4-d55364738098 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:56.971134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b093-0995-42ce-b0c4-d55364738098 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:56.973233 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 228/457] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:56.974915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:56.974915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:56.982421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341e054-1ba7-42e4-8d6a-7cfc502ac6a7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:56.983048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341e054-1ba7-42e4-8d6a-7cfc502ac6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:56.983519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341e054-1ba7-42e4-8d6a-7cfc502ac6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.022325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3341e054-1ba7-42e4-8d6a-7cfc502ac6a7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:57.024250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3341e054-1ba7-42e4-8d6a-7cfc502ac6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:57.176179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 230/458] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:57.221002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 229/459] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:29:57.228307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:57.246479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b38a8-c5d0-4cb6-aec9-e2e681ec165c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.247591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b38a8-c5d0-4cb6-aec9-e2e681ec165c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.248091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b38a8-c5d0-4cb6-aec9-e2e681ec165c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.252089 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 230/460] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:57.254772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b38a8-c5d0-4cb6-aec9-e2e681ec165c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:57.278890 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:57.308438 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:57.397131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dce94-0a03-4c01-8db5-4cc58168cdc6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:57.426719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b38a8-c5d0-4cb6-aec9-e2e681ec165c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:57.467113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:57.467979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.468286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.468636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.473528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:57.474643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.475110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.475558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.482701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:57.484395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:57.487639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:57.489174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-477fae10-1cf4-46eb-b442-d22a8e3160b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:57.507143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:57.509144 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:57.517929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:57.517929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:57.517929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:57.517929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:57.517929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 231/461] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fb3b9679-752f-4eaa-9cc4-af2051d9c72b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:57.518448 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:57.522643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:57.528268 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:57.528268 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:57.528268 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:57.528268 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:57.529103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b810be-05d6-4612-a27e-d14b56f55913 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.529103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b810be-05d6-4612-a27e-d14b56f55913 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.529496 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 231/462] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:57.529659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b810be-05d6-4612-a27e-d14b56f55913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.529881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264dbc4-7ca9-4884-852e-a38f1fda28ae None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.529881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264dbc4-7ca9-4884-852e-a38f1fda28ae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.529881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264dbc4-7ca9-4884-852e-a38f1fda28ae None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.529881 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 232/463] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:57.529881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264dbc4-7ca9-4884-852e-a38f1fda28ae None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:57.539613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-23b810be-05d6-4612-a27e-d14b56f55913 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:57.541144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23b810be-05d6-4612-a27e-d14b56f55913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:57.598258 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:57.623038 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 232/464] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:57.624465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfe1d-10be-4487-8bf7-e56581359ad1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.624759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfe1d-10be-4487-8bf7-e56581359ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.625037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfe1d-10be-4487-8bf7-e56581359ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.648348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-286cfe1d-10be-4487-8bf7-e56581359ad1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:57.649607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-286cfe1d-10be-4487-8bf7-e56581359ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:57.652931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264dbc4-7ca9-4884-852e-a38f1fda28ae None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:57.703063 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:57.704407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:57.705083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.705474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.705870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.706388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:57.706729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:57.708124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:57.722765 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 233/465] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:57.723689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:57.730627 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 233/466] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:57.731966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1273d-f2c0-422c-af40-1a6cd565b05b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.732250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1273d-f2c0-422c-af40-1a6cd565b05b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.732527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1273d-f2c0-422c-af40-1a6cd565b05b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.734019 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 234/467] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:57.735301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1273d-f2c0-422c-af40-1a6cd565b05b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:57.855823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1273d-f2c0-422c-af40-1a6cd565b05b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:57.856241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a974c-1a28-4e8f-9923-ab0b2b4311dc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:57.880553 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:57.897629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:57.898516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.898814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.899086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.900468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:57.901137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.901429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.901716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.902457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:57.902804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:57.904793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:57.918727 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 234/468] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:57.919189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:57.919456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:57.920688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-849f053b-0eeb-41ce-bd36-bbefaff6de7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:57.941926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:57.943110 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:57.944260 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:57.944260 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:57.944260 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:57.944260 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:57.944260 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 235/469] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:57.946176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:57.946469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:57.946803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:57.963823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:57.965038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:57.994312 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.041561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 236/470] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:29:58.041948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570367-168a-461a-89f6-c3dca3eefcc9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.042528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.081777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.082446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.082761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.083039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.083773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.085222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.105869 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 235/471] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:57 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:58.106943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.158832 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.191216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f30e-2fa9-4fc0-b19f-2451b175d6cc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.234582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.235423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.235714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.236009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.248992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.250428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.261331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d36ac-c625-4396-94ed-24f25f250773 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:58.276268 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:58.277904 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:58.279571 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:58.279571 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:58.279571 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:58.279571 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:58.279571 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 237/472] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:58.279571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.295894 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.321810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.321810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.322157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.322461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.323608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.326159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.355379 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 236/473] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:58 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:58.356502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.438417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0eb11-2d05-426b-8a69-bc2a030612fd None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.491237 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.507548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.508986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.509272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.509551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.510886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:58.511196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.512937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.518316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda3032-e4a3-4e21-a6c5-de97ae11e5e6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.528454 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 238/474] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:58.529325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.571561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.572259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.572549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.572828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.573596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.575217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.583012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.sql.core [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:29:58.583012 n-d-master-1 devstack@keystone.service[80990]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:29:58.583012 n-d-master-1 devstack@keystone.service[80990]: [parameters: {'id': '6c245af853134434a9d118642423b6d2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:29:58.583012 n-d-master-1 devstack@keystone.service[80990]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80990) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result.read() Jul 11 14:29:58.601354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:29:58.602479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application yield resource Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise self.value Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application session.commit() Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:29:58.603694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:29:58.604776 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:29:58.605957 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result.read() Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:29:58.607066 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [parameters: {'id': '6c245af853134434a9d118642423b6d2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:58.608183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:29:58.609119 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:29:58.611327 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 237/475] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Jul 11 14:29:58 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:58.611327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.638257 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.686027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357001-db75-42aa-89cd-719c38d0f549 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.736887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.738159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.738662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.739270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.741074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:58.742007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.744775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.751032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258b0d-e7ec-47d5-8a73-a06f844fb40f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.761703 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 239/476] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:58.762847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.799044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.799980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.800328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.800673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.801693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:58.803272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:58.836448 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 238/477] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:58 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:58.838277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:58.867710 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.900083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55582c8c-d041-468d-864f-3cd84557d05c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.937716 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:58.950056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:58.952012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:58.953680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:58.954896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:58.977595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:58.992962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c1a9-9482-49c6-af2f-4a2d10d1a625 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:58.994593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:58.995883 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:29:58.997186 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:29:59.001410 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 240/478] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:59.012257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:59.035957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1c40f-5f7d-486a-9d65-44f52b46c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:59.036360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1c40f-5f7d-486a-9d65-44f52b46c49d None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:59.036652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1c40f-5f7d-486a-9d65-44f52b46c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:59.036931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1c40f-5f7d-486a-9d65-44f52b46c49d None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:59.037655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1c40f-5f7d-486a-9d65-44f52b46c49d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:59.039808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1c40f-5f7d-486a-9d65-44f52b46c49d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:59.064943 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 239/479] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:58 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:59.175308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ef05-f7c7-4a0b-a336-aa2c6f1b488f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:59.216452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:59.217145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:59.217434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:59.217714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:59.218483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:59.218821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:59.220233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3c5c-eec0-436d-a479-c7bb684f0026 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:59.230488 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 241/480] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:00.561441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973d63-a987-4ceb-87d8-44bc15d3d2e3 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:00.561993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973d63-a987-4ceb-87d8-44bc15d3d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:00.561993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973d63-a987-4ceb-87d8-44bc15d3d2e3 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:00.563794 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 240/481] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:00.569808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:00.570391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:00.570391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:00.599703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:00.600953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:00.670866 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:00.693858 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 242/482] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:00.729648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973d63-a987-4ceb-87d8-44bc15d3d2e3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:00.840941 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:00.889373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973d63-a987-4ceb-87d8-44bc15d3d2e3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:00.929534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca71ae8-458e-4c2d-afb0-2993c9a7ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:00.930955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71ae8-458e-4c2d-afb0-2993c9a7ba34 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:00.931452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71ae8-458e-4c2d-afb0-2993c9a7ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:00.931948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71ae8-458e-4c2d-afb0-2993c9a7ba34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:00.949186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca71ae8-458e-4c2d-afb0-2993c9a7ba34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-dca71ae8-458e-4c2d-afb0-2993c9a7ba34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:00.958148 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:00.959149 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:00.960036 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:00.960868 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 241/483] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:00.967034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:01.139666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab3ba-5fb2-4a3b-b2ed-8aaa11c9a1e7 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.139963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab3ba-5fb2-4a3b-b2ed-8aaa11c9a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.140143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab3ba-5fb2-4a3b-b2ed-8aaa11c9a1e7 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.141893 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 242/484] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:01.147500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.147790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.148211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.171003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953269b-09ed-4697-ada8-6ff0be582582 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:01.199938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:01.201182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:01.238396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:01.241089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.241386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.241663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.243079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:01.243392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:01.244802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:01.266299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 243/485] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:01.286451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:01.385767 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:01.408682 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 243/486] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:30:01.453535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:01.511718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e900-2ea5-4e00-8514-bf1ef15743e2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:01.578331 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:01.636150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:01.636678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.637158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.637652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.653010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50733a87-b52c-4d34-89dc-e18b3f8a4be5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:01.672619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:01.674007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:01.716336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29dd3b-de26-44f7-b800-faef77c403bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:01.717490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29dd3b-de26-44f7-b800-faef77c403bb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.718007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29dd3b-de26-44f7-b800-faef77c403bb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.718528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29dd3b-de26-44f7-b800-faef77c403bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-c347a081-5639-41d9-9628-4c1a7d68f752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:01.729255 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:01.730204 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:01.731097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:01.731097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:01.731097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:01.731097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:01.731761 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 244/487] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:01.733112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf9017-6a88-45b8-ba18-1a0febbbebc4 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.733398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf9017-6a88-45b8-ba18-1a0febbbebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.733677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf9017-6a88-45b8-ba18-1a0febbbebc4 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.736098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29dd3b-de26-44f7-b800-faef77c403bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:01.738172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 245/488] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:01.739360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf9017-6a88-45b8-ba18-1a0febbbebc4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-6b29dd3b-de26-44f7-b800-faef77c403bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:01.745098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:01.746045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:01.746917 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:01.753609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 244/489] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:01.755143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:01.755438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:01.755710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:01.795205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:01.797688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:01.902708 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:01.917718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf9017-6a88-45b8-ba18-1a0febbbebc4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:01.939054 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 245/490] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:01.940985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.025422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.026748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.027033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.027291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.028025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:02.028328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.029712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.066464 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 246/491] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:02.067751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.069043 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.176648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfef74-256e-4c8f-b8ce-8dfde9aa3118 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.205361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279422f4-f38f-4e7c-94f4-df2890e89626 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.231561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.235638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.236734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.237483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.243230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:02.244249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.246669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.248538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e237-b29b-4a07-aa81-fd1abf0f995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.249419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e237-b29b-4a07-aa81-fd1abf0f995b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.249707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e237-b29b-4a07-aa81-fd1abf0f995b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.249986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e237-b29b-4a07-aa81-fd1abf0f995b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.262595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 246/492] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:02.262595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.270021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02e237-b29b-4a07-aa81-fd1abf0f995b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-4e02e237-b29b-4a07-aa81-fd1abf0f995b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:02.282267 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:02.283355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 247/493] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:02.290085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c8777-bd5a-4cd2-adc3-0f54a4d10b43 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.290847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c8777-bd5a-4cd2-adc3-0f54a4d10b43 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.290847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c8777-bd5a-4cd2-adc3-0f54a4d10b43 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.290847 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 248/494] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:02.290847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c8777-bd5a-4cd2-adc3-0f54a4d10b43 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.318038 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.414349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c8777-bd5a-4cd2-adc3-0f54a4d10b43 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.416720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032c5a-b82c-4aa8-ab66-56c390ba49a3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.426559 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.453056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.453846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.454131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.454405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.462834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.463168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.463844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.464306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.464683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.464846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.478927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.480424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:02.484631 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:02.485735 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 247/495] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:02.486903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a65349f3-1cc6-4887-aed8-e1784b082ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:02.501953 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:02.502950 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:02.503882 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:02.503882 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:02.503882 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:02.503882 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:02.503882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 249/496] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:02.504661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48325-b6b8-4b04-9f1e-92a73af11a32 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.504905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48325-b6b8-4b04-9f1e-92a73af11a32 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.505184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48325-b6b8-4b04-9f1e-92a73af11a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.521966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a1c48325-b6b8-4b04-9f1e-92a73af11a32 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:02.523260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a1c48325-b6b8-4b04-9f1e-92a73af11a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:02.596188 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.599637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e7962-1945-4aa9-8bda-89de5c50a57a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.602590 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 250/497] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:02.604079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c985a-49c6-4095-8cdd-c7f14a1a8d48 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.604373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c985a-49c6-4095-8cdd-c7f14a1a8d48 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.604651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c985a-49c6-4095-8cdd-c7f14a1a8d48 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.606052 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 251/498] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:02.606796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c985a-49c6-4095-8cdd-c7f14a1a8d48 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.652912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.653590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.653881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.654164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.654967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:02.655277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.656697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.666255 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 248/499] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:02.667212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.702883 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.740905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c985a-49c6-4095-8cdd-c7f14a1a8d48 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.793171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168b255-bf6e-42b4-8cbc-e8f706fcdf41 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:02.795434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.796997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.797274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.797552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.798405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:02.798741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.800397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8ee19-5583-4649-8784-40a9c4b63270 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.841295 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 252/500] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:02.843873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.844168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.844957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.850674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:02.851424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:02.851713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:02.852482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:02.853236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:02.853547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:02.855016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:02.869303 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 249/501] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:02.869698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:02.870202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.871051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:02.938347 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.958373 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 253/502] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:02.959296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:02.974365 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:02.987593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e33d-e409-4dfd-b76d-6e9f0a9cda6d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.036679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.037389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.037677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.037965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.053577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:03.061907 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:03.066772 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 250/503] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:03.067736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.081872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a8491-3dcb-4a50-b743-f163db638513 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.127223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.128061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.128342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.128617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.139667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.141438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:03.162554 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:03.163692 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:03.165254 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:03.165254 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:03.165254 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:03.165254 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:03.165254 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 254/504] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:03.165254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.179403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87e2da-9687-437e-8007-e1f32dac2cbf None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.211442 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:03.217220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.217874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.218157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.218434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.239070 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:03.279485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c12f8-4b73-4f42-a652-9221a9208bea None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.296910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.298356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.315737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.316525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.316815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.317087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.325397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.326877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:03.343669 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:03.344646 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:03.345546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 255/505] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:03.346245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.426460 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 251/506] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:03.427748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.480764 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:03.481575 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:03.484508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883af10-b0b2-4c40-965a-422af89f17a9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.527287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.528100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.528368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.528641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.536588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109964ac-7d5c-44c9-9f8a-792feaac02db None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.540469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.541932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:03.559697 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:03.560717 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:03.561626 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:03.561626 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:03.561626 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:03.561626 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:03.561626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 256/507] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:03.561985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.584153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.584824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.585109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.585386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.586783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:03.587029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.588424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.602808 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 252/508] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:03.602808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.700222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fe26b-2b4c-48a4-9a38-43f6eb56c4b6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.723214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141942-1d99-405c-9cbd-0735ee1c7dba None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.737206 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:03.740358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.741037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.741627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.741627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.742329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:03.742726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.744117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.756453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 257/509] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:03.757129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.759844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.760597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.760959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.761237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.762093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:03.762410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.763895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.771210 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:03.802334 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 253/510] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:03.803233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.894771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9f7c-4e96-4c0b-aa33-1eb6afd11544 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.913423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0c22-0540-49e7-9db8-7b2f95bbc520 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:03.934576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.935364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.935647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.935924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.947619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.949202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.951319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:03.952003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:03.952292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:03.952662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:03.953415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:03.953732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:03.955260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:03.967431 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:03.975557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:03.977202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:03.977202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:03.977202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:03.977202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:03.977613 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 254/511] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:03.977613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:03.977857 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 258/512] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:03.977857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.011726 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.052594 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.093625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262bf2f-246e-4920-b7b7-14ff89456da3 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.100618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95eef0-041f-4950-8c3d-2e35e5b8f593 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.127730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.128540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.128952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.129103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.138193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.139138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.139681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.140402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.140844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.141315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:04.154857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:04.155936 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 259/513] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:04.157048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.161565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.164251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:04.190169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:04.193586 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:04.194464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:04.194464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:04.194464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:04.194464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:04.194464 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 255/514] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:04.194464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.269524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae9fd-cf29-4944-b96f-b02cee918601 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.297382 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.297769 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.311551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.312203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.312492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.312766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.319672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f8dd-b6c6-4959-83bb-c02a2f8a7619 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.357895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.358607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.358894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.359173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.360039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.361522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.383196 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 256/515] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:30:04 2022] POST /identity/v3/users => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:04.384082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.399475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.401108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.546678 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 260/516] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:04.546678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.546938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5059b9-7877-4f1e-9f8f-2ade7ad69b40 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.576152 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.593326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.594155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.594631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.595008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.597303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:04.597303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.597560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.607530 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.611911 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 257/517] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:04.612820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.684943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f372-e6e5-4429-8443-b2396c15b3a6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.722311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.723170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.723558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.723847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.724698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:04.725010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.727035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.746643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650a077-c11a-4924-b6eb-bfb02d17f40c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.751622 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 261/518] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:04.751622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.820048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.820691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.820964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.821241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.821978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:04.822310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.823766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.838621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 258/519] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:04.838621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:04.876489 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.904448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af0d0-24f6-4c60-95e0-4fd511c46a18 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.909862 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:04.944160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:04.944995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:04.945282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:04.945557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:04.957122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:04.958661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:04.977499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b0b34-7430-4218-ab0d-a188cd7b9e97 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:04.978387 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:04.980096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:04.981793 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:04.981793 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:04.981793 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:04.981793 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:04.981793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 262/520] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:04.981793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.026097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.027286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.027763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.028207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.037798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.039748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:05.056181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:05.057093 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:05.058430 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:05.062227 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 259/521] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:05.063026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.121446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42486fc1-09c8-4cf1-9bbd-04032dc0be31 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.162648 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.175885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.176540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.176834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.177109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.193806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473452-e98f-4336-92cd-48ae00bc17b5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.216802 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.237851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.238915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.239213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.239500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.247581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.249088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.265972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.267480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:05.270743 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:05.271945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 260/522] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:05.273354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.412802 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 263/523] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:05.414590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.439838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925c13-0c37-40ae-beb0-6c4bf0d40517 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.467400 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.487568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.488418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.488708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.489046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.489836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:05.490266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.491997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.507817 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 261/524] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:05.509149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.577318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61add26b-4620-4daf-8a42-1e68abd07426 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.578901 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.623027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.623722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.623999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.624294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.625128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:05.625484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.627448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.655898 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 264/525] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:05.657199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.677348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98bad7-74b1-4c00-97d6-aca0c9a3088b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.732870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.733917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.733917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.734190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.735041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:05.735372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.736935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.759315 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 262/526] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:05.760204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.785730 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.804854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c1ec-9176-4e3d-bce6-7044beadbc7d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.845334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.846555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.847073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.847548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.860425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.862653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.883143 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:05.886263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:05.887364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:05.888504 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:05.888504 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:05.888504 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:05.888504 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:05.894558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3127cf-7dc5-4211-a7a4-96767d0b6e8e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:05.895238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 265/527] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:05.895952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:05.948788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:05.949764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:05.950131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:05.950481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:05.961051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:05.963717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:05.990771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:05.991893 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:05.992935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:05.993357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 263/528] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:05.993810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.024465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90591-d86c-4b77-95d7-12b24f3e536b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.081289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.082160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.082583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.082955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.084221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=0522dc9e5943446fbaffdcd857728b59) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:06.084703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.086783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.093867 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 266/529] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/role_assignments?user.id=0522dc9e5943446fbaffdcd857728b59&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:06.098648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.111604 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:06.144977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f77e-2a76-4571-a302-29abebaeb40c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.204657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.206121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.209692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.211180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.231045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda448bd-5169-4831-9311-0ca87ff0034a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.247695 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:06.275282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.276344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.276839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.277324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.278575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:06.279236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.280880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.296520 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 267/530] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:06.297852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.303437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.303990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.381762 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:06.422028 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 264/531] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:06.423203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.423474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a722b-826b-42a0-9f37-96d47e992a9c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.463690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.464612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.465046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.465481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.466538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:06.467050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.468826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.484175 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 268/532] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:06.485455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.494038 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:06.582844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e948b-21d6-4d75-a083-2bb0a967f8f3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.621476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f911-883f-433c-b90c-609dcc382d6a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.626311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.627242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.627608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.627877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.636119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.637584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:06.654376 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:06.655352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 265/533] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:06.656484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.660285 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:06.669993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.670819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.671102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.671373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.683746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.685207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9493d833-df8e-4fd8-a4e5-b0dc4114243c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:06.704318 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:06.705529 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:06.706467 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:06.706467 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:06.706467 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:06.706467 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:06.706467 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 269/534] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:06.707346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309c06d-d5d6-4119-88e8-a8093454853b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.707670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309c06d-d5d6-4119-88e8-a8093454853b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.707835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309c06d-d5d6-4119-88e8-a8093454853b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.709294 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 270/535] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:06.709796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309c06d-d5d6-4119-88e8-a8093454853b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.802233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0610e-b715-4888-be40-2c1216fc1e46 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.826152 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:06.837090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309c06d-d5d6-4119-88e8-a8093454853b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:06.847149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.847921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.848112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.848371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.849219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=66a3753891494abd84fa3c9c17c1b455) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:06.849778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.851080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.857503 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 266/536] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/role_assignments?user.id=66a3753891494abd84fa3c9c17c1b455&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:06.858301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:06.884330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:06.885201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.885357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.885728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.886464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:06.886852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:06.888459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8556dc2-93f1-43ea-b065-5e6c66521ccd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:06.904300 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 271/537] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:06.905891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:06.906182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:06.906547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:06.928072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:06.929489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:06.981278 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:07.016589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f6c63-9743-44da-b3dc-0f172543feec None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.036084 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 272/538] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:07.037388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:07.067382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:07.068608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:07.069096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:07.069583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:07.078527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:07.078527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:07.078527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:07.089717 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 267/539] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:07.090699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:07.159683 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:07.196460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c68e27-2e06-4d1c-9bba-8a09814de044 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.292153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:07.293214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:07.293668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:07.294822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:07.296146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=f2258fe4b6c14d378fcfdd1fb690f179) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:07.298076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658c79d-385c-4c14-9a3d-a888ad989354 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.298650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:07.300752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:07.320622 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 273/540] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:07 2022] GET /identity/v3/role_assignments?user.id=f2258fe4b6c14d378fcfdd1fb690f179&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:07.321998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:07.351951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:07.352825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:07.353069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:07.353355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:07.365539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:07.385689 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:07.388053 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:07.389034 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:07.390047 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 268/541] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:07.397359 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:07.399459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:07.492196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8abd0-57e6-4dc1-937e-329c2229228b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.520990 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:07.525632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e1ea3-3922-4692-9b81-09c898f3770b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.556519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:07.558135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:07.558929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:07.559605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:07.578360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:07.581219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:07.609507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:07.611275 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:07.612999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 274/542] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:07.622711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:07.625590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:07.626984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:07.627688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:07.628306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:07.629293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:07.629804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:07.631453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:07.653057 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 269/543] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:07.660318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:07.901002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec0e05-868a-475c-bcdc-c8ab9f98672c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.954737 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:07.955930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:07.957220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:07.957795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:07.958287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:07.978524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c50385-337a-40de-996d-5e2352bc8755 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:07.987430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:07.989277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:08.019807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:08.022270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:08.022879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:08.023394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:08.024346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:08.024661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:08.026201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:08.046589 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:08.047573 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:08.048428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:08.048428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:08.048428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:08.048428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:08.048638 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 275/544] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:08.050888 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 270/545] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:08.058968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:08.060886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:08.115711 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:08.293434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b46cd-f2c2-45a8-b5ce-20be58d2cdb2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:08.306347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931ccd7-2eaf-41b2-a904-b4c953cd5dbd None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:08.390574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:08.390574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:08.390574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:08.390574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:08.390999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=afe1d2602f5d4180a9d52fbef485bcd0) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:08.392296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:08.394121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:08.406812 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 276/546] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:08 2022] GET /identity/v3/role_assignments?user.id=afe1d2602f5d4180a9d52fbef485bcd0&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:08.408488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:08.409396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:08.409860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:08.410309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:08.411588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:08.412118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:08.413963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97755f5b-649d-4c6f-a742-7eb37d101be5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:08.446042 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 271/547] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:08.452098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:08.489827 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:08.523817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325b41-7f58-472f-82fe-925218d21749 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:08.524147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325b41-7f58-472f-82fe-925218d21749 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:08.524389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325b41-7f58-472f-82fe-925218d21749 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:08.526600 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 272/548] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:30:08.532166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:08.532505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:08.532726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:08.561034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:08.562189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:08.642754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77059348-5840-47b2-89cd-1d02c9c96023 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:08.682683 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 273/549] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:30:08.686062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:08.686933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:08.687227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:08.687495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:08.705080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:08.716161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:08.717659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:08.722871 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:08.758526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:08.759689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:08.760597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:08.764297 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 277/550] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:08.766190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:08.924247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48922122-347d-4572-a5d0-fdd8fd19ac87 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:08.937548 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:08.981088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd0c3-5822-4ae7-a3f9-215f6e0e50d2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:08.999047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:08.999848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.000130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.000420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.024109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:09.037120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:09.038047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:09.039151 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:09.045093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 274/551] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:09.049203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.058569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.058569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.058569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.058569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.058913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:09.059104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.060496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.097294 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 278/552] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Jul 11 14:30:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:09.114972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.166640 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:09.213557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b3d1-d2b8-4be7-97ce-3f29c3876643 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:09.261887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.262597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.262891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.263169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.263934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:09.264245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.265633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.281612 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 275/553] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:09.287527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.296781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8035e3-2fdc-4cd0-85eb-3ed15ed11786 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:09.379021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3697ee-0fc4-46f9-b641-6fbf23b6da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.379692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3697ee-0fc4-46f9-b641-6fbf23b6da36 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.379979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3697ee-0fc4-46f9-b641-6fbf23b6da36 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.380360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3697ee-0fc4-46f9-b641-6fbf23b6da36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.390856 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:09.440787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906a6c-b947-4a38-a557-6c8c20a06266 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:09.469352 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:09.480019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.480933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.481218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.481498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.493718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.495307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.506943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3697ee-0fc4-46f9-b641-6fbf23b6da36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.509068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3697ee-0fc4-46f9-b641-6fbf23b6da36 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-39f1e207-86c9-4198-94e4-65752568ad8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:09.516857 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:09.518193 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:09.519426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:09.519426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:09.519426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:09.519426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:09.519426 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 276/554] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:09.522667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae8dd-91ac-4e79-8d5c-6280b87163e2 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.523036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae8dd-91ac-4e79-8d5c-6280b87163e2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.524961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae8dd-91ac-4e79-8d5c-6280b87163e2 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.525069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 277/555] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:09.527747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae8dd-91ac-4e79-8d5c-6280b87163e2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.643784 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 279/556] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:09.645302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.647295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.647295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.659449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae8dd-91ac-4e79-8d5c-6280b87163e2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:09.665905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:09.667324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:09.699429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.700215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.700506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.700783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.701535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:09.701844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.702579 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:09.706533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.731559 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 278/557] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:09.734150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.749071 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 280/558] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:09.749937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.778597 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:09.846906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f73a-97b9-4fa9-b88e-5666674d0d4f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:09.874434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f597-414c-4734-84a0-11d1fa377cc7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:09.884420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.885217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.885506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.885782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.896955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.898997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.917154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:09.917840 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:09.919816 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:09.921887 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:09.921887 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:09.921887 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:09.921887 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:09.922388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.922388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.922388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.922856 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 279/559] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:09.926543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.931190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:09.932485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-187222cb-5c9c-4f46-89a6-baae2baf41c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:09.948201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:09.949190 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:09.950225 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 281/560] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:09.950886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12bfc-0432-4cfc-b6bb-7f97a3ddb516 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:09.951584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12bfc-0432-4cfc-b6bb-7f97a3ddb516 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:09.951584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12bfc-0432-4cfc-b6bb-7f97a3ddb516 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:09.952674 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 282/561] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:09.956248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12bfc-0432-4cfc-b6bb-7f97a3ddb516 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:09.988924 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.027229 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.041033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af03a-07a1-4119-98d3-d8b8e9d7bff3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.076843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12bfc-0432-4cfc-b6bb-7f97a3ddb516 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.086551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.087695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.087981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.088258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.100502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:10.108341 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:10.109282 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 280/562] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:10.111338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.124494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.125816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.126556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.127058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.128126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:10.129000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.131086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d0ff1-0faa-4bbe-a4e3-51a44d1c403c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.149211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 283/563] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:10.150840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.151301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.151791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.170942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:10.171985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:10.219453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7b21-58e8-46be-8376-d00e1a3ddc9a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.258510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.266944 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 284/564] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:10.267047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.267047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.267205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.267284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.267284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:10.267284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.267284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.285208 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.291998 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 281/565] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:10.293112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.304577 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.385475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600caf2-1bca-4a25-86eb-17a9c082319f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.402652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfbd2f-1c31-4fb3-84dc-d66d6d508431 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.427533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.428347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.428727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.429042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.429806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:10.430115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.431538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.439392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.440182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.445149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.445149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.445331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 285/566] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:10.445331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.452589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.454622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:10.470024 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:10.471043 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:10.471933 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 282/567] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:10.472428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.542579 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.552182 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.567308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76955-5475-42d5-8cc6-ac4c4493dd24 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.597385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe040e-a6c9-4b19-9836-ffa1670335cf None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.610330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.610888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.611172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.611443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.622998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:10.631773 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:10.632792 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:10.633632 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 286/568] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:10.635060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.641341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.642143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.642430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.643240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.655578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.657035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:10.678870 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:10.680058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:10.680949 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:10.680949 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:10.680949 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:10.680949 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:10.680949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 283/569] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:10.681792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.752840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b686f-bb83-4d7f-a6a8-81d9bd90a61f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.790658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.791465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.791754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.791981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b20c-e9b4-43ee-883d-ca0c187a8bae None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.792077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.799070 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.804720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.805660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.813210 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:10.825832 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:10.826948 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:10.827902 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:10.827902 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:10.827902 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:10.827902 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:10.827902 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 287/570] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:10.827902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.837383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.837656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.838274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.838274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.839025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:10.839411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.840908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de33e-ceea-457d-8bff-9d6b59ae8597 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.859913 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 284/571] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:10.861276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7d65-a9bd-4d20-83c2-8a556b940b7c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.861561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7d65-a9bd-4d20-83c2-8a556b940b7c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.861837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7d65-a9bd-4d20-83c2-8a556b940b7c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.863141 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 285/572] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:10.863842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7d65-a9bd-4d20-83c2-8a556b940b7c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:10.937560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe82c-5c52-4df1-83da-642380a156d8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.973344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:10.974124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:10.974477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:10.974866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:10.976282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:10.976282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:10.977402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7d65-a9bd-4d20-83c2-8a556b940b7c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:10.977842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:10.986319 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 288/573] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:10.987320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.014979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.015642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.015925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.016204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.016979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:11.017237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.018633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.035436 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 286/574] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:11.035436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.049159 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.078338 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.101343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae515-fa51-4bf5-ac9e-653ea605d144 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.136611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.137393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.137674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.137947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.138712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:11.138808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842811f-e9e8-42f5-aef8-17aee30a7738 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.139019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.140406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e18582-80ca-4e63-8b57-b73d8fc35788 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.154852 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 289/575] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:11.156151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.156438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.156714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.173851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:11.175091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:11.180024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.180687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.180974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.181253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.182087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=fb9dad5761444d1a8f096c6c2c1cbf19) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:11.182402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.183876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.189489 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 287/576] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/role_assignments?user.id=fb9dad5761444d1a8f096c6c2c1cbf19&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:11.190281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.267198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 290/577] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:11.267198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.332373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633925e-e686-411e-ae7f-4795b370ad53 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.337860 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.346306 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.386194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.387068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.387370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.387638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.402179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.403728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:11.423089 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:11.424426 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:11.425488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:11.425488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:11.425488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:11.425488 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:11.426823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 288/578] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:11.428062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.439635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be92568-88a4-40d7-b96e-1933580d2d50 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.482081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.482925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.483209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.483845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.492063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.493512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:11.509393 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:11.510339 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:11.511578 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:11.512797 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 291/579] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:11.515379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.551226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05926b6-c1a2-43d4-b92f-c5e1eacb3c56 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.591744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.592778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.593184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.594060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.603812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.605532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:11.621674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:11.622911 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:11.623967 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 289/580] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:11.626723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.631247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57103cbb-f857-4fc1-b534-80a196cde826 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.634157 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.657236 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.683300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.684480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.684766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.685040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.700041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:11.707937 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:11.709163 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:11.710012 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 292/581] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:11.710969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.749707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ba29-f24d-4dd3-8986-2cb0d983ed07 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.789625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.790305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.790630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.790909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.791644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:11.791950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.793331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.810828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 290/582] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:11.810828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.830467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed6387-596c-4f46-9d15-31e4f8ee7beb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.866012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.867153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.867429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.867700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.868488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:11.868800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.870257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.883947 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 293/583] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:11.884799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:11.899980 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.916423 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:11.925876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cacc6-2946-4461-9d03-069c27436b7c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:11.964399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:11.965101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:11.965388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:11.965664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:11.966520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:11.966845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:11.968300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:11.986703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 291/584] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:11.992278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.001590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a876-9796-4a8f-a57c-054a0b076717 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.039595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:12.040830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.041116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.041386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.042467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:12.045651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:12.045651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:12.055378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 294/585] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:12.056019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.117350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c977-1754-43dc-bf1f-437ecd175799 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.151227 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:12.155776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:12.157026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.157314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.157593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.160911 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:12.169383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:12.170876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:12.171770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84c68-47bf-4b90-a5cf-ba4ac191c84d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:12.186003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:12.187088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 292/586] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:12.192821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.212211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:12.212211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.212485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.213951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/0522dc9e5943446fbaffdcd857728b59/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.235688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=0522dc9e5943446fbaffdcd857728b59, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:12.237167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:12.266817 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 295/587] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:12 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/0522dc9e5943446fbaffdcd857728b59/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:12.267854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.323544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2d31-a12b-4a07-9593-46b697d040ba None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.402235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:12.404907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.410767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.411838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.448699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:12.451050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:12.472913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ff62-9e6d-4ce2-9cf4-31adbc04debb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:12.485926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:12.487700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:12.489567 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:12.489567 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:12.489567 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:12.489567 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:12.489567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 293/588] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:12.489567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.580732 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:12.615961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:12.617090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.617372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.617643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.628967 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:12.640872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1905c5-fa8d-44eb-abe6-1300fb07f458 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.659400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:12.662326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:12.701633 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:12.702642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:12.703526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:12.703526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:12.703526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:12.703526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:12.707335 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 296/589] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:12.708433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.721928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:12.722812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.722951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.723220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.724178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:12.724391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:12.725908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:12.798867 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 294/590] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Jul 11 14:30:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:12.799851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:12.932240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93a9ca-30c5-4886-937b-d9729fb79ead None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:12.996851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e43f2-a85b-4516-80f5-595c79518cdb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.002884 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.018317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.019035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.019321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.019595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.020331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:13.020639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.022013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.053349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 297/591] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:13.055940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.078668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.079334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.079621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.079900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.080632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:13.080937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.082307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.116139 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 295/592] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:13.117128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.166648 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.296929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312287fb-727f-4ef7-918e-644f6e3c6ed5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.338204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626e02-d1de-43df-9102-7c7438d39fd1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.364937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.366054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.366916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.368826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.384789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.386319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.395619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.396781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.397295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.398600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.408585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.410814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:13.414432 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:13.415383 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:13.416281 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:13.416281 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:13.416281 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:13.416281 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:13.422632 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 298/593] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:13.422632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-95430139-9e1b-445e-9a69-39e0116fa3f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:13.430144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:13.431162 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:13.432057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:13.436533 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 296/594] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:13.438044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa7ca6-466e-43a8-9e99-b89eef53eb0e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.438339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa7ca6-466e-43a8-9e99-b89eef53eb0e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.438650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa7ca6-466e-43a8-9e99-b89eef53eb0e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.445101 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 297/595] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:13.446021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa7ca6-466e-43a8-9e99-b89eef53eb0e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.482631 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.644156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa7ca6-466e-43a8-9e99-b89eef53eb0e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.648288 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.653694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f9457-5ef4-4998-9574-2c4a500907e8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.703758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.704661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.705009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.705341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.717187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.719851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.720098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.720711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.721059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.721344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.722458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:13.722888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.725883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49e127-a4a3-4cab-8e12-7aa40964af1f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:13.745353 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:13.746355 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:30:13.747370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:13.750850 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 299/596] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:13.752820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.759999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 298/597] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:13.761432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.761727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.762013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.786114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:13.788804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:13.926787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 299/598] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:13.928582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.958358 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.969944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483440-5516-4b20-81e9-6f9dd9df82fb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.020485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.020485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.020485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.020867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.023674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:14.024041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.025909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.047680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 300/599] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:14.048351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.108811 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:14.136367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1fd3a-bfe9-4da8-b244-95ebacbde032 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.190317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.191116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.191504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.191887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.192845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:14.193525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.195126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.218654 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 300/600] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:14.220972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.229129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d8a2d-304e-4300-afd6-3cc6063c6db4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.300423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.301231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.301511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.301780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.310022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.311541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.327416 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:14.328035 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:14.329076 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:14.330257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 301/601] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:14.330783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.366576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24436-b0ae-4093-bdd6-0a4fabaaf02d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.408258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.409174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.409458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.409914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.421907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:14.422312 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:14.431201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:14.432981 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 301/602] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:14.436660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.464772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae57246-83f7-4fff-bae8-06e2f7ea9c71 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.499035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.499930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.500210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.500484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/66a3753891494abd84fa3c9c17c1b455/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.519192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=66a3753891494abd84fa3c9c17c1b455, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.520642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.535241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 302/603] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:14 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/66a3753891494abd84fa3c9c17c1b455/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:14.536081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.569994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed779-b22e-40e8-850c-0aa3a4fa0ecf None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.609716 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:14.616700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.617700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.618058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.618437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.633161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.634743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:14.658309 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:14.659446 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:14.660385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:14.660385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:14.660385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:14.660385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:14.660385 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 302/604] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:14.660677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.687805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c23f6-cce2-4551-bcf9-83718a29768a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.726900 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:14.736916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.737848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.738360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.738954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.739768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:14.740081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.742087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969823d-1702-47d3-a1f3-818ab33daf6b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.757572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 303/605] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:14.758969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999e18-4b3a-4635-a65d-33661c08bc8e None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.759267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999e18-4b3a-4635-a65d-33661c08bc8e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.759552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1999e18-4b3a-4635-a65d-33661c08bc8e None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.764973 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 304/606] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:14.765887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1999e18-4b3a-4635-a65d-33661c08bc8e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.798435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8d9a6-5bd2-4a25-ae47-c36fdf522672 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.844416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.845104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.845461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.845662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.846440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:14.846791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.848201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.862360 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 303/607] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:14.863296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:14.903298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1999e18-4b3a-4635-a65d-33661c08bc8e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.915325 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:14.948371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:14.949047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.949333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.949611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.950348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:14.950688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:14.952063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b8f8-2be1-4162-b40c-6fb4724d79ec None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:14.965975 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 305/608] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:14.967305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:14.967599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:14.968113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:14.989157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8275a-ded0-4f62-acc3-0e38f30f5c6e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:14.989334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:14.990544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:15.031331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.032254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.032540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.032817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/f2258fe4b6c14d378fcfdd1fb690f179/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.051512 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:15.057910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=f2258fe4b6c14d378fcfdd1fb690f179, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.059551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.075623 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 304/609] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:14 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/f2258fe4b6c14d378fcfdd1fb690f179/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:15.076452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.096702 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 306/610] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:15.098031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.231023 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:15.241959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa3e9d-1f36-4d23-a599-03e522a4d4fb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.276145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561c85f-2c40-4fa9-ae76-fea54fe31920 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.294631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.295846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.296312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.296771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.311520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.313057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:15.335427 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:15.336415 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:15.337324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:15.337324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:15.337324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:15.337324 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:15.339812 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 305/611] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:15.341039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.355627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.356998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.357516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.358018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.367967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.369770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:15.386095 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:15.387116 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:15.388058 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:15.390785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 307/612] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:15.392007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.443671 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:15.467249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1b2d4-5313-4c02-b08b-ae76722da9e9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.507630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.508783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.509211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.509889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.521035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f902e-fe8c-47d4-b586-937fe26b6221 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.523201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:15.531694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:15.533059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:15.533920 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:15.536855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 306/613] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:15.537938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.551768 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:15.571506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.572530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.573028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.573497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.574435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:15.574981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.576741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.591670 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 308/614] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:15.592784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.671407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c191c-4ca7-46bb-b363-09908ef3846a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.713622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.716313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.716730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.717111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.718063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:15.718479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.720580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.736662 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:15.742743 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 307/615] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:15.744625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.753341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121b710-0fff-44fd-9ab1-e3ec91e33bdd None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.834039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.835692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.836378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.836860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.839046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:15.839580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.843275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.846666 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:15.863765 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 309/616] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:15.865552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:15.893588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36cfc6-3a6d-4a83-80d0-ec9623f614ff None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:15.938257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:15.939953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:15.940453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:15.940956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:15.952964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:15.954992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:15.976181 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:15.977190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:15.978165 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:15.982657 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 308/617] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:15.982657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.045458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd54a-d1e8-475a-9dbb-4dbfd88253de None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.085870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.087140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.087343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.087718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/afe1d2602f5d4180a9d52fbef485bcd0/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.106056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1992a-412c-4b98-aaea-1dd6a68f67ca None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.110569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=afe1d2602f5d4180a9d52fbef485bcd0, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.112244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.138596 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 310/618] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:15 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/afe1d2602f5d4180a9d52fbef485bcd0/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:16.139878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.148931 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:16.164272 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:16.166518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.167555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.167893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.168204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.192499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.194871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:16.243310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:16.244719 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:16.245645 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:16.245645 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:16.245645 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:16.245645 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:16.245645 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 309/619] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:16.254234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.417406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb221f7d-e914-4975-9024-c2a173f8b518 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.454076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c3e5f-6bd4-42a7-83f6-1c48bf05826d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.489624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.490851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.491881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.492362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.493942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:16.494442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.497944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.511148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.512179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.512469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.512750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.513495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:16.513808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.515416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.535558 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 311/620] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:16.544244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.545021 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 310/621] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:16.552894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.638451 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:16.691089 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:16.760477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b47f6-13a2-4777-809e-6757f39ee021 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.763748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb63172-cdd7-458d-a618-061b58c9645a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.831138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.832454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.832737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.833015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.836314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.837115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.837399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.837675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.854214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.855755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.861599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.863097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:16.885002 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:16.886047 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:16.887062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 311/622] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:16.895900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:16.914462 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:16.915441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:16.916352 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:16.916352 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:16.916352 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:16.916352 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:16.922526 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 312/623] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:16.925243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.135741 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.143897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e110-bcdd-4692-8205-21165e159b40 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.154699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d13572-a73c-417e-8f1e-fe998d18c39f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.202872 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.226544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.226544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.226961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.226961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.227820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:17.228136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.229611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.235832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.236514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.242538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.242538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.242538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:17.242538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.242538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.279852 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 313/624] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:17.282091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 312/625] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:17.287687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.291591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.478522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421337c7-fb8b-47f6-affd-d561408e4f05 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.518521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7e83-7a60-4d0f-babf-b62a9431216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.518521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7e83-7a60-4d0f-babf-b62a9431216b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.518521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7e83-7a60-4d0f-babf-b62a9431216b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.518889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7e83-7a60-4d0f-babf-b62a9431216b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.524836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cba2e-703a-4d2c-a277-c79a82324a62 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.552087 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.590462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.592248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.592897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.593682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.602393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7e83-7a60-4d0f-babf-b62a9431216b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.603905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7e83-7a60-4d0f-babf-b62a9431216b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.609354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.612442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-879ba268-f640-496a-82ef-4b02bff7b9ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:17.646409 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:17.648305 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:17.650062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:17.654864 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 314/626] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:17.657603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8fc6-c3c3-4c2c-a326-16266b8ca1e5 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.658408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8fc6-c3c3-4c2c-a326-16266b8ca1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.659453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8fc6-c3c3-4c2c-a326-16266b8ca1e5 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.669623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 315/627] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:17.671703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae8fc6-c3c3-4c2c-a326-16266b8ca1e5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.724815 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 313/628] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:17.727863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885e41-d02a-45ae-8f45-e60a0bf129d9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.727863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885e41-d02a-45ae-8f45-e60a0bf129d9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.727863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885e41-d02a-45ae-8f45-e60a0bf129d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.746633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-82885e41-d02a-45ae-8f45-e60a0bf129d9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:17.747771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-82885e41-d02a-45ae-8f45-e60a0bf129d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:17.760095 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.812163 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.836930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 314/629] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:17.836930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e016-27fb-492e-ac25-605363ec8510 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.836930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e016-27fb-492e-ac25-605363ec8510 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.836930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e016-27fb-492e-ac25-605363ec8510 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.836930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 315/630] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:17.847435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4e016-27fb-492e-ac25-605363ec8510 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.862750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae8fc6-c3c3-4c2c-a326-16266b8ca1e5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.906511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.907624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.908124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.908627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.910235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:17.910993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.913716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7dfea-1378-4d47-b16d-e503a715827a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.936993 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 316/631] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:17.939837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.939837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.940690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.964928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:17.966179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:18.015933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4e016-27fb-492e-ac25-605363ec8510 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.064186 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 317/632] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:18.065961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.080250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.082219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.082806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.083289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.098167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.100483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.119373 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:18.120718 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:18.122407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:18.125399 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:18.125399 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:18.125399 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:18.125399 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:18.125399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 316/633] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:18.125399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.182198 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.264378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ab52-4167-429d-9ecd-86443a6f6a44 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.283024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c321e-cb0d-4558-a508-8613565bc1b1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.331434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.331434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.331434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.331434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/fb9dad5761444d1a8f096c6c2c1cbf19/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.343225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.344726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.345236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.345752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.349150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=fb9dad5761444d1a8f096c6c2c1cbf19, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.351294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.367658 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 317/634] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:18 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/fb9dad5761444d1a8f096c6c2c1cbf19/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:18.367918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:18.376069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:18.389177 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:18.391978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 318/635] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:18.393572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.596252 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.600747 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.623438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604af65-7f25-4e14-9d15-23aaf447a596 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.640161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf28a-4432-4baa-a4df-eb0f0155c285 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.684395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.685573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.686727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.687051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.687887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:18.688397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.689884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.709341 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 319/636] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:18.710968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.719985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.722023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.723056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.723872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.746172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:18.762761 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:18.763833 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:18.764884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:18.765591 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 318/637] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:18.770049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.832764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc065d0-a9dc-45f9-848d-f3dbe4cad5e0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.881241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.881981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.882415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.882823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.883626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:18.883939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.885428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d25fc-0926-43f9-ae25-eb30d69b5f38 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.895619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 320/638] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:18.897008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9713-73b0-4b5f-b367-8d59d15ed259 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.897885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9713-73b0-4b5f-b367-8d59d15ed259 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.898171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9713-73b0-4b5f-b367-8d59d15ed259 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.902646 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 321/639] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:18.902646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9713-73b0-4b5f-b367-8d59d15ed259 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.915553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d360-acaa-4285-afc2-f3ef9a0342b3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.920986 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.959365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.960458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.960802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.961150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.969667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.971337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:18.989317 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:18.991183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:18.993474 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:18.995604 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 319/640] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:18.996549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.011255 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.041267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9713-73b0-4b5f-b367-8d59d15ed259 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.087238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.087925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.088211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.088491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.089247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:19.089559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.090980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c39c9f-baa6-4477-ab5a-432b454f944a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.101058 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 322/641] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:19.106939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.107365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.107516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.126288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:19.127974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:19.176040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acd10d-84d6-46f2-a548-2d17817b109e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.212446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 323/642] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:19.216052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.223826 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.249569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.250987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.251499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.252001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.271176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.274463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:19.313123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:19.314641 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:19.315609 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:19.315609 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:19.315609 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:19.315609 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:19.318729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 320/643] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:19.320047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.346756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e91c4-0e3d-4121-a42e-b4831871bd51 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.387177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.388198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.389338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.389802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.390883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:19.391381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.393446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.409282 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 324/644] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:19.411302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.429870 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.498398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b823-3e97-442f-8dd7-e7dea122da06 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.511963 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.540957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.541864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.542157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.542439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.554772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.556364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:19.576161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:19.577124 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:19.578214 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:19.578214 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:19.578214 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:19.578214 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:19.578214 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 321/645] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:19.579078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.588371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913f80-316a-47c7-85ce-08623b34263e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.643371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.644187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.644473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.644751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.661954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:19.670693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:19.671712 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:19.672591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:19.674967 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 325/646] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:19.677008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.728017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2093f-ddf1-4b62-93fc-84cf755134c4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.747167 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.780190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.780864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.781154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.781594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.782346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:19.783139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.784683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.800652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d53c7-9559-416e-a845-5ee5db5bf257 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.812327 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 322/647] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:19.812327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.841557 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.857238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.857945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.858269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.858574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.859611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=0522dc9e5943446fbaffdcd857728b59) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:19.859952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.861656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.871193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 326/648] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/role_assignments?user.id=0522dc9e5943446fbaffdcd857728b59&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:19.871453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.038347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853831-cc15-42f1-bd6f-f9f8b8a35946 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.047473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac07cd-47a9-4e4d-bc21-438a852c8ef0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.104895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.105777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.106129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.106646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.107810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:20.108293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.110131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.111490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.112260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.112549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.112840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.113787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:20.114155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.115973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.129120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 327/649] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:20.130511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.131648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 323/650] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:20.136797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.205612 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:20.214810 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:20.286535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53006025-f80f-47fb-9248-6ebb82c30c71 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.302637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d8af-40e8-40ca-ba4a-14445e004b8b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.331107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.332148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.332510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.332860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.342653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.344513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.347782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.348743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.349030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.352249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.362264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:20.362597 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:20.363788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:30:20.364827 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:20.366755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.366905 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 328/651] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:20.366905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:20.389422 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:20.391602 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:20.393931 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:20.393931 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:20.393931 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:20.393931 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:20.402545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 324/652] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:20.402545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.510016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1f8d2-849f-4aeb-8b30-05aaaf7f1d4d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.512143 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:20.521943 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:20.543370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54538c-0ec3-4a22-a332-cf7a6ae811be None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.558184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.558751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.559085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.559410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.571077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.573526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:20.597032 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:20.598665 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 329/653] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:20.600668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.611273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.612445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.612932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.613434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.614482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:20.615133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.616969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.640665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 325/654] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:20.641977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.750544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1ca0-ff18-4347-a94e-950ee2317ea8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.791891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17ddcb-4bed-4196-825b-57fd15796482 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:20.795926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.796808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.797078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.797239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.798247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:20.798862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.801228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.827176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 330/655] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:20.828543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.836045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:20.836045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.836045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.836045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.836518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:20.836518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:20.836858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d3f4-9bd7-4287-ab4c-02ed6d2e331a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:20.857037 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 326/656] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:20.858537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013939e-2e15-434f-b167-413deb55ef97 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:20.858855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013939e-2e15-434f-b167-413deb55ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:20.859269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013939e-2e15-434f-b167-413deb55ef97 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:20.862084 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 327/657] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:20.862084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013939e-2e15-434f-b167-413deb55ef97 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:20.869440 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:20.886210 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:20.989802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f071bb-f90d-408b-89cf-37e204a95664 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:21.032137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013939e-2e15-434f-b167-413deb55ef97 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:21.037742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbe0a8-8dbd-452e-a5fb-0dffec7e8456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:21.040922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbe0a8-8dbd-452e-a5fb-0dffec7e8456 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.040922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbe0a8-8dbd-452e-a5fb-0dffec7e8456 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.040922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbe0a8-8dbd-452e-a5fb-0dffec7e8456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.084938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:21.087069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.087891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.088792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.107407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:21.109597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:21.135322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:21.136384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:21.137336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 328/658] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:21.139778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:21.156714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbe0a8-8dbd-452e-a5fb-0dffec7e8456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:21.158917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbe0a8-8dbd-452e-a5fb-0dffec7e8456 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:21.195071 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:21.228784 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:21.285548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb081c-9332-43ba-9043-6280ee714d41 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:21.309829 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 331/659] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:21.311414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.311718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.311995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.330388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:21.331143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.331461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.331751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.339016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:21.340240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:21.438426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:21.442577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:21.445221 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 332/660] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:21.446255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:21.544169 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:21.549284 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:21.612231 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 329/661] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:21.612231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:21.612542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e753-2c07-41ed-a863-970e29650359 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:21.651373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:21.652187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.652451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.652764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.653621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:21.653950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:21.655654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:21.680552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 333/662] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Jul 11 14:30:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:21.686317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:21.746916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51af38-a8b4-4f0e-aa8d-a3ee7bb5d723 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:21.801351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:21.802426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.803121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.803629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.822857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:21.825620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:21.852852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b6ac-2002-419b-bd30-50895b53576c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:21.853543 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:21.854477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:21.855407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:21.855407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:21.855407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:21.855407 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:21.860745 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 330/663] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:21.860745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:21.883432 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:21.884605 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:21.916176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:21.917412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:21.917693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:21.917967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:21.934461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:21.946277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:21.947551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 334/664] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:21.948593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.011342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbc0b-4c2c-4ecf-8724-40ecfce7081f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.071843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.073116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.073490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.073794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.089394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7f5d-ac58-475b-a82e-8e048eca3df9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.090683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.094248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:22.119112 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:22.120184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:22.121195 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:22.121195 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:22.121195 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:22.121195 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:22.127037 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 331/665] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:22.128771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.148483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.149156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.149444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.149723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.233661 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.250593 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.287511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.289337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.291260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebad88-689a-4b25-8491-72b493f80a25 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.338332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.339653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.339653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.340027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.340558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:22.340870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.342262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.365576 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 332/666] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:22.368704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.424587 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 335/667] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:22.425245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.507938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65165043-3a79-4863-a82d-b1f713d5321a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.527696 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.551385 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.558299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae4dbe-85f7-4fbe-b7e9-48192e3c725a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.565919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.569648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.569648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.569648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.569648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:22.569648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.571558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab48a3-e209-4045-83db-635064b95e5b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.584243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 333/668] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:22.586893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd9aa-0af3-45ef-8bd6-2f6888404944 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.587410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd9aa-0af3-45ef-8bd6-2f6888404944 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.587911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd9aa-0af3-45ef-8bd6-2f6888404944 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.590347 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 334/669] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:22.591505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd9aa-0af3-45ef-8bd6-2f6888404944 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.609462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.610268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.610704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.611122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.611988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:22.612341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.614245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.644098 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 336/670] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:22.644971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.713415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd9aa-0af3-45ef-8bd6-2f6888404944 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.756793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.757856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.758266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.758764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.769400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.772078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.780192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56625d72-419b-4889-9c13-dda5137829cc None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:22.791744 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:22.793219 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 335/671] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:22.795170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.827358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.828482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.828766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.829065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.840727 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.842135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.843694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-3b6f2c99-8926-4118-8844-a9f7d63d351d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:22.864854 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:22.866422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:22.867525 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:22.867525 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:22.867525 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:22.867525 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:22.867525 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 337/672] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:22.870461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.871195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.871959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.877460 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.898700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:22.900384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:22.941410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6a1b9-c99d-4dab-af01-a1ae18680104 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.988840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.992689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.993150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.993449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.993807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 338/673] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:22.994700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.007118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.010299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:23.039970 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:23.041045 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:23.042342 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:23.042342 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:23.042342 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:23.042342 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:23.042342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 336/674] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:23.045695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.132998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32afb-bc2d-463a-b0c2-0ad99c58a55c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.157071 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.172010 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.174887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.175792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.176097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.176418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.177725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2dddf-e3c4-49ae-976f-bba7b5d43d50 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.184189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.185946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:23.202958 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:23.203966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:23.204878 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 339/675] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:23.205800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.224007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.225019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.225997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.226440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.227381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.227803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.229543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.242916 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 337/676] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.243905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.340846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2817-72a8-46ab-bb19-430246352a5f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.377733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913ff4f-a229-4cf9-8fbe-530d0f378217 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.397072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.398617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.399015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.399451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.400363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.400671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.402235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.422068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 340/677] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.422068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.422526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.422526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.422526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.422526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.434341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:23.443510 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:23.445221 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:23.446313 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 338/678] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:23.447440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.474168 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.477421 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.566965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cf15-61ec-4549-95ec-beda4164759a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.572859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40279e-dfb2-4166-a609-befac9d12204 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.613114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.613871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.614187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.614683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.615633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.616025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.618110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.622083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.623256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.623697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.624202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.625169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.625622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.627609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.636666 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 339/679] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.638082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.643173 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 341/680] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.644332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.758990 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.773659 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.779275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c684ab-2e3e-4175-b788-b44044651c8e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.790193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35176cf6-58ce-4d53-a708-be7ba9add62b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.826150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.826970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.827245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.828051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.832763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.833519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.833804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.834077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.835686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=66a3753891494abd84fa3c9c17c1b455) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.836060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.838004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.839950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.842072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.845776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 340/681] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/role_assignments?user.id=66a3753891494abd84fa3c9c17c1b455&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.846799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:23.877826 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:23.880537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 342/682] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:23.882754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.034824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f418028-b597-4364-b51f-f4c1fe334637 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.067645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4252-48da-47c8-be10-897a91ea607c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.112004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.112918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.113319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.113732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.114929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.115450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.118448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.132701 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 341/683] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.134249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.142324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.143554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.144022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.144479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.146007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=f2258fe4b6c14d378fcfdd1fb690f179) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.146530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.149591 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.150801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.166546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 343/684] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/role_assignments?user.id=f2258fe4b6c14d378fcfdd1fb690f179&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.166546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.204164 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.312322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962ba2-b3ee-4199-a3d6-813fe6dd9b47 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.332395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5914ef-f59b-4dfd-b1a2-ec089bf4f04b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.371871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.378532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.378532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.378532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.384870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.386476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.387158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.387322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.387741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.388243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.389124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.389438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.391195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.407775 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 344/685] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.408780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:24.409855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:24.411611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:24.415530 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 342/686] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:24.421652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.559846 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.560571 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.589511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf13c4f-6fce-476e-a59e-84ad0bc24096 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.629810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850a63a-e36b-439f-b816-c0071eb0e1d6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.643303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.644678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.645167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.645712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.661677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.664164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.675584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.676719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.676832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.677089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.678037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.678937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.680497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:24.688666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:24.690012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:24.691649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:24.691649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:24.691649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:24.691649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:24.699293 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 345/687] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:24.700691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.702455 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 343/688] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.703439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.831216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644db55-3dc8-46af-ab61-661b88fc9f56 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.831558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15334a6-af63-4be3-86e6-91c699141123 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.862892 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.876428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.879356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.879356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.879356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.882721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=afe1d2602f5d4180a9d52fbef485bcd0) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.882721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.882721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.885574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.886345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.886690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.887022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.887945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.888254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.889669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.892884 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.897609 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 346/689] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/role_assignments?user.id=afe1d2602f5d4180a9d52fbef485bcd0&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.898646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.911668 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 344/690] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.919351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:25.040325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35507c-de05-478b-b5bf-8eb72acdbce5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:25.088054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:25.089000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:25.089498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:25.089873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:25.183956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbcfc3-7a28-41a5-b0fb-e192eecea088 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:25.188742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:25.190536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:25.235040 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:25.246211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:25.246915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:25.247241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:25.247526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:25.259710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:25.261808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:25.286184 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:25.287328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:25.288934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:25.289979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 345/691] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:25.299201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:25.392598 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 347/692] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:25.398643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:25.423981 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:25.562248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187f9a-98ba-4e1b-ac26-9643fbc00544 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:25.572603 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:25.609474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:25.610607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:25.610942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:25.611355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:25.623239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:25.625067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:25.640890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571d00c-cbaf-40d9-9c7f-5ac21c5d7535 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:25.651059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:25.652043 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:25.652955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:25.652955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:25.652955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:25.652955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:25.653619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 348/693] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:25.659615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:25.765176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:25.765954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:25.766276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:25.766659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:25.767740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:25.768065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:25.769660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:25.802527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 346/694] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:30:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:25.812507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:25.836578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7759-bdcc-423e-bfa3-588d3480c980 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:25.877924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:25.878744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:25.879030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:25.879307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:25.880070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:25.880677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:25.881919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:25.902539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 349/695] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:25.905803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:25.938580 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:25.956264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4cd37-f9c4-444e-ad24-a34c2152114c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:25.958273 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:26.057283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2a79e-d138-43a7-985e-3039df8429e5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:26.067124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:26.067837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.068388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.068698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.097794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:26.098652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.098935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.099209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.111216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:26.114524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:26.142522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:26.143557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:26.144507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:26.154785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 350/696] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:26.160050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:26.238535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:26.238749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:26.354614 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:26.396097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effb418-680c-48c2-9101-d600e0aa3214 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:26.440394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:26.441158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.441524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.441887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.443605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:26.444103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:26.446765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:26.470207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 351/697] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:26.479967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:26.554526 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 347/698] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:30:26.556124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:26.565775 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:26.676759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032fbcc-3805-4534-8b38-e04feefef52b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:26.714250 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:26.720925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:26.721914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.722365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.722819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.723842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=fb9dad5761444d1a8f096c6c2c1cbf19) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:26.724339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:26.726015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a1602-b502-4f90-b77f-c7151c462bd5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:26.733705 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 352/699] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:26 2022] GET /identity/v3/role_assignments?user.id=fb9dad5761444d1a8f096c6c2c1cbf19&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:26.735847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e9631-20e0-4d3b-899f-e2316ea37cd6 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.736383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e9631-20e0-4d3b-899f-e2316ea37cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.736842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e9631-20e0-4d3b-899f-e2316ea37cd6 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.743013 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 353/700] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:26.745163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.745671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.746107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.765705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:26.767356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:26.782982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c0a1-5dce-4ac6-890e-9e56e56aa616 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:26.858756 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 354/701] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:30:26.876705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:26.891379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:26.892286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:26.892777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:26.893136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:26.916549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:26.918197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:26.961902 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:26.962967 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:26.963928 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:26.963928 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:26.963928 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:26.963928 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:26.976383 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 348/702] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:26.987647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.013002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604f95-bcd2-4ee6-9966-a10d60827361 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.044768 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.057769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.065267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.065267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.065267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.066760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.070522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:27.107934 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:27.108961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:27.109843 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:27.112918 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 355/703] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Jul 11 14:30:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:27.121294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.126787 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.193583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4a595-e1c0-4745-bbb0-4923058b7edd None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.249681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.250360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.250809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.251288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.252173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:27.252557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.253983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614bf9-7413-4063-81fd-367caf6311e6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.276912 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 349/704] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:27.278383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeaa79-5a79-4130-b6d7-6e690e5b5df4 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.279293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeaa79-5a79-4130-b6d7-6e690e5b5df4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.280035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeaa79-5a79-4130-b6d7-6e690e5b5df4 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.281849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 350/705] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:27.288088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeaa79-5a79-4130-b6d7-6e690e5b5df4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.310299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72369703-49a1-4148-9ba1-1fefdafd0b01 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.362722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.363515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.363802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.364144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.365429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:27.365814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.369544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8988-9b69-4467-9fd7-6bac2d60659b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.376848 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 356/706] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:27.382308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.382308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.382308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.406049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:27.408579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:27.488478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeaa79-5a79-4130-b6d7-6e690e5b5df4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.501665 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.511112 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.532975 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 357/707] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:27.534793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.541251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.542063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.542346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.542683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.550713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.552421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:27.570262 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:27.571283 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:27.572191 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 351/708] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:27.583198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.695329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbdfcc-605b-4459-aa13-ec96eefcc88d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.744926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190ab65-ee24-462e-85d5-b30d8ac9c6f9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.748513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.751447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.752376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.753197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.754901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:27.755759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.758189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.778533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 358/709] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:27.778533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.848830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.850549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.850549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.850822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.854551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:27.854551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.854551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d64211-3e4a-451a-80c9-36c1682eb22b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.877105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 352/710] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:27.879081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fc114-2345-460e-ad63-5120a148cf7e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.879575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fc114-2345-460e-ad63-5120a148cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.880076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fc114-2345-460e-ad63-5120a148cf7e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.883739 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 353/711] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:27.885797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fc114-2345-460e-ad63-5120a148cf7e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.892785 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.959877 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.964450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc8ee1-a1ab-4ac9-b83b-0ac0fa835630 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.010601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.011731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.012020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.012294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.032260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.035813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9838aa5d-402c-46bb-90c0-15e9d2e52eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:28.092753 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:28.093877 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:28.095063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:28.095063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:28.095063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:28.095063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:28.096919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 359/712] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:28.102546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.102546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.102546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.108141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fc114-2345-460e-ad63-5120a148cf7e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.133618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:28.136233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:28.156228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.157240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.157633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.157929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.159368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=0522dc9e5943446fbaffdcd857728b59) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:28.159794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.161968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.172392 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 354/713] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/role_assignments?user.id=0522dc9e5943446fbaffdcd857728b59&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:28.172392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.245768 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 360/714] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:28.296426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.404020 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:28.441767 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:28.451351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b20f2-7a13-4812-95d3-749502b0d112 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.529122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cfa16-afcb-4df2-8308-50472364ee29 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.575441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.576826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.577385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.577950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.579658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:28.580201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.581815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.607714 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 355/715] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:28.616287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.703281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.704143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.704429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.704708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] PATH_INFO: `/v3/services/network` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.705393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.711328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:28.758539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:28.759839 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:28.760942 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 361/716] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:28 2022] GET /identity/v3/services/network => generated 88 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:28.774342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.790531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7ccf-5c33-418f-b6d3-ea57742ef270 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.861537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.862713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.862713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.862995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.863544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.870543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.915636 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 356/717] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:30:28 2022] POST /identity/v3/users => generated 254 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:29.022666 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:29.034322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1cfce-653b-47f0-9e8c-9f3bf907e99f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:29.134849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:29.135462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.135748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.138544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.138544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] RBAC: Adding query filter params (name=network) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:29.138544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:29.138544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617528-1be6-4bcd-bbd2-629dcc1b4134 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.144087 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 362/718] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:29.154316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:29.189654 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:29.352600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420aa6-0150-4406-945d-bf7be657e9d9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:29.416453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:29.417788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.418298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.420250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.421425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:29.421956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:29.423598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d4e93-0e37-4aaa-9ff2-36edfbab52d3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.433163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 357/719] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:29.796178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a273d6-eccf-4964-9b8d-5d11cace278d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.796391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a273d6-eccf-4964-9b8d-5d11cace278d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.796686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a273d6-eccf-4964-9b8d-5d11cace278d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.798703 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 363/720] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:29.807338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.807338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.807338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.832176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:29.833723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:29.953185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 358/721] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:29.990949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a273d6-eccf-4964-9b8d-5d11cace278d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:30.161469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a273d6-eccf-4964-9b8d-5d11cace278d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:30.215500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:30.216423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:30.216713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:30.216996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:30.240698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:30.252857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:30.254192 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:30.256001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 364/722] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:30.266060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:30.286411 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:30.436995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0062-03f0-49a4-af11-da5f22177a1c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:30.492136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:30.493485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:30.494131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:30.494674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:30.495972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:30.496681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:30.498564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:30.517138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 359/723] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:30.527751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:30.567042 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:30.720909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57c37-a5a4-4ae9-bd12-4ac9f67af7fb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:30.824403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:30.825310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:30.828299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:30.828299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:30.852330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:30.853908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1998c058-fec2-4687-88cd-f2eb906c9908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:30.889652 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:30.891306 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:30.893549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:30.893549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:30.893549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:30.893549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:30.893549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 365/724] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:30.899703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:31.025967 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:31.090900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ac4c-e75a-4230-a642-3374de6d3a80 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.092935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ac4c-e75a-4230-a642-3374de6d3a80 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.092935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ac4c-e75a-4230-a642-3374de6d3a80 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.093296 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 366/725] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:30:31.098054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf75af-f5e2-4685-8338-e96cfbb50398 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:31.107933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.108240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.108600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.160128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:31.161399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:31.207743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:31.209495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.210290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.211059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.212848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:31.213646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:31.222367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:31.269762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 360/726] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:31.283781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:31.338336 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:31.341369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 367/727] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:31.387901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:31.455086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f3f2-4620-421c-a85b-7ef51e1b515a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:31.491549 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:31.501511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:31.502774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.503276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.504061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.514686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:31.516898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c435a054-bb0c-4b0d-a443-7651386c5332 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:31.536563 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:31.537611 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:31.539057 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:31.546390 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 361/728] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:31.548283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b0f7-5423-42d1-a2f4-9f5174bf383e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.549845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b0f7-5423-42d1-a2f4-9f5174bf383e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.550385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b0f7-5423-42d1-a2f4-9f5174bf383e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.553731 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 362/729] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:31.555409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b0f7-5423-42d1-a2f4-9f5174bf383e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:31.569475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fcd21-1c7f-4edc-942a-ea3b2c0d74f9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:31.633302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0fd3d-6be4-4a17-af06-17d296179dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:31.634011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0fd3d-6be4-4a17-af06-17d296179dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.634292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0fd3d-6be4-4a17-af06-17d296179dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.634637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0fd3d-6be4-4a17-af06-17d296179dc7 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.635372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0fd3d-6be4-4a17-af06-17d296179dc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:31.636753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0fd3d-6be4-4a17-af06-17d296179dc7 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:31.669321 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 368/730] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:30:31 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:31.672037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.672358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.672618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.706550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b0f7-5423-42d1-a2f4-9f5174bf383e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:31.722796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:31.726538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:31.773689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:31.775911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:31.776492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:31.780317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:31.781565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:31.782102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:31.785580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:31.822650 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 363/731] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Jul 11 14:30:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:31.828574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:31.882263 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:31.914379 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 369/732] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:31.917865 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:31.946811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:31.987454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb001-f6bb-41f3-82ae-6e785b79f2cf None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.029219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.030720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.031219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.031699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.082895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48a92-db45-41c4-bc18-177b55240c4f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.124501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.125539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.125539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.125739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.128378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.130135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.140045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:32.148605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:32.149647 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:32.150535 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 370/733] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:32.156043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.189054 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.245473 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.266844 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 364/734] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:31 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:30:32.268187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.357376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8388f-d37f-45f3-b492-5c2db913a250 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.399918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f933-8aa3-4991-b758-74204f3a02f4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.422996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.423682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.423973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.424255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.425199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:32.425509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.431094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d3bc-55c4-4d76-956e-4e89353e0793 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.448349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 371/735] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:32.449425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a817-f682-4680-acf2-a57bdc801560 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.449719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a817-f682-4680-acf2-a57bdc801560 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.450005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a817-f682-4680-acf2-a57bdc801560 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.459945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.461177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.461668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.462145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.462474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 372/736] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:32.463915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.464215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.464498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.481382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.483297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.488087 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.491418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:32.492664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:32.516182 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:32.517198 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:32.518113 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:32.518113 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:32.518113 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:32.518113 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:32.523406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 365/737] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:32.524649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.626667 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 373/738] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:32.626667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.664537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1371-7df2-49d0-854b-b70f45d4d829 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.683452 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.703514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.704841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.705316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.706018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.717783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.719603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-b7d881b3-5bab-4e1a-81c6-d736260ef566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:32.740990 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:32.741940 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:32.742908 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:32.742908 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:32.742908 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:32.742908 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:32.745244 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 366/739] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:32.746865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf72d-5435-4e4b-b52f-e1b5050c55ee None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.747225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf72d-5435-4e4b-b52f-e1b5050c55ee None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.747577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf72d-5435-4e4b-b52f-e1b5050c55ee None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.750637 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 367/740] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:32.750637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf72d-5435-4e4b-b52f-e1b5050c55ee None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.771973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19a15c-8753-4c9c-8a3e-558b20cb4743 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.824975 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.828394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.829097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.829382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.829658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.830444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:32.830884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.832485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.850834 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 374/741] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:32.850834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.900310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf72d-5435-4e4b-b52f-e1b5050c55ee None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.941376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb384bf-3b4c-4a13-ac62-4005543164c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.942389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb384bf-3b4c-4a13-ac62-4005543164c1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.943285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb384bf-3b4c-4a13-ac62-4005543164c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.944470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb384bf-3b4c-4a13-ac62-4005543164c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.957821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb384bf-3b4c-4a13-ac62-4005543164c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-edb384bf-3b4c-4a13-ac62-4005543164c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:32.967207 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:32.968205 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:32.969056 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 368/742] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:32.972827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.972827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.972827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.978236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279ea74-858c-44d5-8730-e69a3f9f1bf2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.979947 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.992578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:32.993903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:33.033321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.034116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.034400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.034749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.035568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:33.035882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.037988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.057187 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 375/743] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:33.057187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.094697 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 369/744] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:30:33.096287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.151813 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.198067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f47f9-57a6-4d25-9404-55566332df36 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.231919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a313-0411-4edc-8212-fdb769a34e07 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.253739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.254857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.255408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.255846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.264790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.266538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.281203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.281203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.281203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.281203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.281625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:33.281625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.283227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:33.286782 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:33.288205 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:33.289111 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:33.296591 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 376/745] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:33.297733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.299119 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 370/746] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:33.300120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.331415 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.450611 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.450782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a069-9326-4b2e-89da-8af76810cbb6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.455791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b962-4d2f-4c80-a8b3-dc5866fb5ff8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.504356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.505188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.505476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.505866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.506929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.507623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.507915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.508260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.509143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.511267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.516616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.518262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.538539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 371/747] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:30:33 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:33.538539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:33.538811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:33.539989 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:33.540962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:33.543544 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 377/748] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:33.544503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.704427 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.739070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e257ea-381e-4e25-935c-49c25edc1526 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.747763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c175e-8613-4349-9610-9b39e92b7ca7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.787167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.788523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.789713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.789713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.789904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:33.790217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.792932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.800565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.802003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.802350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.802676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.818714 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 372/749] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:33.818714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.819000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.819000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:33.842527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:33.843490 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:33.844417 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:33.844417 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:33.844417 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:33.844417 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:33.844417 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 378/750] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:33.844701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.858819 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.993561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f0d5-4d45-468d-9549-ea4e533a4a4f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.009407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de716b7-c5e1-4c53-b902-79e91a98be3b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.060749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.065493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.066014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.066630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.067741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:34.069076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.069642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.070321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.071801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.071801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.072287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=fb9dad5761444d1a8f096c6c2c1cbf19) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:34.072642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.072754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.074216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.082818 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 379/751] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/role_assignments?user.id=fb9dad5761444d1a8f096c6c2c1cbf19&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:34.085616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.086364 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.110283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 373/752] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:34.117108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.293367 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.309086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc32bf-7a3e-45e9-8c10-d6ae1a116518 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.324391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968ebe9-ec80-45f0-a060-9546a11775de None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.360818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.362229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.363070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.363606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.365643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:34.366330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.368340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c7e1-1378-4241-a2cf-4ecb2a709107 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.369250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.370152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.370517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.370954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.387413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.389791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.391845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 380/753] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:34.394113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38017fc6-17a6-4dd7-80b7-f97863834292 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.394724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38017fc6-17a6-4dd7-80b7-f97863834292 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.395440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38017fc6-17a6-4dd7-80b7-f97863834292 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.398272 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 381/754] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:34.399836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38017fc6-17a6-4dd7-80b7-f97863834292 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ef3e66d4-3d61-4acb-a90e-97c39b7eb0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:34.430648 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:34.431837 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:34.432875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:34.432875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:34.432875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:34.432875 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:34.437531 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 374/755] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:34.439494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.439494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.439721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.462664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:34.465329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:34.489945 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.569181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38017fc6-17a6-4dd7-80b7-f97863834292 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.589769 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 375/756] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:34.591609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.649167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.650003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.650286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.650622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.666044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.667612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:34.690219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:34.691337 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:34.692344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 382/757] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:34.693211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.722201 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.823622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98834c8-e09c-4ca8-870b-27958395540e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.854735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6ea8-a18e-4efd-99d5-6ada00b9a441 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.873794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.874514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.874809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.875090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.875859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:34.876172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.877618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.897564 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.905490 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 376/758] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:34.906202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.931246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.932621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.933670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.934364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.937164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.940136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:34.963606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:34.964648 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:34.965521 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:34.973629 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 383/759] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:34.975466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.101500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd1b3-2555-4d26-853c-d8166551abc7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.122143 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:35.143343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.144337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.144337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.144568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.145415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:35.145725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.148276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.167431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 377/760] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:35.168395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.174611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bf83-fd1e-491d-a6ce-23cacf50516f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.241848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.246064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.246626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.247107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.256289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.258130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:35.276550 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:35.277514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:35.278402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:35.280035 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 384/761] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:35.280913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.308323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb192-a00a-4917-b6f7-14a231708035 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.383092 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:35.386283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.387754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.388501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.389098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.391310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:35.392093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.395063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.405157 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 378/762] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:35.406884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.468329 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:35.493553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea985-f2bb-4589-b728-17c9a5a0eb18 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.548899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a211c-9871-4062-b13c-e42716ae7d1b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.565596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.566684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.567168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.567638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.629144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.631714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.632461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.634551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.636494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:35.637405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.639990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.672346 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 379/763] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:35.674987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.737481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.740963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.856021 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:35.902399 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:35.906322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf859a6-8758-4a01-af30-4fea40726374 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.952303 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 385/764] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:35.953288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.955287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.956498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.957946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.958467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.960074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:35.961034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.962813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf69470-b90b-4964-b08e-e03649011941 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.971273 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 380/765] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:35.973788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ecb2f-ef17-426f-ab5b-4c3817607391 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.974603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ecb2f-ef17-426f-ab5b-4c3817607391 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.975154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ecb2f-ef17-426f-ab5b-4c3817607391 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.977645 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 381/766] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:35.978829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ecb2f-ef17-426f-ab5b-4c3817607391 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.096328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b7d80-6033-4c57-ae32-6fc0e70656d2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:36.130087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ecb2f-ef17-426f-ab5b-4c3817607391 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:36.155305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:36.156150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.156433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.156710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/0522dc9e5943446fbaffdcd857728b59/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.159438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=0522dc9e5943446fbaffdcd857728b59, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:36.161278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:36.181142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:36.181948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.182218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.182609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.194540 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 386/767] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:35 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/0522dc9e5943446fbaffdcd857728b59/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:36.194540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.194540 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:36.199592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:36.201561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5dd0364a-f482-49d0-a032-a0614de13053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:36.222783 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:36.223841 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:36.224930 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:36.224930 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:36.224930 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:36.224930 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:36.229434 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 382/768] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:36.231148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.231527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.231886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.255800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:36.260294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:36.274460 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:36.399792 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 383/769] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:36.400678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.493324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e78838-ecc2-4ba8-b3f1-589b5ff1eb2c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:36.536713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:36.538470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.539064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.540334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.541422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] RBAC: Adding query filter params (interface=public, service_id=d8df94523ce74f16a19464f206d81568, region_id=RegionOne) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:36.541811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:36.543070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065c1d4-1879-4a02-a1fb-b03650272ea8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:36.543405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581597-d57e-413f-9fba-6d4368fc73f8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:36.553995 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 387/770] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:30:36 2022] GET /identity/v3/endpoints?service_id=d8df94523ce74f16a19464f206d81568&interface=public®ion_id=RegionOne => generated 194 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:36.555689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7e3a2-c2d4-4f69-881e-78d5be10f7cf None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.556056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7e3a2-c2d4-4f69-881e-78d5be10f7cf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.556413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7e3a2-c2d4-4f69-881e-78d5be10f7cf None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.558357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 388/771] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:36.559206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7e3a2-c2d4-4f69-881e-78d5be10f7cf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.593184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:36.594348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.594772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.595058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.596625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:36.596944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:36.600765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:36.620227 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 384/772] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:36.621404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.626111 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:36.656482 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:36.704334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7e3a2-c2d4-4f69-881e-78d5be10f7cf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:36.747204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:36.748162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.748426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.748647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] PATH_INFO: `/v3/services/network` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.749317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:36.751107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:36.756519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42b951-d0fc-4bfc-9073-772b669d89c7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-123a34eb-c68c-4385-a3b9-3a76ec5f1c56 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:36.769767 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:36.771396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:36.772825 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:36.774387 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 389/773] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:36 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:36.776320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.776320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.776320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.799392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:36.801523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:36.807476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:36.808457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:36.808968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:36.809445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:36.810345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:36.813103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:36.826689 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 385/774] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:30:36 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:36.827999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.900521 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 390/775] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:36.901647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:36.951019 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:37.006592 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:37.024940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1b44-cca8-46f4-8b80-27d4664f4ff1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.084580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c412b-33f1-4f20-8f7f-d974a9d60dd1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.089215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.090476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.091039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.091529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.102697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:37.107398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:37.124884 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:37.126694 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:37.127616 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:37.128789 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 386/776] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:37.137548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.140658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.141373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.141716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.141964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.142884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] RBAC: Adding query filter params (name=network) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:37.143086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:37.144406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:37.149897 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 391/777] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:37.154802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.338127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349565e4-c061-42f5-a383-a11060aeaf1b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.356794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb41b5-04a8-40fb-9a0b-dee2fb757142 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.375233 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:37.389497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.391467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.392079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.392565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.399878 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:37.415288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:37.418181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.419194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.419708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.420200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.421225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:37.421734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:37.423535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:37.426302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:37.427322 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:37.428307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:37.440946 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 387/778] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:37.441186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.450877 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 392/779] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:37.453501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.591253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec52a-09ac-41eb-8395-b549aba5c73b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.626958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec497f-2080-43e2-ba40-0f0fd7c8a6f5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.642317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.643454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.643953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.644445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.645415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:37.645926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:37.647570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:37.663209 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 393/780] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:37.664445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.711141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.712966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.712966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.713256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.714607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:37.714997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:37.716433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:37.727254 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:37.731355 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 388/781] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:37.734362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.802002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c877f-e3c6-42b6-b279-2eec8dfb570b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:37.826528 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:37.850704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:37.851755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.852044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.852324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.854323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=8399c431392046719f704ff154c9f729) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:37.854876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:37.856329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:37.871051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 394/782] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/role_assignments?user.id=8399c431392046719f704ff154c9f729&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:37.872404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.941306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50d20-4fbc-4ad3-a2a4-d87a709149f2 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.029892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.032481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.035784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.036353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.058861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.060367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.095397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c31217-4dc5-4419-ae9a-f69461e935b4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.108727 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:38.109701 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:38.110621 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:38.111520 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:38.111520 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:38.111520 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:38.111520 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:38.119399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 389/783] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:38.120592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.147900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.148999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.149493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.149971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.154577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] RBAC: Adding query filter params (interface=public, service_id=f032a4700f164b14ac8de3fff8a24820, region_id=RegionOne) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:38.155307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.158353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.168478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 395/784] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/endpoints?service_id=f032a4700f164b14ac8de3fff8a24820&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:38.173172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.363423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c0a9f-16dc-476d-aac4-4b6a6d7dc364 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.373282 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.432066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844458b-2e91-44a7-8971-1a1d20110988 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.468892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.469943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.470580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.472647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.473793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:38.474109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.476217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fb7c7-2f90-4bb0-ad07-ef966d024b7c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.498435 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 390/785] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:38.500114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3935-ab7c-434d-96b6-8bca759fa886 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.500413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3935-ab7c-434d-96b6-8bca759fa886 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.500696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3935-ab7c-434d-96b6-8bca759fa886 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.508195 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 391/786] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:38.508195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3935-ab7c-434d-96b6-8bca759fa886 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.512730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b0ec-8505-4812-910a-d6da6d007bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.513740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b0ec-8505-4812-910a-d6da6d007bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.514225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b0ec-8505-4812-910a-d6da6d007bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.514720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b0ec-8505-4812-910a-d6da6d007bf4 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.515634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b0ec-8505-4812-910a-d6da6d007bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.517215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b0ec-8505-4812-910a-d6da6d007bf4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.524537 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 396/787] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/services => generated 772 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:38.526281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.526810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.527484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.550346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:38.552636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:38.607593 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.686981 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 397/788] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:38.728993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.763338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3935-ab7c-434d-96b6-8bca759fa886 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.833604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.836799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.837108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.837394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.856887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.858970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.870914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff496e36-3fde-4440-bbd4-6e49b81d41a0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:38.888008 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:38.889031 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:38.889976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:38.895987 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 392/789] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:38.897460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.920987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96438246-b875-496d-b429-91f422ae67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.922160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96438246-b875-496d-b429-91f422ae67db None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.923031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96438246-b875-496d-b429-91f422ae67db None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.923653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96438246-b875-496d-b429-91f422ae67db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.940432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96438246-b875-496d-b429-91f422ae67db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-96438246-b875-496d-b429-91f422ae67db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:38.949023 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:38.950097 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:38.950978 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:38.953820 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 398/790] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:38.961927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96438246-b875-496d-b429-91f422ae67db None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.982868 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.999585 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.091437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96438246-b875-496d-b429-91f422ae67db None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.139967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.140655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.140937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.141209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.142041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:39.142349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.143832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.172743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 399/791] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:39.179564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.194596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828d0c3-802d-46c7-9d6b-fc8d6d734419 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.266553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.266553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.266553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.266553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.266982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:39.266982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.266982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513faff-e289-4b85-bca0-633e580b979f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.310636 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 393/792] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:39.312104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435f599-6379-4e37-8f3b-c63c55b2a0d8 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.312394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435f599-6379-4e37-8f3b-c63c55b2a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.312672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435f599-6379-4e37-8f3b-c63c55b2a0d8 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.319879 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.324450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 394/793] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:39.325686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435f599-6379-4e37-8f3b-c63c55b2a0d8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.336905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f815-6b3f-429f-8193-70e2a1d61bef None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.410232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.411650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.411650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.411987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.434164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.436742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7a9459fe-39f8-4d1b-989d-d8265482a015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:39.468012 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:39.468964 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:39.469891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:39.469891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:39.469891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:39.469891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:39.473283 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.475199 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 400/794] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:39.477402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.477883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.478343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.499657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:39.500896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:39.501372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435f599-6379-4e37-8f3b-c63c55b2a0d8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.559528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.561137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.561679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.562574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.581379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.585452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.598522 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 401/795] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:39.598522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:39.622009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:39.623017 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:39.623906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:39.623906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:39.623906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:39.623906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:39.626458 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 395/796] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:39.631677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.697796 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.757708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d2154-6d60-48f0-b8c5-54405c4ccacc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.833451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.834186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.834474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.838318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.838973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:39.839288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.840725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.865852 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 402/797] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:39.873714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a0bd-1e98-489a-9828-c653d485c380 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.876144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.957325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.958019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.958303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.958683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.959524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:39.959835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.961329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.976183 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.993531 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 396/798] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:39.996082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.063760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fcf47-0763-49b7-856b-76c49e517524 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.104526 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.110619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.113097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.113097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.113097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.113619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.115319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:40.133269 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:40.134341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:30:40.135280 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:40.137925 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 403/799] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:40.139044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.229561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557ea43-22a3-4670-9336-106981aed6cb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.280343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5459314-b12e-400c-8f23-71b3e5366280 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.300740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.303489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.304018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.304498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.322401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.325745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.350542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.351710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.352202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.352706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:40.355255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:40.356208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:30:40.357211 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:40.364532 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 397/800] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:40.369827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.374992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.383917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:40.414680 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:40.415649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:40.416561 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:40.424889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 404/801] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:40.426183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.477443 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.525438 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.553897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b960f2-ece8-4224-a0ef-623e1a3de583 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.589337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c80e-98bd-4c9f-9375-2b8283d91ab8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.631815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.632500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.632789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.633073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.633809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:40.634127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.635568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.638250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.639258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.639972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.640424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.641537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:40.642131 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 398/802] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Jul 11 14:30:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:40.643119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.643378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.645130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe78e-255a-48df-9881-2d9bab952243 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.679347 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 405/803] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:30:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:40.680939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7354d-677e-44b4-bbd1-b05bec3358be None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.681318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7354d-677e-44b4-bbd1-b05bec3358be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.681663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7354d-677e-44b4-bbd1-b05bec3358be None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.688876 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 406/804] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:40.688876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7354d-677e-44b4-bbd1-b05bec3358be None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.827725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cad79-00d7-4cba-8e22-bd790901e7fe None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.847555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7354d-677e-44b4-bbd1-b05bec3358be None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.851194 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.874280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.875011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.875302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.875885 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.876280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.877169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:40.877490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.879790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55723-d1c9-4119-bc27-34408987d904 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.904222 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 399/805] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:40.904222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.904222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.904222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.917026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.917716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.918006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.918298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.919083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:40.919394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.920816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.932920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:40.933124 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 407/806] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Jul 11 14:30:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:40.933124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.933331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:41.037952 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 400/807] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:41.039005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:41.081597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa3e6-3f64-4b7e-baeb-127e0319b467 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:41.124536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:41.125633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.125911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.126184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.181121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d176-4fd4-48a8-92dd-5559861c83e6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:41.182447 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:41.192378 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:41.216448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:41.218053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:41.236473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:41.237378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.237659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.237924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/fb9dad5761444d1a8f096c6c2c1cbf19/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.240735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=fb9dad5761444d1a8f096c6c2c1cbf19, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:41.242207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:41.262044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 401/808] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:41 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/fb9dad5761444d1a8f096c6c2c1cbf19/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:41.263489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:41.361656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 408/809] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:41.362701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:41.459016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4180b-6833-45c7-a1b8-630e3e10f9ef None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:41.486759 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:41.519791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff961ee-9b56-44c2-9602-bf0f71438e82 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:41.520323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c59c5c-19ce-4a87-861e-b38d110aa64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:41.521786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c59c5c-19ce-4a87-861e-b38d110aa64e None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.522269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c59c5c-19ce-4a87-861e-b38d110aa64e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.522808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c59c5c-19ce-4a87-861e-b38d110aa64e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.523786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c59c5c-19ce-4a87-861e-b38d110aa64e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:41.525256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c59c5c-19ce-4a87-861e-b38d110aa64e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:41.565157 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 402/810] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:30:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:41.572373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb0e1-a97c-4981-9151-79b2a73e509b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.572690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb0e1-a97c-4981-9151-79b2a73e509b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.572956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb0e1-a97c-4981-9151-79b2a73e509b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.577134 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 403/811] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:41.578940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb0e1-a97c-4981-9151-79b2a73e509b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:41.586609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd7a4-d23b-4137-af83-359a3935a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:41.588042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd7a4-d23b-4137-af83-359a3935a43d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.588333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd7a4-d23b-4137-af83-359a3935a43d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.588607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd7a4-d23b-4137-af83-359a3935a43d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.611417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cd7a4-d23b-4137-af83-359a3935a43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-425cd7a4-d23b-4137-af83-359a3935a43d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:41.622009 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:41.634887 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 409/812] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:41.636704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.638203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.638203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.642226 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:41.681802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:41.686686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:41.845404 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 410/813] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:41.847639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:41.855660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb0e1-a97c-4981-9151-79b2a73e509b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:41.938999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:41.938999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:41.942145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:41.942145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:41.951776 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:41.960400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:41.962238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:41.985232 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:41.986192 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:41.987123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:41.987123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:41.987123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:41.987123 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:41.995362 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 404/814] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:41.996837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.039201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069edb1-48d0-4221-af72-4b28f36acf08 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.095705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.096850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.097344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.098020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.099045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:42.099772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.101670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:42.112254 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 411/815] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:42.113675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.168985 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:42.222808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827d57e-6ecc-4e56-95d0-a9adf4d9f173 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.286139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9745f-80fb-4601-b098-e4f274f4bf15 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.292625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.293442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.293730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.294010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] PATH_INFO: `/v3/services/network` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.294708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.296117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:42.320609 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:42.331871 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:42.333143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:30:42.334121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:42.335701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.336744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.337329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.337814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.338848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:42.339362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.340290 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 405/816] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:41 2022] GET /identity/v3/services/network => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:42.341230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:42.341340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.368917 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 412/817] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:42.372561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.510442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102dfb-c3cd-4c80-bfbf-42e658e96860 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.556817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.558819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.559352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.559864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.572625 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:42.577837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.579720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:42.601404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:42.602365 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:42.603462 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:42.603462 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:42.603462 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:42.603462 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:42.609309 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 406/818] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:42.610785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.644305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf263-f8f6-4638-9cb4-54bcf435ef2e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.714379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.715033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.715322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.715602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.716330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] RBAC: Adding query filter params (name=network) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:42.716642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.721592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:42.741101 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 413/819] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:42.741101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.841192 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:42.843367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1ccc-631e-425d-8f1f-89a15284e7f8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.910574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.913867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.914169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.914460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.916409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f834f1-de6f-458b-b1d6-9792578b6974 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.936985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.941261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:42.977054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:42.978015 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:42.979054 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:42.982662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 407/820] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:42.984680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.989595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.990708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.991248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.991749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.992688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:42.993199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:42.995209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.029370 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 414/821] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.031026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.155176 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.185690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607a883-360b-4eec-9ce4-7ef80ec437ba None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.210681 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.253655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1233c-fbd5-408b-9fc1-d526efb68dc9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.257696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.258483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.258980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.260029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.261068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:43.266040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.266040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.299908 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 415/822] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.301053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.316807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.317596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.318331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.319425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.320773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] RBAC: Adding query filter params (type=network) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:43.321211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.322989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.343042 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 408/823] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.344334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.494552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866a7b4-899f-4af8-978a-ded26626b286 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.560937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.561686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.561953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.562235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.571119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.572466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:43.592850 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:43.593891 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:43.594915 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:43.598914 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 416/824] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:43.599805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.642862 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.654127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5e8d6-a44c-4871-952b-1e9294c60946 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.683669 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.724195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.726659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.726772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.727117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.730240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=0522dc9e5943446fbaffdcd857728b59) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:43.731137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.735244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a6ed-5197-4958-bd61-d2496545efbd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.743479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59bb82-564d-43c5-9447-3037f0363008 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.747012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 409/825] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/role_assignments?user.id=0522dc9e5943446fbaffdcd857728b59&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.748565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e751-fd85-4741-8e77-45654bf624a9 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.748857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e751-fd85-4741-8e77-45654bf624a9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.749132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e751-fd85-4741-8e77-45654bf624a9 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.755182 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 410/826] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:43.755182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222e751-fd85-4741-8e77-45654bf624a9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.903539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191ce9d-0edd-46c4-9457-a66eac661949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.913560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191ce9d-0edd-46c4-9457-a66eac661949 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.913560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191ce9d-0edd-46c4-9457-a66eac661949 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.913560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191ce9d-0edd-46c4-9457-a66eac661949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.913865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191ce9d-0edd-46c4-9457-a66eac661949 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.915177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191ce9d-0edd-46c4-9457-a66eac661949 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.958567 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 417/827] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:30:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:43.961142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20032771-8269-4885-a200-2d30a3085b70 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.961510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20032771-8269-4885-a200-2d30a3085b70 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.961859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20032771-8269-4885-a200-2d30a3085b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.048534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-20032771-8269-4885-a200-2d30a3085b70 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:44.051353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-20032771-8269-4885-a200-2d30a3085b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:44.158335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222e751-fd85-4741-8e77-45654bf624a9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.221377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.222236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.222893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.222893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.223740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:44.224057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.226116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3ecba-03f5-4857-90e9-b031346442f3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.253707 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 411/828] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:44.256538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd94dc-34d0-4ddf-98f1-8f2226fa52f2 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.257092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd94dc-34d0-4ddf-98f1-8f2226fa52f2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.257581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd94dc-34d0-4ddf-98f1-8f2226fa52f2 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.259331 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 412/829] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:44.260909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd94dc-34d0-4ddf-98f1-8f2226fa52f2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.283970 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 418/830] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:44.288347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.288642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.288948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.319188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:44.319941 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.323128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:44.334945 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.411308 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 419/831] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:44.413234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.428783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd94dc-34d0-4ddf-98f1-8f2226fa52f2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.492236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.493601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.493889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.494176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.510423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.511720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:44.544308 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:44.545356 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:44.547561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:44.547561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:44.547561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:44.547561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:44.547561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 413/832] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:44.547561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.574653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf375504-fbd9-4288-a65b-8d5c93725b81 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.628912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.630141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.631128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.631760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.651744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:44.662032 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:44.666137 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:44.667620 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:44.668539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:44.671568 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 420/833] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:44.672778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.685699 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.692285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284846f9-147a-4d59-8401-91f1da100c9e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.738402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.739491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.739940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.740297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.741425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.743359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:44.761251 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:44.762464 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:44.763491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:44.767884 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 414/834] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:44.768814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.810365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838a7e-46ea-4af1-a3f4-0f2a5855784a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.854630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.855225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.855507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.855788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.856559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:44.856866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.858412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.873127 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 421/835] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:44.876136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.922353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0219e4-e06c-476a-a2f7-a9b534c7897e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.970852 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.987940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.989080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.989646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.990154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.991500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:44.991825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.993251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.002657 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 415/836] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:45.003527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.024844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f72fde-7b49-408c-b3d1-a8a1f364a055 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.028342 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:45.073734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beea73-6b05-439f-839f-591463937841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.074488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beea73-6b05-439f-839f-591463937841 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.074801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beea73-6b05-439f-839f-591463937841 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.075076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beea73-6b05-439f-839f-591463937841 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.075785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beea73-6b05-439f-839f-591463937841 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:45.076088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beea73-6b05-439f-839f-591463937841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.077456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beea73-6b05-439f-839f-591463937841 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.082212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 422/837] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:45.083051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beea73-6b05-439f-839f-591463937841 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.162872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d064515-126c-4dc3-a9bb-6091710c488b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.206856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.207654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.207943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.208221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.214899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beea73-6b05-439f-839f-591463937841 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.215879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.217340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:45.231674 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:45.232643 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:45.233553 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 416/838] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:45.234041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.251443 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:45.260029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.260997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.261290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.261567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.281812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.284482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:45.311710 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:45.313289 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:45.314607 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:45.314607 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:45.314607 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:45.314607 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:45.318314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 423/839] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:45.319413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.359037 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:45.422443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152211cc-99a9-4ff7-bd46-ea8caf991b13 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.473092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.474117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.474679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.475155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.476060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:45.476544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.478171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.489388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 417/840] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:45.489388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.527239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab677aa-b40d-4782-904b-abc18281dea1 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.610420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.611312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.612163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.612163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.612883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:45.613259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.616629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.628526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844301c6-2f54-487d-b368-eb8d9b890ab1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.646521 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 424/841] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:45.649596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.700239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.702721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.703321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.703815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.704980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:45.705515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.710380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.717550 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:45.742736 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:45.744209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 418/842] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:45.751894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.892759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674ed03-721c-42d8-aada-34376693d3e9 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.965205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0285f-c523-4eeb-bd8a-6bb2ecac525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.966486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0285f-c523-4eeb-bd8a-6bb2ecac525c None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.967012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0285f-c523-4eeb-bd8a-6bb2ecac525c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.967825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0285f-c523-4eeb-bd8a-6bb2ecac525c None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/8399c431392046719f704ff154c9f729/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.994240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0285f-c523-4eeb-bd8a-6bb2ecac525c None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=8399c431392046719f704ff154c9f729, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.996746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0285f-c523-4eeb-bd8a-6bb2ecac525c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:46.018227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 425/843] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:45 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/8399c431392046719f704ff154c9f729/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:46.022901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195eed4-b12a-4787-a0a8-78a06d4bb749 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:46.112041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:46.115377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.118008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.119687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.137658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:46.141480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:46.145192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4b43-4be1-4497-9955-11e012d200e9 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.145487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4b43-4be1-4497-9955-11e012d200e9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.145870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4b43-4be1-4497-9955-11e012d200e9 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.153838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 426/844] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:30:46.155330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.155624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.155901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:46.173302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:46.174333 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:30:46.175358 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:46.175907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:46.175907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:46.179757 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 419/845] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:46.191401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:46.292338 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 427/846] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:46.325417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:46.361957 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:46.362898 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:46.423046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34a9ba-dce3-4418-82a9-79f290c6e8fb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:46.470287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:46.471009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.471293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.471569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.472424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:46.472734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:46.474633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:46.504435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7a9d3-36e1-43eb-9ac1-06a408968a25 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:46.514079 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 420/847] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Jul 11 14:30:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:46.516096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:46.546900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:46.547750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.548038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.548316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.548986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:46.550366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:46.569962 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:46.571975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:46.573540 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 428/848] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Jul 11 14:30:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:46.584633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:46.670650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253590bd-39d0-4d3b-8354-d6fa20c8271e None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:46.702923 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:46.732350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:46.733033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.733323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.733603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.746763 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:46.776490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fff6e-1222-4c68-bc75-f94b21d6a062 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:46.823834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:46.825342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:46.835029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:46.836646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:46.837467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:46.838245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:46.839847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:46.840662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:46.843465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:46.858999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 429/849] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:46.862701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:46.974990 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 421/850] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:46.980877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:46.996333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b3a3-02ee-466f-a4a3-af19aafbd5c4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:47.009489 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:47.041304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:47.041991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.042277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.042567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.043424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:47.043736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:47.045477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:47.074656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 430/851] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:47.143557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde2e3-53fb-4e6e-a2b7-3427625ee4c6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:47.185686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:47.186524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.186824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.187091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.200877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:47.202471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:47.223238 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:47.224987 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:47.227779 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:47.227779 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:47.227779 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:47.227779 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:47.227779 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 422/852] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:47.237432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:47.269277 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:47.426748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e1827-7093-4950-b2f1-9bbc41a32789 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:47.486259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:47.487959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.488740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.489536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.491356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:47.492192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:47.495163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:47.518364 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 431/853] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:47.528356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:47.651056 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:47.717937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724a33-5bf1-4cba-97f8-ef9ab0bfa8cc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:47.756641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:47.757809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.758302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.758824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.766384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:47.768208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:47.782916 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:47.783865 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:47.784741 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:47.787497 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 423/854] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:47.796734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:47.913541 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:47.942517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680cb65-f3e4-43d7-b9bb-99239957d1d3 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:47.981216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:47.982220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.982742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.983245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.984243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:47.984755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:47.986384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae6a05-eb19-47e3-9b91-51d3f1b048cc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:48.000551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 432/855] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:48.010104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.156509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143e069-c1aa-4269-aa61-ad27e9df9bfa None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:48.191268 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:48.200040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:48.200975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.201440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.201932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.202975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=fb9dad5761444d1a8f096c6c2c1cbf19) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:48.203433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:48.205088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6211-c7e5-4209-bce0-b7eaef43bd77 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:48.215325 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 424/856] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:48 2022] GET /identity/v3/role_assignments?user.id=fb9dad5761444d1a8f096c6c2c1cbf19&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:48.231364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17f29-6420-4623-a8fb-89ad1f574223 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.231552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17f29-6420-4623-a8fb-89ad1f574223 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.231863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17f29-6420-4623-a8fb-89ad1f574223 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.234838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 433/857] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:48.239684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719b47e-fe55-431c-bd64-2526de72e9f2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.240012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719b47e-fe55-431c-bd64-2526de72e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.240291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719b47e-fe55-431c-bd64-2526de72e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.259506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6719b47e-fe55-431c-bd64-2526de72e9f2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:48.260726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6719b47e-fe55-431c-bd64-2526de72e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:48.360990 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 425/858] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:48.399836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be17f29-6420-4623-a8fb-89ad1f574223 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.503148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e249a-c1f3-471f-bf10-f72b3d1777ef None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.503453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e249a-c1f3-471f-bf10-f72b3d1777ef None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.503640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e249a-c1f3-471f-bf10-f72b3d1777ef None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.505271 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 426/859] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:30:48.510950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.511243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.511528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.529216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be17f29-6420-4623-a8fb-89ad1f574223 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:48.531595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:48.533697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:48.575620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:48.576790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.577276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.577779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.580465 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:48.592959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:48.601932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:48.603188 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:48.604016 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:48.607068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 434/860] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:48.616881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.670692 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 427/861] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:30:48.692786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.771030 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:48.815738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b07eb-e4a5-4fee-89f6-c67e53fcba65 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:48.856567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:48.857255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.857541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.857849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.858728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:48.859040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:48.860431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:48.863844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507a76-9bc4-4740-af60-26f995078a1f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:48.870631 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 435/862] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:48.876380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.912598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:48.913425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.913776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.914119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.915081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:48.916564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:48.938859 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 428/863] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:30:48 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:30:48.944761 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:48.998063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d61af-8789-4fd9-8409-8a9b6e2d9151 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:49.045678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:49.047236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.047671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.048094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.061090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:49.062600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:49.088185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:49.089151 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:49.090172 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:49.090172 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:49.090172 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:49.090172 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:49.094270 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 436/864] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:49.095771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:49.228138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c8b3-a90c-4241-ade5-640eebba9839 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:49.242267 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:49.273810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:49.274483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.274793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.275065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.275806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:49.276112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:49.277488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5385df4-d813-4496-8024-a9525a400075 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:49.290611 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 429/865] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:49.296516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:49.421839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ff7e2-02df-478a-ad0d-c0739b0aeb28 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:49.425622 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:49.473105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:49.474832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.475124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.475401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.487014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:49.489116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:49.510878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b2f2a-69cf-410c-8b3f-0d720184186f None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.511654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b2f2a-69cf-410c-8b3f-0d720184186f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-44185e1c-338a-43d2-bd94-5a5dcaacf73b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:49.511935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:49.512857 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:49.514201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:49.515099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b2f2a-69cf-410c-8b3f-0d720184186f None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.515186 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 437/866] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:49.515262 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 430/867] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:49.522234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.522548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.522840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.523218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b2f2a-69cf-410c-8b3f-0d720184186f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:49.541056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:49.542278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:49.634892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 438/868] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:49.653097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:49.689154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b2f2a-69cf-410c-8b3f-0d720184186f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:49.741293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:49.741987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.742301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.742611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.743472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:49.743786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:49.745246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:49.779537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 431/869] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Jul 11 14:30:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:49.782038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:49.784185 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:49.796751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15342c50-5f38-47ed-869f-763c2f097357 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:49.831705 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:49.849660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:49.850358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:49.850715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:49.851004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:49.851755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:49.853156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:49.878603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 439/870] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:30:49 2022] POST /identity/v3/services => generated 269 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:30:49.946676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af2bd-1927-4e8e-9eee-e9dc194e308a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:50.014883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:50.016010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.016574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.017087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.120322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:50.121802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:50.149805 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:50.241348 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 432/871] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:50.247209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.368581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17aac8-cda3-47f8-8244-087f34625a33 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:50.415683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:50.417124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.417844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.418641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.438824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:50.441938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-af9a34c8-86e2-4a32-8249-064896636c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:50.465987 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:50.467507 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:50.469527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:50.469527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:50.469527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:50.469527 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:50.469527 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 440/872] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:50.479890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.544041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c67bf-d6f3-4b9f-ac42-3f90cf123fc6 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.544246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c67bf-d6f3-4b9f-ac42-3f90cf123fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.544527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c67bf-d6f3-4b9f-ac42-3f90cf123fc6 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.545894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 441/873] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:50.553123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.553412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.553694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.568306 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:50.575994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:50.577212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:50.605918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd4173-b0ae-4237-ba67-2e58b0fdb078 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:50.642632 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:50.655238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:50.656053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.656434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.656807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.657632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:50.658036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:50.658654 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 442/874] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:30:50.663669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:50.676876 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 433/875] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:50.683743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.688212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.796922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4fc3a-504d-4fcc-b7c5-29abdd0bdf09 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:50.813186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d443-b018-451d-af14-8b3d7d78d692 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:50.855981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:50.856809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.857148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.857432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.858099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:50.859062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:50.859802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:50.860911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.861438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.862479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.868234 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:50.874599 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:50.876433 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:30:50.877612 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:50.881592 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 434/876] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:50.882894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:50.883222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.886420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:50.908034 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:50.909328 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:50.910386 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:50.917531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 443/877] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:50.924455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.948493 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:51.005920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da682c2b-97ed-488c-8926-c0f6fe7a2653 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.039306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc715-5f51-456a-9606-0d79b4316441 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.041800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.042484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.043608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.043608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.044298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:51.044611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.046724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.064252 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 435/878] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:30:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:51.066530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:51.087729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.088571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.088974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.089335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.090239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:51.090679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.092247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.110668 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 444/879] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:51.113104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:51.181082 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:51.208405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d108-343e-4a64-bc98-add290b74102 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.222159 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:51.237159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7218158-4072-487f-81d6-2e7164fdcc7f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.244832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.245509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.245799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.246080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.246834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:51.247149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.248541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f013a8-ec9f-4882-9c01-c73dc2589f61 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.253304 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 436/880] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:30:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:51.254755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b7a7-ffbf-473b-a912-2b0779bbe7a4 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.255057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b7a7-ffbf-473b-a912-2b0779bbe7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.255691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b7a7-ffbf-473b-a912-2b0779bbe7a4 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.257407 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 437/881] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:51.263478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.263773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.264063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.282603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:51.283863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:51.293720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.295775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.296275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.296740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.298605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=8399c431392046719f704ff154c9f729) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:51.299185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.301727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.318903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 445/882] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:51 2022] GET /identity/v3/role_assignments?user.id=8399c431392046719f704ff154c9f729&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:51.378710 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 438/883] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:30:51.400133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:51.530087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b350d-bc0d-4336-83db-91326cf6a82d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.551996 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:51.569519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.570250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.570558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.570840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.571505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.572874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:51.585759 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:51.586844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:51.587693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 446/884] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:51.593178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:51.708062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ada8-dfc3-49fa-8e6d-710741f4d062 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.717562 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:51.749608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.750283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.750598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.750882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.751607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:51.751919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.753310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.762619 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 439/885] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:51.767677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:51.877162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9506-aacd-4071-a2da-08eb5d06d8ef None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:51.913553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:51.914237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:51.914551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:51.914837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:51.915562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:51.915877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:51.917263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:51.922893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 447/886] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:51.928873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:52.040340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed661-f3d0-48fa-81c7-6815dd0e7231 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:52.087884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:52.088551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.088843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.089127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.089929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] RBAC: Adding query filter params (interface=public, service_id=b9bf1893a027458f81e3f2832774b87a, region_id=RegionOne) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:52.090247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:52.091663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e9b14-3f45-4384-81ac-082126577523 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:52.104315 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 440/887] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:30:51 2022] GET /identity/v3/endpoints?service_id=b9bf1893a027458f81e3f2832774b87a&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:52.105746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:52.158736 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:52.216953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa79788-5f06-4bae-bbfd-cba5e24da88d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:52.235499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74a59-c8cd-4e50-a7dc-aaf954bdd11c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.235809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74a59-c8cd-4e50-a7dc-aaf954bdd11c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.236068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74a59-c8cd-4e50-a7dc-aaf954bdd11c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.237752 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 441/888] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:52.243824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.244119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.244406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.253174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:52.253856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.254146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.254427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.255144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:52.257060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:52.262672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:52.263493 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 448/889] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:30:52 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:30:52.265009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:52.300528 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:52.348345 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 442/890] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:30:52.372387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:52.490234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cdf5c-e702-43d2-8475-3b32d0c006d4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:52.506392 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:52.529471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:52.530292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.530607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.530892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.531560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:52.532942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:52.546411 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:52.548543 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:52.550537 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 449/891] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Jul 11 14:30:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:52.553794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:52.669583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65d734-731f-4296-8b92-6dc0ecda88a9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:52.706953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:52.707628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.707913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.708190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.709489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:52.709792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:52.711222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:52.716610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 443/892] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:52.723592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:52.830131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ddda1-8f06-4116-b759-47626c372a47 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:52.865420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:52.866644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:52.867148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:52.867651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:52.868557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:52.869058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:52.870679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:52.876320 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 450/893] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:52.886517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:52.913283 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.119824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca6ff-c1d5-4511-84eb-b920d004e017 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.161380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.162615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.162905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.163186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.163990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] RBAC: Adding query filter params (interface=public, service_id=b93f26a14de348caae1daa8c1d8c45b5, region_id=RegionOne) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:53.164308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.166146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b64f9-4784-491d-b09c-cb35f9c50f2a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.172387 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 444/894] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:30:52 2022] GET /identity/v3/endpoints?service_id=b93f26a14de348caae1daa8c1d8c45b5&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:53.177801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.228943 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.295607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bad214-498c-4001-bfd2-9da6eb99713b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.330878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4a5fd-98b1-44be-9873-8ab581101745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.331551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4a5fd-98b1-44be-9873-8ab581101745 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.331838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4a5fd-98b1-44be-9873-8ab581101745 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.332117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4a5fd-98b1-44be-9873-8ab581101745 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.332809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4a5fd-98b1-44be-9873-8ab581101745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.334744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4a5fd-98b1-44be-9873-8ab581101745 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.341110 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 451/895] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:30:53 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:30:53.542346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d98d8-c649-4489-aab5-1485cb0c0c29 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.542874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d98d8-c649-4489-aab5-1485cb0c0c29 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.543280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d98d8-c649-4489-aab5-1485cb0c0c29 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.545060 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 445/896] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:53.550743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872798-6e6d-4072-8799-c222cb81133a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.551221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872798-6e6d-4072-8799-c222cb81133a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.551503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872798-6e6d-4072-8799-c222cb81133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.569540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-33872798-6e6d-4072-8799-c222cb81133a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:53.570775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-33872798-6e6d-4072-8799-c222cb81133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:53.647740 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 452/897] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:53.649358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f08e7-04c8-4532-9882-892b49d0b027 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.649658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f08e7-04c8-4532-9882-892b49d0b027 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.649940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f08e7-04c8-4532-9882-892b49d0b027 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.651320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 446/898] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:53.656732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.657032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.657316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.670361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f08e7-04c8-4532-9882-892b49d0b027 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.675659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:53.676870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:53.711743 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.766605 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 453/899] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:53.778629 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.790341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f08e7-04c8-4532-9882-892b49d0b027 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.790568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.835804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.836421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.836711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.836992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.837731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.839233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.862534 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 447/900] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:30:53 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:30:53.925355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d0ec-709d-4fcb-895a-c48f7af64678 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.972162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.972986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.973269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.973543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.986742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:53.995473 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:53.996495 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:53.997819 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 454/901] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Jul 11 14:30:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:54.005051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.124844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515ba8a-c39b-4c79-8bcf-eed4614e7cc6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.161506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:54.162190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.162475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.162784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.163553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:54.163864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:54.165261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:54.178617 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 448/902] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:54.180839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.207771 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:54.302526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d916453-7700-48a2-ad12-69f4b652d838 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.343855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:54.344663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.344949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.345228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.358179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:54.359756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-99d7a380-e41e-4890-968c-ed9a58b060c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:54.379435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:54.381579 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:54.383690 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:54.383690 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:54.383690 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:54.383690 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:54.390531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 455/903] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:54.390825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.410889 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:54.450046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6550c-3c0e-4dab-86f2-b44634289f33 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.450709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6550c-3c0e-4dab-86f2-b44634289f33 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.451216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6550c-3c0e-4dab-86f2-b44634289f33 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.453099 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 456/904] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:30:54.458420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.458747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.459030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.477323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:54.478633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:54.508266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4694a4-008d-46ce-81b4-9a28677c20b1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.551032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:54.551886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.552654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.553091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.554206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:54.554643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:54.556233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:54.569156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 457/905] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:54.580833 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 449/906] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:54.582595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.585882 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:54.596854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.690445 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:54.721212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a3d50-6a10-4e94-afad-025ad3244632 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.733733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f4f6e-fb49-4fb6-a4d6-cb5c68e99f3a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.759544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:54.760734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.761214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.761703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.762579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:54.764327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:54.776218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:54.777039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.777326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.777611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:54.779003 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:54.779945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:30:54.780771 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:54.788247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:54.788247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:54.789085 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 450/907] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:54.790201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:54.815223 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:54.816271 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:54.817235 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:54.822519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 458/908] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:54.823830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.906377 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:54.922041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835ed8a-280e-44c0-ad5c-a2362de110d8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.961217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051bd9-6cca-4672-a05b-c9851487bdef None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:54.967995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:54.968676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:54.968967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:54.969248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:54.969965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:54.970279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:54.971722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:54.984163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 451/909] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:54.985796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:54.991237 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.017807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.019147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.020117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.021132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.022519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:55.023072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.025235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.051545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 459/910] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:55.057070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.124201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed4719-b586-4572-8d8d-c3210a37c22c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:55.164841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.165873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.166386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.166804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.167999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:55.168501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.170575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.183874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 452/911] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Jul 11 14:30:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:55.184986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.207252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b851d3-22fd-4c60-9efd-3343ef300a2a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:55.231111 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.249033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76f2c7-97bc-4f29-afdf-475ef1681cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.249752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76f2c7-97bc-4f29-afdf-475ef1681cee None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.250096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76f2c7-97bc-4f29-afdf-475ef1681cee None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.250376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76f2c7-97bc-4f29-afdf-475ef1681cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.289337 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.337344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3bb4-1d8d-4403-845f-ad9374a65b7b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:55.339082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76f2c7-97bc-4f29-afdf-475ef1681cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.341273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76f2c7-97bc-4f29-afdf-475ef1681cee None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.383505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.384655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.385711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.386193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.387658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.389840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.423092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 453/912] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:30:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:55.466987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 460/913] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:55 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:30:55.472796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.593131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02bdba-829f-475d-bcde-d3ac9fe2a0dd None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:55.608385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786593-f978-4388-8d35-85aa49dec586 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.608932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786593-f978-4388-8d35-85aa49dec586 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.609016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786593-f978-4388-8d35-85aa49dec586 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.610692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 461/914] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:55.615820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.616110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.616393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.620459 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.635427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:55.636626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:55.638132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.639029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.639324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.639688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.652473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.653945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.655943 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:55.676347 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:55.677327 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:55.678222 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:55.678222 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:55.678222 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:55.678222 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:55.682602 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 454/915] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:55.684350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.732634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 462/916] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:55.758408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.801889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647e58-2d67-43bc-9949-832d395a9c9c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:55.837769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.838767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.839219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.839636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.840502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:55.840949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.842445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.856078 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 455/917] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:55.862870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.889664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab38de8-40f0-4731-bad1-374a1ef387b9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:55.895345 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.935045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:55.935865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.936145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.936417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.937069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:55.938444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:55.955365 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:55.956404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:30:55.957263 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:55.962041 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 463/918] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Jul 11 14:30:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:55.963246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:55.980059 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:55.986318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04790e-6c13-48d3-85a9-833063fa7746 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.033138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.035459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.036981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.037495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.046744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.049082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:56.066964 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:56.068271 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:56.069172 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:56.073979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 456/919] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:56.074709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.085613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9fa19-1d02-48d4-be8a-40dbb3cd825c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.131865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.132889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.133377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.134398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.135656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:56.136168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.138676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.146882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 464/920] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:56.152785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.185491 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.199958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61a1b-e924-4e9e-8e6d-f7020e7fcaf1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.245637 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.246921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.247692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.248304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.248901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.249697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:56.250009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.251497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364742-147e-41f0-b727-dd3a11d2cd22 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.265839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 457/921] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:56.267793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74fa7-441e-4229-a8f5-8e6e48f2eb1b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.268323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74fa7-441e-4229-a8f5-8e6e48f2eb1b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.268785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74fa7-441e-4229-a8f5-8e6e48f2eb1b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.270231 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 458/922] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:56.272960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74fa7-441e-4229-a8f5-8e6e48f2eb1b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.276373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb948959-15a7-4891-a030-4091f763d918 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.313410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.314086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.314372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.314696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.315416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:56.315727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.317096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8d77-9636-4f0c-b6c7-18ad3b656c71 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.326974 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 465/923] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:56.326974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.326974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.326974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.342726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:56.343919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:56.392177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74fa7-441e-4229-a8f5-8e6e48f2eb1b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.419839 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 466/924] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:56.420774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.432996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.433924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.434433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.434938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.436136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] RBAC: Adding query filter params (role.id=0606cfa7820245a7b62b12842d6f686a, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=8399c431392046719f704ff154c9f729) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:56.436953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.440002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.451753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 459/925] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/role_assignments?user.id=8399c431392046719f704ff154c9f729&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=0606cfa7820245a7b62b12842d6f686a => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:56.453708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.475370 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.522757 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.601756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed482f-c3be-473c-803a-8e4d8dce099a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.613924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbdd71-b8b1-44fa-b374-e3e5396684ce None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.658099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.659580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.660105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.660591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.661693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.663408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.668004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.669206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.669499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.669781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.670782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.672338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:56.687301 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:56.688398 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:30:56.689249 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:56.692257 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 460/926] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:56.694546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 467/927] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:30:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:56.706566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.816117 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.853031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abac6-f0d4-4668-8250-bac5f3517aa3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.897602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.898283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.898596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.898872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.899592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:56.899897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.901291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.907253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 461/928] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:56.915981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:57.095425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e51d8-93e6-47d9-ba4a-a4c21edb9ed3 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:57.148267 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:57.158645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:57.160432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:57.161156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:57.163025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:57.164578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:57.165698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:57.169064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:57.183324 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 468/929] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:57.189185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:57.297076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8abf9-2bae-4981-87f8-bec5d9c00ad4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:57.339548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:57.340221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:57.340510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:57.340792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:57.341605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] RBAC: Adding query filter params (interface=public, service_id=bcdbbe761cd14ceeb56ad11e7e9443c7, region_id=RegionOne) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:57.341922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:57.343612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf70ed-6c21-415a-9dd4-cb70132ddd48 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:57.350223 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 462/930] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:30:57 2022] GET /identity/v3/endpoints?service_id=bcdbbe761cd14ceeb56ad11e7e9443c7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:57.355789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:57.472171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732035b-955b-4f94-a0b4-4147e1ad69ef None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:57.508885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa0b5a-3977-49d0-86e4-8eed1c8b553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:57.509565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa0b5a-3977-49d0-86e4-8eed1c8b553c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:57.509851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa0b5a-3977-49d0-86e4-8eed1c8b553c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:57.510135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa0b5a-3977-49d0-86e4-8eed1c8b553c None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:57.510860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa0b5a-3977-49d0-86e4-8eed1c8b553c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:57.512229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa0b5a-3977-49d0-86e4-8eed1c8b553c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:57.519351 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 469/931] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:30:57 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:30:57.734006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a4ade-a71f-486c-b92c-e5706616108d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:57.734441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a4ade-a71f-486c-b92c-e5706616108d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:57.734869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a4ade-a71f-486c-b92c-e5706616108d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:57.736598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 463/932] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:57.742471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:57.742968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:57.743268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:57.761365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:57.762603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:57.817174 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:57.837291 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 470/933] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:57.861023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a4ade-a71f-486c-b92c-e5706616108d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:57.864210 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:57.982051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a4ade-a71f-486c-b92c-e5706616108d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:58.019620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:58.020205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.020489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.021336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.022065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:58.023510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:58.024935 n-d-master-1 devstack@keystone.service[80990]: WARNING keystone.server.flask.common [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:30:58.050076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.sql.core [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:30:58.050076 n-d-master-1 devstack@keystone.service[80990]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:30:58.050076 n-d-master-1 devstack@keystone.service[80990]: [parameters: {'id': '11a19013da954ef691fc83a26ef7966f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:30:58.050076 n-d-master-1 devstack@keystone.service[80990]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80990) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11a19013da954ef691fc83a26ef7966f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11a19013da954ef691fc83a26ef7966f. Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:30:58.059302 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result.read() Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 14:30:58.060118 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application yield resource Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise self.value Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application session.commit() Jul 11 14:30:58.061070 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:30:58.061971 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:30:58.062925 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result.read() Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:30:58.063807 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [parameters: {'id': '11a19013da954ef691fc83a26ef7966f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:58.064690 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:58.065485 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11a19013da954ef691fc83a26ef7966f. Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:58.066421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 464/934] 10.222.0.77 () {60 vars in 1140 bytes} [Mon Jul 11 14:30:57 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:58.077929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:58.184268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34cb4-db55-4b0f-bec6-64bcada99c3e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:58.221399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:58.222721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.223244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.224645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.232713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:58.234637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-53e9b2b7-2ece-4a44-a0f4-62ee9296846e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:58.250540 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:58.251484 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:58.252841 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:58.255382 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 471/935] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:58.261628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:58.328950 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:58.379941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f25b-8513-443e-b48d-bd773e3df685 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:58.422447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:58.423151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.423439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.423721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.424604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:58.424915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:58.426614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7eed-0d34-4e5a-8f95-9a11b5854c22 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:58.448977 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 465/936] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:58.716008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251572d6-4760-419d-9718-e114597ea171 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.716408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251572d6-4760-419d-9718-e114597ea171 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.716642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251572d6-4760-419d-9718-e114597ea171 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.718290 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 472/937] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:58.725170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5a9b-ccd2-42ce-8bf2-e3755afb1fcb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.725469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5a9b-ccd2-42ce-8bf2-e3755afb1fcb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.725756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5a9b-ccd2-42ce-8bf2-e3755afb1fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.744274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-57ac5a9b-ccd2-42ce-8bf2-e3755afb1fcb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:58.745821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-57ac5a9b-ccd2-42ce-8bf2-e3755afb1fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:58.820585 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 466/938] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:58.844042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251572d6-4760-419d-9718-e114597ea171 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:58.901900 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:58.955152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a93d7-9965-417b-9cab-257d60fc9c59 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.955483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a93d7-9965-417b-9cab-257d60fc9c59 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.955723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a93d7-9965-417b-9cab-257d60fc9c59 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.958677 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 467/939] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:30:58.963127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:58.963465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:58.963736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:58.965584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251572d6-4760-419d-9718-e114597ea171 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:58.988136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:58.989523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:59.004314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.006193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.006951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.007460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.021170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:59.030472 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:59.031518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:30:59.032370 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:59.034138 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 473/940] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Jul 11 14:30:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:59.047731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.058357 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.087249 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 468/941] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:59.110977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.165764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bef00-4b5f-404a-aae7-d8e6ec883c78 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.179040 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.209337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.210171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.210576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.211193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.212028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:59.212412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.214354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.230951 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 474/942] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:59.232050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.235929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1c0d2-2f6e-49e6-8560-699a8f56382c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.280299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.282004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.282708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.283440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.284348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.285963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:59.299829 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:59.300895 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:30:59.302273 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:30:59.311104 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 469/943] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:59.312872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.363918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94cbc1-63b8-4702-aa56-21b57bb1a249 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.365345 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.402257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.403106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.403394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.403675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.415423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.416900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:59.435591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:59.436562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:59.437468 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:59.437468 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:59.437468 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:59.437468 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:59.437468 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 475/944] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:59.446024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.447999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c46bb2-9783-442a-8c07-2d17f1445a24 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.477553 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.496617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.497346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.497637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.497943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.498712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:59.499835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.500720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.511823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 470/945] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:59.512768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.578978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd367-42a5-4612-a135-406e6fc05c5f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.620305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.621406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.621983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.622466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.623491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:59.623601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6ed9-1a6e-47c8-8325-a084ca37a18b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.624120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.625883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.631979 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.648407 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 476/946] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:59.650093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.663869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.664764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.665148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.665683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.666815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:59.667299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.668724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358817-ede9-47bc-924c-58a2e9cd6619 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.683055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 471/947] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:59.684250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481ff2-2206-42ab-9a87-3362347a811f None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.684551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481ff2-2206-42ab-9a87-3362347a811f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.684838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481ff2-2206-42ab-9a87-3362347a811f None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.686221 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 472/948] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:59.694459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.695085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.695504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.722637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:59.724845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:59.765300 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.792097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f2d7a-5064-4c15-b21b-897c9918f4a2 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:59.831451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 473/949] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:30:59.842918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:59.844191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.845236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.845739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.855207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.856193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:59.857699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:59.878537 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:59.879576 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:30:59.884243 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 477/950] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:59.886615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:59.990101 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.995249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9df7-e56b-4dca-8476-691a2976f42a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.030483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388d10f-7a38-42e3-807c-d73302f7233f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.044659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.045479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.045764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.046040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.046904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.048818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:00.065307 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:00.066669 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:00.068142 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:00.070593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 474/951] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:00.074398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.080953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.081699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.081932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.082214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.083692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:00.084058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.085601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.096872 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.110527 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 478/952] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Jul 11 14:30:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:00.113286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.216436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693616c2-888e-429b-bc7d-f7616c7608dc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.241788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954254d-2c9c-4be6-9db8-e45dca9b3e64 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.255486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.256513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.256513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.256811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.257590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:00.258024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.259711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.269478 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 475/953] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:00.271705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.290217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.291184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.291576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.292006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.304463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.306244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.310132 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:00.326951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:00.328140 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:00.334131 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:00.334131 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:00.334131 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:00.334131 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:00.334131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 479/954] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:00.336126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.401010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22556be8-a053-4abb-9c1c-3fbfc51e8036 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.414790 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.437487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.438165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.438580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.438753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.439477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:00.439787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.441178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.451832 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 476/955] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:00.455949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.481954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ccdd-def5-4f4a-a5d2-06fae3d3bbc5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.524648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.525325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.525619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.525883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.526824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:00.527190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.528665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.546052 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 480/956] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:00.548459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.595853 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.608841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80b8a3-8fbf-43c8-9b75-29fe7fbee5ab None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.661812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e487-4962-4255-95a4-9289381d75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.663327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e487-4962-4255-95a4-9289381d75db None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.663721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e487-4962-4255-95a4-9289381d75db None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.664108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e487-4962-4255-95a4-9289381d75db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.665085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e487-4962-4255-95a4-9289381d75db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.667151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e487-4962-4255-95a4-9289381d75db None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.695414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 477/957] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:31:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:00.695689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23edc8c-2b1e-4964-aa8e-f39caa7e178e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.695785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674dd63-bd51-4902-9d5a-1877e3df5a9d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.695785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674dd63-bd51-4902-9d5a-1877e3df5a9d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.695785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674dd63-bd51-4902-9d5a-1877e3df5a9d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.695785 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 478/958] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:00.702267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.703365 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.703994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.704296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.731351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:00.733009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:00.747594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.748411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.748696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.748969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.757511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.759117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:31:00.777127 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:00.778201 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:00.779284 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:00.783506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 481/959] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:00.785200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.847598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 479/960] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:00.872818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.929504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99a654-c557-444d-aa4f-b70073876fcf None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.973083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.975140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.975923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.976516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.977750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:00.979069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.980932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.988409 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.999874 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 482/961] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:01.008245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:01.026320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85a694-9efd-44d5-8159-6a3d686aebd7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:01.049242 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:01.077471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:01.078157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:01.078668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:01.079247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:01.080164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:01.081767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:01.099666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.sql.core [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:31:01.099666 n-d-master-1 devstack@keystone.service[80990]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:31:01.099666 n-d-master-1 devstack@keystone.service[80990]: [parameters: {'user_id': 'd53c422fcc34490198927d4020c37ee0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:31:01.099666 n-d-master-1 devstack@keystone.service[80990]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80990) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result.read() Jul 11 14:31:01.109979 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:31:01.110994 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application yield resource Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise self.value Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application session.commit() Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:31:01.112012 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:31:01.113144 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:31:01.116827 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application result.read() Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:31:01.119120 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd53c422fcc34490198927d4020c37ee0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:01.121325 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 14:31:01.123453 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 480/962] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Jul 11 14:31:00 2022] POST /identity/v3/users => generated 160 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:01.127009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:01.161248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894a8e-bcea-4141-ab7f-0f4f9f0df73f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:01.199749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:01.201180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:01.201778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:01.202333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/8399c431392046719f704ff154c9f729/roles/0606cfa7820245a7b62b12842d6f686a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:01.206298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=8399c431392046719f704ff154c9f729, role_id=0606cfa7820245a7b62b12842d6f686a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:01.208778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:01.239309 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 483/963] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:31:01 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/8399c431392046719f704ff154c9f729/roles/0606cfa7820245a7b62b12842d6f686a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:31:01.255761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463d63-e6cb-4295-8452-7cb894e22b36 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:01.294292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:01.295151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:01.295435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:01.295711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:01.305717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:01.307471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:01.311395 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-476d4cd5-f411-4f53-9ab8-7615dc48a57e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:31:01.327306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:01.328465 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:01.329437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 481/964] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:01.336536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:01.438093 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:01.460701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db90c9-6ef2-4d7e-a385-ec84e7f5ddbc None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:01.498033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:01.498743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:01.499094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:01.499644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:01.500783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:01.501093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:01.502585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2631e4-06c3-4b3f-8c98-df7b2f551657 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:01.542926 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 484/965] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Jul 11 14:31:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:01.857429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8e067-d3f7-4589-97ac-a0ef2b73b879 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:01.857721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8e067-d3f7-4589-97ac-a0ef2b73b879 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:01.857975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8e067-d3f7-4589-97ac-a0ef2b73b879 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:01.862228 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 482/966] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:01.868290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afde5d-39c4-488e-b40d-d1184b2f3377 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:01.868586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afde5d-39c4-488e-b40d-d1184b2f3377 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:01.868867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afde5d-39c4-488e-b40d-d1184b2f3377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:01.887358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-95afde5d-39c4-488e-b40d-d1184b2f3377 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:01.888562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-95afde5d-39c4-488e-b40d-d1184b2f3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:01.967172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 485/967] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:01.990450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8e067-d3f7-4589-97ac-a0ef2b73b879 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:02.115149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8e067-d3f7-4589-97ac-a0ef2b73b879 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:02.151231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21711bc-4d86-44cf-bfec-058b9fd4b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:02.151898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21711bc-4d86-44cf-bfec-058b9fd4b073 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:02.152182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21711bc-4d86-44cf-bfec-058b9fd4b073 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:02.152455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21711bc-4d86-44cf-bfec-058b9fd4b073 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:02.153189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21711bc-4d86-44cf-bfec-058b9fd4b073 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:02.154590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21711bc-4d86-44cf-bfec-058b9fd4b073 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:02.170163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 483/968] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:31:01 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:02.920107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe60b8-1163-4c44-b35a-716d2b5fca74 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:02.920465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe60b8-1163-4c44-b35a-716d2b5fca74 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:02.921203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe60b8-1163-4c44-b35a-716d2b5fca74 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:02.922662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 486/969] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:02.930048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:02.930781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:02.930781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:02.949069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:02.950664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:03.036082 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.070539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 484/970] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:03.090723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe60b8-1163-4c44-b35a-716d2b5fca74 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.178801 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.209461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe60b8-1163-4c44-b35a-716d2b5fca74 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.248203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.249014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.249291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.249561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.250225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.251714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a87adcb2-de37-4916-adad-7b2ff97329fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:03.265029 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:03.267159 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:03.268616 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:03.271346 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 487/971] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:03.273264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.399936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317966-5a30-4eae-870b-7dec8930a22c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.444515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.445162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.445450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.445727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.446453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:03.446786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.448179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.450198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508ba3d-6745-4d8a-af8a-42b353314404 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.450512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508ba3d-6745-4d8a-af8a-42b353314404 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.450811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508ba3d-6745-4d8a-af8a-42b353314404 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.452349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 488/972] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:03.459879 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 485/973] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:03.461287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.461444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.461587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.461932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.478603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:03.479812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:03.527924 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.567448 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 489/974] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:03.588085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e4dba-d379-44f5-9c1b-ac16b2ddad61 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.592636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.628063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.628793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.629015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.629290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.630806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:03.631105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.632477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.637968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 486/975] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:03.644213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.682891 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.744242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3466-6c5f-4881-b7b8-1987f565cfac None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.772545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aa97f-05ce-42a0-831b-f11e2ab5f442 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.781282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.782097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.782663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.782663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.787937 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.793527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:03.802338 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:03.803455 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:03.804310 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 490/976] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:03.809446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.814069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.814330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.814651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.814929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.815745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] RBAC: Adding query filter params (interface=admin, service_id=bcdbbe761cd14ceeb56ad11e7e9443c7, region_id=RegionOne) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:03.816060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.818330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.829118 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 487/977] 10.222.0.77 () {56 vars in 1249 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/endpoints?service_id=bcdbbe761cd14ceeb56ad11e7e9443c7&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:03.830256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.919948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41e8a-15f9-4812-9433-ef6d09e299e8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.937090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0d23-acf4-43e6-afd8-44fc24f583cc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.949649 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.962623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.963706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.964072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.964373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.965261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:03.965446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.966798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.975500 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 491/978] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:03.977209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.978119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.978652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.979134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.980441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.981039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.981822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.989415 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 488/979] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:31:04.108343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51d1db-149c-4fab-b156-1e1134a18cc0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.150973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.151956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.151956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.152409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.169649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.171824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f1d70bc3-d91a-4366-874b-3004b28b0ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:04.195433 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:04.196405 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:04.197325 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:04.197325 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:04.197325 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:04.197325 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:04.197325 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 492/980] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:04.202442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.249346 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:04.260025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1a76-e5f9-4a88-80ae-bdbe361bd120 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.260326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1a76-e5f9-4a88-80ae-bdbe361bd120 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.260596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b1a76-e5f9-4a88-80ae-bdbe361bd120 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.262595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 493/981] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:04.267787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.268278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.268645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.295229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:04.296421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:04.311742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb15e-3241-43da-91c6-33c929c5bc96 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.339120 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:04.348473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.349141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.349428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.349703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.350431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:04.350767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.352130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.364794 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 489/982] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:04.370129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.381536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 494/983] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:04.404076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.496185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e4256-0daa-4604-bfa3-7cc8489702b4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.499461 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:04.537798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.538650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.538936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.539212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.547066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35daab6-ece8-4f3d-8d25-617759fbfc56 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.550273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.552303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:31:04.574129 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:04.575208 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:04.576224 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 490/984] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:04.583577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.591194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.592020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.592305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.592582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.593251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.594661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:04.609385 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:04.610769 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:04.611667 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 495/985] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:04.616390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.656186 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:04.714228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461fb2c-8143-4474-9fe8-5a63eaa33c76 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.740144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04798-cc01-4078-908d-7be6cf0a4e94 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.756450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.757517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.757821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.758106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.758996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:04.759313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.760753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.780446 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 491/986] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:04.786615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.787127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.787809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.788088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.788358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.789125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:04.789425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.790844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.796301 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 496/987] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:04.802552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.811722 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:04.902223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3f8d-3925-4368-ab68-4b5efb5be1b2 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.910167 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:04.914250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99340ad-0f2e-4be4-9533-9764efc15f82 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.940969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.941700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.942336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.942336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.960430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.961196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.961510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.961876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.962666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:04.963004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.964444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.970640 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 497/988] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:04.977408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.024205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.026669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.056382 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:05.096527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76060-787c-4d1c-b3a6-af103dfd8ed6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:05.136792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:05.137480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:05.137736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:05.138043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:05.138871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] RBAC: Adding query filter params (interface=public, service_id=24fbd9d85fc74cdca1ceddabdc435a4f, region_id=RegionOne) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:05.139182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.140548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.144779 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 492/989] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:31:05.147676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 498/990] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/endpoints?service_id=24fbd9d85fc74cdca1ceddabdc435a4f&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:05.151075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.153142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.187909 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:05.266443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b3405-ed83-47a2-8ce0-62f8ac1712e1 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:05.269491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f921c-d2b8-4000-a1a3-12855f46c20e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:05.288859 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:05.303824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:05.304619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:05.304907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:05.305185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:05.308934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:05.309944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:05.310393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:05.310830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:05.311787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.313171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.315653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.317137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.330530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 499/991] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:31:05 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:05.343620 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:05.344698 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:05.345704 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:05.345704 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:05.345704 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:05.345704 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:05.346861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 493/992] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:05.351490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.456234 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:05.467660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b2934-17b2-4700-bee1-637d1ce83131 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:05.503446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:05.504115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:05.504403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:05.505213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:05.505936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:05.506239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.507663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.519890 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 500/993] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:05.525835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.629348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b481e0-f363-4dc8-bb2a-21970eb3e195 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:05.666657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:05.667451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:05.667733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:05.668008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:05.675303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.676817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:31:05.691106 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:05.692603 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:05.693801 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:05.694274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 494/994] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:05.700058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.807335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfc64-66b0-4b62-8e33-47736402929b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:05.845905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:05.846600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:05.846881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:05.847153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:05.847947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:05.848256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:05.849724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a25ebc-1f02-4ca5-93d7-44c8a92d50c4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:05.863232 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 501/995] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:05.869541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:05.902688 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:05.974825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd3a82-5d20-41c2-ab15-25b02524786d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:06.009910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:06.010587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.010872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.011149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.011982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] RBAC: Adding query filter params (role.id=0606cfa7820245a7b62b12842d6f686a, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=8399c431392046719f704ff154c9f729) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:06.012292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:06.013721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590c3c-2d14-456a-bd54-810f7fdb73b0 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:06.021011 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 495/996] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:05 2022] GET /identity/v3/role_assignments?user.id=8399c431392046719f704ff154c9f729&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=0606cfa7820245a7b62b12842d6f686a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:06.116954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dedd1-210f-4126-8067-8d1afc8772b8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.117299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dedd1-210f-4126-8067-8d1afc8772b8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.117526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dedd1-210f-4126-8067-8d1afc8772b8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.118987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 502/997] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:06.124812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.125146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.125380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.143406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:06.144658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:06.218616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 496/998] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:06.241734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dedd1-210f-4126-8067-8d1afc8772b8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:06.257626 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.351365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dedd1-210f-4126-8067-8d1afc8772b8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:06.386544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:06.387362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.387651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.387929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.388595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:06.389977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:06.402569 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:06.403662 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:31:06.404649 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:06.406576 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 503/999] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Jul 11 14:31:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:06.410206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:06.438253 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.521659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c276b-f631-4376-ae85-fa2ce304f573 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:06.557891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:06.558664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.558956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.559238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.559952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:06.560265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:06.561649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:06.566777 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 497/1000] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:31:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:06.572662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:06.654444 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.683100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c101-8b7e-4706-b417-481f99576cbc None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:06.717864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:06.718560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.718850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.719131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.719841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:06.720153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:06.721519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b609f1-9828-43a6-a93b-02aa1ea3dc91 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:06.731397 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 504/1001] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Jul 11 14:31:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:06.732590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:06.827236 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.838470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ac06-d8f2-4b05-8ab6-50396e91631f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:06.873418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0808b-5068-488f-8a83-d1f100352990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:06.874124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0808b-5068-488f-8a83-d1f100352990 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.874412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0808b-5068-488f-8a83-d1f100352990 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.874720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0808b-5068-488f-8a83-d1f100352990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.875510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0808b-5068-488f-8a83-d1f100352990 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:06.876888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0808b-5068-488f-8a83-d1f100352990 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:06.893192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 498/1002] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:31:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:07.401555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51becd61-33be-4f74-b300-2d259a8b07f0 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:07.402097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51becd61-33be-4f74-b300-2d259a8b07f0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:07.402097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51becd61-33be-4f74-b300-2d259a8b07f0 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:07.403553 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 505/1003] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:07.409007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:07.409508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:07.409590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:07.427366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:07.428592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:07.503716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 499/1004] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:07.527963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51becd61-33be-4f74-b300-2d259a8b07f0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:07.635607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51becd61-33be-4f74-b300-2d259a8b07f0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:07.674703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:07.675789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:07.676274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:07.676772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:07.677610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:07.679260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:07.691555 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:07.693403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:31:07.694241 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:07.700977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 506/1005] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:07.702152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:07.791148 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:07.818421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74741c82-81cd-45ea-a0d3-9bea98402973 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:07.853972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:07.854674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:07.854962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:07.855237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:07.855957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:07.856261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:07.857649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:07.864702 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 500/1006] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:31:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:07.870217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:07.874143 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:07.974942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5047-5c9e-4af0-92db-b1b3f6ad06fb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.010822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.011502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.011787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.012059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.012774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:08.013076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.014466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385b6c-1a56-45e0-9f1e-eb8f4a081974 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.020578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 507/1007] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Jul 11 14:31:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:08.026323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:08.139067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633784c-07fc-427a-80d1-085554e8d3ae None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.145568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cb94-0be9-43e8-a86f-9b9d1c6fb978 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.145937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cb94-0be9-43e8-a86f-9b9d1c6fb978 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.146147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cb94-0be9-43e8-a86f-9b9d1c6fb978 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.147704 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 508/1008] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:08.152766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.153057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.153329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.170895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:08.172091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:08.176132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.177393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.177682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.177959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.178746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.180144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.189285 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:08.209118 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 501/1009] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:31:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:08.268760 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:08.286653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 509/1010] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:08.310293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:08.448920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96ac5-f046-481a-bbb1-b1b18db5b1a4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.496190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.497242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.497706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.498186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] PATH_INFO: `/v3/services/image` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.499075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.501053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:08.516098 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:08.517825 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:08.519439 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 502/1011] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Jul 11 14:31:08 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:08.524552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:08.677464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff562-c6f2-4c9c-8c4f-8aaee8644fe3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.715838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.716517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.716803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.717083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.717803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] RBAC: Adding query filter params (name=image) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:08.718204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.719781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10bf6-f29f-420c-be70-673677d85318 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.725913 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 510/1012] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:08.731478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:08.794785 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:08.841180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed414a-be3b-45cd-954e-d57127bd3317 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.888655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.889708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.890235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.890798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.891750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] RBAC: Adding query filter params (type=image) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:08.892262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.893878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29e135-a884-4c97-a7eb-dd762cd3aa3f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.900708 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 503/1013] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:08.985138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da3a1-20fa-442b-9bc4-731b723f7a96 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.985512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da3a1-20fa-442b-9bc4-731b723f7a96 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.985696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da3a1-20fa-442b-9bc4-731b723f7a96 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.987359 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 511/1014] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:08.993833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.994208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.994395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.012344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:09.013597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:09.120797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 504/1015] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:09.144696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0da3a1-20fa-442b-9bc4-731b723f7a96 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:09.218875 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:09.265184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0da3a1-20fa-442b-9bc4-731b723f7a96 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:09.303593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5b6f8-41a5-4b23-adf5-160996df356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:09.304397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b6f8-41a5-4b23-adf5-160996df356e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.304678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b6f8-41a5-4b23-adf5-160996df356e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.304953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b6f8-41a5-4b23-adf5-160996df356e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.306196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b6f8-41a5-4b23-adf5-160996df356e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:09.307633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b6f8-41a5-4b23-adf5-160996df356e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:09.309553 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 512/1016] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:09.315447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:09.398466 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:09.481502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53c4c8-c687-4af2-b2b4-0569fcb112cd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:09.532707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382d23a-738c-450f-a640-9cef0cbae9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:09.533529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382d23a-738c-450f-a640-9cef0cbae9da None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.533829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382d23a-738c-450f-a640-9cef0cbae9da None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.534189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382d23a-738c-450f-a640-9cef0cbae9da None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.535125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382d23a-738c-450f-a640-9cef0cbae9da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:09.536712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382d23a-738c-450f-a640-9cef0cbae9da None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:09.575235 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 505/1017] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:31:09 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:31:10.570672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0422-e111-4ea6-9b0b-a99c7d2b4a66 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:10.571247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0422-e111-4ea6-9b0b-a99c7d2b4a66 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:10.571566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0422-e111-4ea6-9b0b-a99c7d2b4a66 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:10.573326 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 513/1018] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:10.580920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:10.581592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:10.581592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:10.600091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:10.601291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:10.698093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 506/1019] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:10.725031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0422-e111-4ea6-9b0b-a99c7d2b4a66 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:10.871718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0422-e111-4ea6-9b0b-a99c7d2b4a66 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:10.912392 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:10.925928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:10.927378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:10.927669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:10.927937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:10.945888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:10.954925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:10.955966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:10.963059 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 514/1020] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Jul 11 14:31:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:10.963803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:11.003376 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:11.119088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc61f-46a7-4c43-8c30-f8b7cb94f8e8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:11.161879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:11.162592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.162878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.163153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.163917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:11.164217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:11.165605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7879032-d0fe-48f5-a2d1-97714a5e937f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:11.182893 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 507/1021] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:31:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:11.184400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:11.325967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844e4a4-ff51-4768-a8ec-cee5f4c15876 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.326247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844e4a4-ff51-4768-a8ec-cee5f4c15876 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.326547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844e4a4-ff51-4768-a8ec-cee5f4c15876 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.328065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 508/1022] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:11.333807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.334102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.334396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.344790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3a7bf-13d3-4658-b3d9-b22a11506a48 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:11.352119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:11.353313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:11.386565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:11.387390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.387700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.388057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.402249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:11.404052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:11.422912 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:11.424522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:11.426133 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:11.426133 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:11.426133 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:11.426133 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:11.426133 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 515/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:11.431866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:11.466593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 509/1024] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:11.480402 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:11.483166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:11.512864 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:11.557843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb353-8b37-4a5a-86e4-60fbb10e5692 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:11.596857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:11.597620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.597814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.598128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.598357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff27d-82ec-4ed9-b341-52b7ebfc1739 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:11.598899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:11.599209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:11.600604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:11.613145 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 516/1025] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:11.618663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:11.640941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:11.641877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.642313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.642876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.643963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:11.646328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:11.663464 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 510/1026] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:31:11 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:31:11.763891 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:11.769157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111a24-3127-43fa-9708-87645bdb16f3 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:11.819515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:11.820506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.820941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.821391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.835983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:11.838097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9ce66016-a459-439c-9e00-c536102ea915 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:31:11.856403 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:11.857457 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:11.858448 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 517/1027] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:31:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:11.863698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:11.869203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c8f5f-fada-4c65-970c-883b13936449 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.869494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c8f5f-fada-4c65-970c-883b13936449 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.869773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c8f5f-fada-4c65-970c-883b13936449 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.871355 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 518/1028] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:11.876734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:11.877020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:11.877295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:11.894257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:11.896023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:11.964203 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:11.971567 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 519/1029] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:11.981308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd9a40-cfc9-4aa5-a27d-f8e48436a33b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:11.996012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.018043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.018703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.019267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.019555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.021112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:12.021427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:12.023496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:12.052874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 511/1030] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:31:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:12.054706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.103635 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.123351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36b3cd-008f-4c43-8412-2dbf036bfa56 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.174298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.174298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.174298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.174298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.175590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:12.177085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:12.182528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 520/1031] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:12.184428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.186717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebefe1-29f4-44ba-82d3-f32dc20cfc37 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.231141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.233040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.234744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.235093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.255470 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.328034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7270-29df-45f2-bd0b-cae7b49e6e47 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.328758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:12.330811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:12.386988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.388089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.388524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.388985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.390515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:12.393606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:12.421649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 521/1032] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:31:12 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:31:12.453515 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 512/1033] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:31:12.459257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.474548 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.576259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ea2d3-87e2-42a1-b663-6f798d26e066 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.613828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.615345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.615772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.616205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.628182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:12.630003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:12.654999 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:12.656143 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:12.657181 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:12.657181 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:12.657181 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:12.657181 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:12.658825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 522/1034] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:12.666178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.722114 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.780939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25042ef-2e81-4a8d-9c22-b12fbdb92a29 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.817000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.817936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.818225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.818530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.819272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:12.819581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:12.820963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:12.833999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 513/1035] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:12.839782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.907794 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.960656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a1134-fe64-4796-91b7-4ae2a5718acb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.998292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.999118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.999402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.999681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:13.007710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:13.009175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:31:13.024562 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:13.025591 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:13.027091 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:13.030812 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 523/1036] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:13.032753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:13.215595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91a08e-c16a-4e00-857c-9a9624a35335 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:13.229221 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:13.276404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:13.277507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:13.278045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:13.278467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:13.279992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:13.280535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:13.283225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b60f2-08e1-4835-aa8a-ec2cd5613e69 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:13.309353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 514/1037] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:13.311994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:13.428208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab9b6a-8615-4817-afba-1e07898837a8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:13.451598 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:13.468980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:13.469572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:13.469881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:13.470160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:13.471220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] RBAC: Adding query filter params (role.id=0606cfa7820245a7b62b12842d6f686a, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=0522dc9e5943446fbaffdcd857728b59) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:13.471220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:13.472956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eccce-cf20-4930-8f6e-c5d546cba7b9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:13.479264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 524/1038] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:13 2022] GET /identity/v3/role_assignments?user.id=0522dc9e5943446fbaffdcd857728b59&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=0606cfa7820245a7b62b12842d6f686a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:13.790872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb95f0c-cdaa-460e-96f4-db0bbdd5212a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:13.791375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb95f0c-cdaa-460e-96f4-db0bbdd5212a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:13.791375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb95f0c-cdaa-460e-96f4-db0bbdd5212a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:13.792888 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 515/1039] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:13.798589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:13.799054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:13.799157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:13.816493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:13.818530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:13.893286 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 525/1040] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:13.916657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb95f0c-cdaa-460e-96f4-db0bbdd5212a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:14.026253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb95f0c-cdaa-460e-96f4-db0bbdd5212a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:14.070217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:14.071033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.071320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.071596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.072248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:14.073613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:14.085261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:14.086479 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:14.092521 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 516/1041] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Jul 11 14:31:13 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:14.093351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:14.200317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6b562-fa13-45b7-9a1d-46cd6a32436d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:14.216857 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:14.244940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:14.245596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.245880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.246155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.246914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] RBAC: Adding query filter params (name=image) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:14.247224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:14.248607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:14.258982 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 526/1042] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:14.259951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:14.294886 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:14.375076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495644a-ea95-4207-a84c-6f8c8ca283d3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:14.411105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:14.411771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.412060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.412338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.413052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] RBAC: Adding query filter params (type=image) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:14.413364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:14.414769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:14.420289 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 517/1043] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:14.426073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:14.543759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b241d1-fe4e-4b78-a0af-50c749d7557c None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:14.581834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:14.582592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.582885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.583166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.583979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] RBAC: Adding query filter params (interface=public, service_id=698722ea67ae41d08ae458cd28c47181, region_id=RegionOne) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:14.584300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:14.585730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe7bf-b42f-4cb0-a480-ef5125796034 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:14.592349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 527/1044] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:31:14 2022] GET /identity/v3/endpoints?service_id=698722ea67ae41d08ae458cd28c47181&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:14.598455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:14.705041 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:14.713733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeeb1f-ddca-4da9-adee-a455f3ecf320 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:14.767468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfab78-ddde-4bf7-ba3d-352ebfc085db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:14.768407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfab78-ddde-4bf7-ba3d-352ebfc085db None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.768847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfab78-ddde-4bf7-ba3d-352ebfc085db None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.769253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfab78-ddde-4bf7-ba3d-352ebfc085db None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.770942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfab78-ddde-4bf7-ba3d-352ebfc085db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:14.773415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfab78-ddde-4bf7-ba3d-352ebfc085db None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:14.781858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 518/1045] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:31:14 2022] GET /identity/v3/services => generated 1957 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:31:14.784053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702acd-d555-424b-90ce-1bc51ad983df None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.784517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702acd-d555-424b-90ce-1bc51ad983df None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.784905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702acd-d555-424b-90ce-1bc51ad983df None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.786832 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 528/1046] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:14.793077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:14.793617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:14.793694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:14.813510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:14.814924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:14.911056 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 519/1047] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:14.938765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702acd-d555-424b-90ce-1bc51ad983df None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:14.996117 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:15.075287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702acd-d555-424b-90ce-1bc51ad983df None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:15.113781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:15.114630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.115153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.115153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.126468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:15.134650 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:15.135642 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:15.137349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:15.138576 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 529/1048] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:15.142313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:15.241518 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:15.257091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf87c65-52b3-483f-baae-addb1192ec9e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:15.297416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:15.298410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.298641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.298919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.299610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:15.299920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:15.301336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:15.313073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 520/1049] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:15.319495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:15.456170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512758-3046-4915-9dee-3944d51e400e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:15.458783 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:15.511388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fec24-e0f9-45d9-89ab-243bd1395b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:15.512267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fec24-e0f9-45d9-89ab-243bd1395b8a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.512557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fec24-e0f9-45d9-89ab-243bd1395b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.512829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fec24-e0f9-45d9-89ab-243bd1395b8a None admin] PATH_INFO: `/v3/users/101407b1b49b464185a84707e6251013` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.529605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fec24-e0f9-45d9-89ab-243bd1395b8a None admin] RBAC: Authorizing `identity:get_user(user_id=101407b1b49b464185a84707e6251013)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:15.531390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fec24-e0f9-45d9-89ab-243bd1395b8a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:15.533404 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 530/1050] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/users/101407b1b49b464185a84707e6251013 => generated 285 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:15.540865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:15.591324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ecde-8d31-4a6c-b28f-30abefaec756 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.591601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ecde-8d31-4a6c-b28f-30abefaec756 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.591952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ecde-8d31-4a6c-b28f-30abefaec756 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.593416 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 531/1051] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:15.603252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.603252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.603660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.630036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:15.631599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:15.701859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4ce01-5823-4106-b9b1-69e2430c2243 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:15.722845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 532/1052] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:15.738353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:15.741000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:15.741968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.742348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.742858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.766296 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:15.841276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:15.842851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:15.860150 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:15.876060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92811-9a92-45d2-8a2e-8636842f56a4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:15.922671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:15.924290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.924290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.924290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.936951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:15.946124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:15.951645 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:15.952813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 533/1053] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:15.955055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:15.968714 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 521/1054] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:31:15.974940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:16.030266 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:16.089295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db258884-866c-44c2-aad1-8856f2e91ef7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.091754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f308-9597-4844-af47-53a32f9ac05c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.127079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.127765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.128051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.128331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.129625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:16.129926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.131327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.131688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.132540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.133001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.133278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.134853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] RBAC: Authorizing `identity:get_project(project_id=4bc680b501d04a93a324af52859e71ed)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.136275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.138637 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 522/1055] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/projects/4bc680b501d04a93a324af52859e71ed => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:16.144394 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 534/1056] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:16.146098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:16.146224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:16.164574 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:16.281631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4302e-5bd8-4eb3-88cd-311a2a1f0b5c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.282121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266a82-e1f2-47fb-842d-140e94fd4942 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.300729 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:16.320916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.321715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.321998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.322275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.322610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.323270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.323559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.323841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.324677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=4bc680b501d04a93a324af52859e71ed, user.id=101407b1b49b464185a84707e6251013) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:16.324994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.326422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.332593 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 535/1057] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:16 2022] GET /identity/v3/role_assignments?user.id=101407b1b49b464185a84707e6251013&scope.project.id=4bc680b501d04a93a324af52859e71ed&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:16.333010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.334469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:16.353947 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:16.355210 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:16.356132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:16.356132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:16.356132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:16.356132 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:16.356132 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 523/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:16.362562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:16.456582 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:16.483324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af6e23-b8b1-44e2-ba7d-a39c5f165764 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.520302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.520974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.521265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.521538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.522395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:16.522704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.524021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.537367 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 536/1059] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:16.543139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:16.690631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908310-1036-47ed-80eb-40c51fe4df99 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.731377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.732297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.732645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.733043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.743875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.745724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-31cfcd8b-9eb9-4a2e-b4d3-35679827bc81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:31:16.763052 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:16.764596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:16.765923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 524/1060] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:31:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:16.777506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:16.909209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161dbcc-8da6-44c0-b33c-b1fb33a2f82b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:16.929471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55eb43-4d4d-45f4-9529-65e4e2a2b30a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.930105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55eb43-4d4d-45f4-9529-65e4e2a2b30a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.930105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55eb43-4d4d-45f4-9529-65e4e2a2b30a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.932124 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 525/1061] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:16.938820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.939235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.939538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.955298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:16.956113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:16.956310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:16.956554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:16.957462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:16.957784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:16.959251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:16.962223 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:16.963373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:16.965342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:16.985380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 537/1062] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:31:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:16.986755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.002559 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:17.065096 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 526/1063] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:17.089310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.126003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9b92-e7de-4346-aa81-8a965dd13d06 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.182977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.184000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.184322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.184775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.204378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.205851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:17.226256 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:17.227556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:17.235157 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:17.235157 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:17.235157 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:17.235157 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:17.235389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f819ac-033a-4c4a-b42f-4c494effba04 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.235466 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 538/1064] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:17.235466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.275965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.276924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.277288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.277645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] PATH_INFO: `/v3/services/image` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.278418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.279920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:17.292068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:17.293143 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:17.294300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 527/1065] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Jul 11 14:31:17 2022] GET /identity/v3/services/image => generated 86 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:17.301380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.302161 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:17.339800 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:17.371704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920d31-5f13-4337-87ac-8aa7ad6a2fab None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.422904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.423591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.423938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.424201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.424995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:17.425497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.427925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.443920 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 539/1066] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:17.449326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.456922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2669-9f02-48c3-a95d-67d09daced31 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.498623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.499509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.499693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.499959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.500767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:17.501075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.503090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.513719 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 528/1067] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:17.514683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.565444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78351-de7e-4998-aa41-6454daedc198 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.575546 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:17.607350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.608247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.608509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.608901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.616259 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:17.616848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.618358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.631357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb4b32-1686-4163-9e09-19033e4ba1c6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:31:17.634622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:17.635522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:17.636458 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 540/1068] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:17.641762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.679499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.680160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.680450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.680729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.681446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] RBAC: Adding query filter params (type=image) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:17.681757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.683164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.688421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 529/1069] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:17.694774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.773389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04ef7-e977-4dca-8415-3e6432faba4e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.822665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.823382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.823668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.823946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.824810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:17.825126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.826612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.828380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f9870-20ba-41cf-808b-61930286eb38 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:17.850380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 541/1070] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:17.852146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:17.871715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0071-2934-4ad7-a5db-e4d2cde2c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:17.872835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0071-2934-4ad7-a5db-e4d2cde2c6e7 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.873315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0071-2934-4ad7-a5db-e4d2cde2c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.873860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0071-2934-4ad7-a5db-e4d2cde2c6e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.875148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f0071-2934-4ad7-a5db-e4d2cde2c6e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:17.877777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f0071-2934-4ad7-a5db-e4d2cde2c6e7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:17.896368 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:17.919044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 530/1071] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:31:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:31:18.001839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefe972-72c5-4bb3-a85f-5c7eafe2616d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:18.057198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e062b-6242-4cb7-a027-dbe0caaa38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:18.058129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e062b-6242-4cb7-a027-dbe0caaa38b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:18.058413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e062b-6242-4cb7-a027-dbe0caaa38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:18.058722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e062b-6242-4cb7-a027-dbe0caaa38b1 None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/0522dc9e5943446fbaffdcd857728b59/roles/0606cfa7820245a7b62b12842d6f686a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:18.061007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e062b-6242-4cb7-a027-dbe0caaa38b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=0522dc9e5943446fbaffdcd857728b59, role_id=0606cfa7820245a7b62b12842d6f686a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:18.062477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e062b-6242-4cb7-a027-dbe0caaa38b1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:18.078660 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 542/1072] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:31:17 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/0522dc9e5943446fbaffdcd857728b59/roles/0606cfa7820245a7b62b12842d6f686a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:31:18.423442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e787df-3e24-4b8b-b013-3abe10d28c03 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:18.423973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e787df-3e24-4b8b-b013-3abe10d28c03 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:18.424053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e787df-3e24-4b8b-b013-3abe10d28c03 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:18.426180 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 531/1073] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:18.432212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:18.432577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:18.432807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:18.451376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:18.452568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:18.532929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 543/1074] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:18.557204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e787df-3e24-4b8b-b013-3abe10d28c03 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:18.577725 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:18.697463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e787df-3e24-4b8b-b013-3abe10d28c03 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:18.737747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:18.739151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:18.739433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:18.739700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:18.753151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:18.763932 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:18.765702 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:18.766935 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:18.770750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 532/1075] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:18.772301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:18.796065 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:18.949505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67595edd-1102-4250-ba50-d80c03c51007 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:19.007922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:19.008891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:19.009216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:19.009385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:19.010160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:19.010564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:19.012466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:19.033388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 544/1076] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:19.034614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:19.113953 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:19.179067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f709a1-9719-4657-8c6f-5a8b77ab3be3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:19.238910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:19.240739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:19.241472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:19.242232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] PATH_INFO: `/v3/users/101407b1b49b464185a84707e6251013` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:19.244681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] RBAC: Authorizing `identity:get_user(user_id=101407b1b49b464185a84707e6251013)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:19.247770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:19.262685 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 533/1077] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:19 2022] GET /identity/v3/users/101407b1b49b464185a84707e6251013 => generated 285 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:19.262984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:19.352852 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:19.382910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53d7d1-f3c3-43be-a8dc-b48d8d0c53df None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:19.429025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823cde4-ce51-48eb-be54-26ec0bd5bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:19.430028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823cde4-ce51-48eb-be54-26ec0bd5bf91 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:19.430358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823cde4-ce51-48eb-be54-26ec0bd5bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:19.430656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823cde4-ce51-48eb-be54-26ec0bd5bf91 None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:19.432004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823cde4-ce51-48eb-be54-26ec0bd5bf91 None admin] RBAC: Authorizing `identity:get_project(project_id=4bc680b501d04a93a324af52859e71ed)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:19.433487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823cde4-ce51-48eb-be54-26ec0bd5bf91 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:19.436022 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 545/1078] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:19 2022] GET /identity/v3/projects/4bc680b501d04a93a324af52859e71ed => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:19.444220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:19.583618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112b298-b4f6-4852-8ffa-0ec5ba40cbfb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:19.647418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00801f3-dc38-4d47-83b3-226ef4d67c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:19.648834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00801f3-dc38-4d47-83b3-226ef4d67c8f None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:19.649372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00801f3-dc38-4d47-83b3-226ef4d67c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:19.649689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00801f3-dc38-4d47-83b3-226ef4d67c8f None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed/users/101407b1b49b464185a84707e6251013/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:19.653505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00801f3-dc38-4d47-83b3-226ef4d67c8f None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc680b501d04a93a324af52859e71ed, user_id=101407b1b49b464185a84707e6251013, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:19.656286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00801f3-dc38-4d47-83b3-226ef4d67c8f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:19.661822 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:19.677694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 534/1079] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:31:19 2022] PUT /identity/v3/projects/4bc680b501d04a93a324af52859e71ed/users/101407b1b49b464185a84707e6251013/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:31:20.350401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c531c5-95cc-45e2-9d3a-ade4bd1557be None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.351198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c531c5-95cc-45e2-9d3a-ade4bd1557be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.351198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c531c5-95cc-45e2-9d3a-ade4bd1557be None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.352257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 546/1080] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:20.358339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.358770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.358910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.383766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:20.385690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:20.502572 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 535/1081] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:20.526052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562f4a1-c7d7-4412-8ea5-5c6eb9054f4a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.526618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562f4a1-c7d7-4412-8ea5-5c6eb9054f4a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.527172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562f4a1-c7d7-4412-8ea5-5c6eb9054f4a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.527624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:20.530100 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 547/1082] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:20.535748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.536040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.536314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.553693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:20.554944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:20.659115 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 548/1083] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:20.673044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d695-7adb-4042-883d-533c9ed8ba60 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:20.675997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:20.708842 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:20.721464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:20.721934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.722243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.722521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.808675 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:20.811581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:20.813703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:20.876187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1995-193a-4054-b484-d8d85d4f95d1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:20.937594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:20.938879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.939338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.939791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.944300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 536/1084] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:31:20.950079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:20.962779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:20.971539 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:20.972699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:20.974347 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 549/1085] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Jul 11 14:31:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:20.979923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:21.002241 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:21.094560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfd1c-92ea-45cb-96b4-f9075b0a718d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.110876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50c544-3d40-4063-a829-210c1aedd8d0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.147621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.148558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.149044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.149212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.151637 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:21.162530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.162792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.163766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.164010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.164260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.164753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.166171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:21.166748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.169281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:21.183977 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:21.185614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:21.187230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:21.187230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:21.187230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:21.187230 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:21.187230 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 537/1086] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:21.190987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 550/1087] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:31:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:21.192045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:21.194970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:21.282605 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:21.309016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c171-5f25-4878-86c0-280f2926dd18 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.364242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.364914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.365198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.365468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.366195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:21.366516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.368057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.381800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 538/1088] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:21.382908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6f547-3a44-482e-937c-251eba4dd3db None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.450543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.451884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.452385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.452991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.475818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.478381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:21.501807 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:21.503729 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:21.506333 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:21.506333 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:21.506333 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:21.506333 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:21.508848 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 551/1089] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:21.510185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:21.656250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd4d29-54a4-4f36-af86-6c54bb0383c2 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.693988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.694563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.694971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.695259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.696006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:21.696319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.697726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.705569 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:21.713257 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 539/1090] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:21.719498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:21.768862 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:21.824901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19974f7-6550-4ccc-8d61-a6c631a7801b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.859154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.859956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.860236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.860508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.869218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.870709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:31:21.893508 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:21.894750 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:21.895739 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 552/1091] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Jul 11 14:31:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:21.901448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.020242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea552-e07e-424c-a700-94697c738c87 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.068849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.069971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.070464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.070988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.072472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:22.073031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:22.075949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05f239-410f-4cea-80db-7aa92be7dff2 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:22.109555 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 540/1092] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Jul 11 14:31:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:22.116355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.118899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778050e5-2e14-4320-ae02-39a386d5a4a9 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.119195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778050e5-2e14-4320-ae02-39a386d5a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.119478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778050e5-2e14-4320-ae02-39a386d5a4a9 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.120929 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 541/1093] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:22.126857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.127148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.127437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.148441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:22.149715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:22.230870 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:22.255280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 542/1094] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:22.262014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c531f-59ac-4c07-86ec-f57401eb752a None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.271401 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:22.280784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.305181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.306114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.306114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.306416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.402090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:22.404104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:22.416180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0915d2-1546-4a5f-afb7-a6052ebc41ba None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.467927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.469148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.469534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.469946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.487213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:22.501404 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:22.503385 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:22.511261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 543/1095] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:22.512165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.556600 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 553/1096] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:31:22.563013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.575564 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:22.586787 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:22.652405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c53f1-6f17-4c14-905f-b46b9f822493 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.695198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa0d42-60a8-47fe-b229-81f0c959910b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.710892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.711982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.712459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.712931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.714273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:22.714831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:22.716886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:22.727182 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 544/1097] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:22.733589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.740047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.740995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.741272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.741545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.755014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:22.758151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:22.791331 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:22.793262 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:22.794617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:31:22.794617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:22.794617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:31:22.794617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:22.794617 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 554/1098] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:22.803488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.878950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2ac4-a250-4eba-89b6-f59ed36c3ece None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.883998 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:22.895197 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:22.925479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.926972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.927258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.927536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] PATH_INFO: `/v3/users/101407b1b49b464185a84707e6251013` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.928872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] RBAC: Authorizing `identity:get_user(user_id=101407b1b49b464185a84707e6251013)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:22.930344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:22.932123 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 545/1099] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/users/101407b1b49b464185a84707e6251013 => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:22.938131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:22.944352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a04b-5fcd-4e1f-8459-dce4c3617bf0 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:22.988256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:22.989148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:22.989519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:22.989876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:22.990825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:22.991264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:22.992791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.006096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 555/1100] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:23.012301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:23.074745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea02e-4ead-40ae-a001-8d25e08c8a97 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:23.121286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:23.122290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.122787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.123252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.161772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cc1f1-5f93-42f5-bdb7-e103129b9279 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:23.174683 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:23.183460 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:23.206530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:23.208011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.210873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:23.211684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.211976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.212256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.219752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:23.221221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:31:23.236395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:23.239114 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:31:23.240925 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:23.242703 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 556/1101] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:31:23.244788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:23.331208 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 546/1102] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:31:23.332556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:23.382712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b344f-5277-4d13-bad8-4eb7d06c8364 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:23.436065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:23.437034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.437461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.438185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.439194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:23.439703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:23.442262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.452138 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:23.460901 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 557/1103] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:23.467841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:23.488057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064de7-7991-4125-b6de-5f4e22edd17a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:23.527876 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:23.534154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:23.535587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.535874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.536160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.537384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] RBAC: Authorizing `identity:get_project(project_id=4bc680b501d04a93a324af52859e71ed)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:23.538852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.540806 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 547/1104] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:23 2022] GET /identity/v3/projects/4bc680b501d04a93a324af52859e71ed => generated 311 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:23.547825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:23.595888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db5c3-0989-4342-a893-3b8ff1a99c3d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:23.635946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:23.636627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.636906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.637181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.638022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] RBAC: Adding query filter params (role.id=0606cfa7820245a7b62b12842d6f686a, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=0522dc9e5943446fbaffdcd857728b59) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:23.638344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:23.639858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932889-2f39-4ee4-967b-3989c9a4e53e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.647245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 558/1105] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:23 2022] GET /identity/v3/role_assignments?user.id=0522dc9e5943446fbaffdcd857728b59&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=0606cfa7820245a7b62b12842d6f686a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:23.665825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca183e6e-c59d-46e5-b707-39c3117fcd22 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:23.707579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:23.708171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.708456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.708733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.709613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=4bc680b501d04a93a324af52859e71ed, user.id=101407b1b49b464185a84707e6251013) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:23.709959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:23.711489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94c67-444c-4e1a-9356-c649bc7b4ab7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:23.718733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 548/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:23 2022] GET /identity/v3/role_assignments?user.id=101407b1b49b464185a84707e6251013&scope.project.id=4bc680b501d04a93a324af52859e71ed&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:26.203965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5eb6-de92-4b5d-901d-cef632b34efb None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:26.204847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5eb6-de92-4b5d-901d-cef632b34efb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:26.204847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5eb6-de92-4b5d-901d-cef632b34efb None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:26.206376 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 559/1107] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:26.213300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:26.214079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:26.214079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:26.236079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:26.237455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:26.241644 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:26.362728 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 549/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:26.397861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5eb6-de92-4b5d-901d-cef632b34efb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:26.579028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5eb6-de92-4b5d-901d-cef632b34efb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:26.582972 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:26.639918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17941a-9d1f-461a-8844-b98702268845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:26.640768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17941a-9d1f-461a-8844-b98702268845 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:26.641157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17941a-9d1f-461a-8844-b98702268845 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:26.641500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17941a-9d1f-461a-8844-b98702268845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:26.643261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17941a-9d1f-461a-8844-b98702268845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:26.645057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17941a-9d1f-461a-8844-b98702268845 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:26.647257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 560/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:26.656192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:26.781335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5d6d-6217-495b-8003-c0a21d7442cc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:26.835609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3984832-1ae0-489c-87be-658f5fd3c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:26.836297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984832-1ae0-489c-87be-658f5fd3c8cf None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:26.836583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984832-1ae0-489c-87be-658f5fd3c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:26.836859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984832-1ae0-489c-87be-658f5fd3c8cf None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:26.837591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984832-1ae0-489c-87be-658f5fd3c8cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:26.839349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984832-1ae0-489c-87be-658f5fd3c8cf None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:26.850042 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:26.865645 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 550/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:31:26 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:29.160040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0cedd-8dba-4410-a1e0-517cb64cfece None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:29.160659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0cedd-8dba-4410-a1e0-517cb64cfece None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:29.160659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0cedd-8dba-4410-a1e0-517cb64cfece None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:29.162159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 561/1111] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:29.169009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:29.169666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:29.169950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:29.191904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:29.193510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:29.282812 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 551/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:29.308316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0cedd-8dba-4410-a1e0-517cb64cfece None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:29.415480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0cedd-8dba-4410-a1e0-517cb64cfece None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:29.454711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:29.455571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:29.455855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:29.456128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] PATH_INFO: `/v3/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:29.457686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] RBAC: Authorizing `identity:get_role(role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:29.459094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:29.460487 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 562/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:29 2022] GET /identity/v3/roles/f3798a3824ee40189ce3ab7045b9621e => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:29.466566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:29.566992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91875455-863a-4503-af9b-7706e1d11d98 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:29.595862 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:29.612308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:29.613740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:29.614018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:29.614290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] PATH_INFO: `/v3/users/ea64c659b9614311b0ab8fbe487cea40` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:29.628142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] RBAC: Authorizing `identity:get_user(user_id=ea64c659b9614311b0ab8fbe487cea40)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:29.629962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:29.632184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 552/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:29 2022] GET /identity/v3/users/ea64c659b9614311b0ab8fbe487cea40 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:29.639263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:29.682617 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:29.743117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2189e-b1dd-4ba3-8ff1-922b3d4fc108 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:29.777668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:29.778324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:29.778641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:29.778922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:29.846907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:29.848379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:29.887208 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:29.952001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 563/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:31:29.959154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:30.086789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851d6de-b7f6-4769-b009-456d20a32f42 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:30.125500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cda23-2a33-4566-8c5f-4751310fcb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:30.126280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cda23-2a33-4566-8c5f-4751310fcb46 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:30.126601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cda23-2a33-4566-8c5f-4751310fcb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:30.126886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cda23-2a33-4566-8c5f-4751310fcb46 None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:30.128238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cda23-2a33-4566-8c5f-4751310fcb46 None admin] RBAC: Authorizing `identity:get_project(project_id=4bc680b501d04a93a324af52859e71ed)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:30.130281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cda23-2a33-4566-8c5f-4751310fcb46 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:30.132065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 553/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:29 2022] GET /identity/v3/projects/4bc680b501d04a93a324af52859e71ed => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:30.139021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:30.274029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e78af-7c16-441a-8950-389ee9d8c091 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:30.311165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:30.311903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:30.312235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:30.312565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:30.313458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] RBAC: Adding query filter params (role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=4bc680b501d04a93a324af52859e71ed, user.id=ea64c659b9614311b0ab8fbe487cea40) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:30.313820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:30.315352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789f7ea-cf57-4589-9d4b-57c60119c39b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:30.322459 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 564/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:30 2022] GET /identity/v3/role_assignments?user.id=ea64c659b9614311b0ab8fbe487cea40&scope.project.id=4bc680b501d04a93a324af52859e71ed&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:32.391931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12cf8b-5459-494e-b730-965f9ea44cdd None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:32.392447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12cf8b-5459-494e-b730-965f9ea44cdd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:32.392447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12cf8b-5459-494e-b730-965f9ea44cdd None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:32.393751 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 554/1118] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:32.399093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:32.399480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:32.399658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:32.404944 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:32.419339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:32.420544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:32.489908 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 565/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:32.512753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12cf8b-5459-494e-b730-965f9ea44cdd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:32.570146 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:32.623957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12cf8b-5459-494e-b730-965f9ea44cdd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:32.661960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:32.663307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:32.663701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:32.663985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] PATH_INFO: `/v3/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:32.665668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] RBAC: Authorizing `identity:get_role(role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:32.667135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:32.668540 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 555/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:32 2022] GET /identity/v3/roles/f3798a3824ee40189ce3ab7045b9621e => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:32.674335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:32.780121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd86c3-122e-47d1-ad6b-b5fb03cd71ee None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:32.809679 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:32.815047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:32.815975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:32.816259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:32.816523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] PATH_INFO: `/v3/users/ea64c659b9614311b0ab8fbe487cea40` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:32.818044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] RBAC: Authorizing `identity:get_user(user_id=ea64c659b9614311b0ab8fbe487cea40)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:32.819521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:32.821172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 566/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:32 2022] GET /identity/v3/users/ea64c659b9614311b0ab8fbe487cea40 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:32.827101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:32.939926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f46f9-7e58-4349-92b8-ce12b6de2e32 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:32.959942 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:32.978482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01461d-08a5-4bd0-9248-1f6e2cdfc8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:32.979390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01461d-08a5-4bd0-9248-1f6e2cdfc8bb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:32.979682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01461d-08a5-4bd0-9248-1f6e2cdfc8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:32.979966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01461d-08a5-4bd0-9248-1f6e2cdfc8bb None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:32.981196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01461d-08a5-4bd0-9248-1f6e2cdfc8bb None admin] RBAC: Authorizing `identity:get_project(project_id=4bc680b501d04a93a324af52859e71ed)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:32.982798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01461d-08a5-4bd0-9248-1f6e2cdfc8bb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:32.984541 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 556/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:32 2022] GET /identity/v3/projects/4bc680b501d04a93a324af52859e71ed => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:32.990652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:33.096877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15dd57-8722-400e-b249-dc6321457e67 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:33.131359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fdfb9-79da-4419-a4cc-dc969fd29f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:33.132253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fdfb9-79da-4419-a4cc-dc969fd29f40 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:33.132538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fdfb9-79da-4419-a4cc-dc969fd29f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:33.132822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fdfb9-79da-4419-a4cc-dc969fd29f40 None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed/users/ea64c659b9614311b0ab8fbe487cea40/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:33.135192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fdfb9-79da-4419-a4cc-dc969fd29f40 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc680b501d04a93a324af52859e71ed, user_id=ea64c659b9614311b0ab8fbe487cea40, role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:33.136638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fdfb9-79da-4419-a4cc-dc969fd29f40 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:33.150054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 567/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:31:32 2022] PUT /identity/v3/projects/4bc680b501d04a93a324af52859e71ed/users/ea64c659b9614311b0ab8fbe487cea40/roles/f3798a3824ee40189ce3ab7045b9621e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:31:35.230304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273f785-604a-4553-abdb-8237970e58ea None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:35.230866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273f785-604a-4553-abdb-8237970e58ea None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:35.230866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273f785-604a-4553-abdb-8237970e58ea None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:35.232265 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 557/1124] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:35.239507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:35.240040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:35.240357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:35.257964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:35.259217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:35.317986 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:35.329952 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 568/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:35.353540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273f785-604a-4553-abdb-8237970e58ea None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:35.460529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273f785-604a-4553-abdb-8237970e58ea None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:35.501999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:35.503098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:35.503451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:35.503777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] PATH_INFO: `/v3/roles/f3798a3824ee40189ce3ab7045b9621e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:35.505507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] RBAC: Authorizing `identity:get_role(role_id=f3798a3824ee40189ce3ab7045b9621e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:35.507050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:35.508592 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 558/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:35 2022] GET /identity/v3/roles/f3798a3824ee40189ce3ab7045b9621e => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:35.514618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:35.627112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed021ab5-7ff5-4a3c-9cff-9d36a4896a87 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:35.674022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:35.674924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:35.675823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:35.676236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] PATH_INFO: `/v3/users/ea64c659b9614311b0ab8fbe487cea40` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:35.677750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] RBAC: Authorizing `identity:get_user(user_id=ea64c659b9614311b0ab8fbe487cea40)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:35.679489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:35.681613 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 569/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:35 2022] GET /identity/v3/users/ea64c659b9614311b0ab8fbe487cea40 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:35.687456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:35.743982 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:35.791343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9209-5592-46e9-b731-964f5a119d77 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:35.825705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:35.826345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:35.826667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:35.826926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:35.897345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:35.898836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:35.954829 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:36.005807 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 559/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:31:36.011756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:36.075274 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:36.117105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82627e-9bd1-4920-b333-46da6fce1814 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:36.151906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943bb6e-5021-4d40-afad-ca59ee37dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:36.152683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943bb6e-5021-4d40-afad-ca59ee37dbfc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:36.152972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943bb6e-5021-4d40-afad-ca59ee37dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:36.153252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943bb6e-5021-4d40-afad-ca59ee37dbfc None admin] PATH_INFO: `/v3/projects/4bc680b501d04a93a324af52859e71ed` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:36.154442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943bb6e-5021-4d40-afad-ca59ee37dbfc None admin] RBAC: Authorizing `identity:get_project(project_id=4bc680b501d04a93a324af52859e71ed)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:36.155911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943bb6e-5021-4d40-afad-ca59ee37dbfc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:36.157617 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 570/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:36 2022] GET /identity/v3/projects/4bc680b501d04a93a324af52859e71ed => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:36.164344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:36.266318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6dd83-a1bb-4955-8469-cf7bded05405 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:36.303497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:36.304143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:36.304425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:36.304697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:36.305601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] RBAC: Adding query filter params (role.id=f3798a3824ee40189ce3ab7045b9621e, scope.project.id=4bc680b501d04a93a324af52859e71ed, user.id=ea64c659b9614311b0ab8fbe487cea40) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:36.305914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:36.307374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a028e84-9666-43ec-8f1a-87160f7a0ec4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:36.313443 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 560/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:36 2022] GET /identity/v3/role_assignments?user.id=ea64c659b9614311b0ab8fbe487cea40&scope.project.id=4bc680b501d04a93a324af52859e71ed&role.id=f3798a3824ee40189ce3ab7045b9621e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:38.521600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51064-588f-4464-badb-b251b8966c4e None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:38.522186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51064-588f-4464-badb-b251b8966c4e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:38.522186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51064-588f-4464-badb-b251b8966c4e None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:38.523566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 571/1131] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:38.529593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:38.530098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:38.530193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:38.547857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:38.549050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:38.563405 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:38.638065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 561/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:38.662911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51064-588f-4464-badb-b251b8966c4e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:38.787858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51064-588f-4464-badb-b251b8966c4e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:38.816558 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:38.826744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a9de2-5245-4887-a8df-562194c35183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:38.827547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a9de2-5245-4887-a8df-562194c35183 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:38.827829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a9de2-5245-4887-a8df-562194c35183 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:38.828107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a9de2-5245-4887-a8df-562194c35183 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:38.829318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a9de2-5245-4887-a8df-562194c35183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:38.830882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a9de2-5245-4887-a8df-562194c35183 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:38.832510 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 572/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:38.838858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:38.954004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee9ac-d94a-45e2-af9e-cc2f0f71f83a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:38.988952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600dcd-86e8-4ea8-a7aa-64bf818ceb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:38.989610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600dcd-86e8-4ea8-a7aa-64bf818ceb6e None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:38.989894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600dcd-86e8-4ea8-a7aa-64bf818ceb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:38.990170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600dcd-86e8-4ea8-a7aa-64bf818ceb6e None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:38.990919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a600dcd-86e8-4ea8-a7aa-64bf818ceb6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:38.992350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a600dcd-86e8-4ea8-a7aa-64bf818ceb6e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:39.013003 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:39.022097 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 562/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:31:38 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:31:41.132091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777896-8ce0-47d5-b717-e435e1e69afb None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:41.132619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777896-8ce0-47d5-b717-e435e1e69afb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:41.132730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777896-8ce0-47d5-b717-e435e1e69afb None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:41.134007 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 573/1135] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:41.140076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:41.140579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:41.140710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:41.159158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:41.160945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:41.228769 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 563/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:41.253654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777896-8ce0-47d5-b717-e435e1e69afb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:41.363541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777896-8ce0-47d5-b717-e435e1e69afb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:41.397340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75c47-341f-4da1-ab08-72c59da06e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:41.398133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75c47-341f-4da1-ab08-72c59da06e55 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:41.398414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75c47-341f-4da1-ab08-72c59da06e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:41.398715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75c47-341f-4da1-ab08-72c59da06e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:41.399891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75c47-341f-4da1-ab08-72c59da06e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:41.401317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75c47-341f-4da1-ab08-72c59da06e55 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:41.402988 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 574/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:31:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:41.408981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:41.508916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ba02-4086-4f94-b4d6-5a2b12aea35b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:41.538577 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:41.545016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9edacf-d21b-4a38-9886-18c16f5961d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:41.545682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edacf-d21b-4a38-9886-18c16f5961d7 None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:41.545966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edacf-d21b-4a38-9886-18c16f5961d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:41.546241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edacf-d21b-4a38-9886-18c16f5961d7 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:41.546994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9edacf-d21b-4a38-9886-18c16f5961d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:41.548590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9edacf-d21b-4a38-9886-18c16f5961d7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:41.570561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 564/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:31:41 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:43.703680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff1dbd-f24e-4627-8957-04c1595b3c0a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:43.704505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff1dbd-f24e-4627-8957-04c1595b3c0a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:43.704684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff1dbd-f24e-4627-8957-04c1595b3c0a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:43.706649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 575/1139] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:43.712099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:43.712571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:43.712701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:43.729351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:43.730585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:43.797760 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 565/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:43.822376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff1dbd-f24e-4627-8957-04c1595b3c0a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:43.886346 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:43.926548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff1dbd-f24e-4627-8957-04c1595b3c0a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:43.961728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:43.962436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:43.962750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:43.963031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:43.974084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:43.981784 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:43.983287 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:43.984422 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 576/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:43.989303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:44.091046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1be06-8426-4f83-a2c8-3f6326c63f99 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:44.108608 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:44.128663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:44.129331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.129608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.129877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.130663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:44.130966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:44.132344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:44.140740 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 566/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:44.146727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:44.248746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f824d7d-94c5-45f1-91b9-6f3a0d9ce812 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:44.272127 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:44.284387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:44.285268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.285553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.285829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] PATH_INFO: `/v3/users/498df28e70a647f1b14e99667867e4ba` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.300595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] RBAC: Authorizing `identity:get_user(user_id=498df28e70a647f1b14e99667867e4ba)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:44.302042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:44.303785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 577/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:44 2022] GET /identity/v3/users/498df28e70a647f1b14e99667867e4ba => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:44.309831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:44.410832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513171-8187-4677-a5bf-a3ca0e4d2806 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:44.443664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:44.444302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.444584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.444856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.490385 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:44.512174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:44.513681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:44.614956 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 567/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:31:44.621704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:44.731436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6267b-d94c-4b88-abb3-86091ba47930 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:44.768056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0699b-7660-4eec-94b6-280d04096587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:44.769374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0699b-7660-4eec-94b6-280d04096587 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.769652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0699b-7660-4eec-94b6-280d04096587 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.769926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0699b-7660-4eec-94b6-280d04096587 None admin] PATH_INFO: `/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.771140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0699b-7660-4eec-94b6-280d04096587 None admin] RBAC: Authorizing `identity:get_project(project_id=ae1a4836912442f9bcd9de3ed4cb8b76)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:44.772578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0699b-7660-4eec-94b6-280d04096587 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:44.774280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 578/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:44 2022] GET /identity/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:44.780546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:44.859042 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:44.880177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62b27-6de6-4121-9c56-fe7245fafbf4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:44.918642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:44.919309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.919667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.919950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.920793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=ae1a4836912442f9bcd9de3ed4cb8b76, user.id=498df28e70a647f1b14e99667867e4ba) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:44.921111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:44.922576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fe535-1b9e-42ba-99e9-649e18b91d65 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:44.929423 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 568/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:44 2022] GET /identity/v3/role_assignments?user.id=498df28e70a647f1b14e99667867e4ba&scope.project.id=ae1a4836912442f9bcd9de3ed4cb8b76&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:47.047397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64255b-a08a-4cf6-ad73-a06110809bd8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:47.047943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64255b-a08a-4cf6-ad73-a06110809bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:47.047943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64255b-a08a-4cf6-ad73-a06110809bd8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:47.049320 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 579/1147] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:47.055786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:47.056492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:47.056713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:47.079022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:47.080299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:47.154614 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 569/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:47.178126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64255b-a08a-4cf6-ad73-a06110809bd8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:47.241115 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:47.297974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64255b-a08a-4cf6-ad73-a06110809bd8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:47.334963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:47.335756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:47.336035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:47.336308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:47.357912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:47.366105 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:47.367349 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:47.368503 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 580/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:31:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:47.374431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:47.449183 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:47.482988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358e10-3243-425f-8349-1585ad88d4e3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:47.517929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:47.519198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:47.519483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:47.519762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:47.520523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:47.520832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:47.522213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:47.537165 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 570/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:47.543158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:47.678063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd9da2-53ec-4cf3-a1f2-bb6b1404fb93 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:47.695302 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:47.730326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:47.731237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:47.731515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:47.731786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] PATH_INFO: `/v3/users/498df28e70a647f1b14e99667867e4ba` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:47.733025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] RBAC: Authorizing `identity:get_user(user_id=498df28e70a647f1b14e99667867e4ba)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:47.734520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:47.736222 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 581/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:47 2022] GET /identity/v3/users/498df28e70a647f1b14e99667867e4ba => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:47.743173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:47.860441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c55077-00d2-43f2-91a8-09dbf79f0934 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:47.904492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf26b2-e73d-4a87-a433-2db4909de64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:47.905683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf26b2-e73d-4a87-a433-2db4909de64e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:47.906092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf26b2-e73d-4a87-a433-2db4909de64e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:47.906564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf26b2-e73d-4a87-a433-2db4909de64e None admin] PATH_INFO: `/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:47.908278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf26b2-e73d-4a87-a433-2db4909de64e None admin] RBAC: Authorizing `identity:get_project(project_id=ae1a4836912442f9bcd9de3ed4cb8b76)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:47.909839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf26b2-e73d-4a87-a433-2db4909de64e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:47.912802 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 571/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:47 2022] GET /identity/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:47.919561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:48.025098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf9959-bbf7-4bd6-924b-45b37f6c6f2f None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:48.081395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ee7b6-1bb3-4cf4-b7d9-12857ec34659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:48.083055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee7b6-1bb3-4cf4-b7d9-12857ec34659 None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:48.083582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee7b6-1bb3-4cf4-b7d9-12857ec34659 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:48.084099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee7b6-1bb3-4cf4-b7d9-12857ec34659 None admin] PATH_INFO: `/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76/users/498df28e70a647f1b14e99667867e4ba/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:48.087714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ee7b6-1bb3-4cf4-b7d9-12857ec34659 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae1a4836912442f9bcd9de3ed4cb8b76, user_id=498df28e70a647f1b14e99667867e4ba, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:48.089997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ee7b6-1bb3-4cf4-b7d9-12857ec34659 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:48.111629 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 582/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:31:47 2022] PUT /identity/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76/users/498df28e70a647f1b14e99667867e4ba/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:31:50.180270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf5939-c6e8-4d65-b86a-ca7d1e6abafe None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.180798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf5939-c6e8-4d65-b86a-ca7d1e6abafe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.180798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf5939-c6e8-4d65-b86a-ca7d1e6abafe None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.182183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 572/1154] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:50.187427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.187844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.187997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.206639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:50.207940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:50.237568 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:50.279676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 583/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:50.303441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf5939-c6e8-4d65-b86a-ca7d1e6abafe None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:50.306434 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:50.418583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf5939-c6e8-4d65-b86a-ca7d1e6abafe None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:50.454508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:50.455418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.455636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.455910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.466723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:31:50.474804 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:50.475988 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:31:50.476968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 573/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:50.482272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:50.590909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35202a1e-4ede-4b71-97ec-30dc5f090a3b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:50.627378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:50.628059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.628345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.628626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.629378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:50.629687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:50.631098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:50.639583 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 584/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:50.646350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:50.716808 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:50.755994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1623156-5dc6-452a-bfa0-88ac32bf511c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:50.793234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:50.794115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.794399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.794701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] PATH_INFO: `/v3/users/498df28e70a647f1b14e99667867e4ba` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.795900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] RBAC: Authorizing `identity:get_user(user_id=498df28e70a647f1b14e99667867e4ba)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:50.797338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:50.799029 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 574/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:31:50 2022] GET /identity/v3/users/498df28e70a647f1b14e99667867e4ba => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:50.804836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:50.834168 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:50.909218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42330-34c9-4d2d-9a6e-d1d8713567ec None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:50.943106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:50.943893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.944280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.944657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:51.016737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:51.018893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:51.052480 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:51.126262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 585/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:31:51.132643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:51.241771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f72a38-1b4a-4508-a913-2e5a0e21347f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:51.272126 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:51.279481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c83ed3-4d9f-4063-ad28-1d337a9fc36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:51.280374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83ed3-4d9f-4063-ad28-1d337a9fc36a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:51.280660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83ed3-4d9f-4063-ad28-1d337a9fc36a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:51.280938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83ed3-4d9f-4063-ad28-1d337a9fc36a None admin] PATH_INFO: `/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:51.282294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c83ed3-4d9f-4063-ad28-1d337a9fc36a None admin] RBAC: Authorizing `identity:get_project(project_id=ae1a4836912442f9bcd9de3ed4cb8b76)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:51.284442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c83ed3-4d9f-4063-ad28-1d337a9fc36a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:51.286369 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 575/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:31:51 2022] GET /identity/v3/projects/ae1a4836912442f9bcd9de3ed4cb8b76 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:31:51.292936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:51.397931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67057f-c91f-4fd1-a8cc-e5ae46b8053e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:51.428869 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:51.437391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:51.438051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:51.438337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:51.438652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:51.439497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=ae1a4836912442f9bcd9de3ed4cb8b76, user.id=498df28e70a647f1b14e99667867e4ba) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:51.439856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:51.441310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425761a9-b2be-4151-8ca9-e1c5229dacdf None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:51.447799 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 586/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:31:51 2022] GET /identity/v3/role_assignments?user.id=498df28e70a647f1b14e99667867e4ba&scope.project.id=ae1a4836912442f9bcd9de3ed4cb8b76&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:53.661862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721c20-7f6d-4682-90db-d45ece8a2443 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:53.662487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721c20-7f6d-4682-90db-d45ece8a2443 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:53.662487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721c20-7f6d-4682-90db-d45ece8a2443 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:53.663823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 576/1162] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:53.669539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:53.670108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:53.670108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:53.687925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:53.689134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:53.758420 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 587/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:53.781338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721c20-7f6d-4682-90db-d45ece8a2443 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:53.886141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721c20-7f6d-4682-90db-d45ece8a2443 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:53.920379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:53.920948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:53.921235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:53.921511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:53.994750 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:53.998856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:54.000865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:54.110178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 577/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:31:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:31:54.116970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:54.224806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294ce4b-5abc-4bc3-a21f-3ad1c1995ddd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:54.249271 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:54.261180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:54.262002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:54.262284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:54.262597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:54.270224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:54.271719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b898331c-6c4b-47c9-bc47-400acf0a6169 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:31:54.287126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:31:54.288518 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:31:54.289435 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 588/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:31:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:31:54.294767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:54.397447 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:54.401092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c03160-ddd0-4e31-aba8-96a7dd7b9470 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:54.436558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:54.437218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:54.437498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:54.437771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:54.438532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:31:54.438826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:54.440651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8965bca-7478-4a47-8485-5403111573b1 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:54.449212 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 578/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Jul 11 14:31:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:56.519453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2fa50-1ee8-4a1b-a2f0-4d343b9c9bd0 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:56.519989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2fa50-1ee8-4a1b-a2f0-4d343b9c9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:56.519989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2fa50-1ee8-4a1b-a2f0-4d343b9c9bd0 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:56.521377 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 589/1167] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:56.527015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c83b3-bdb2-448f-b036-24fcf363d6eb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:56.527481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c83b3-bdb2-448f-b036-24fcf363d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:56.527584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c83b3-bdb2-448f-b036-24fcf363d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:56.545113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-792c83b3-bdb2-448f-b036-24fcf363d6eb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:56.546322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-792c83b3-bdb2-448f-b036-24fcf363d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:56.618255 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 579/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:31:56.641360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2fa50-1ee8-4a1b-a2f0-4d343b9c9bd0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:56.751282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2fa50-1ee8-4a1b-a2f0-4d343b9c9bd0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:56.793411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cc91-642e-425d-81e1-08c9b7382af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:56.794011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cc91-642e-425d-81e1-08c9b7382af1 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:56.794299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cc91-642e-425d-81e1-08c9b7382af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:56.794608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cc91-642e-425d-81e1-08c9b7382af1 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:56.795384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cc91-642e-425d-81e1-08c9b7382af1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:56.797190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cc91-642e-425d-81e1-08c9b7382af1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:56.813646 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 590/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Mon Jul 11 14:31:56 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:58.937357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49416f-da09-4471-a81c-952323321a65 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:58.937895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49416f-da09-4471-a81c-952323321a65 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:58.937895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49416f-da09-4471-a81c-952323321a65 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:58.939341 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 580/1170] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:58.945889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:58.946404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:58.946539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:58.965278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:58.966532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:59.005585 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:59.046387 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 591/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:31:59.073286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49416f-da09-4471-a81c-952323321a65 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:59.169721 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:59.180300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49416f-da09-4471-a81c-952323321a65 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:59.217132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c662ea-7e29-4d31-866d-fbc782888492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:59.217791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c662ea-7e29-4d31-866d-fbc782888492 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:59.218075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c662ea-7e29-4d31-866d-fbc782888492 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:59.218350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c662ea-7e29-4d31-866d-fbc782888492 None admin] PATH_INFO: `/v3/domains/58841f571b7e42a98beb9402b9be1f6a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:59.229541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c662ea-7e29-4d31-866d-fbc782888492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=58841f571b7e42a98beb9402b9be1f6a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:59.231048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c662ea-7e29-4d31-866d-fbc782888492 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:59.233155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 581/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Mon Jul 11 14:31:59 2022] GET /identity/v3/domains/58841f571b7e42a98beb9402b9be1f6a => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:31:59.239491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:59.344377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5f4ad-5ed8-4219-b207-90164af8578b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:59.380750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b223-9752-432f-83c9-16179f9790b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:59.381448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b223-9752-432f-83c9-16179f9790b5 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:59.381735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b223-9752-432f-83c9-16179f9790b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:59.382008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b223-9752-432f-83c9-16179f9790b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:59.382748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8b223-9752-432f-83c9-16179f9790b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:59.384176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8b223-9752-432f-83c9-16179f9790b5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:59.411099 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 592/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:31:59 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:01.555167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687757d-2cc6-41ad-89ae-2bab1b7650b3 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:01.555991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687757d-2cc6-41ad-89ae-2bab1b7650b3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:01.555991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687757d-2cc6-41ad-89ae-2bab1b7650b3 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:01.557181 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 582/1174] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:01.563622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:01.564186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:01.564186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:01.584282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:01.585545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:01.606909 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:01.697250 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 593/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:32:01.724494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687757d-2cc6-41ad-89ae-2bab1b7650b3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:01.841919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687757d-2cc6-41ad-89ae-2bab1b7650b3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:01.877758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40be56-2af7-43e5-9b3d-0fc6b3d22b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:01.878633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40be56-2af7-43e5-9b3d-0fc6b3d22b55 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:01.878918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40be56-2af7-43e5-9b3d-0fc6b3d22b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:01.879192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40be56-2af7-43e5-9b3d-0fc6b3d22b55 None admin] PATH_INFO: `/v3/domains/58841f571b7e42a98beb9402b9be1f6a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:01.880371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40be56-2af7-43e5-9b3d-0fc6b3d22b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=58841f571b7e42a98beb9402b9be1f6a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:01.881801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40be56-2af7-43e5-9b3d-0fc6b3d22b55 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:01.883451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 583/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Mon Jul 11 14:32:01 2022] GET /identity/v3/domains/58841f571b7e42a98beb9402b9be1f6a => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:01.892426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:01.997841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4d24-1cc0-4958-b15e-7f427129adab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:02.032947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752fde-b218-4e83-b406-b3dabab6fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:02.033674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752fde-b218-4e83-b406-b3dabab6fd09 None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:02.033956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752fde-b218-4e83-b406-b3dabab6fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:02.034230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752fde-b218-4e83-b406-b3dabab6fd09 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:02.034985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752fde-b218-4e83-b406-b3dabab6fd09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:02.036414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752fde-b218-4e83-b406-b3dabab6fd09 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:02.059426 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 594/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:32:01 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:32:04.191315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c56ac-86b5-42c1-8cb3-32dbca345e63 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.192305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c56ac-86b5-42c1-8cb3-32dbca345e63 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.192305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c56ac-86b5-42c1-8cb3-32dbca345e63 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.193491 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 584/1178] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:04.199434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.199932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.200019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.218209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:04.219485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:04.223227 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:04.295749 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 595/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:32:04.319928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c56ac-86b5-42c1-8cb3-32dbca345e63 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:04.345111 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:04.434096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c56ac-86b5-42c1-8cb3-32dbca345e63 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:04.473238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:04.474050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.474333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.474644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.487542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:04.495348 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:04.496539 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:32:04.497926 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 585/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:04.503998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:04.657066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db60e-d207-418f-90c3-9fb435b37136 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:04.694303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:04.695022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.695313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.695596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.696369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:04.696680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:04.698074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:04.707928 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 596/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:04.714078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:04.800736 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:04.824402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f6c6-d8dd-4eb9-a297-540f1e0113d6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:04.862765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:04.863639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.863926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.864205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] PATH_INFO: `/v3/users/9c1826db84074d7b9f2a17bcb6b10f87` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.880722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] RBAC: Authorizing `identity:get_user(user_id=9c1826db84074d7b9f2a17bcb6b10f87)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:04.882847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:04.885379 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 586/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:04 2022] GET /identity/v3/users/9c1826db84074d7b9f2a17bcb6b10f87 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:04.891873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:04.895332 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:05.006605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa29a4-88cb-4571-9f7b-e967f8f0cdd5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:05.044508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:05.045304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:05.045656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:05.046000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:05.137369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:05.138886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:05.141020 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:05.249047 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 597/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:32:05.258018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:05.366871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df20a3-6807-475d-a598-f8fc6ed4ebbe None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:05.402391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662c3a-1e02-4172-aceb-a17bc7ef1235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:05.403282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662c3a-1e02-4172-aceb-a17bc7ef1235 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:05.403563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662c3a-1e02-4172-aceb-a17bc7ef1235 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:05.403834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662c3a-1e02-4172-aceb-a17bc7ef1235 None admin] PATH_INFO: `/v3/projects/b1dea6e3c35a499a83b65b7badd66683` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:05.405115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662c3a-1e02-4172-aceb-a17bc7ef1235 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dea6e3c35a499a83b65b7badd66683)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:05.406610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662c3a-1e02-4172-aceb-a17bc7ef1235 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:05.408948 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 587/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:05 2022] GET /identity/v3/projects/b1dea6e3c35a499a83b65b7badd66683 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:05.415659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:05.536322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324513d-d6e9-4d28-a001-895df55ff505 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:05.537832 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:05.573242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:05.573912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:05.574195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:05.574472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:05.575343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=b1dea6e3c35a499a83b65b7badd66683, user.id=9c1826db84074d7b9f2a17bcb6b10f87) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:05.575654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:05.577092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624c7bb-2025-48d8-8912-863251a352fc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:05.583244 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 598/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:05 2022] GET /identity/v3/role_assignments?user.id=9c1826db84074d7b9f2a17bcb6b10f87&scope.project.id=b1dea6e3c35a499a83b65b7badd66683&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:08.023704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5d4d-562e-4813-9f9a-fa3495b08881 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:08.024315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5d4d-562e-4813-9f9a-fa3495b08881 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:08.024548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5d4d-562e-4813-9f9a-fa3495b08881 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:08.025958 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 588/1186] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:08.032177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:08.032927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:08.032927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:08.052256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:08.053497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:08.126119 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 599/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:32:08.149640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e5d4d-562e-4813-9f9a-fa3495b08881 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:08.159379 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:08.256324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e5d4d-562e-4813-9f9a-fa3495b08881 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:08.292994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:08.293699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:08.293989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:08.294271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:08.305168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:08.312796 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:08.314447 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:32:08.315515 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 589/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:08.323834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:08.424476 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:08.435124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc126-9283-4225-ae81-63fce25dbe4a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:08.490932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:08.491609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:08.491895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:08.492168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:08.492973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:08.493278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:08.494687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:08.504595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 600/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:08.510830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:08.596552 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:08.635224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3483d-c1d1-4a41-9e5b-7a559cf39fb6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:08.678146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:08.679060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:08.679342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:08.679621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] PATH_INFO: `/v3/users/9c1826db84074d7b9f2a17bcb6b10f87` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:08.680843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1826db84074d7b9f2a17bcb6b10f87)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:08.682305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:08.684025 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 590/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:08 2022] GET /identity/v3/users/9c1826db84074d7b9f2a17bcb6b10f87 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:08.692160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:08.811902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c481c2-62bc-4558-81d4-709f53b613cb None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:08.847513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b44c-4bd2-49bb-92a9-8825478d6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:08.848293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b44c-4bd2-49bb-92a9-8825478d6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:08.848575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b44c-4bd2-49bb-92a9-8825478d6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:08.848849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b44c-4bd2-49bb-92a9-8825478d6ffd None admin] PATH_INFO: `/v3/projects/b1dea6e3c35a499a83b65b7badd66683` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:08.850020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15b44c-4bd2-49bb-92a9-8825478d6ffd None admin] RBAC: Authorizing `identity:get_project(project_id=b1dea6e3c35a499a83b65b7badd66683)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:08.851494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15b44c-4bd2-49bb-92a9-8825478d6ffd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:08.853197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 601/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:08 2022] GET /identity/v3/projects/b1dea6e3c35a499a83b65b7badd66683 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:08.859640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:08.982830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036181-f8bf-4ba3-bbdf-cfe63d67a3d5 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:09.016588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749412-3b9d-4652-aafc-1e1fabe74f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:09.017994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749412-3b9d-4652-aafc-1e1fabe74f22 None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:09.018279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749412-3b9d-4652-aafc-1e1fabe74f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:09.018586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749412-3b9d-4652-aafc-1e1fabe74f22 None admin] PATH_INFO: `/v3/projects/b1dea6e3c35a499a83b65b7badd66683/users/9c1826db84074d7b9f2a17bcb6b10f87/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:09.020569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749412-3b9d-4652-aafc-1e1fabe74f22 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dea6e3c35a499a83b65b7badd66683, user_id=9c1826db84074d7b9f2a17bcb6b10f87, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:09.022002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749412-3b9d-4652-aafc-1e1fabe74f22 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:09.024285 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:09.036265 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 591/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:32:08 2022] PUT /identity/v3/projects/b1dea6e3c35a499a83b65b7badd66683/users/9c1826db84074d7b9f2a17bcb6b10f87/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:32:11.085478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90cbd-389f-4fe5-8a5b-030ef913df84 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:11.086022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90cbd-389f-4fe5-8a5b-030ef913df84 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:11.086161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90cbd-389f-4fe5-8a5b-030ef913df84 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:11.087623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 602/1193] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:11.096588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:11.097465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:11.097570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:11.126587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:11.128584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:11.241629 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 592/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:32:11.265834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90cbd-389f-4fe5-8a5b-030ef913df84 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:11.296023 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:11.386555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90cbd-389f-4fe5-8a5b-030ef913df84 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:11.427713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:11.428503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:11.428783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:11.429055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:11.440449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:32:11.448448 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:32:11.450052 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:32:11.451869 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 603/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:32:11.456670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:11.573535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b144-ec0b-44e2-b496-9f040a1aed96 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:11.600016 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:11.622121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:11.623238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:11.623722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:11.624184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:11.625520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:11.626003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:11.629035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:11.645288 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 593/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:32:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:11.654568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:11.775657 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:11.793645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22f2f-b156-4c65-932a-07481a1dba46 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:11.837140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:11.838723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:11.839236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:11.839735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] PATH_INFO: `/v3/users/9c1826db84074d7b9f2a17bcb6b10f87` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:11.841932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] RBAC: Authorizing `identity:get_user(user_id=9c1826db84074d7b9f2a17bcb6b10f87)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:11.844757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:11.847974 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 604/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Jul 11 14:32:11 2022] GET /identity/v3/users/9c1826db84074d7b9f2a17bcb6b10f87 => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:32:11.855832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:12.029277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edba65-828a-472b-b82e-699725fb86c7 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:12.083605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:12.084647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:12.085113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:12.085572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:12.159243 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:12.177649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:12.179247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:12.309263 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 594/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:32:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:32:12.316140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:12.445617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17c62-14d3-4be5-8897-9f456171d47d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:12.504450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7163-6a06-4ef1-b79b-88e0acb6c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:12.505818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7163-6a06-4ef1-b79b-88e0acb6c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:12.506284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7163-6a06-4ef1-b79b-88e0acb6c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:12.506791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7163-6a06-4ef1-b79b-88e0acb6c5a9 None admin] PATH_INFO: `/v3/projects/b1dea6e3c35a499a83b65b7badd66683` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:12.508959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7163-6a06-4ef1-b79b-88e0acb6c5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dea6e3c35a499a83b65b7badd66683)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:12.511560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7163-6a06-4ef1-b79b-88e0acb6c5a9 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:12.514647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 605/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Jul 11 14:32:12 2022] GET /identity/v3/projects/b1dea6e3c35a499a83b65b7badd66683 => generated 361 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:12.521246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:12.613998 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:12.631505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4ab19-5578-4d02-86b4-96b69abba07a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:12.673447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:12.674113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:12.674398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:12.674701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:12.675542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=b1dea6e3c35a499a83b65b7badd66683, user.id=9c1826db84074d7b9f2a17bcb6b10f87) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:32:12.675854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:12.677306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4daa-c8d8-4de3-894d-0d99de385450 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:12.684184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 595/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:32:12 2022] GET /identity/v3/role_assignments?user.id=9c1826db84074d7b9f2a17bcb6b10f87&scope.project.id=b1dea6e3c35a499a83b65b7badd66683&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:32:22.496581 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:22.681704 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=25 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.158113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0961f-27c5-457c-857b-f540b3361b1f None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.158965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0961f-27c5-457c-857b-f540b3361b1f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.158965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0961f-27c5-457c-857b-f540b3361b1f None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.160427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 606/1201] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:14.169061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.169061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.169061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.187567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:14.189121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:14.288697 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 596/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:14.317912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0961f-27c5-457c-857b-f540b3361b1f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.467978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0961f-27c5-457c-857b-f540b3361b1f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.525404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.526388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.526812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.527142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.549200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.550858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:14.573549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:14.574735 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:14.575757 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:14.575757 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:14.575757 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:14.575757 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:14.578662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 607/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:14.586266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.734265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f5fe8-5033-425d-940b-587f8ddbef7b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.775841 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.788537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.789338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.789653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.789967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.790855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:14.791256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.793288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2355a-ec36-4877-95d0-8218e757f206 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.814550 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 597/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:14.816788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.901138 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.959414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d437f3b-74df-4531-941a-4ffc7914852e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.003834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c38c37-1989-4295-8f0d-cf33d6a7b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.004579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38c37-1989-4295-8f0d-cf33d6a7b0fc None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.004858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38c37-1989-4295-8f0d-cf33d6a7b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.005129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38c37-1989-4295-8f0d-cf33d6a7b0fc None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.005837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c38c37-1989-4295-8f0d-cf33d6a7b0fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.007525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c38c37-1989-4295-8f0d-cf33d6a7b0fc None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.042545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 608/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Jul 11 14:33:14 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:17.542758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6ce31-fb3d-476b-b087-95519dea64fe None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.543350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6ce31-fb3d-476b-b087-95519dea64fe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.543350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6ce31-fb3d-476b-b087-95519dea64fe None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.544957 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 598/1206] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:17.551659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.551659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.551659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:17.574583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:17.575822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:17.696400 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 609/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:17.724323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6ce31-fb3d-476b-b087-95519dea64fe None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:17.933251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6ce31-fb3d-476b-b087-95519dea64fe None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:17.983279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:17.984052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:17.984367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:17.984651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.001336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:18.010059 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:18.011397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:18.017921 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 599/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:18.019521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.088145 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.199065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9494000-5cc5-4adc-a28e-d9e4594be38b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.277641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.278656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.279408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.280381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.280502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:18.280815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:18.282350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:18.292198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 610/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:18.298846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.395675 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.477581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51de92-8d95-4682-b385-6e5afebfec97 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.531756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.533168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.533168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.533168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.545693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:18.550348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:18.567811 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:18.577529 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:18.579439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:18.579439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:18.579439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:18.579439 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:18.579439 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 600/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:18.580001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.742546 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.745571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3091f7c-2aca-431e-bc54-d7ea87ffe1c4 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.797783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.797783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.797783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.797783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.805556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:18.805556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:18.805556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:18.819630 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 611/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:18.825368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.026577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263162-8a9a-4231-99fb-1c3cdb1dd61f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.030549 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.090826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.091202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.092884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.092884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.109217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.112162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:19.141692 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:19.143800 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:19.146676 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:19.149280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 601/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:19.154537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.335442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a100e-6f39-401c-b09c-5d65abb33049 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.384102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.385428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.385428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.385721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.387077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:19.387077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.389077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.415114 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 612/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:19.427418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.594965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b64af2-ee00-4d1c-a184-60529061309b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.643149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.644140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.644387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.644728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.689884 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.745731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.748507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.880953 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 602/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:33:19.888969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.910553 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.005816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790d3a-1bc3-4bf2-b7e4-1d5a025d5747 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.044877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.045742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.046112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.046522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.063740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.065276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:20.087025 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:20.088250 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:20.089225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:20.089225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:20.089225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:20.089225 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:20.089225 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 613/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:20.094635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.172693 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.221532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ebce-e350-479c-8db8-0e119baedf25 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.263082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.264511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.264748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.265052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.265858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:20.266291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.267903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.286222 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 603/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:20.288152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.381673 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.422600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3423112-e4ad-49e1-b882-6db1fc050f44 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.467438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.468105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.468392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.468674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.475816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.477273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:20.495542 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:20.496549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:20.497551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 614/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:20.503070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.624212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1d112-9e39-4ede-951f-e111e73b09a4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.651393 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.664878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.665636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.665948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.666412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.669303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:20.669973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.671653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62707-3918-428e-b281-c5acb5386a53 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.689296 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 604/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:20.697027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:20.823810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8947f5-c0a9-4524-8767-b85abdb4beb1 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:20.859471 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:20.866938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:20.867677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:20.868021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:20.868361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:20.869258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=d54b9488fd1442f188054731e089bfc5) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:20.869673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:20.871232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcf2bc-2d8e-48da-910e-be7a88b3c021 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:20.879033 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 615/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:20 2022] GET /identity/v3/role_assignments?user.id=d54b9488fd1442f188054731e089bfc5&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:23.075258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4fd3-98a9-4a94-a3cb-87774d49c79d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.075922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4fd3-98a9-4a94-a3cb-87774d49c79d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.075922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4fd3-98a9-4a94-a3cb-87774d49c79d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.077280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 605/1220] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:23.085150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.085961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.085961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.105207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:23.106405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:23.188893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 616/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:23.213899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4fd3-98a9-4a94-a3cb-87774d49c79d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.330325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4fd3-98a9-4a94-a3cb-87774d49c79d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.374088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.374943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.375285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.375551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.388281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:23.396722 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:23.398051 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:23.399164 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:23.406527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 606/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:23.406700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.526607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04cb15-ffbd-4d61-bcbb-faa23ed29cab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.564182 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.577680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.578358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.578666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.578941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.579696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:23.579994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.581425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.590408 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 617/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:23.596605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.661029 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:23.734835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3837a-7163-400f-80d8-4c5425cd1c1a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.770976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.771790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.772074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.772350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.786578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.788083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:23.809460 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:23.812088 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:23.813377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:23.813377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:23.813377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:23.813377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:23.813377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 607/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:23.817954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:23.940210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372cd3-9c74-4589-bcc8-58e44973a3f6 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:23.979774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:23.980238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:23.980549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:23.980821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:23.981642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:23.982476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:23.983897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:23.996272 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 618/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:24.003008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:24.107275 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.114430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ded57c-d377-42fb-8861-00be550f1c08 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.152391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.153457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.154300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.154664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.163853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:24.165322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:24.180569 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:24.182169 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:24.183386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 608/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:24.187938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:24.241590 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.326525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13e71c-54a7-455d-8739-8c4fa8e2cd56 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.381086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.381863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.382209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.382620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.383606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:24.384042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:24.385956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:24.407907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 619/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Jul 11 14:33:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:24.414370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:24.555630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046fcb-b685-437c-b48c-e588be6bd363 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.593249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.594184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.594523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.594845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.606308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:24.607822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:24.626695 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:24.628303 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:24.629496 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:24.629496 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:24.629496 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:24.629496 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:24.629496 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 609/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:24.634726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:24.758031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72251b4-cbbf-46dc-8558-5b49aa9fa83d None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.761366 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.804032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.804708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.804976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.805255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.806146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:24.806412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:24.808029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:24.823653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 620/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:24.830148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:24.840479 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.943463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9f26-fc6e-48f5-920e-d2243ec693a0 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.995490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.997063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.998146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.998830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:25.012650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:25.016545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:25.046717 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:25.047891 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:25.049040 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:25.049488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 610/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:25.055221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:25.177007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445ae38-11fe-4879-9bed-bf16d6e84182 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:25.235899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:25.236707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:25.237209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:25.237501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:25.238378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:25.238698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:25.240176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd32c-4b9f-4bff-bc26-be9c9d77d1fb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:25.257130 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 621/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:25.264265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:25.355981 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:25.396682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630ef58-d09a-4e67-bb13-fe70468d60d6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:25.439840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00c152-a5a6-4895-888a-a9b9bb58906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:25.441175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00c152-a5a6-4895-888a-a9b9bb58906b None admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:25.441558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00c152-a5a6-4895-888a-a9b9bb58906b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:25.441945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00c152-a5a6-4895-888a-a9b9bb58906b None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/d54b9488fd1442f188054731e089bfc5/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:25.464698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00c152-a5a6-4895-888a-a9b9bb58906b None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=d54b9488fd1442f188054731e089bfc5, role_id=6a57f6a8aa4a418c86a3c73f97c5d5d0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:25.466452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00c152-a5a6-4895-888a-a9b9bb58906b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:25.482585 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 611/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:25 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/d54b9488fd1442f188054731e089bfc5/roles/6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:27.779276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23acbd4-b8c0-4101-adfc-96049735d810 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.779863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23acbd4-b8c0-4101-adfc-96049735d810 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.780006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23acbd4-b8c0-4101-adfc-96049735d810 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.781520 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 622/1233] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:27.788292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.788826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.788947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.810272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:27.812042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:27.897161 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 612/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:27.924096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23acbd4-b8c0-4101-adfc-96049735d810 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:27.954595 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.054768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23acbd4-b8c0-4101-adfc-96049735d810 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.092181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.093059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.093350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.093629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.105052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:28.113030 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:28.114167 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:28.115063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 623/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Jul 11 14:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:28.120674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.173246 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.236986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb15ee-5892-46e6-9312-4822c3e7f110 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.277515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.277763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.277958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.278244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.279121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:28.279390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.280816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.290835 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 613/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:28.298096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.410431 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.432730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea644-b570-44d6-aee8-b407e8ff3bb3 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.489347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.490899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.491328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.491740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.507953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.509900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:28.530955 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:28.532047 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:28.533168 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:28.533168 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:28.533168 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:28.533168 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:28.533168 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 624/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:28.538363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.654046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27415ef-cbac-4876-ba80-59b9c99dbe4f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.677520 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.720637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.721769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.722263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.722800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.724140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:28.724722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.727256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.744201 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 614/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:28.750539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.869060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9300-e0a6-4593-b211-c2d1e82c0130 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:28.909648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:28.910800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.911076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.911351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.914666 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.925583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:28.928759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:28.950973 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:28.952601 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:28.953824 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 625/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:28.959011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:29.086254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ab49d-dd22-44ca-901a-d216c0bc848b None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:29.126289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:29.127089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:29.127376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:29.127652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:29.128500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:29.128813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:29.130401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:29.151379 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 615/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:29.157999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:29.296397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affd1e4-7ae4-40e5-b63d-c44dd3265138 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:29.350686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:29.351356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:29.351638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:29.351915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:29.443102 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:29.455316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:29.458147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:29.600597 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 626/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:33:29.607782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:29.639475 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:29.747489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f055-9dbc-470e-a4e4-94a0afd1f02f None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:29.795724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:29.796675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:29.796985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:29.797289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:29.811377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:29.812846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:29.836668 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:29.837906 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:29.839406 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:29.839406 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:29.839406 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:29.839406 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:29.839406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 616/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:29.845123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:29.952837 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:29.959102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a56650-d958-4c8b-ac65-6aa783e0589e None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:29.999852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.000536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.000827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.001114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.002050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:30.002402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:30.003972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:30.017575 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 627/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:30.023368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:30.114589 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:30.142246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db561696-e5d0-493f-9cb0-dd0ce31e7eda None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:30.180016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.180818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.181269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.181615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.191086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:30.192694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:30.209890 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:30.215759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:30.217027 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 617/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:30.217721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:30.338642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd5ec-e9a6-4c16-8635-3e03cd834a61 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:30.382065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.382792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.383078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.383356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.384161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:30.384465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:30.385901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2187-8fee-4d7b-b611-1fa3aaa781d8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:30.399549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 628/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:30.405884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:30.525110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682c14-2fee-4ff1-97ff-4d09c2346702 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:30.565704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:30.566416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:30.566722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:30.567006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:30.567852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] RBAC: Adding query filter params (role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=d54b9488fd1442f188054731e089bfc5) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:30.568167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:30.569740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4744b-fd08-4208-aa20-ede97f498d45 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:30.578697 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 618/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:30 2022] GET /identity/v3/role_assignments?user.id=d54b9488fd1442f188054731e089bfc5&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=6a57f6a8aa4a418c86a3c73f97c5d5d0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:32.786206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30db19-cc31-41df-b357-7275ea312512 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.786787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30db19-cc31-41df-b357-7275ea312512 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.787265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30db19-cc31-41df-b357-7275ea312512 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.789001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 629/1247] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:32.795474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.796121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.796121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.801290 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.816586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:32.817899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:32.900625 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 619/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:33:32.925628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30db19-cc31-41df-b357-7275ea312512 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.957031 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.066035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30db19-cc31-41df-b357-7275ea312512 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.107149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.107963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.108304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.108531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.121294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:33.130185 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.131881 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:33.133180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 630/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.138358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.269934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17949408-8d88-4252-b5b6-146cc1a45d9e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.304362 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.310904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.311592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.311887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.312356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.313223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:33.313674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.315843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.326234 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 620/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:33.333557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.426688 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.455488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30890d69-661d-44ef-8631-f3d3709417e7 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.495881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.496778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.497080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.497359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.510965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.513143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:33.536175 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.537323 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.539586 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:33.539586 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:33.539586 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:33.539586 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:33.539586 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 631/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.543933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.666581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d81a8-5279-4e3c-9e38-70aa1681cd5a None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.716332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.717268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.717679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.717947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.718953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:33.719276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.720870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.738532 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 621/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:33.742050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.861155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec978-c130-49a2-9d91-67945de2d1ce None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:33.891126 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.900899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:33.901715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.901992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.902265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.911182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:33.912744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:33.928096 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:33.929811 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:33.931156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 632/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:33.936275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.006722 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.063849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1904d-5d34-4572-b832-948da005fefc None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.109578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.110265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.110635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.110871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.111731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.112045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.113585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.133450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 622/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:34.140025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.267803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357f9e3-fcf8-44ed-96b4-3468c31dd3e8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.307227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.308463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.308994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.310029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.384327 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.399322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.400788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.532483 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 633/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:33:34.538850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.678952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c16a4-2b76-462f-90c0-6923e0f3fde4 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.706108 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.734008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.734954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.735264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.735531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.751191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.752702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:34.772904 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:34.774267 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:34.775428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:34.775428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:34.775428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:34.775428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:34.775428 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 623/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:34.782279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.895911 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.913710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775abc7d-efea-411f-bafb-595ac8ec8d18 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.960620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.961339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.961619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.961897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.962811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:34.963121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.964891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.983417 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 634/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:34.984705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.098820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e1d-4f5f-4928-ba8b-373e232405a8 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.135972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.136776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.137063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.137369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.145222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.146860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:35.161046 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:35.162188 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:35.163335 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 624/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:35.168400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.286011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915615e-f694-427e-a266-843a526fcdfd None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.334107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.336837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.337166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.337754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.339461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:35.340029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.342028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1283b7-7b77-4cb5-9f10-686c9c5699ba None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.360701 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 635/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:35.369932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:35.405411 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.495058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcb909-2a32-4873-a174-532a09842460 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.533833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.534641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.534966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.535256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.536140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=d54b9488fd1442f188054731e089bfc5) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:35.536519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.538173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205404a-c71b-443c-ae32-2bdd051deb48 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.545363 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 625/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:35 2022] GET /identity/v3/role_assignments?user.id=d54b9488fd1442f188054731e089bfc5&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=70eee5d669654151b878064c431c4f7b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:37.673947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de220013-1190-42ea-be8e-703daa16dcae None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.674520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de220013-1190-42ea-be8e-703daa16dcae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.674636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de220013-1190-42ea-be8e-703daa16dcae None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.676521 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 636/1261] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:37.682733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.683295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.683295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.705073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:37.706710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:37.778561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 626/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:33:37.800877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de220013-1190-42ea-be8e-703daa16dcae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.812594 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.906769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de220013-1190-42ea-be8e-703daa16dcae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:37.941073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:37.941784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.942068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.942340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.952473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:37.960169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:37.961237 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:37.962366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 637/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:37.968008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:37.987242 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.068458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d14268-da59-49aa-b202-3f2d2eae7869 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.102582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.103241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.103529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.103806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.104556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.104913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.106250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.114482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 627/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.120245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.188825 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.224164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059997e0-2c3f-4146-95ab-1f5f8f983060 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.257316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.258110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.258422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.258729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.269785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.271365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:38.289123 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.290277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.291258 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:38.291258 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:38.291258 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.291258 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:38.291258 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 638/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.296472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.378251 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.400501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0508a8d-241f-4bf6-8c9c-7351bec920c6 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.434246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.434931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.435221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.435498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.436225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.436534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.437907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.451183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 628/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.457084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.562423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744404e-aaa3-40f5-b5ef-bac69d6f86fe None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.582280 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.597015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.597840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.598120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.598399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.606970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.608421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:38.623252 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.624556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:38.625983 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 639/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.630635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.738021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8de86-9955-49b0-b2d8-6e5fb7a6f217 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.772410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.773074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.773353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.773628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.774465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:38.774806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.776257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.785691 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.795255 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 629/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:38.800959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.900985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b636051-27ca-4298-aeb3-0a91faab21bf None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.934683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.935490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.935768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.936038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.947384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.948832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:38.967300 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:38.968452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:38.969634 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:38.969634 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:38.969634 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:38.969634 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:38.969634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 640/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:38.974262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.080777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fa8fa-f6a9-4dbf-8cce-3e17a59ddabe None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.115132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.115783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.116069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.116347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.117068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.117372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.118772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.130295 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 630/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.135961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.168311 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.241899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5997f2a-2608-4477-b8ad-9c0e0ffa2c1b None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.277511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.278308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.278617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.278892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.285891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.287387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:39.301781 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:39.302935 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:39.303963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 641/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:39.309633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.376174 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.423986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3e00a-bcb0-42b2-86ef-9cd9ddbc6ddb None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.461533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.462206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.462514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.462792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.463600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:39.463912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.465412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6895c9-02f4-4862-b102-38bcb7fd8457 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.478849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 631/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:39.484931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:39.577890 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:39.586984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb690bb-1936-44de-b919-7ecb66f3d832 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:39.622728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84d2c-474e-4e14-a231-4c9606ec2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:39.623638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84d2c-474e-4e14-a231-4c9606ec2fbe None admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:39.623927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84d2c-474e-4e14-a231-4c9606ec2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:39.624202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84d2c-474e-4e14-a231-4c9606ec2fbe None admin] PATH_INFO: `/v3/projects/c300f7d942c043228fb3ede5022dd568/users/d54b9488fd1442f188054731e089bfc5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:39.626183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84d2c-474e-4e14-a231-4c9606ec2fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=c300f7d942c043228fb3ede5022dd568, user_id=d54b9488fd1442f188054731e089bfc5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:39.627669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84d2c-474e-4e14-a231-4c9606ec2fbe None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:39.641378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 642/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Jul 11 14:33:39 2022] PUT /identity/v3/projects/c300f7d942c043228fb3ede5022dd568/users/d54b9488fd1442f188054731e089bfc5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:33:41.676631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb8ea-83e8-439d-9ef5-99473571bf9f None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.677642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb8ea-83e8-439d-9ef5-99473571bf9f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.677642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb8ea-83e8-439d-9ef5-99473571bf9f None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.678721 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 632/1274] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:41.686919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.687981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.687981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.712913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:41.714751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:41.803996 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 643/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:41.828870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beb8ea-83e8-439d-9ef5-99473571bf9f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.979729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beb8ea-83e8-439d-9ef5-99473571bf9f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.005346 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.032403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.033237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.033526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.033799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.048563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:33:42.060614 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:42.062595 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:42.064138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 633/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:42.068886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.195427 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.230894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bed5d-3d78-4fef-a9e8-350ab796f4d9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.284982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.285696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.288079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.288079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.288079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.288079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.289263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.300961 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 644/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:42.308004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.452589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ab297-40c8-4c03-9f3e-06ea60332ab3 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.524277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.525033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.525335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.525747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.541738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.544613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:42.575651 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:42.577658 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:42.579673 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:42.579673 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:42.579673 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:42.579673 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:42.579673 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 634/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:42.588119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.736623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c08a66-18ae-4284-9e31-ce32f3b52ad5 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.780569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.781150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.781433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.781714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.782446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:42.782791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.784185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.798745 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 645/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:42.804706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:42.842917 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.937728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23f8a0-c804-41c6-82c3-1bdaa1916412 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.980028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.980883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.981169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.981964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.990245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.991776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:33:43.008459 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:43.009795 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:43.011821 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 635/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:43.017540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.022233 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.139574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93afd9-9786-474c-9671-da819cf3f671 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.176242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.176915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.177202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.177481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.178341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:43.178693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.180153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.200022 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 646/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:43.205941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.308739 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.322322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f3de-447e-4cdd-990d-867f0afd6a97 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.359134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.360067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.360358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.360640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.431014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.432497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.526572 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.537598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 636/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:33:43.543385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.607094 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:43.646928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96bc75-5083-4fbb-b170-fee658ee05f8 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.691950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.692774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.693059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.693336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.705217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.706750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:33:43.725124 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:43.726354 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:43.727436 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:33:43.727436 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:33:43.727436 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:33:43.727436 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:43.727436 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 647/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:43.732287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:43.842992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554991fd-fdee-405b-9ea0-61566b9c9ec9 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:43.882770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:43.883748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:43.884083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:43.884357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:43.885120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:43.885589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:43.887220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:43.899623 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 637/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:43.906002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.023843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f220d-f2a5-4bfa-8a60-a1e7a4088ff1 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.040882 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.064309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.065115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.065649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.065921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.075345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.077009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:33:44.092617 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:44.093836 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:33:44.094851 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 648/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Jul 11 14:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:44.100224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.153956 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:44.206322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695efd-d1b6-4b86-bc3a-703081f5210d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.240873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.241522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.241805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.242078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.242896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:44.243204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.244648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a6a5-af43-4de4-8da1-fe37d122612e None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.257177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 638/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:44.264497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:44.374792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2553f-4247-4b50-9e3b-7c41c4fcbf19 None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:44.410788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:44.411359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:44.411640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:44.411913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:44.412739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] RBAC: Adding query filter params (role.id=70eee5d669654151b878064c431c4f7b, scope.project.id=c300f7d942c043228fb3ede5022dd568, user.id=d54b9488fd1442f188054731e089bfc5) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:44.413045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:44.414467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339cab-3801-4074-90e7-13f8032c474f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:44.420784 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 649/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Jul 11 14:33:44 2022] GET /identity/v3/role_assignments?user.id=d54b9488fd1442f188054731e089bfc5&scope.project.id=c300f7d942c043228fb3ede5022dd568&role.id=70eee5d669654151b878064c431c4f7b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:46.746274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4aca-5d4b-4aa8-bb9e-c056edcb8be9 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.747118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4aca-5d4b-4aa8-bb9e-c056edcb8be9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.747585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4aca-5d4b-4aa8-bb9e-c056edcb8be9 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.750487 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 639/1288] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:46.757719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:46.758296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:46.758296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:46.777189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:46.778893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:46.811255 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:46.856625 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 650/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:46.879455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4aca-5d4b-4aa8-bb9e-c056edcb8be9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:46.999438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4aca-5d4b-4aa8-bb9e-c056edcb8be9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.012996 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.043564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.044483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.044790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.044938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.045584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.049072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:47.063507 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:47.064561 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:47.066352 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 640/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:33:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:33:47.071452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.198268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002c91f-25d0-4d6b-b7bb-877ff937e854 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.234833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.235506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.235788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.236064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.236780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.237089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.238456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26d23-3d24-4997-a412-2fc695f2e13f None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.243423 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 651/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:47.250373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.362002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85813a-50c7-4bc7-a153-f8cadec7c266 None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.399418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.400143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.400482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.400835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.401554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:47.401858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:47.403852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbb513-b401-449f-810b-3310314120a5 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:47.408799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 641/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:33:49.471939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516215ad-0b71-4e9a-a5e5-d677f9260366 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.472476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516215ad-0b71-4e9a-a5e5-d677f9260366 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.472476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516215ad-0b71-4e9a-a5e5-d677f9260366 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.473854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 652/1293] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:49.479134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4c23-079c-4b64-b14f-703e8e529d4f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.479562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4c23-079c-4b64-b14f-703e8e529d4f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.479691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4c23-079c-4b64-b14f-703e8e529d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.498285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cc0b4c23-079c-4b64-b14f-703e8e529d4f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:49.499570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cc0b4c23-079c-4b64-b14f-703e8e529d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:49.530344 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.571746 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 642/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:49.596768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516215ad-0b71-4e9a-a5e5-d677f9260366 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:49.630351 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:49.720783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516215ad-0b71-4e9a-a5e5-d677f9260366 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:49.768581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c7385-28e7-4f31-b7c5-7c697caf0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:49.769433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c7385-28e7-4f31-b7c5-7c697caf0cbb None admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:49.769902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c7385-28e7-4f31-b7c5-7c697caf0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:49.770333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c7385-28e7-4f31-b7c5-7c697caf0cbb None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:49.771242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c7385-28e7-4f31-b7c5-7c697caf0cbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:49.772935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c7385-28e7-4f31-b7c5-7c697caf0cbb None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:49.787278 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 653/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Jul 11 14:33:49 2022] POST /identity/v3/services => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:33:51.902120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d980-d1f4-4007-a5a7-c7b96cbac6db None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.902841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d980-d1f4-4007-a5a7-c7b96cbac6db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.902841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d980-d1f4-4007-a5a7-c7b96cbac6db None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.904203 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 643/1296] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:51.909605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:51.910034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:51.910169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:51.927631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:51.928846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:52.010560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 654/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:52.034114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d980-d1f4-4007-a5a7-c7b96cbac6db None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.143343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d980-d1f4-4007-a5a7-c7b96cbac6db None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.178272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.179025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.179407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.179720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.180393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.181777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:52.194831 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:52.196083 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:52.197328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 644/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:52.203472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.223442 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.309496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3ea76-b40c-450a-855c-a4ff4d3e7266 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.345985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.346693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.346981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.347258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.347968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:52.348275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.349638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.356473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 655/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:52.366331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.419876 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.495962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bfdd3-c767-4eb6-8c43-8ca8c553556c None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.536091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.536748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.537031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.537304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.538109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] RBAC: Adding query filter params (interface=public, service_id=0f309b7d3d894003be8d7557913dbd91, region_id=RegionOne) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:52.538617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.540073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ae89d-8a4b-4022-9e79-2b04cbec8102 None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.545828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 645/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/endpoints?service_id=0f309b7d3d894003be8d7557913dbd91&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:52.551914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.638981 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.660674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0a7f-c9cb-41fd-b9e4-e349b142d2cd None admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:52.703016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d619b2-0b3b-47b7-b90d-700bdc01ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:52.703817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d619b2-0b3b-47b7-b90d-700bdc01ab29 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.704151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d619b2-0b3b-47b7-b90d-700bdc01ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.704431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d619b2-0b3b-47b7-b90d-700bdc01ab29 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.705135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d619b2-0b3b-47b7-b90d-700bdc01ab29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:52.706555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d619b2-0b3b-47b7-b90d-700bdc01ab29 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:52.714238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 656/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:33:54.791971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27468fa-51c8-4bf9-9c0f-664ae4a9c220 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.793080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27468fa-51c8-4bf9-9c0f-664ae4a9c220 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.793080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27468fa-51c8-4bf9-9c0f-664ae4a9c220 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.794456 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 646/1302] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:54.800060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:54.800515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:54.800607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:54.817812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:54.819050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:54.887030 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 657/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:33:54.911639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27468fa-51c8-4bf9-9c0f-664ae4a9c220 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.013184 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.020457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27468fa-51c8-4bf9-9c0f-664ae4a9c220 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.057383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.058221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.058543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.058823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.059485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.060875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:33:55.073157 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:33:55.074534 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 14:33:55.075421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 647/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Jul 11 14:33:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:33:55.080804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.159635 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.184349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e894f-3824-4ac7-9379-569e7ad5d5b9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.220064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.220743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.221030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.221306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.222021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:33:55.222893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.223746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e9ff7-f92a-48bb-86c4-9a9343397718 None admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.229650 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 658/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:33:55.235670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.341598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297b0f-70d3-462c-85c7-8e731e73570d None admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.378509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c702-30fe-4000-bd94-4b1c7b8c2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.379186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c702-30fe-4000-bd94-4b1c7b8c2e2b None admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.379465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c702-30fe-4000-bd94-4b1c7b8c2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.379739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c702-30fe-4000-bd94-4b1c7b8c2e2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.380523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c702-30fe-4000-bd94-4b1c7b8c2e2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.381860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c702-30fe-4000-bd94-4b1c7b8c2e2b None admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:55.401065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 648/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Jul 11 14:33:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:34:05.225951 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=30 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.396504 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:02.881875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f92df-1902-4099-87af-07b2ec1b3026 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.883670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f92df-1902-4099-87af-07b2ec1b3026 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.884248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f92df-1902-4099-87af-07b2ec1b3026 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.890836 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 659/1307] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:02.892177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717df9b-7b49-4f96-96b8-aa6dbd78ec76 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.893035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717df9b-7b49-4f96-96b8-aa6dbd78ec76 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.893466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717df9b-7b49-4f96-96b8-aa6dbd78ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.978675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7717df9b-7b49-4f96-96b8-aa6dbd78ec76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:02.980501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7717df9b-7b49-4f96-96b8-aa6dbd78ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:03.119030 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 649/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:03.156643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88729e-5570-44bc-9e2a-9d7531f579be None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:03.156975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88729e-5570-44bc-9e2a-9d7531f579be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:03.157211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88729e-5570-44bc-9e2a-9d7531f579be None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:03.158932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 660/1309] 10.222.0.77 () {54 vars in 964 bytes} [Mon Jul 11 14:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:03.166743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541fd0-12aa-4e70-83b3-3b1d67d4a60f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:03.167538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541fd0-12aa-4e70-83b3-3b1d67d4a60f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:03.168037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541fd0-12aa-4e70-83b3-3b1d67d4a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:03.344577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-03541fd0-12aa-4e70-83b3-3b1d67d4a60f None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:03.348380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-03541fd0-12aa-4e70-83b3-3b1d67d4a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:03.404755 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:03.501647 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 650/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Jul 11 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:35:03.511472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88729e-5570-44bc-9e2a-9d7531f579be None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:03.513604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd88729e-5570-44bc-9e2a-9d7531f579be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:03.670612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88729e-5570-44bc-9e2a-9d7531f579be None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:03.759384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:03.760042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:03.760327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:03.760596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:03.762262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:03.852536 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:03.946418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:03.947925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe3b34-e624-44a2-9c0c-3b6ebf4a2dbb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:03.971363 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 661/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:06.406619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd328b77-66f1-4398-94a0-43c8a9819459 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:06.407213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd328b77-66f1-4398-94a0-43c8a9819459 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:06.407213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd328b77-66f1-4398-94a0-43c8a9819459 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:06.408954 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 651/1312] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:06.415462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828ed4-b2be-41db-80f3-be640662d6f2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:06.416015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828ed4-b2be-41db-80f3-be640662d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:06.416319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828ed4-b2be-41db-80f3-be640662d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:06.526796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-91828ed4-b2be-41db-80f3-be640662d6f2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:06.529198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-91828ed4-b2be-41db-80f3-be640662d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:06.675466 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 662/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:06.733404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd328b77-66f1-4398-94a0-43c8a9819459 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:06.735611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cd328b77-66f1-4398-94a0-43c8a9819459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:06.886601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd328b77-66f1-4398-94a0-43c8a9819459 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:06.980868 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:06.983841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:06.984769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:06.985274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:06.985909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:06.987745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:07.115311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:07.116441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d1946-44de-4a2d-bcad-07938feb6980 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:07.146461 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 652/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:09.581537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d753a-40f8-4e01-94d8-0e42479ad04a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:09.582124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d753a-40f8-4e01-94d8-0e42479ad04a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:09.582124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d753a-40f8-4e01-94d8-0e42479ad04a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:09.583526 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 663/1315] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:09.588907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b064-9bdf-4652-8a05-003be6d03e18 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:09.589332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b064-9bdf-4652-8a05-003be6d03e18 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:09.589447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b064-9bdf-4652-8a05-003be6d03e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:09.656928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1cb5b064-9bdf-4652-8a05-003be6d03e18 None None] MFA Rules not processed for user `cf3043f1a63b4881b1c42ef97ac8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:09.658204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1cb5b064-9bdf-4652-8a05-003be6d03e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:09.712783 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:09.761017 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 653/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:09.801408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d753a-40f8-4e01-94d8-0e42479ad04a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:09.803025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-878d753a-40f8-4e01-94d8-0e42479ad04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:09.813248 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:09.918780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d753a-40f8-4e01-94d8-0e42479ad04a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:09.994507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:09.995167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:09.995453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:09.995730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:09.997396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:10.067073 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:10.116456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:10.117900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390fce2-2166-450b-a70f-45cef06efdc7 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:10.137754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 664/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:12.811594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904593de-fbb8-42c5-8c1d-88af9f0c3d2b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:12.812271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904593de-fbb8-42c5-8c1d-88af9f0c3d2b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:12.812271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904593de-fbb8-42c5-8c1d-88af9f0c3d2b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:12.813902 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 654/1318] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:12.821857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba2e0-318c-4119-8eb3-59f201987fc6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:12.822630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba2e0-318c-4119-8eb3-59f201987fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:12.822630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba2e0-318c-4119-8eb3-59f201987fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:12.888251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bd9ba2e0-318c-4119-8eb3-59f201987fc6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:12.889473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd9ba2e0-318c-4119-8eb3-59f201987fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:12.992631 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 665/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:13.032256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904593de-fbb8-42c5-8c1d-88af9f0c3d2b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:13.034142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-904593de-fbb8-42c5-8c1d-88af9f0c3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:13.140638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904593de-fbb8-42c5-8c1d-88af9f0c3d2b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:13.213722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:13.214368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:13.214734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:13.215016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:13.217001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:13.225537 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:13.329612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:13.331106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16f40-53e7-4649-88a6-515482791881 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:13.349217 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 655/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:16.090945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756801-c15e-496a-9f2d-be5ce62d1e97 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.091584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756801-c15e-496a-9f2d-be5ce62d1e97 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.091584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756801-c15e-496a-9f2d-be5ce62d1e97 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.092872 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 666/1321] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:16.098186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63024-d13c-4dd5-b886-05ae5e7a72e0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.098683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63024-d13c-4dd5-b886-05ae5e7a72e0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.098780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63024-d13c-4dd5-b886-05ae5e7a72e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.166954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-10b63024-d13c-4dd5-b886-05ae5e7a72e0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:16.168160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-10b63024-d13c-4dd5-b886-05ae5e7a72e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:16.228684 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.270787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 656/1322] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:16.308319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95756801-c15e-496a-9f2d-be5ce62d1e97 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:16.309924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-95756801-c15e-496a-9f2d-be5ce62d1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:16.342394 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.443052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95756801-c15e-496a-9f2d-be5ce62d1e97 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:16.536945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:16.542175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.542466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.542766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.544495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:16.629035 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.676815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:16.678808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dda76-92f2-4d40-8dba-047f258b4eaf service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:16.698695 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 667/1323] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:18.828978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c588e3-9aa5-4a06-8ddc-77de064c44bd None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:18.829568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c588e3-9aa5-4a06-8ddc-77de064c44bd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:18.829568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c588e3-9aa5-4a06-8ddc-77de064c44bd None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:18.831388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 657/1324] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:18.837834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37362a-3484-407b-95f1-a3c91b2349d6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:18.838538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37362a-3484-407b-95f1-a3c91b2349d6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:18.838538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37362a-3484-407b-95f1-a3c91b2349d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:18.932698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ed37362a-3484-407b-95f1-a3c91b2349d6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:18.933930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ed37362a-3484-407b-95f1-a3c91b2349d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.046847 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 668/1325] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:19.083191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c588e3-9aa5-4a06-8ddc-77de064c44bd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:19.085243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0c588e3-9aa5-4a06-8ddc-77de064c44bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.221786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c588e3-9aa5-4a06-8ddc-77de064c44bd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:19.324275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:19.324941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.325230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.325517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.327344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.346918 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:19.468419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:19.469865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b3c0a-a679-45a6-88a3-84876fae0181 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:19.495456 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 658/1326] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:21.654311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef228-1b69-45dc-b0d8-a61ac702d6bd None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:21.654940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef228-1b69-45dc-b0d8-a61ac702d6bd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:21.654940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef228-1b69-45dc-b0d8-a61ac702d6bd None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:21.656218 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 669/1327] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:21.662936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559028ce-b8fd-4e02-8440-513eb3c7cb87 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:21.663448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559028ce-b8fd-4e02-8440-513eb3c7cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:21.663964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559028ce-b8fd-4e02-8440-513eb3c7cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:21.740827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-559028ce-b8fd-4e02-8440-513eb3c7cb87 None None] MFA Rules not processed for user `cf3043f1a63b4881b1c42ef97ac8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:21.742064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-559028ce-b8fd-4e02-8440-513eb3c7cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:21.819215 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:21.853007 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 659/1328] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:21.891127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef228-1b69-45dc-b0d8-a61ac702d6bd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:21.892653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb2ef228-1b69-45dc-b0d8-a61ac702d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:21.924984 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.004495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef228-1b69-45dc-b0d8-a61ac702d6bd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:22.088388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:22.089036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:22.089317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:22.089602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:22.091290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:22.197561 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:22.236080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:22.237644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714abf9-5417-4c13-a7cd-f8929ce27f2f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:22.260098 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 670/1329] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:24.590130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091caaa9-1ca8-4b80-a4bd-b03bd4de8c69 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:24.590758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091caaa9-1ca8-4b80-a4bd-b03bd4de8c69 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:24.590758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091caaa9-1ca8-4b80-a4bd-b03bd4de8c69 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:24.592109 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 660/1330] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:24.597683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e1834-b8ab-41b6-88ae-8f602941f28f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:24.598197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e1834-b8ab-41b6-88ae-8f602941f28f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:24.598309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e1834-b8ab-41b6-88ae-8f602941f28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:24.664913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ad5e1834-b8ab-41b6-88ae-8f602941f28f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:24.666134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad5e1834-b8ab-41b6-88ae-8f602941f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:24.767798 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 671/1331] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:35:24.803974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091caaa9-1ca8-4b80-a4bd-b03bd4de8c69 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:24.805508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-091caaa9-1ca8-4b80-a4bd-b03bd4de8c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:24.917116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091caaa9-1ca8-4b80-a4bd-b03bd4de8c69 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:25.000735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:25.001391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:25.001806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:25.002034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:25.004071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:25.033125 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:25.124993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:25.126352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd27f0b-6337-4d00-8d04-0fd54843dd6f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:25.145077 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 661/1332] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:27.304042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f58673-5b34-4bed-a0d7-fb7258e23c26 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.304585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f58673-5b34-4bed-a0d7-fb7258e23c26 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.304585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f58673-5b34-4bed-a0d7-fb7258e23c26 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.305959 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 672/1333] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:27.311259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213fc7f-0a59-4819-b154-e7e666047684 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.311688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213fc7f-0a59-4819-b154-e7e666047684 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.311834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213fc7f-0a59-4819-b154-e7e666047684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.377430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6213fc7f-0a59-4819-b154-e7e666047684 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:27.378670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6213fc7f-0a59-4819-b154-e7e666047684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:27.452545 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:27.478851 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 662/1334] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:27.533414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc8c0-aacb-445f-9463-a7dc8040bef1 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.533698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc8c0-aacb-445f-9463-a7dc8040bef1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.533978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc8c0-aacb-445f-9463-a7dc8040bef1 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.535392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 673/1335] 10.222.0.77 () {54 vars in 964 bytes} [Mon Jul 11 14:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:27.541665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d8ff3-4c36-4808-8251-d781dc713be3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.541974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d8ff3-4c36-4808-8251-d781dc713be3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.542255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d8ff3-4c36-4808-8251-d781dc713be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.621348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-360d8ff3-4c36-4808-8251-d781dc713be3 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:27.622478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-360d8ff3-4c36-4808-8251-d781dc713be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:27.700848 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 663/1336] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Jul 11 14:35:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:27.711562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc8c0-aacb-445f-9463-a7dc8040bef1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:27.713149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23fbc8c0-aacb-445f-9463-a7dc8040bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:27.758112 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:27.826164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc8c0-aacb-445f-9463-a7dc8040bef1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:27.904290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:27.904946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:27.905233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:27.905512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:27.907229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:27.992938 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:28.019267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:28.020711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82fa26-a73e-4f1b-b47f-27e6cf2a6be1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:28.039589 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 674/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:30.979407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac12ed-93aa-4b3c-8c3c-66ff8b5cecc4 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:30.980004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac12ed-93aa-4b3c-8c3c-66ff8b5cecc4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:30.980004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac12ed-93aa-4b3c-8c3c-66ff8b5cecc4 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:30.981361 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 664/1338] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:30.987053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d87a6-9c47-4da0-856a-6f1ccbb4ff80 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:30.987513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d87a6-9c47-4da0-856a-6f1ccbb4ff80 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:30.987609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d87a6-9c47-4da0-856a-6f1ccbb4ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:31.055129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-914d87a6-9c47-4da0-856a-6f1ccbb4ff80 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:31.056123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-914d87a6-9c47-4da0-856a-6f1ccbb4ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:31.157391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 675/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:31.194791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac12ed-93aa-4b3c-8c3c-66ff8b5cecc4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:31.196362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-faac12ed-93aa-4b3c-8c3c-66ff8b5cecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:31.274220 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:31.303696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac12ed-93aa-4b3c-8c3c-66ff8b5cecc4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:31.378808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:31.379455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:31.379740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:31.380017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:31.381720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:31.499500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:31.500961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a91b5b-6c10-48d2-8ff2-f73fb87af27a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:31.521104 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 665/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:35.823064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31da854-4464-4810-ad28-64c451462655 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:35.823831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31da854-4464-4810-ad28-64c451462655 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:35.823831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31da854-4464-4810-ad28-64c451462655 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:35.825193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 676/1341] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:35.831040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde87d2-678f-4995-91b3-a34e9ebb59da None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:35.831537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde87d2-678f-4995-91b3-a34e9ebb59da None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:35.831629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde87d2-678f-4995-91b3-a34e9ebb59da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:35.836532 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:35.902891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5bde87d2-678f-4995-91b3-a34e9ebb59da None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:35.904119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5bde87d2-678f-4995-91b3-a34e9ebb59da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:36.007890 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 666/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:36.047274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31da854-4464-4810-ad28-64c451462655 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:36.048905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d31da854-4464-4810-ad28-64c451462655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:36.101036 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:36.159599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31da854-4464-4810-ad28-64c451462655 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:36.237096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:36.237748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:36.238029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:36.238336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:36.240531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:36.353022 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:36.372518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:36.373964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe082677-125b-4b11-b06c-4baee27a5ca1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:36.393673 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 677/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:39.133116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652fa6-547f-48dc-bf59-77eaca093faa None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.133644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652fa6-547f-48dc-bf59-77eaca093faa None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.133644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652fa6-547f-48dc-bf59-77eaca093faa None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.135083 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 667/1344] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:39.141056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc62f83-fe7a-42b1-8912-d50640cdce01 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.141617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc62f83-fe7a-42b1-8912-d50640cdce01 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.141617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc62f83-fe7a-42b1-8912-d50640cdce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.223510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ccc62f83-fe7a-42b1-8912-d50640cdce01 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:39.225315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ccc62f83-fe7a-42b1-8912-d50640cdce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.334807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 678/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:39.379486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652fa6-547f-48dc-bf59-77eaca093faa None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:39.381090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14652fa6-547f-48dc-bf59-77eaca093faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.474590 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:39.494901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652fa6-547f-48dc-bf59-77eaca093faa None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:39.573590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:39.574242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.574641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.574922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.577104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.705106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:39.707783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2df53-cb63-4bfb-bcc5-032904b506d8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:39.743494 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 668/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:43.834837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77e1c-7e83-4cd3-b881-702aec3dc3e1 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:43.835482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77e1c-7e83-4cd3-b881-702aec3dc3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:43.835482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77e1c-7e83-4cd3-b881-702aec3dc3e1 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:43.836779 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 679/1347] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:43.842284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7614-f43a-4ae1-992a-2c105f03c3e2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:43.842804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7614-f43a-4ae1-992a-2c105f03c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:43.842904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7614-f43a-4ae1-992a-2c105f03c3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:43.858450 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:43.924579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9e1c7614-f43a-4ae1-992a-2c105f03c3e2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:43.925797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e1c7614-f43a-4ae1-992a-2c105f03c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:44.063422 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 669/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:44.103403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce77e1c-7e83-4cd3-b881-702aec3dc3e1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:44.105010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3ce77e1c-7e83-4cd3-b881-702aec3dc3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:44.176706 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:44.228568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce77e1c-7e83-4cd3-b881-702aec3dc3e1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:44.313520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:44.314194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:44.314481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:44.314802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:44.317489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:44.443373 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:44.447546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:44.449777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74144-9809-419d-934e-ff10ab0a2020 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:44.473433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 680/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:49.586642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a351-2e81-4d88-9e05-424e319eeaec None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:49.587096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a351-2e81-4d88-9e05-424e319eeaec None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:49.587417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a351-2e81-4d88-9e05-424e319eeaec None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:49.590260 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 670/1350] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:35:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:49.600891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2058-88ff-4375-bd41-ba532b6094d4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:49.600891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2058-88ff-4375-bd41-ba532b6094d4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:49.600891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2058-88ff-4375-bd41-ba532b6094d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:49.706263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ad9b2058-88ff-4375-bd41-ba532b6094d4 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:49.716044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad9b2058-88ff-4375-bd41-ba532b6094d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:49.876936 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 681/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:35:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:54.060910 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=59 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:54.666096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0e7d-0b70-4420-b588-ff8de371dc87 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:54.666442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0e7d-0b70-4420-b588-ff8de371dc87 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:54.666970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0e7d-0b70-4420-b588-ff8de371dc87 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:54.668836 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 671/1352] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:54.674399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a180e-39e1-47cb-acce-7acbaa6fa560 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:54.674945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a180e-39e1-47cb-acce-7acbaa6fa560 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:54.675211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a180e-39e1-47cb-acce-7acbaa6fa560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:54.735383 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:54.765234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e30a180e-39e1-47cb-acce-7acbaa6fa560 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:54.766531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e30a180e-39e1-47cb-acce-7acbaa6fa560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:54.900329 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 682/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:35:56.257676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4ebc-4494-4c6f-8c7e-49370625bfc0 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:56.258207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4ebc-4494-4c6f-8c7e-49370625bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:56.258342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4ebc-4494-4c6f-8c7e-49370625bfc0 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:56.259840 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 672/1354] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:56.265227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2502-10eb-47cf-ab88-fb5ac20ed8bb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:56.265770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2502-10eb-47cf-ab88-fb5ac20ed8bb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:56.265770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2502-10eb-47cf-ab88-fb5ac20ed8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:56.362232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-947e2502-10eb-47cf-ab88-fb5ac20ed8bb None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:56.363409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-947e2502-10eb-47cf-ab88-fb5ac20ed8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:56.407700 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:56.481989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 683/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:59.773665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4435-2646-4e30-af65-98b3fc913742 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:59.774979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4435-2646-4e30-af65-98b3fc913742 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:59.775498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4435-2646-4e30-af65-98b3fc913742 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:59.777665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 673/1356] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:35:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:59.783837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9aa4a-9c4f-4064-bee6-931fa4f17499 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:59.784317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9aa4a-9c4f-4064-bee6-931fa4f17499 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:59.784317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9aa4a-9c4f-4064-bee6-931fa4f17499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:59.889988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-97b9aa4a-9c4f-4064-bee6-931fa4f17499 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:59.891465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97b9aa4a-9c4f-4064-bee6-931fa4f17499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:00.015333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 684/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:00.070400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8984-7aab-49a3-8218-bfac62b01df0 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:00.070990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8984-7aab-49a3-8218-bfac62b01df0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:00.071482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8984-7aab-49a3-8218-bfac62b01df0 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:00.073360 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 674/1358] 10.222.0.77 () {54 vars in 961 bytes} [Mon Jul 11 14:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:00.080254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2de19-204a-42e3-a29e-1d619e0a36b3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:00.080695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2de19-204a-42e3-a29e-1d619e0a36b3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:00.081416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2de19-204a-42e3-a29e-1d619e0a36b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:00.105581 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:00.180266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e8a2de19-204a-42e3-a29e-1d619e0a36b3 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:00.181528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e8a2de19-204a-42e3-a29e-1d619e0a36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:00.318867 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 685/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Jul 11 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:00.323576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8984-7aab-49a3-8218-bfac62b01df0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:00.325093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc9a8984-7aab-49a3-8218-bfac62b01df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:00.493281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8984-7aab-49a3-8218-bfac62b01df0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:00.579497 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:00.626783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:00.627442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:00.627728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:00.628003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:00.629816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:00.739854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:00.741510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dbe8d-233d-49d4-a8fe-e7a52a45e19c service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:00.763835 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 675/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:03.220972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7ed3-cbdc-416c-a29b-6ca313b9b3c2 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:03.221506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7ed3-cbdc-416c-a29b-6ca313b9b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:03.221584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7ed3-cbdc-416c-a29b-6ca313b9b3c2 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:03.223245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 686/1361] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:03.229168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982625c-3fdb-4604-9955-f6f5cf2dface None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:03.229641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982625c-3fdb-4604-9955-f6f5cf2dface None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:03.230039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982625c-3fdb-4604-9955-f6f5cf2dface None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:03.350368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d982625c-3fdb-4604-9955-f6f5cf2dface None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:03.351616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d982625c-3fdb-4604-9955-f6f5cf2dface None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:03.412386 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:03.502128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 676/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:03.549044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7ed3-cbdc-416c-a29b-6ca313b9b3c2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:03.550592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2abb7ed3-cbdc-416c-a29b-6ca313b9b3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:03.640369 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:03.741105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7ed3-cbdc-416c-a29b-6ca313b9b3c2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:03.877852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:03.878533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:03.878823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:03.879103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:03.881337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:03.913000 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:04.011757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:04.013413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3c9f1-eeea-4342-b460-bf08cced47c7 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:04.034181 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 687/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:06.467465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e491-b35c-4dd1-b2e7-f5e35e0f6802 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:06.468107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e491-b35c-4dd1-b2e7-f5e35e0f6802 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:06.468107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e491-b35c-4dd1-b2e7-f5e35e0f6802 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:06.469467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 677/1364] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:06.475516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed7410-883b-47bb-8d0a-daf81044ae30 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:06.476072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed7410-883b-47bb-8d0a-daf81044ae30 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:06.476244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed7410-883b-47bb-8d0a-daf81044ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:06.572272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-30ed7410-883b-47bb-8d0a-daf81044ae30 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:06.574901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-30ed7410-883b-47bb-8d0a-daf81044ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:06.712624 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:06.722717 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 688/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:36:06.765741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76bf6c-d308-4822-9431-2d84d25b72cd None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:06.766486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76bf6c-d308-4822-9431-2d84d25b72cd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:06.767136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76bf6c-d308-4822-9431-2d84d25b72cd None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:06.769012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 678/1366] 10.222.0.77 () {54 vars in 961 bytes} [Mon Jul 11 14:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:06.777799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8766-02d3-424d-bf8c-ec88bc8ca20d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:06.778173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8766-02d3-424d-bf8c-ec88bc8ca20d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:06.778660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8766-02d3-424d-bf8c-ec88bc8ca20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:06.883984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-728c8766-02d3-424d-bf8c-ec88bc8ca20d None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:06.885238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-728c8766-02d3-424d-bf8c-ec88bc8ca20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:07.081020 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 689/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Jul 11 14:36:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:07.090281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76bf6c-d308-4822-9431-2d84d25b72cd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:07.092328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ef76bf6c-d308-4822-9431-2d84d25b72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:07.281521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76bf6c-d308-4822-9431-2d84d25b72cd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:07.320605 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:07.481016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:07.482455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:07.483026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:07.483380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:07.485182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:07.588538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:07.590140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da9d3-557d-4192-a030-65677b8a6446 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:07.614008 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 679/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:10.136562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9572-2528-48e7-867c-ca14ad7305e4 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:10.137065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9572-2528-48e7-867c-ca14ad7305e4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:10.137159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9572-2528-48e7-867c-ca14ad7305e4 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:10.138728 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 690/1369] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:10.146029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e813-2d2d-4598-a243-018df4b59275 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:10.146481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e813-2d2d-4598-a243-018df4b59275 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:10.146771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e813-2d2d-4598-a243-018df4b59275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:10.194229 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:10.248237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-07a7e813-2d2d-4598-a243-018df4b59275 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:10.249657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-07a7e813-2d2d-4598-a243-018df4b59275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:10.373789 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 680/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:10.425972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb9572-2528-48e7-867c-ca14ad7305e4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:10.427610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fccb9572-2528-48e7-867c-ca14ad7305e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:10.493454 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:10.625242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb9572-2528-48e7-867c-ca14ad7305e4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:10.778340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:10.779790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:10.780325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:10.780820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:10.783593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:10.794899 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:10.911825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:10.913498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d83e57-4826-4ecc-9ee0-9710702d1fa1 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:10.949449 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 691/1371] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:12.255112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5f34-687e-4513-9ea5-54a3f48d32e2 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:12.255973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5f34-687e-4513-9ea5-54a3f48d32e2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:12.255973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5f34-687e-4513-9ea5-54a3f48d32e2 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:12.257044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 681/1372] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:12.262589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4353d-5688-4f54-8597-4cdcdb9610e4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:12.263086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4353d-5688-4f54-8597-4cdcdb9610e4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:12.263214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4353d-5688-4f54-8597-4cdcdb9610e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:12.344597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dba4353d-5688-4f54-8597-4cdcdb9610e4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:12.345744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dba4353d-5688-4f54-8597-4cdcdb9610e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:12.441223 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:12.466593 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 692/1373] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:12.777586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebde9-bccb-4f0a-b840-8cb880210694 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:12.777825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebde9-bccb-4f0a-b840-8cb880210694 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:12.778302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebde9-bccb-4f0a-b840-8cb880210694 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:12.779988 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 682/1374] 10.222.0.77 () {54 vars in 963 bytes} [Mon Jul 11 14:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:12.785015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d87de-abd7-4092-a21d-1715a84bac3e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:12.785398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d87de-abd7-4092-a21d-1715a84bac3e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:12.785770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d87de-abd7-4092-a21d-1715a84bac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:12.874529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d83d87de-abd7-4092-a21d-1715a84bac3e None None] MFA Rules not processed for user `66a3753891494abd84fa3c9c17c1b455`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:12.875801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d83d87de-abd7-4092-a21d-1715a84bac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:12.978676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 693/1375] 10.222.0.77 () {58 vars in 1060 bytes} [Mon Jul 11 14:36:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:12.988455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebde9-bccb-4f0a-b840-8cb880210694 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:12.992232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ac5ebde9-bccb-4f0a-b840-8cb880210694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:13.145479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebde9-bccb-4f0a-b840-8cb880210694 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:13.150330 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:13.254961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:13.256068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:13.257130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:13.257623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:13.260918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:13.461329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5eb97-70dc-448c-a8bb-0ab7f3daebd3 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:13.462046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5eb97-70dc-448c-a8bb-0ab7f3daebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:13.462346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5eb97-70dc-448c-a8bb-0ab7f3daebd3 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:13.464745 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 694/1376] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:13.465164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:13.467996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:13.473058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eb470-c5fa-497c-830d-b7489c9aea5e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:13.474029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eb470-c5fa-497c-830d-b7489c9aea5e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:13.474029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eb470-c5fa-497c-830d-b7489c9aea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:13.504610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 683/1377] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:13.573958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eb7eb470-c5fa-497c-830d-b7489c9aea5e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:13.575242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb7eb470-c5fa-497c-830d-b7489c9aea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:13.609697 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:13.702892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 695/1378] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:36:13.748377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:13.750914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:13.794980 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:13.866273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a91e7-a717-4505-ae28-caed906b1152 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:14.002703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:14.003526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:14.003891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:14.004374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:14.006484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:14.104870 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:14.194723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:14.197688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a4db3-ab7f-4838-a04e-7310b87b8cf0 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:14.235712 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 684/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:16.510212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7213b48-d303-48d0-a350-c0b00eee8bae None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:16.510825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7213b48-d303-48d0-a350-c0b00eee8bae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:16.511056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7213b48-d303-48d0-a350-c0b00eee8bae None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:16.512626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 696/1380] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:16.518728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff9157-2e2e-4401-87de-4ea941c78dbb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:16.519553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff9157-2e2e-4401-87de-4ea941c78dbb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:16.519983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff9157-2e2e-4401-87de-4ea941c78dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:16.625144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1bff9157-2e2e-4401-87de-4ea941c78dbb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:16.626418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1bff9157-2e2e-4401-87de-4ea941c78dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:16.746653 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 685/1381] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:16.808274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7213b48-d303-48d0-a350-c0b00eee8bae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:16.809855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a7213b48-d303-48d0-a350-c0b00eee8bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:17.067800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7213b48-d303-48d0-a350-c0b00eee8bae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:17.092784 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:17.214340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:17.215477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:17.215967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:17.216493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:17.219310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:17.354419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:17.356008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f42c19-e3cf-4e35-8d73-49072698f5bf service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:17.375045 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 697/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:19.854882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d08fc-5601-4d88-b6ba-c84dc3288287 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:19.855504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d08fc-5601-4d88-b6ba-c84dc3288287 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:19.855653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d08fc-5601-4d88-b6ba-c84dc3288287 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:19.863632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bcf8d-ee71-4913-b141-55ad7b110d7e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:19.864166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bcf8d-ee71-4913-b141-55ad7b110d7e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:19.864166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bcf8d-ee71-4913-b141-55ad7b110d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:19.868135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 686/1383] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:19.888253 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:19.968236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-db8bcf8d-ee71-4913-b141-55ad7b110d7e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:19.969752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-db8bcf8d-ee71-4913-b141-55ad7b110d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:20.094539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 698/1384] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:20.152442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d08fc-5601-4d88-b6ba-c84dc3288287 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:20.154939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1c6d08fc-5601-4d88-b6ba-c84dc3288287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:20.189571 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:20.375238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d08fc-5601-4d88-b6ba-c84dc3288287 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:20.546112 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:20.571160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:20.572238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:20.572734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:20.573252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:20.575234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:20.779227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:20.783048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f62e69-536e-48c5-b3c7-4c610594fa84 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:20.824871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 687/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:23.097674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed1da7-25ca-49a6-bbd9-138011ef69ad None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:23.098365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed1da7-25ca-49a6-bbd9-138011ef69ad None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:23.098365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed1da7-25ca-49a6-bbd9-138011ef69ad None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:23.099654 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 699/1386] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:23.106282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbf30-fe95-4a78-befe-24a1f8a8b483 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:23.106824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbf30-fe95-4a78-befe-24a1f8a8b483 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:23.107184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbf30-fe95-4a78-befe-24a1f8a8b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:23.208615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b24cbf30-fe95-4a78-befe-24a1f8a8b483 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:23.209810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b24cbf30-fe95-4a78-befe-24a1f8a8b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:23.274628 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:23.331584 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 688/1387] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:23.379884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed1da7-25ca-49a6-bbd9-138011ef69ad None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:23.381994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5aed1da7-25ca-49a6-bbd9-138011ef69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:23.521731 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:23.621791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed1da7-25ca-49a6-bbd9-138011ef69ad None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:23.826583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:23.827624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:23.827984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:23.828352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:23.830751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:23.916276 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:23.959871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:23.962363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191489c-1331-4f53-aa64-7ee8c2c1dbfa service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:23.992581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 700/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:26.137151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b541b5-258a-41ad-b6e8-8ac4eef904ba None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:26.137808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b541b5-258a-41ad-b6e8-8ac4eef904ba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:26.137808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b541b5-258a-41ad-b6e8-8ac4eef904ba None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:26.139648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 689/1389] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:26.145559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029e2d-98cb-44ca-a8f2-6db4599de6dc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:26.146373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029e2d-98cb-44ca-a8f2-6db4599de6dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:26.146373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029e2d-98cb-44ca-a8f2-6db4599de6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:26.231646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-df029e2d-98cb-44ca-a8f2-6db4599de6dc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:26.233203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-df029e2d-98cb-44ca-a8f2-6db4599de6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:26.397071 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 701/1390] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:26.447805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b541b5-258a-41ad-b6e8-8ac4eef904ba None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:26.449413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7b541b5-258a-41ad-b6e8-8ac4eef904ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:26.648812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b541b5-258a-41ad-b6e8-8ac4eef904ba None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:26.757637 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:26.898109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:26.898980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:26.899101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:26.899333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:26.901086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:27.015321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:27.016752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f0a6b-e520-4646-96bb-3fb10046c3ff service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:27.037459 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 690/1391] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:36:29.182668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f91f-70ed-4916-89aa-abc75c952a8d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:29.183460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f91f-70ed-4916-89aa-abc75c952a8d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:29.183460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f91f-70ed-4916-89aa-abc75c952a8d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:29.184623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 702/1392] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:29.192231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b813ccf-c7be-4730-b590-2123a7ac15af None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:29.193067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b813ccf-c7be-4730-b590-2123a7ac15af None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:29.193067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b813ccf-c7be-4730-b590-2123a7ac15af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:29.266550 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:29.275675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4b813ccf-c7be-4730-b590-2123a7ac15af None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:29.276891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b813ccf-c7be-4730-b590-2123a7ac15af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:29.388636 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 691/1393] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:29.440630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f91f-70ed-4916-89aa-abc75c952a8d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:29.443785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3c2f91f-70ed-4916-89aa-abc75c952a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:29.493474 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:29.613508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f91f-70ed-4916-89aa-abc75c952a8d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:29.747360 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:29.752231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:29.753511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:29.754094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:29.754455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:29.756656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:29.853060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531800fe-9449-40fd-b24d-a918d91da488 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:29.853642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531800fe-9449-40fd-b24d-a918d91da488 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:29.854029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531800fe-9449-40fd-b24d-a918d91da488 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:29.855607 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 692/1394] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:36:29.860970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce76bf-1da0-4376-a186-d88916b67aa6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:29.861263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce76bf-1da0-4376-a186-d88916b67aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:29.861547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce76bf-1da0-4376-a186-d88916b67aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:29.869201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:29.870859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f3be8-1bcb-4e27-8bfc-a77d0e54f27d service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:29.890557 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 703/1395] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:29.939182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0fce76bf-1da0-4376-a186-d88916b67aa6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:29.940424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0fce76bf-1da0-4376-a186-d88916b67aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:30.042924 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:30.082260 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 693/1396] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:36:30.140385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaf90-2bc8-487f-b0bb-38888ccecac8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:30.140834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaf90-2bc8-487f-b0bb-38888ccecac8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:30.141192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaf90-2bc8-487f-b0bb-38888ccecac8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:30.143211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 704/1397] 10.222.0.77 () {54 vars in 962 bytes} [Mon Jul 11 14:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:30.149448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229f62f-d5f0-4fd5-859d-7f101a552bb4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:30.149744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229f62f-d5f0-4fd5-859d-7f101a552bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:30.150030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229f62f-d5f0-4fd5-859d-7f101a552bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:30.235565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3229f62f-d5f0-4fd5-859d-7f101a552bb4 None None] MFA Rules not processed for user `f2258fe4b6c14d378fcfdd1fb690f179`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:30.236907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3229f62f-d5f0-4fd5-859d-7f101a552bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:30.320113 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 694/1398] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Jul 11 14:36:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:30.328001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaf90-2bc8-487f-b0bb-38888ccecac8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:30.329848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-61bfaf90-2bc8-487f-b0bb-38888ccecac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:30.444979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaf90-2bc8-487f-b0bb-38888ccecac8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:30.472554 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:30.532211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:30.532881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:30.533178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:30.533458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:30.535256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:30.718979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:30.721797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f9c0f-1c9b-4067-954b-76a02e5b124b service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:30.750469 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 705/1399] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:31.493751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f45f-1572-4a3e-8236-4a3c1bce2d41 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:31.494273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f45f-1572-4a3e-8236-4a3c1bce2d41 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:31.494377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f45f-1572-4a3e-8236-4a3c1bce2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:31.564113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-42a8f45f-1572-4a3e-8236-4a3c1bce2d41 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:31.565341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-42a8f45f-1572-4a3e-8236-4a3c1bce2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:31.588113 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:31.664567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 695/1400] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:31.711594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade90d-989b-47dc-b770-f896bbe815cd None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:31.712139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade90d-989b-47dc-b770-f896bbe815cd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:31.712255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade90d-989b-47dc-b770-f896bbe815cd None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:31.713743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 706/1401] 10.222.0.77 () {54 vars in 942 bytes} [Mon Jul 11 14:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:31.720368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379891-e793-4125-bcc5-99281b39a6e0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:31.721040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379891-e793-4125-bcc5-99281b39a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:31.721561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379891-e793-4125-bcc5-99281b39a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:31.804517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9d379891-e793-4125-bcc5-99281b39a6e0 None None] MFA Rules not processed for user `fb9dad5761444d1a8f096c6c2c1cbf19`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:31.805811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9d379891-e793-4125-bcc5-99281b39a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:31.917615 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:31.924892 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 696/1402] 10.222.0.77 () {58 vars in 1039 bytes} [Mon Jul 11 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:31.934790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ade90d-989b-47dc-b770-f896bbe815cd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:31.936321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-76ade90d-989b-47dc-b770-f896bbe815cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:31.998108 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:32.009396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9f22-f950-4421-bd2e-ece4fa48c760 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:32.009694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9f22-f950-4421-bd2e-ece4fa48c760 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:32.009975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9f22-f950-4421-bd2e-ece4fa48c760 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:32.011415 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 697/1403] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:36:32.017003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:32.017295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:32.017706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:32.088623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:32.089858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:32.090634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ade90d-989b-47dc-b770-f896bbe815cd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:32.205668 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 698/1404] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:36:32.209803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:32.210466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:32.210779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:32.211059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:32.212747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:32.254696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:32.255937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:32.262814 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:32.324267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:32.325962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e3d04-de8c-44a0-a5de-5cbc65c76c29 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:32.337029 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 707/1405] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:36:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:36:32.346793 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:32.395347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d7a8-c912-4fb5-98a8-04f438afefc7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:32.549094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:32.549862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:32.549862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:32.550191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:32.552208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:32.641091 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:32.668167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:32.669775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09dc99-9ce3-44d8-8e38-1abbf8bd9e25 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:32.692596 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 699/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:36:34.887367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc4b3-545c-4ba1-a9d0-969798c8817c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:34.887933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc4b3-545c-4ba1-a9d0-969798c8817c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:34.887933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc4b3-545c-4ba1-a9d0-969798c8817c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:34.889267 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 708/1407] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:34.894587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bab13-6dd1-4ea6-98d0-3ff79e5bcdf2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:34.895081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bab13-6dd1-4ea6-98d0-3ff79e5bcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:34.895169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bab13-6dd1-4ea6-98d0-3ff79e5bcdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:34.977909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c65bab13-6dd1-4ea6-98d0-3ff79e5bcdf2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:34.979257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c65bab13-6dd1-4ea6-98d0-3ff79e5bcdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:35.110550 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 700/1408] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:35.160651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc4b3-545c-4ba1-a9d0-969798c8817c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:35.163448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a00cc4b3-545c-4ba1-a9d0-969798c8817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:35.351698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc4b3-545c-4ba1-a9d0-969798c8817c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:35.396503 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:35.499996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:35.500850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:35.501133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:35.501407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:35.503362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:35.627210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:35.628800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cb5a3-1dfd-4808-864c-4b1c684b3f4a service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:35.649492 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 709/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:45.119275 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=79 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:45.645886 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:55.403841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccafb-8248-4f4e-a47d-6be98946ffce None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:55.404416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccafb-8248-4f4e-a47d-6be98946ffce None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:55.404416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccafb-8248-4f4e-a47d-6be98946ffce None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:55.405811 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 701/1410] 10.222.0.77 () {54 vars in 918 bytes} [Mon Jul 11 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:55.411844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc13b-6c2c-4800-bf87-3a2930b80f3b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:55.412401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc13b-6c2c-4800-bf87-3a2930b80f3b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:55.412401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc13b-6c2c-4800-bf87-3a2930b80f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:55.493356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-24cfc13b-6c2c-4800-bf87-3a2930b80f3b None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:55.494601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24cfc13b-6c2c-4800-bf87-3a2930b80f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:55.605516 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 710/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Jul 11 14:36:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:36:55.621332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4fc1d-7a15-48fc-8ea4-d992aadcba1a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:55.621619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4fc1d-7a15-48fc-8ea4-d992aadcba1a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:55.621902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4fc1d-7a15-48fc-8ea4-d992aadcba1a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:55.624109 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 702/1412] 10.222.0.77 () {54 vars in 918 bytes} [Mon Jul 11 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:55.628020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb86e7-6a46-4946-b5c3-3df981850384 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:55.628308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb86e7-6a46-4946-b5c3-3df981850384 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:55.628588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb86e7-6a46-4946-b5c3-3df981850384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:55.703501 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:55.706275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dddb86e7-6a46-4946-b5c3-3df981850384 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:55.708138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dddb86e7-6a46-4946-b5c3-3df981850384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:55.945395 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 711/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Jul 11 14:36:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:36:58.467756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82136a9-d872-47c7-b398-0b4c01bb709e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.468624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82136a9-d872-47c7-b398-0b4c01bb709e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.468808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82136a9-d872-47c7-b398-0b4c01bb709e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.470215 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:58.475591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1303-5468-4e06-96e5-4726c3f5627e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.476076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1303-5468-4e06-96e5-4726c3f5627e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.476212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1303-5468-4e06-96e5-4726c3f5627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.542464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-de9d1303-5468-4e06-96e5-4726c3f5627e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:58.543722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de9d1303-5468-4e06-96e5-4726c3f5627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:58.599512 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:58.640891 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:58.685251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82136a9-d872-47c7-b398-0b4c01bb709e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:58.687182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a82136a9-d872-47c7-b398-0b4c01bb709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:58.835798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82136a9-d872-47c7-b398-0b4c01bb709e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:58.907394 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:58.948981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:58.949563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:58.949846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:58.950120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:58.951805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:59.042522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:59.044190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e247a0-c6b3-417e-9fa4-89f59818348c service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:59.062805 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 704/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:59.977999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4da9fa-8494-4628-a52d-4412803ba711 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:59.978602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4da9fa-8494-4628-a52d-4412803ba711 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:59.978602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4da9fa-8494-4628-a52d-4412803ba711 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:59.979963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:59.985317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb5c8-2871-4ee3-b0dd-9514f5aad1df None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:59.985797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb5c8-2871-4ee3-b0dd-9514f5aad1df None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:59.986062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb5c8-2871-4ee3-b0dd-9514f5aad1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:00.060781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-63cbb5c8-2871-4ee3-b0dd-9514f5aad1df None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:00.061998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-63cbb5c8-2871-4ee3-b0dd-9514f5aad1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:00.093250 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:00.163783 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:00.323507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4da9fa-8494-4628-a52d-4412803ba711 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:00.324946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c4da9fa-8494-4628-a52d-4412803ba711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:00.471525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4da9fa-8494-4628-a52d-4412803ba711 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:00.513413 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:00.587615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:00.588171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:00.588455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:00.588725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:00.590347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:00.680114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:00.681709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f53e2-96c5-4e6d-8b38-6296f04c6950 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:00.700665 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 714/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:01.585746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d98cb-bc85-48ae-a860-3a122e2ba4be None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.586336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d98cb-bc85-48ae-a860-3a122e2ba4be None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.586336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d98cb-bc85-48ae-a860-3a122e2ba4be None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.587789 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:01.592784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e239a-a410-4c6f-b4fa-3da95c726237 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.593205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e239a-a410-4c6f-b4fa-3da95c726237 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.593351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e239a-a410-4c6f-b4fa-3da95c726237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.646423 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:01.670803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4b9e239a-a410-4c6f-b4fa-3da95c726237 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:01.672028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4b9e239a-a410-4c6f-b4fa-3da95c726237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:01.769337 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:01.924223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d98cb-bc85-48ae-a860-3a122e2ba4be None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:01.925640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f63d98cb-bc85-48ae-a860-3a122e2ba4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:02.073465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d98cb-bc85-48ae-a860-3a122e2ba4be None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.086323 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.188350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.188988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.189280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.189562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.191285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:02.285067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.286728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636652a-5ef5-4e6d-847c-48db95d2a955 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.304667 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 707/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:03.167932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab437-67b9-4783-80c1-23520120b8f0 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.168503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab437-67b9-4783-80c1-23520120b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.168503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab437-67b9-4783-80c1-23520120b8f0 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.169894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:03.175018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940a961-88ae-4940-87f9-4f0322c946f7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.175437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940a961-88ae-4940-87f9-4f0322c946f7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.175585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940a961-88ae-4940-87f9-4f0322c946f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.198963 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:03.255503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7940a961-88ae-4940-87f9-4f0322c946f7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:03.256751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7940a961-88ae-4940-87f9-4f0322c946f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:03.352091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:03.505223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab437-67b9-4783-80c1-23520120b8f0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:03.506805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02aab437-67b9-4783-80c1-23520120b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:03.618335 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:03.655288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab437-67b9-4783-80c1-23520120b8f0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:03.771320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:03.771876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.772160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.772435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.774083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:03.850767 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:03.865421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:03.867604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ce8b-3ecf-4963-8e5b-bf3b80e31cfe service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:03.885509 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 717/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:04.761903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b99f4-e548-4f3e-9b1b-ee95e2054ce2 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:04.762540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b99f4-e548-4f3e-9b1b-ee95e2054ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:04.762540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b99f4-e548-4f3e-9b1b-ee95e2054ce2 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:04.763866 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:04.768779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa279f0-c1f0-4c79-bfaf-41830dd34179 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:04.769222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa279f0-c1f0-4c79-bfaf-41830dd34179 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:04.769350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa279f0-c1f0-4c79-bfaf-41830dd34179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:04.845452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-daa279f0-c1f0-4c79-bfaf-41830dd34179 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:04.846722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-daa279f0-c1f0-4c79-bfaf-41830dd34179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:04.947086 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:05.100111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b99f4-e548-4f3e-9b1b-ee95e2054ce2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:05.101850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b12b99f4-e548-4f3e-9b1b-ee95e2054ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:05.185682 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:05.249664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b99f4-e548-4f3e-9b1b-ee95e2054ce2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:05.372693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:05.373343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:05.373629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:05.373906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:05.375714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:05.424333 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:05.467670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:05.469280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1521b-0bb5-49b6-89b9-67b48f53a2be service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:05.487169 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 710/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:06.302091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9cc7-9941-4595-b1e4-7d49865d1771 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.302697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9cc7-9941-4595-b1e4-7d49865d1771 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.302697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9cc7-9941-4595-b1e4-7d49865d1771 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.304017 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:06.309728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5b92e-48f4-4c50-9053-8872654eba9c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.310145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5b92e-48f4-4c50-9053-8872654eba9c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.310259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5b92e-48f4-4c50-9053-8872654eba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.390462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-faa5b92e-48f4-4c50-9053-8872654eba9c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:06.391725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-faa5b92e-48f4-4c50-9053-8872654eba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:06.488758 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:06.640513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce9cc7-9941-4595-b1e4-7d49865d1771 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:06.641941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9bce9cc7-9941-4595-b1e4-7d49865d1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:06.692727 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:06.792489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce9cc7-9941-4595-b1e4-7d49865d1771 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:06.906884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:06.907544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:06.907832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:06.908113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:06.909767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:06.917366 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:07.001250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:07.002884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053fcf1-ae01-4b98-858e-67b9524b94f9 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:07.020755 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 720/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:07.825787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951f95a-9975-4b63-a10b-062b5ade9a93 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.826369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951f95a-9975-4b63-a10b-062b5ade9a93 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.826369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951f95a-9975-4b63-a10b-062b5ade9a93 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.827751 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:07.832891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9606fea-8be9-4913-a950-1ca8f95ae8a8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:07.833338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9606fea-8be9-4913-a950-1ca8f95ae8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:07.833458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9606fea-8be9-4913-a950-1ca8f95ae8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:07.909012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d9606fea-8be9-4913-a950-1ca8f95ae8a8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:07.910228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d9606fea-8be9-4913-a950-1ca8f95ae8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:07.978742 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:08.008358 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:08.159057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951f95a-9975-4b63-a10b-062b5ade9a93 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:08.160597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5951f95a-9975-4b63-a10b-062b5ade9a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:08.178195 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:08.342910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951f95a-9975-4b63-a10b-062b5ade9a93 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:08.428340 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:08.455645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:08.456379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:08.456660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:08.456937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:08.458697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:08.553163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:08.555407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a85014-0f93-4d61-b8a1-8d6dfcaa761e service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:08.574500 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 713/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:09.377459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582d1d-38d7-466d-873e-9dc0dc71ecf8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:09.378010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582d1d-38d7-466d-873e-9dc0dc71ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:09.378010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582d1d-38d7-466d-873e-9dc0dc71ecf8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:09.379176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:09.384791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626c98-f5e9-4c6f-9c24-fe8df1d1d515 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:09.385196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626c98-f5e9-4c6f-9c24-fe8df1d1d515 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:09.385336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626c98-f5e9-4c6f-9c24-fe8df1d1d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:09.460174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3f626c98-f5e9-4c6f-9c24-fe8df1d1d515 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:09.461435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f626c98-f5e9-4c6f-9c24-fe8df1d1d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:09.502557 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:09.557593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:09.708864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582d1d-38d7-466d-873e-9dc0dc71ecf8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:09.710706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5f582d1d-38d7-466d-873e-9dc0dc71ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:09.858195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582d1d-38d7-466d-873e-9dc0dc71ecf8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:09.916082 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:09.975023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:09.975598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:09.975879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:09.976738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:09.978396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:10.067687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:10.069543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104ea21-91ce-4c3f-bbb5-37a790523c80 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:10.088117 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 723/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:10.892474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28d8a-fc4e-4f9e-ab49-b90c834e9d2d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.893006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28d8a-fc4e-4f9e-ab49-b90c834e9d2d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.893120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28d8a-fc4e-4f9e-ab49-b90c834e9d2d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.894429 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:10.899975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e391-b8ca-4388-814f-660d5072a9fc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:10.900446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e391-b8ca-4388-814f-660d5072a9fc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:10.900618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e391-b8ca-4388-814f-660d5072a9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:10.977195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4545e391-b8ca-4388-814f-660d5072a9fc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:10.978414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4545e391-b8ca-4388-814f-660d5072a9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:10.980462 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:11.076005 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:11.224004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28d8a-fc4e-4f9e-ab49-b90c834e9d2d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:11.225508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cee28d8a-fc4e-4f9e-ab49-b90c834e9d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:11.374079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28d8a-fc4e-4f9e-ab49-b90c834e9d2d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:11.401193 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:11.488291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:11.488840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:11.489119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:11.489389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:11.491074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:11.579172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:11.580847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4cdae-c0e9-478e-9aca-0e9eb5f5a1ff service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:11.599444 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 716/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:13.566936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260231a-9ce4-49f5-8585-702b0b0d1f2b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:13.567481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260231a-9ce4-49f5-8585-702b0b0d1f2b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:13.567481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260231a-9ce4-49f5-8585-702b0b0d1f2b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:13.569121 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:13.575064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87d7a-01d3-49d5-a51a-f925fb6c29ad None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:13.575521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87d7a-01d3-49d5-a51a-f925fb6c29ad None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:13.575619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87d7a-01d3-49d5-a51a-f925fb6c29ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:13.619782 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:13.651988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e2c87d7a-01d3-49d5-a51a-f925fb6c29ad None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:13.654202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e2c87d7a-01d3-49d5-a51a-f925fb6c29ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:13.764602 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:13.802617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260231a-9ce4-49f5-8585-702b0b0d1f2b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:13.804723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5260231a-9ce4-49f5-8585-702b0b0d1f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:13.909391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260231a-9ce4-49f5-8585-702b0b0d1f2b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:13.943806 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:13.988937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:13.989541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:13.989889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:13.990106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:13.992337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:14.125360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:14.127104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a474f4e-489c-44c2-b2fd-e77f28fd3e6a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:14.149137 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 726/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:16.463116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09117d-8ea6-4071-b969-05d1cedb46ac None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:16.463753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09117d-8ea6-4071-b969-05d1cedb46ac None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:16.463753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09117d-8ea6-4071-b969-05d1cedb46ac None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:16.465059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:16.470535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015e68-565b-423e-bd60-8b22af3b3fb4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:16.471086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015e68-565b-423e-bd60-8b22af3b3fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:16.471086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015e68-565b-423e-bd60-8b22af3b3fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:16.541612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e9015e68-565b-423e-bd60-8b22af3b3fb4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:16.542866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e9015e68-565b-423e-bd60-8b22af3b3fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:16.556715 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:16.647622 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:16.688172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09117d-8ea6-4071-b969-05d1cedb46ac None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:16.690416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1b09117d-8ea6-4071-b969-05d1cedb46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:16.810065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09117d-8ea6-4071-b969-05d1cedb46ac None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:16.822536 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:16.889557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:16.890251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:16.890576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:16.890861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:16.892643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:17.020525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:17.021971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52168-a4ea-4db2-9855-05ca1b0d4b11 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:17.040762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 719/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:19.480386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530971-8c23-49ab-85e5-df2bbe50dac8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:19.480975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530971-8c23-49ab-85e5-df2bbe50dac8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:19.480975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530971-8c23-49ab-85e5-df2bbe50dac8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:19.482389 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:19.488535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b995f-80f3-4031-bb67-d5517f80b403 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:19.488999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b995f-80f3-4031-bb67-d5517f80b403 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:19.489176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b995f-80f3-4031-bb67-d5517f80b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:19.539302 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:19.558596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2c7b995f-80f3-4031-bb67-d5517f80b403 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:19.559841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c7b995f-80f3-4031-bb67-d5517f80b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:19.658264 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:19.698094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530971-8c23-49ab-85e5-df2bbe50dac8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:19.699649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7530971-8c23-49ab-85e5-df2bbe50dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:19.806479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530971-8c23-49ab-85e5-df2bbe50dac8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:19.848301 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:19.885872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:19.886556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:19.886847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:19.887152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:19.888997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:20.006050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:20.008051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec06f5-dd5c-4bbd-8d6a-11065fb28317 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:20.028611 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 729/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:22.278752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe18-497f-4845-a6a0-4a868a7e50d3 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:22.279347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe18-497f-4845-a6a0-4a868a7e50d3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:22.279347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe18-497f-4845-a6a0-4a868a7e50d3 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:22.280722 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:22.286599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385283e-0f8b-40b7-8d40-7db44e7293c9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:22.287115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385283e-0f8b-40b7-8d40-7db44e7293c9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:22.287222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385283e-0f8b-40b7-8d40-7db44e7293c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:22.354738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8385283e-0f8b-40b7-8d40-7db44e7293c9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:22.355894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8385283e-0f8b-40b7-8d40-7db44e7293c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:22.377298 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:22.459605 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:22.498761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bfe18-497f-4845-a6a0-4a868a7e50d3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:22.500318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-816bfe18-497f-4845-a6a0-4a868a7e50d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:22.603909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bfe18-497f-4845-a6a0-4a868a7e50d3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:22.624254 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:22.686120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:22.686793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:22.687074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:22.687343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:22.689014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:22.803792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:22.805261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0765090-a1cb-447f-85de-a4ecdc005932 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:22.823596 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 722/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:25.017812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3e9b-fee2-4f8c-8cf8-c8a98a947682 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:25.018378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3e9b-fee2-4f8c-8cf8-c8a98a947682 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:25.018378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3e9b-fee2-4f8c-8cf8-c8a98a947682 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:25.019778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:37:25.025496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b22f84-9f70-471e-8a17-5531d37a0f52 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:25.026054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b22f84-9f70-471e-8a17-5531d37a0f52 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:25.026054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b22f84-9f70-471e-8a17-5531d37a0f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:25.097780 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:25.101242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-54b22f84-9f70-471e-8a17-5531d37a0f52 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:25.102940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-54b22f84-9f70-471e-8a17-5531d37a0f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:25.203405 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:25.241225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3e9b-fee2-4f8c-8cf8-c8a98a947682 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:25.243360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aa0b3e9b-fee2-4f8c-8cf8-c8a98a947682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:25.354009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3e9b-fee2-4f8c-8cf8-c8a98a947682 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:25.407950 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:25.435743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:25.436402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:25.436686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:25.436960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:25.438650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:25.559127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:25.560517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2be19-9456-4bee-9939-3f4c12ace442 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:25.580895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 732/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:37:27.753236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad60a-0e48-4506-b38c-cf21c134c7af None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:27.755741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad60a-0e48-4506-b38c-cf21c134c7af None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:27.755741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad60a-0e48-4506-b38c-cf21c134c7af None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:27.755741 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:27.762173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab13cc-5ec1-4c5e-9c4e-12289078d7b2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:27.762821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab13cc-5ec1-4c5e-9c4e-12289078d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:27.762821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab13cc-5ec1-4c5e-9c4e-12289078d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:27.835208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-85ab13cc-5ec1-4c5e-9c4e-12289078d7b2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:27.837002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85ab13cc-5ec1-4c5e-9c4e-12289078d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:27.868063 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:27.940144 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:27.979378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad60a-0e48-4506-b38c-cf21c134c7af None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:27.981017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-505ad60a-0e48-4506-b38c-cf21c134c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:28.094323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad60a-0e48-4506-b38c-cf21c134c7af None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:28.124536 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:28.172714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:28.173377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:28.173665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:28.173945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:28.175719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:28.294544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:28.295912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f487b77-b6d7-4f73-979c-d6894f990aca service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:28.315701 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 725/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:30.592359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37e937-f0fb-4b0d-9688-99d28044b1dc None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:30.592937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37e937-f0fb-4b0d-9688-99d28044b1dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:30.592937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37e937-f0fb-4b0d-9688-99d28044b1dc None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:30.594288 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:30.599653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3a1c-a59e-4f35-a1f5-8d95c0db2e77 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:30.600101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3a1c-a59e-4f35-a1f5-8d95c0db2e77 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:30.600207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3a1c-a59e-4f35-a1f5-8d95c0db2e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:30.668703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-98cf3a1c-a59e-4f35-a1f5-8d95c0db2e77 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:30.669940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-98cf3a1c-a59e-4f35-a1f5-8d95c0db2e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:30.678565 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:30.779399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:30.816930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37e937-f0fb-4b0d-9688-99d28044b1dc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:30.818553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0b37e937-f0fb-4b0d-9688-99d28044b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:30.925254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37e937-f0fb-4b0d-9688-99d28044b1dc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:30.981724 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:31.001482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:31.002145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:31.002427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:31.002834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:31.004417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:31.120541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:31.122003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fcf2e-44f4-4c10-b5d9-7981bf823a52 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:31.143416 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 735/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:33.238902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43d6e-be8c-46f8-9040-210acadf8905 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:33.239419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43d6e-be8c-46f8-9040-210acadf8905 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:33.239419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43d6e-be8c-46f8-9040-210acadf8905 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:33.240775 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:33.246806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70f93-873b-4f22-99b9-a7f7c5f92b38 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:33.247257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70f93-873b-4f22-99b9-a7f7c5f92b38 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:33.247361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70f93-873b-4f22-99b9-a7f7c5f92b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:33.313346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d4f70f93-873b-4f22-99b9-a7f7c5f92b38 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:33.314587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d4f70f93-873b-4f22-99b9-a7f7c5f92b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:33.354111 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:33.414850 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:33.453245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43d6e-be8c-46f8-9040-210acadf8905 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:33.454895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9af43d6e-be8c-46f8-9040-210acadf8905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:33.562379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43d6e-be8c-46f8-9040-210acadf8905 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:33.604066 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:33.649218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:33.649872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:33.650153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:33.650434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:33.652144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:33.764039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:33.765484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704af587-2128-4150-98dc-2deed48691d8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:33.783485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 728/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:35.868678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de403c0-d162-4fcf-9cd5-a3efcf0e6ed6 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:35.869216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de403c0-d162-4fcf-9cd5-a3efcf0e6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:35.869216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de403c0-d162-4fcf-9cd5-a3efcf0e6ed6 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:35.870570 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:35.876041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c9d1-4abc-4f84-997d-a598303b7905 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:35.876466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c9d1-4abc-4f84-997d-a598303b7905 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:35.876615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c9d1-4abc-4f84-997d-a598303b7905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:35.942146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8670c9d1-4abc-4f84-997d-a598303b7905 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:35.943408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8670c9d1-4abc-4f84-997d-a598303b7905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:35.962689 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:36.043157 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:37:36.080149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de403c0-d162-4fcf-9cd5-a3efcf0e6ed6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:36.081701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9de403c0-d162-4fcf-9cd5-a3efcf0e6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:36.190446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de403c0-d162-4fcf-9cd5-a3efcf0e6ed6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:36.258768 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:36.266065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:36.266746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:36.267034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:36.267313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:36.268965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:36.384251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:36.385693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85810ab-cdc1-45b6-835b-5e5f9f6c147c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:36.404518 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 738/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:38.469917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595d9e-627f-4b4f-bfb7-75eb2ab7a668 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:38.470511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595d9e-627f-4b4f-bfb7-75eb2ab7a668 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:38.470511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595d9e-627f-4b4f-bfb7-75eb2ab7a668 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:38.471883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:37:38.477902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193841-c78d-48a3-953d-467607ce3de5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:38.478676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193841-c78d-48a3-953d-467607ce3de5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:38.478676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193841-c78d-48a3-953d-467607ce3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:38.554974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-08193841-c78d-48a3-953d-467607ce3de5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:38.556220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-08193841-c78d-48a3-953d-467607ce3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:38.610959 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:38.659434 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:38.697929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595d9e-627f-4b4f-bfb7-75eb2ab7a668 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:38.699510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5595d9e-627f-4b4f-bfb7-75eb2ab7a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:38.803290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595d9e-627f-4b4f-bfb7-75eb2ab7a668 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:38.853571 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:38.878842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:38.879495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:38.879777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:38.880053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:38.881703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:38.992126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:38.993574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dae2e-9928-42ae-83fb-eaedd149a874 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:39.012242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 731/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:48.657535 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=22 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:49.009904 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=66 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:59.292171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a701f05-1352-46f9-8e7e-10ed08f8deea None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:59.292817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a701f05-1352-46f9-8e7e-10ed08f8deea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:59.292817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a701f05-1352-46f9-8e7e-10ed08f8deea None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:59.294049 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 740/1471] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:59.299304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cab60-119c-4a6e-84c3-b39d68dbe68e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:59.299714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cab60-119c-4a6e-84c3-b39d68dbe68e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:59.300147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cab60-119c-4a6e-84c3-b39d68dbe68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:59.365672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-284cab60-119c-4a6e-84c3-b39d68dbe68e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:59.367000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-284cab60-119c-4a6e-84c3-b39d68dbe68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:59.472795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 732/1472] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:59.558740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74d2d-c536-4feb-9520-98003b2c2380 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:59.559025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74d2d-c536-4feb-9520-98003b2c2380 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:59.559301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74d2d-c536-4feb-9520-98003b2c2380 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:59.560652 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 741/1473] 10.222.0.77 () {54 vars in 962 bytes} [Mon Jul 11 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:59.565614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91574346-f5c0-430a-bc50-d21d3d336460 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:59.565858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91574346-f5c0-430a-bc50-d21d3d336460 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:59.566137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91574346-f5c0-430a-bc50-d21d3d336460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:59.642839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-91574346-f5c0-430a-bc50-d21d3d336460 None None] MFA Rules not processed for user `f2258fe4b6c14d378fcfdd1fb690f179`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:59.644049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91574346-f5c0-430a-bc50-d21d3d336460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:59.664447 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:59.722847 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 733/1474] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Jul 11 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:59.730354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74d2d-c536-4feb-9520-98003b2c2380 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:59.731961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6f74d2d-c536-4feb-9520-98003b2c2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:59.837084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74d2d-c536-4feb-9520-98003b2c2380 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:59.910114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:59.910859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:59.911227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:59.911512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:59.913216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:59.969443 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:00.029435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:00.031008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dcd95-6f65-4305-a2e0-df93d13c6d41 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:00.050036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 742/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:02.229430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f7f6-ef6f-46f5-89ce-aca1e8aa6fdf None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:02.230001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f7f6-ef6f-46f5-89ce-aca1e8aa6fdf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:02.230001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f7f6-ef6f-46f5-89ce-aca1e8aa6fdf None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:02.231400 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 734/1476] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:02.236767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd0789-3569-4803-aa8d-5d8a5535e182 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:02.237195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd0789-3569-4803-aa8d-5d8a5535e182 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:02.237305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd0789-3569-4803-aa8d-5d8a5535e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:02.306675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-55dd0789-3569-4803-aa8d-5d8a5535e182 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:02.307813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55dd0789-3569-4803-aa8d-5d8a5535e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:02.407537 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 743/1477] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:02.431073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f7f6-ef6f-46f5-89ce-aca1e8aa6fdf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:02.432608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea57f7f6-ef6f-46f5-89ce-aca1e8aa6fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:02.558958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f7f6-ef6f-46f5-89ce-aca1e8aa6fdf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:02.608164 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:02.654416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:02.655112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:02.655393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:02.655674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:02.656429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:02.658259 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:38:02.658259 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:38:02.658259 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:38:02.659474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5306-c069-4b79-9f08-6eedfd64a117 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:02.679121 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 735/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Jul 11 14:38:02 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:38:04.753615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be8ae-c774-4f8d-826d-830b14fc0823 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:04.754442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be8ae-c774-4f8d-826d-830b14fc0823 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:04.754442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be8ae-c774-4f8d-826d-830b14fc0823 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:04.755566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 744/1479] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:04.760834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db5275-7755-4f16-884c-7ba47e71aa33 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:04.761908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db5275-7755-4f16-884c-7ba47e71aa33 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:04.761908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db5275-7755-4f16-884c-7ba47e71aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:04.826117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-85db5275-7755-4f16-884c-7ba47e71aa33 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:04.827365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85db5275-7755-4f16-884c-7ba47e71aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:04.934884 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 736/1480] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:04.979002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be8ae-c774-4f8d-826d-830b14fc0823 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:04.980594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-089be8ae-c774-4f8d-826d-830b14fc0823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:04.991329 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:05.140170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be8ae-c774-4f8d-826d-830b14fc0823 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:05.221449 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:05.254306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:05.254989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:05.255277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:05.255558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:05.257235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:05.349922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:05.351494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe372ae-ff7f-40b1-8457-d8a5102ab1f8 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:05.370381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 745/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:07.609139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c471f-3a48-4a42-922f-bb376068ba0d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:07.609721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c471f-3a48-4a42-922f-bb376068ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:07.609721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c471f-3a48-4a42-922f-bb376068ba0d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:07.611094 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 737/1482] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:07.616366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151819d-7317-4280-b942-6e6b8076c235 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:07.616796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151819d-7317-4280-b942-6e6b8076c235 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:07.616951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151819d-7317-4280-b942-6e6b8076c235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:07.683366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c151819d-7317-4280-b942-6e6b8076c235 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:07.684589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c151819d-7317-4280-b942-6e6b8076c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:07.733375 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:07.785510 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 746/1483] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:07.822675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c471f-3a48-4a42-922f-bb376068ba0d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:07.824226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-656c471f-3a48-4a42-922f-bb376068ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:07.846671 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:07.926291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c471f-3a48-4a42-922f-bb376068ba0d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:08.000486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:08.001140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:08.001427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:08.001702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:08.003413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:08.082716 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:08.120895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:08.122357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8c1bc-155c-4563-83c4-38336c274e9a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:08.141508 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 738/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:10.261069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbc1af-52e2-4849-a73a-c436a9c8c479 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:10.261670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbc1af-52e2-4849-a73a-c436a9c8c479 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:10.261805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbc1af-52e2-4849-a73a-c436a9c8c479 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:10.263215 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 747/1485] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:10.269028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc28b5f-dd83-446d-998f-7c98681f257b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:10.269519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc28b5f-dd83-446d-998f-7c98681f257b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:10.269662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc28b5f-dd83-446d-998f-7c98681f257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:10.338598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bdc28b5f-dd83-446d-998f-7c98681f257b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:10.339775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bdc28b5f-dd83-446d-998f-7c98681f257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:10.445974 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 739/1486] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:10.485934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbc1af-52e2-4849-a73a-c436a9c8c479 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:10.487556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9bcbc1af-52e2-4849-a73a-c436a9c8c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:10.609593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbc1af-52e2-4849-a73a-c436a9c8c479 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:10.700873 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:10.703213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:10.704178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:10.704507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:10.704858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:10.707651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:10.838726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:10.840247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee394cb-ec8d-4e0d-b804-a761c1b8fcda service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:10.861187 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 748/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:13.079983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942614-5c88-4bba-8bb2-6dadd7b1479c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:13.080576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942614-5c88-4bba-8bb2-6dadd7b1479c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:13.080576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942614-5c88-4bba-8bb2-6dadd7b1479c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:13.081928 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 740/1488] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:13.087953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d6bcc-2892-4801-be16-87b336f71d4e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:13.088441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d6bcc-2892-4801-be16-87b336f71d4e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:13.088551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d6bcc-2892-4801-be16-87b336f71d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:13.158454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1b8d6bcc-2892-4801-be16-87b336f71d4e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:13.160273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b8d6bcc-2892-4801-be16-87b336f71d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:13.217214 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:13.262369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 749/1489] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:13.303391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942614-5c88-4bba-8bb2-6dadd7b1479c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:13.304960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cb942614-5c88-4bba-8bb2-6dadd7b1479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:13.346657 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:13.418695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942614-5c88-4bba-8bb2-6dadd7b1479c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:13.498880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:13.499844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:13.499844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:13.500070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:13.501713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:13.587324 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:13.617500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:13.618998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091af1cc-d3c7-4a7d-a050-20619873db7c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:13.637631 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 741/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:38:15.894402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbd5e1-5aac-4b75-88e6-bfd7612487a8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:15.894993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbd5e1-5aac-4b75-88e6-bfd7612487a8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:15.894993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbd5e1-5aac-4b75-88e6-bfd7612487a8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:15.896353 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 750/1491] 10.222.0.77 () {54 vars in 926 bytes} [Mon Jul 11 14:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:15.902311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebb23f-1ea8-4a75-af7e-fe071492f651 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:15.902788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebb23f-1ea8-4a75-af7e-fe071492f651 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:15.903018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebb23f-1ea8-4a75-af7e-fe071492f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:15.968765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-eaebb23f-1ea8-4a75-af7e-fe071492f651 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:15.969969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eaebb23f-1ea8-4a75-af7e-fe071492f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:16.071130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 742/1492] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Jul 11 14:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:16.110526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbd5e1-5aac-4b75-88e6-bfd7612487a8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:16.112096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0bbbd5e1-5aac-4b75-88e6-bfd7612487a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:16.218292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbd5e1-5aac-4b75-88e6-bfd7612487a8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:16.294703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:16.295356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:16.295644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:16.295922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:16.297579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:16.307862 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:16.412365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:16.413808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b41677-faf4-4c33-8a65-d7364c6ada69 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:16.433677 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 751/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:26.068635 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=82 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:26.430771 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=50 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:51.063750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:51.064263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:51.064372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:51.140484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:51.141691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:51.244203 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 743/1494] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:51.252284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:51.252812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:51.252924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:51.330783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:51.331920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:51.434393 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 752/1495] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:51.439166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:51.440411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:51.452656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abdc14-5751-45b3-806d-8916af9ab22c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:51.515327 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:51.550198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:51.550905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:51.551189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:51.551468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:51.552202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:39:51.552514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:51.553538 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:51.553538 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:39:51.553538 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:39:51.554456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:51.566073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 744/1496] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:39:51.575190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:51.584827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5145-28a3-4304-aa50-72742f98c175 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:51.645802 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:51.682127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:51.682828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:51.683115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:51.683393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:51.684080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:51.685821 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:51.685821 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:39:51.685821 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:39:51.687040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:51.743261 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 753/1497] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:39:51 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:39:51.747500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:51.749045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:51.782645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946683-ddea-425e-a515-6aa4a06638bc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:51.878213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:51.878813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:51.879093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:51.879369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:51.880062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:51.881091 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:51.881091 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:39:51.881091 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:39:51.882913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:51.927102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 745/1498] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:39:51 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:39:51.931740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:51.933307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:51.995967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cbdd-369f-42b4-97cc-8cc0930eba0b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:52.081321 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:52.092279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:52.092954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.093238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.093513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.094251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:52.095390 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:52.095390 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:39:52.095390 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:39:52.096274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:52.109933 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 754/1499] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:39:52.114125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:52.115676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:52.127878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50920b08-93f2-4fd6-a84b-5d6c2859b6ea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:52.154534 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:52.227410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:52.228074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.228354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.228628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.229357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:52.230372 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:52.230372 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:39:52.230372 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:39:52.231287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b721-7fb2-409f-8a2f-c5befc7304ee admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:52.244063 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 746/1500] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:39:52.248571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:52.250105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:52.283788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc35b-b546-45a3-b304-5d2b73f12062 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:52.380093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:52.380989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.381268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.381569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] PATH_INFO: `/v3/projects/e7e148719e6b4b41bc0aaf37933ad82d/users/b76265979657480fbd72d2e8d1aedf7b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.403666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e148719e6b4b41bc0aaf37933ad82d, user_id=b76265979657480fbd72d2e8d1aedf7b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:52.404749 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:52.404749 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:39:52.404749 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:39:52.406733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c35c7-83fd-40a9-9180-40d01ef32d6d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:52.432951 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 755/1501] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:39:52 2022] PUT /identity/v3/projects/e7e148719e6b4b41bc0aaf37933ad82d/users/b76265979657480fbd72d2e8d1aedf7b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:39:52.445479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1957b63-e495-4ba7-8a88-19fd703d1a20 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.445769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1957b63-e495-4ba7-8a88-19fd703d1a20 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.446049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1957b63-e495-4ba7-8a88-19fd703d1a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.503139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f1957b63-e495-4ba7-8a88-19fd703d1a20 None None] MFA Rules not processed for user `b76265979657480fbd72d2e8d1aedf7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:52.504353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f1957b63-e495-4ba7-8a88-19fd703d1a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:52.586986 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 747/1502] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:52.600347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cef45-d393-4c95-87ed-6b2bd60945bc None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.600643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cef45-d393-4c95-87ed-6b2bd60945bc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.601538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cef45-d393-4c95-87ed-6b2bd60945bc None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.603002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 756/1503] 10.222.0.77 () {54 vars in 963 bytes} [Mon Jul 11 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:52.607931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e89d6-035c-4001-a81d-01a7b9588e47 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.608226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e89d6-035c-4001-a81d-01a7b9588e47 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.608515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e89d6-035c-4001-a81d-01a7b9588e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.637889 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:52.685503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0c5e89d6-035c-4001-a81d-01a7b9588e47 None None] MFA Rules not processed for user `66a3753891494abd84fa3c9c17c1b455`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:52.686686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0c5e89d6-035c-4001-a81d-01a7b9588e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:52.769143 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 748/1504] 10.222.0.77 () {58 vars in 1060 bytes} [Mon Jul 11 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:52.777485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cef45-d393-4c95-87ed-6b2bd60945bc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:52.779035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-693cef45-d393-4c95-87ed-6b2bd60945bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:52.831286 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:52.889046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cef45-d393-4c95-87ed-6b2bd60945bc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:52.963069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:52.963656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:52.963980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:52.964254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:52.965889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:53.066072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:53.067769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:53.072496 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:53.088497 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 757/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:53.129773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a2bb-9cfc-4043-b096-945f98a799a1 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:53.130225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a2bb-9cfc-4043-b096-945f98a799a1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:53.130323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a2bb-9cfc-4043-b096-945f98a799a1 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:53.131643 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 749/1506] 10.222.0.77 () {52 vars in 829 bytes} [Mon Jul 11 14:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:53.135717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:53.136965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:53.240842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f3e1-bd4c-4a01-bdd8-da289b82425f service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:53.335421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:53.336290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:53.336575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:53.336850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] PATH_INFO: `/v3/users/b76265979657480fbd72d2e8d1aedf7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:53.349464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76265979657480fbd72d2e8d1aedf7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:53.350526 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:53.350526 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:39:53.350526 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:39:53.351773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:53.362084 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:53.415524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76265979657480fbd72d2e8d1aedf7b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:53.416017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76265979657480fbd72d2e8d1aedf7b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:53.434423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76265979657480fbd72d2e8d1aedf7b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:53.435004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76265979657480fbd72d2e8d1aedf7b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:53.449498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76265979657480fbd72d2e8d1aedf7b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:53.464780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 758/1507] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:39:53 2022] DELETE /identity/v3/users/b76265979657480fbd72d2e8d1aedf7b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:39:53.469344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:53.469660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:53.469937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:53.525800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:53.526965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:53.603093 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:53.615785 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 750/1508] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:53.627476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:53.628740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:53.729961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf8c3-c121-401b-a85d-fe5238c9fb02 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:53.785103 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:53.806507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:53.807166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:53.807454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:53.807742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:53.809664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:53.923010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:53.924689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2e673-26a2-466c-a90b-3ba840e6fefb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:53.946247 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 759/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:54.344346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:54.346173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:54.362769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3894bb-e228-4ce1-afe5-810dbaa4d2f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:54.470197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:54.471112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:54.471396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:54.471671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] PATH_INFO: `/v3/projects/e7e148719e6b4b41bc0aaf37933ad82d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:54.481895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e148719e6b4b41bc0aaf37933ad82d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:54.482970 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:39:54.482970 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:39:54.482970 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:39:54.484204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:54.546894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e148719e6b4b41bc0aaf37933ad82d', 'request_id': 'req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:54.553128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e148719e6b4b41bc0aaf37933ad82d', 'request_id': 'req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:54.563388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e148719e6b4b41bc0aaf37933ad82d', 'request_id': 'req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:54.595205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] The token cache is being invalidate because project e7e148719e6b4b41bc0aaf37933ad82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:39:54.595422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:54.595933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-707da0c8-ad77-464f-8ed3-d03b9d6a2a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:39:54.597320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 751/1510] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:39:54 2022] DELETE /identity/v3/projects/e7e148719e6b4b41bc0aaf37933ad82d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:03.943664 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=62 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:04.592918 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:23.643262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322755-204d-4a27-9f98-1201ac788c87 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:23.644377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322755-204d-4a27-9f98-1201ac788c87 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:23.644377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322755-204d-4a27-9f98-1201ac788c87 None None] PATH_INFO: `/v3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:23.645198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 760/1511] 10.222.0.65 () {54 vars in 925 bytes} [Mon Jul 11 14:43:23 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:43:23.653129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3cb80-cc45-4464-b970-76721bd2391b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:23.654063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3cb80-cc45-4464-b970-76721bd2391b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:23.654063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3cb80-cc45-4464-b970-76721bd2391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:23.754229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b9e3cb80-cc45-4464-b970-76721bd2391b None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:23.755634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b9e3cb80-cc45-4464-b970-76721bd2391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:23.897118 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 752/1512] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Jul 11 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:26.066068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eed93-e20b-4463-ab26-ee8bb385b258 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:26.066537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eed93-e20b-4463-ab26-ee8bb385b258 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:26.066669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eed93-e20b-4463-ab26-ee8bb385b258 None None] PATH_INFO: `/v3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:26.068014 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 761/1513] 10.222.0.84 () {54 vars in 925 bytes} [Mon Jul 11 14:43:26 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:43:26.074283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14d612-182a-486b-a201-136dbc73d910 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:26.074840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14d612-182a-486b-a201-136dbc73d910 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:26.074840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14d612-182a-486b-a201-136dbc73d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:26.108336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9a14d612-182a-486b-a201-136dbc73d910 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:26.110293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a14d612-182a-486b-a201-136dbc73d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:26.123961 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 753/1514] 10.222.0.84 () {58 vars in 1015 bytes} [Mon Jul 11 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:32.840290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb1074-757e-4a14-bac9-efdb44d2d919 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:32.840827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb1074-757e-4a14-bac9-efdb44d2d919 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:32.840827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb1074-757e-4a14-bac9-efdb44d2d919 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:32.842123 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 762/1515] 10.222.0.77 () {54 vars in 960 bytes} [Mon Jul 11 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:32.846989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddb804-8118-4fc0-b1a9-48b1e0afedda None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:32.847887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddb804-8118-4fc0-b1a9-48b1e0afedda None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:32.848079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddb804-8118-4fc0-b1a9-48b1e0afedda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:32.866675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-27ddb804-8118-4fc0-b1a9-48b1e0afedda None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:32.867899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-27ddb804-8118-4fc0-b1a9-48b1e0afedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:32.876648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 754/1516] 10.222.0.77 () {58 vars in 1057 bytes} [Mon Jul 11 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:32.884503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb1074-757e-4a14-bac9-efdb44d2d919 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:32.899068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb1074-757e-4a14-bac9-efdb44d2d919 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:32.904028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5ba47-6145-413b-83b6-01fbdbf69b2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:32.904677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5ba47-6145-413b-83b6-01fbdbf69b2d service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:32.904957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5ba47-6145-413b-83b6-01fbdbf69b2d service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:32.905236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5ba47-6145-413b-83b6-01fbdbf69b2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:32.914171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5ba47-6145-413b-83b6-01fbdbf69b2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:32.915837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5ba47-6145-413b-83b6-01fbdbf69b2d service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:32.926091 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 763/1517] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:34.605925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3768b8-844b-4123-80ba-34e4d0647fec None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:34.606811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3768b8-844b-4123-80ba-34e4d0647fec None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:34.606811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3768b8-844b-4123-80ba-34e4d0647fec None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:34.608289 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 755/1518] 10.222.0.77 () {54 vars in 960 bytes} [Mon Jul 11 14:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:43:34.615346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106244-21a9-4d24-a733-eb4ef7d321c1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:34.615943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106244-21a9-4d24-a733-eb4ef7d321c1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:34.615943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106244-21a9-4d24-a733-eb4ef7d321c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:34.639320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1d106244-21a9-4d24-a733-eb4ef7d321c1 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:34.640926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1d106244-21a9-4d24-a733-eb4ef7d321c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:34.650795 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 764/1519] 10.222.0.77 () {58 vars in 1057 bytes} [Mon Jul 11 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:34.659445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3768b8-844b-4123-80ba-34e4d0647fec None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:34.674002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3768b8-844b-4123-80ba-34e4d0647fec None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:34.680100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e9006-4024-4e83-8304-784eef4fea2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:34.680828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9006-4024-4e83-8304-784eef4fea2f service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:34.681147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9006-4024-4e83-8304-784eef4fea2f service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:34.681469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9006-4024-4e83-8304-784eef4fea2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:34.693844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9006-4024-4e83-8304-784eef4fea2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:34.695714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9006-4024-4e83-8304-784eef4fea2f service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:34.709519 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 756/1520] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:43:44.633730 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:44.702726 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:55.900336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770fad-cbb8-4cb5-b193-0f8dec5e182b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.900336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770fad-cbb8-4cb5-b193-0f8dec5e182b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.901020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770fad-cbb8-4cb5-b193-0f8dec5e182b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.902837 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 765/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:55.914295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ce244-ce0a-41f4-8962-41bfea0ec301 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.914959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ce244-ce0a-41f4-8962-41bfea0ec301 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.914959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ce244-ce0a-41f4-8962-41bfea0ec301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.979207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3d2ce244-ce0a-41f4-8962-41bfea0ec301 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:55.980469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3d2ce244-ce0a-41f4-8962-41bfea0ec301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:56.059122 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 757/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:56.213706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770fad-cbb8-4cb5-b193-0f8dec5e182b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:56.215435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6e770fad-cbb8-4cb5-b193-0f8dec5e182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:56.336595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770fad-cbb8-4cb5-b193-0f8dec5e182b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:56.342663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041188a6-3633-44f5-8f4c-b0511be43112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:56.343339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041188a6-3633-44f5-8f4c-b0511be43112 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:56.343624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041188a6-3633-44f5-8f4c-b0511be43112 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:56.343888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041188a6-3633-44f5-8f4c-b0511be43112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:56.354725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041188a6-3633-44f5-8f4c-b0511be43112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:56.356474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041188a6-3633-44f5-8f4c-b0511be43112 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:56.367906 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 766/1523] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:57.221062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b04754-c237-444d-88fb-4b062c397c9a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:57.221588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b04754-c237-444d-88fb-4b062c397c9a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:57.221700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b04754-c237-444d-88fb-4b062c397c9a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:57.223106 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:43:57.227958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574db1-7b3e-40b9-91b8-dbf54ee17777 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:57.228429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574db1-7b3e-40b9-91b8-dbf54ee17777 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:57.228560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574db1-7b3e-40b9-91b8-dbf54ee17777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:57.248008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5b574db1-7b3e-40b9-91b8-dbf54ee17777 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:57.249210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5b574db1-7b3e-40b9-91b8-dbf54ee17777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:57.257687 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:57.408859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b04754-c237-444d-88fb-4b062c397c9a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:57.424639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b04754-c237-444d-88fb-4b062c397c9a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:57.430810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2968d6-93d2-45cd-a511-d470ad30cd5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:57.431465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2968d6-93d2-45cd-a511-d470ad30cd5e service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:57.431754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2968d6-93d2-45cd-a511-d470ad30cd5e service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:57.432035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2968d6-93d2-45cd-a511-d470ad30cd5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:57.440817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2968d6-93d2-45cd-a511-d470ad30cd5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:57.442438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2968d6-93d2-45cd-a511-d470ad30cd5e service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:57.458990 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 759/1526] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:01.332858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b1bb1-3afe-4e64-872a-55fd64980582 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:01.333439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b1bb1-3afe-4e64-872a-55fd64980582 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:01.333439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b1bb1-3afe-4e64-872a-55fd64980582 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:01.334786 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:01.341287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5bb92-9594-489b-8611-9a928493ffdd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:01.342090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5bb92-9594-489b-8611-9a928493ffdd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:01.342277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5bb92-9594-489b-8611-9a928493ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:01.363581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-72c5bb92-9594-489b-8611-9a928493ffdd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:01.365032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-72c5bb92-9594-489b-8611-9a928493ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:01.373665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:01.458044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b1bb1-3afe-4e64-872a-55fd64980582 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:01.460232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c6b1bb1-3afe-4e64-872a-55fd64980582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:01.554474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b1bb1-3afe-4e64-872a-55fd64980582 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:01.558524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1dd3-b0d9-447f-8fa2-0b1aaa694313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:01.559244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1dd3-b0d9-447f-8fa2-0b1aaa694313 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:01.559535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1dd3-b0d9-447f-8fa2-0b1aaa694313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:01.559815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1dd3-b0d9-447f-8fa2-0b1aaa694313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:01.570820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec1dd3-b0d9-447f-8fa2-0b1aaa694313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:01.572413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec1dd3-b0d9-447f-8fa2-0b1aaa694313 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:01.583107 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 769/1529] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:03.757726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56dfd-ff37-4c26-8acb-fbb3a0259e39 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:03.758301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56dfd-ff37-4c26-8acb-fbb3a0259e39 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:03.758301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56dfd-ff37-4c26-8acb-fbb3a0259e39 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:03.759680 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:03.765127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdc6d-52be-4ab5-be90-10c90dd9e2fc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:03.765600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdc6d-52be-4ab5-be90-10c90dd9e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:03.765600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdc6d-52be-4ab5-be90-10c90dd9e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:03.784540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-410bdc6d-52be-4ab5-be90-10c90dd9e2fc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:03.785796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-410bdc6d-52be-4ab5-be90-10c90dd9e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:03.793774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:03.829812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f56dfd-ff37-4c26-8acb-fbb3a0259e39 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:03.841329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f56dfd-ff37-4c26-8acb-fbb3a0259e39 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:03.844784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38f584-7b41-4ec2-959d-36b598253f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:03.845414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38f584-7b41-4ec2-959d-36b598253f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:03.845697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38f584-7b41-4ec2-959d-36b598253f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:03.845977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38f584-7b41-4ec2-959d-36b598253f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:03.855225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38f584-7b41-4ec2-959d-36b598253f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:03.856646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38f584-7b41-4ec2-959d-36b598253f96 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:03.865804 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 762/1532] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:13.779111 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:13.861921 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=65 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:57.401159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70388777-c606-4064-8834-c9b7d6274238 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:57.401665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70388777-c606-4064-8834-c9b7d6274238 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:57.401760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70388777-c606-4064-8834-c9b7d6274238 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:57.403118 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 771/1533] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:57.408914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870217ce-d3c4-4163-be26-9dccb1f2be10 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:57.409306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870217ce-d3c4-4163-be26-9dccb1f2be10 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:57.409477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870217ce-d3c4-4163-be26-9dccb1f2be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:57.428798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-870217ce-d3c4-4163-be26-9dccb1f2be10 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:57.430254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-870217ce-d3c4-4163-be26-9dccb1f2be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:57.439612 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 763/1534] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:07.423919 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:35.144740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.145318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.145318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.166523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.167707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.179032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 772/1535] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:35.190354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.190951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.191029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.215895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.217168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.229327 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 764/1536] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:35.235255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.246317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb769e33-d3ab-466b-bb7f-65d120a87e50 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.255395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.256102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.256385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.256751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.257512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:35.257825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.258915 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:45:35.258915 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:45:35.258915 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:45:35.263384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.281280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 773/1537] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:35.290655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.302028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a059676-ee6d-472f-b8f0-b53dd4a50b70 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.311312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.312079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.312948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.313230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.313944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.315012 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:45:35.315012 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:45:35.315012 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:45:35.316214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.365418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 765/1538] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:35.372923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.396331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f74c-2513-4df6-80f6-32e6540fa3e2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.476667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.477863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.478467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.478982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.479881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.481583 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:45:35.481583 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:45:35.481583 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:45:35.483212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.513460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 774/1539] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:35.518350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.537136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12c6f0-5d3f-412a-b02e-f35cf6351609 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.543818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.544598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.544870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.545200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.545963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.548707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.564926 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 766/1540] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:35.569616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.583550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc755-6be7-4023-80f5-8667c6a4c2ee admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.594744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e3acf-9282-40fd-b6e9-24bcccfd9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.595800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3acf-9282-40fd-b6e9-24bcccfd9a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.596358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3acf-9282-40fd-b6e9-24bcccfd9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.596897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3acf-9282-40fd-b6e9-24bcccfd9a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.597893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3acf-9282-40fd-b6e9-24bcccfd9a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.600081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3acf-9282-40fd-b6e9-24bcccfd9a6c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.618227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 775/1541] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:35.622963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.636308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d2ab-6632-458d-9fc6-ac70c6748412 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.645840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.646875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.647125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.647450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] PATH_INFO: `/v3/projects/f6768e8c5a234adb8892c51f92d69fc5/users/e0ec5422bbdd43dd95578a02f0d842fe/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.669724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6768e8c5a234adb8892c51f92d69fc5, user_id=e0ec5422bbdd43dd95578a02f0d842fe, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.670864 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:45:35.670864 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:45:35.670864 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:45:35.673486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaaa55-a158-4188-bfb7-0cbf9c90d83b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.693372 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 767/1542] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:35 2022] PUT /identity/v3/projects/f6768e8c5a234adb8892c51f92d69fc5/users/e0ec5422bbdd43dd95578a02f0d842fe/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:35.708188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005c3a-bfdc-4de2-a666-d6e8e9ae7432 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.708834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005c3a-bfdc-4de2-a666-d6e8e9ae7432 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.709490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005c3a-bfdc-4de2-a666-d6e8e9ae7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.712757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adecfcc-93a5-4dc4-9ca1-09b3c955a8c6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.713053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adecfcc-93a5-4dc4-9ca1-09b3c955a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.713333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adecfcc-93a5-4dc4-9ca1-09b3c955a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.739704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9f005c3a-bfdc-4de2-a666-d6e8e9ae7432 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.741839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f005c3a-bfdc-4de2-a666-d6e8e9ae7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.756919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9adecfcc-93a5-4dc4-9ca1-09b3c955a8c6 None None] MFA Rules not processed for user `e0ec5422bbdd43dd95578a02f0d842fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.758664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9adecfcc-93a5-4dc4-9ca1-09b3c955a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.849874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 768/1543] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:35.851494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.851788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.852071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.861531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 776/1544] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:35.864429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927068fd-7fff-41a7-8cbd-dd99eacacd57 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.865278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927068fd-7fff-41a7-8cbd-dd99eacacd57 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.866162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927068fd-7fff-41a7-8cbd-dd99eacacd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.871853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.873823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.895846 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 769/1545] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:35.897100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.925303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-927068fd-7fff-41a7-8cbd-dd99eacacd57 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.927378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-927068fd-7fff-41a7-8cbd-dd99eacacd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.929513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a3926-9c54-495b-9f46-6b7219e30525 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.944566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c59aef-7bfb-4529-8fb4-8aade05648cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.945769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c59aef-7bfb-4529-8fb4-8aade05648cd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.946290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c59aef-7bfb-4529-8fb4-8aade05648cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.946830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c59aef-7bfb-4529-8fb4-8aade05648cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.948202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c59aef-7bfb-4529-8fb4-8aade05648cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.957938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c59aef-7bfb-4529-8fb4-8aade05648cd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.961706 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 777/1546] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:35.964899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92577272-ff06-4341-b766-24cfe6b03c14 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.965200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92577272-ff06-4341-b766-24cfe6b03c14 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.965486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92577272-ff06-4341-b766-24cfe6b03c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.991924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-92577272-ff06-4341-b766-24cfe6b03c14 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.993698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-92577272-ff06-4341-b766-24cfe6b03c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.005454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 770/1547] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.010587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7824e-6e19-416f-981e-95857ce0107a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.010897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7824e-6e19-416f-981e-95857ce0107a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.011174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7824e-6e19-416f-981e-95857ce0107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.012804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 778/1548] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.016712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcca7d-b09f-42ba-9532-26df163c55d8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.017237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcca7d-b09f-42ba-9532-26df163c55d8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.017751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcca7d-b09f-42ba-9532-26df163c55d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.044328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-20a7824e-6e19-416f-981e-95857ce0107a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.046008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-86dcca7d-b09f-42ba-9532-26df163c55d8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.046781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20a7824e-6e19-416f-981e-95857ce0107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.048055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-86dcca7d-b09f-42ba-9532-26df163c55d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.106335 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.108490 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.126070 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 771/1549] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.127588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef6a9-0797-4261-928b-ac07f211b352 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.127889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef6a9-0797-4261-928b-ac07f211b352 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.128179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef6a9-0797-4261-928b-ac07f211b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.131420 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 779/1550] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.132744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.133036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.133316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.148543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-047ef6a9-0797-4261-928b-ac07f211b352 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.149844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-047ef6a9-0797-4261-928b-ac07f211b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.153612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.154852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.158792 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 772/1551] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.160184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d95bf-394f-41e8-85d2-9afb5a3c9b6c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.160641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d95bf-394f-41e8-85d2-9afb5a3c9b6c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.160889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d95bf-394f-41e8-85d2-9afb5a3c9b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.164594 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 780/1552] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.165407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.175606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d82380-9a52-4226-8162-53dbc5324afe None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.180359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbde1-1f37-4d1c-af01-93bbe85c03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.181067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbde1-1f37-4d1c-af01-93bbe85c03f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.181386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbde1-1f37-4d1c-af01-93bbe85c03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.181631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbde1-1f37-4d1c-af01-93bbe85c03f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.182448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbde1-1f37-4d1c-af01-93bbe85c03f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.183758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-308d95bf-394f-41e8-85d2-9afb5a3c9b6c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.184515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbde1-1f37-4d1c-af01-93bbe85c03f0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.185168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-308d95bf-394f-41e8-85d2-9afb5a3c9b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.194352 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 773/1553] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.195731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.196021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.196311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.210586 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 781/1554] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.211943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f0ea-555c-4263-8fdb-c34be1acc30d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.212298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f0ea-555c-4263-8fdb-c34be1acc30d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.212644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f0ea-555c-4263-8fdb-c34be1acc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.219966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.221291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.229669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 774/1555] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.230720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.234275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a4c6f0ea-555c-4263-8fdb-c34be1acc30d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.235535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4c6f0ea-555c-4263-8fdb-c34be1acc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.240390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf59e-a20a-4b20-8a65-52f18732d42e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.244427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 782/1556] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.245440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836dc45-2873-46f1-8ae6-046a077b4f5d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.245731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836dc45-2873-46f1-8ae6-046a077b4f5d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.246011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836dc45-2873-46f1-8ae6-046a077b4f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.247257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.247917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.248203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.248490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.249232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.249541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.251764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.263874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 775/1557] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.264748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.271292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c836dc45-2873-46f1-8ae6-046a077b4f5d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.272512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c836dc45-2873-46f1-8ae6-046a077b4f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.275131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a2333-d8ea-4aa4-b171-5f7864073eec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.279660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.280299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.280749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.280850 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 783/1558] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.280937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.281867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.282068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.282178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.282418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.282553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.284154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.303731 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 776/1559] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.303731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.304033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.304033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.308066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786bad-bbd9-44dc-a541-91e6b0866810 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.311623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 784/1560] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.312919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.313248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.314019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.314409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.314883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.315755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.316070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.317738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.326776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02319d5d-f5d4-46db-ba6e-759a96a07b7f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.332010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6e21-596b-43b1-b20f-faadeb9d8233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.332163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 777/1561] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.339421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6e21-596b-43b1-b20f-faadeb9d8233 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.339421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6e21-596b-43b1-b20f-faadeb9d8233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.339588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.339674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6e21-596b-43b1-b20f-faadeb9d8233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.339674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f6e21-596b-43b1-b20f-faadeb9d8233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.339674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f6e21-596b-43b1-b20f-faadeb9d8233 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.344796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3ab7f-c602-47d1-b27c-0d27e3c8a478 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.348696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 785/1562] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:36.348696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.348696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.348696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.352899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.353550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.353840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.354383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.355153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.355466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.357076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.365186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:36.366426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:36.369595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 778/1563] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.370452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.375856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 786/1564] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:36.377191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.381504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947911bd-f848-4c25-ac6c-84b4000f7768 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.386137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.386831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.387116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.387392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.387773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef5ef-5171-4f18-99bb-fb9ce06cf06a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.388081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.389983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.393223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.393951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.394329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.394650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.395376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.395684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.397335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.411947 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 787/1565] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.412780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.423852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e000-f4e8-4d88-8929-d4fc36f24a8d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.425591 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 779/1566] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.426940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.505659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff525108-9430-42f0-8432-1000bfc52cf4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.507358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.509475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.509971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.510533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.511383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.511891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.512073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.512359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.512729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.513508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.513861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.515614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.515800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.528948 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 780/1567] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.529794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.547418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4446cb-7cac-423c-a797-7eb216e5dab2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.552551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.553229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.553484 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 788/1568] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.553660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.553792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.554394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.554748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.556965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.595771 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 781/1569] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.595771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.626057 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.633810 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.638868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73b92b-bbe9-4bc1-84c3-3e5e62f65958 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.662186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2db4-5ab4-45dc-8f56-0dd243087d37 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.667228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.667831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.668119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.668401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.669103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.671057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.697783 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 782/1570] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.698798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.705542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.706452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.706797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.707078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] PATH_INFO: `/v3/projects/b9edda9802af44d8a98cea08662d4938/users/d39426571cd344b3b9e7f3a0d2773e6e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.721836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9edda9802af44d8a98cea08662d4938, user_id=d39426571cd344b3b9e7f3a0d2773e6e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.724543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.739062 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 789/1571] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:36 2022] PUT /identity/v3/projects/b9edda9802af44d8a98cea08662d4938/users/d39426571cd344b3b9e7f3a0d2773e6e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:36.742352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.764118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deb465-36ae-4187-9247-31e0b67ee1aa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.805407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b809-1464-40a7-9371-b6561d1a8352 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.810155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.810847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.811134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.811410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.812163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.814600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.823589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.824403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.824698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.824980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.825739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:36.826056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.827974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.843159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 790/1572] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.843874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 783/1573] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:36.843982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.844067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.852486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8728-0bf0-482e-9260-ccd72014d044 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.907002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079617-2a2e-4e1d-a466-efb5d78a30e0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:36.912593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.913295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.913586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.913864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.914290 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.914828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.916794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.926754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:36.927438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:36.927887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:36.928198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:36.928949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:36.931148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:36.950865 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 791/1574] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.950865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.956816 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:36.970757 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 784/1575] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:36.970757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:36.971151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836062-e00e-4034-b64a-0b7d19ab55e9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.035979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb2c24-78bc-4f5b-9984-7b14a94de03d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.041535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.042225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.042527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.047338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.047338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.047338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.048430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.049132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.049414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.049688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.053625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.053625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.069963 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 785/1576] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.071125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.076023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 792/1577] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:36 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.077236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.082437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16230a7-88b9-446f-bf12-e40380d9d51f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.086983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8d1a0-ac87-4c2b-ad13-7a206615a6d0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.087257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.087920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.088218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.088475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.089207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.091102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.091641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.092289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.092569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.092841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.094079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.095669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.108996 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 793/1578] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.108996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.116392 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 786/1579] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.116392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.120161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c262-268e-4e16-a0ed-27762ba5f177 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.125099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a5399-28eb-4961-b992-c9edde17695a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.125725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.126408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.126755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.127041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.127969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.129886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.131637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.132306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.132593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.132899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.133619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.135582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.151697 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 794/1580] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/users => generated 291 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.155487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.169972 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 787/1581] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.169972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.172189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955e16-5e3a-48b9-a1d5-4003f2eb70b4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.237969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558609b5-3ba2-4bf2-a929-ceae20b28b51 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.242949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.243622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.243909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.244186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.244885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.246850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.259144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.259829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.260113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.260389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.261118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.262758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.269439 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 788/1582] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.270281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.274250 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 795/1583] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.275260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.281763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adccae-ac14-41db-88e6-eecd822735c8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.285739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6ba5-ad9c-4d14-b167-942cdddc921d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.288251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.288853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.289137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.289414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.290153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.290615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.291287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.291572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.291830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.291938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.292561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.294141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.305328 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 796/1584] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.306057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.309853 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 789/1585] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.313740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.316157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b03ce-ec41-4b2a-80e6-a3a23cf1d785 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.320839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.321731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.322016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.322297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] PATH_INFO: `/v3/projects/b9edda9802af44d8a98cea08662d4938/users/d39426571cd344b3b9e7f3a0d2773e6e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.323408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafddf9-859b-42c9-b2e5-01626561869f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.324294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9edda9802af44d8a98cea08662d4938, user_id=d39426571cd344b3b9e7f3a0d2773e6e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.327246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.328816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.329479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.329771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.330059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.330834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.332428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.333800 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:37.339377 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 797/1586] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:37 2022] PUT /identity/v3/projects/b9edda9802af44d8a98cea08662d4938/users/d39426571cd344b3b9e7f3a0d2773e6e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:37.340209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.355205 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 790/1587] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.355205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.363491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38338e3b-4cc2-4080-83d6-f885da8a2bca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.390936 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:37.417686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482e06-921c-4cb8-a4f4-01275259eb20 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.426482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.427287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.427639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.427991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.428907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.430693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.444417 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 798/1588] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.444417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.445936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.446637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.446926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.447211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.447907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.449833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.452559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e161-d860-43ee-a95f-b90d4b6d70fe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.457642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.458297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.458613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.458895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.459735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.461344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.472341 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 791/1589] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:37.476459 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 799/1590] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.476601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.476684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.483943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d416-ed5a-4a39-b95b-9a5c1f476cac admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.484141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce515ccd-e753-4e5f-8589-8aa3304a10e1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.488528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.488976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc274ef-fc7a-4b69-8b4a-b0bed6631efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.489186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.489472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.489751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.489842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc274ef-fc7a-4b69-8b4a-b0bed6631efa admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.490032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc274ef-fc7a-4b69-8b4a-b0bed6631efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.490312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc274ef-fc7a-4b69-8b4a-b0bed6631efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.490469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.491090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc274ef-fc7a-4b69-8b4a-b0bed6631efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.492095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.492719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc274ef-fc7a-4b69-8b4a-b0bed6631efa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.502695 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 792/1591] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.502948 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 800/1592] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.503771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.504451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.504745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.505063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.518972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cefbe1-3344-4382-81a5-07ac872d99c8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.523679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.524348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.524633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.524909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.525641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.527322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.532790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] MFA Rules not processed for user `d39426571cd344b3b9e7f3a0d2773e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:37.534117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:37.538073 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 801/1593] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.538974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.548913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad225ec-291c-4081-883d-11453c6c31dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.554161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.555304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.555593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.555874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.557041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.558670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.569002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 802/1594] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.569813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.580043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe39f-be6a-45dc-9eb3-3c19b7d400ac admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.584788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.585443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.585728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.586007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.586746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.588329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.599234 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 803/1595] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.600039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.610254 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 793/1596] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:37.611143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.611953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ce491-381d-4f51-bf1b-8755a5e88f8c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.617063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.617747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.618032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.618314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.619089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.620701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.622367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614080f-ae47-4814-9983-23ba471f0788 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.628289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.629176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.629494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.629752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.630510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.632195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.633604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 804/1597] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.634610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.648994 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 794/1598] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.648994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.649344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674d23c-86f0-4659-9546-32193d6e4de6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.654179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.655271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.655549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.655944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] PATH_INFO: `/v3/projects/2dcc68d8d7564969b5fca32eab506e04/users/ecd5513ec3344d4fa1da80247a88cf38/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.659164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601850ca-6aa8-43c5-8904-52d4ee8ffc52 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.663821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.664672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.664959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.665241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] PATH_INFO: `/v3/projects/1140c993d9a54885b62eb64c1a7ead0d/users/98c5142aba9a49bc8138fa10974c4ceb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.676572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcc68d8d7564969b5fca32eab506e04, user_id=ecd5513ec3344d4fa1da80247a88cf38, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.681807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1140c993d9a54885b62eb64c1a7ead0d, user_id=98c5142aba9a49bc8138fa10974c4ceb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.682727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.684529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.702544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 795/1599] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:37 2022] PUT /identity/v3/projects/1140c993d9a54885b62eb64c1a7ead0d/users/98c5142aba9a49bc8138fa10974c4ceb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:37.703982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.712713 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 805/1600] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:37 2022] PUT /identity/v3/projects/2dcc68d8d7564969b5fca32eab506e04/users/ecd5513ec3344d4fa1da80247a88cf38/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:37.714169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.735682 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:37.780591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027fd3f-eb13-4863-bda5-75c6d3973fe4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.800696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7e6fd-d1e9-4fe7-80db-3223184c67b8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.805315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.806222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.806539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.806830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] PATH_INFO: `/v3/projects/bf468174e57f430686162dc3609aee30/users/874dee0f13df4727acd31d5c93d31ca1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.830589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf468174e57f430686162dc3609aee30, user_id=874dee0f13df4727acd31d5c93d31ca1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.833296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.852357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 806/1601] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:37 2022] PUT /identity/v3/projects/bf468174e57f430686162dc3609aee30/users/874dee0f13df4727acd31d5c93d31ca1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:37.852357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.857102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.858070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.858363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.858852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] PATH_INFO: `/v3/projects/895c69e056de462e9a3f0ff0a6c15527/users/8f8e48049c4449ccb6ddb744250e7e9d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.875886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=895c69e056de462e9a3f0ff0a6c15527, user_id=8f8e48049c4449ccb6ddb744250e7e9d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.878583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.884551 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:37.898008 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 796/1602] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:37 2022] PUT /identity/v3/projects/895c69e056de462e9a3f0ff0a6c15527/users/8f8e48049c4449ccb6ddb744250e7e9d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:37.903446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:37.926514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea4e6-574a-4746-8758-1b7f0975c2ef admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.976931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590015c5-04ab-4112-889b-77faf1e5ed4c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:37.981670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8c8d5-83f6-4612-b9f6-bb6374c59156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:37.982604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8c8d5-83f6-4612-b9f6-bb6374c59156 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.982751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8c8d5-83f6-4612-b9f6-bb6374c59156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.983724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8c8d5-83f6-4612-b9f6-bb6374c59156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:37.983724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8c8d5-83f6-4612-b9f6-bb6374c59156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:37.985823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8c8d5-83f6-4612-b9f6-bb6374c59156 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:37.996394 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 797/1603] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:37.997841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062507ff-ecf4-42db-81d6-04fc26adc360 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:37.998139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062507ff-ecf4-42db-81d6-04fc26adc360 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:37.998557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062507ff-ecf4-42db-81d6-04fc26adc360 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.000714 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 798/1604] 10.222.0.77 () {54 vars in 961 bytes} [Mon Jul 11 14:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:38.001599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062507ff-ecf4-42db-81d6-04fc26adc360 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.017425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062507ff-ecf4-42db-81d6-04fc26adc360 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.026724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d440b-1682-42a8-9a19-051eb58d53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.027631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d440b-1682-42a8-9a19-051eb58d53cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.027923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d440b-1682-42a8-9a19-051eb58d53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.028206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d440b-1682-42a8-9a19-051eb58d53cc admin admin] PATH_INFO: `/v3/projects/7596d2cf020740f98586a353aeacc1c1/users/604da253c7904c48b3693484caf63938/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.029971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73767b58-375f-40eb-84b3-776ab75c74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.031493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73767b58-375f-40eb-84b3-776ab75c74f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.031781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73767b58-375f-40eb-84b3-776ab75c74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.032225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73767b58-375f-40eb-84b3-776ab75c74f0 admin admin] PATH_INFO: `/v3/projects/bc47065b015e49349f0aa74a18e3f569/users/aec8411581244013aaee015b17bb8f8f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.054295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73767b58-375f-40eb-84b3-776ab75c74f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc47065b015e49349f0aa74a18e3f569, user_id=aec8411581244013aaee015b17bb8f8f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.055161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d440b-1682-42a8-9a19-051eb58d53cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7596d2cf020740f98586a353aeacc1c1, user_id=604da253c7904c48b3693484caf63938, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.056537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73767b58-375f-40eb-84b3-776ab75c74f0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.061936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d440b-1682-42a8-9a19-051eb58d53cc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.079140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 807/1605] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:37 2022] PUT /identity/v3/projects/bc47065b015e49349f0aa74a18e3f569/users/aec8411581244013aaee015b17bb8f8f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:38.081715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93916c0-7911-48ed-8d65-8d6570f275a1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.082437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93916c0-7911-48ed-8d65-8d6570f275a1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.082976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93916c0-7911-48ed-8d65-8d6570f275a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.083435 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 799/1606] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:38 2022] PUT /identity/v3/projects/7596d2cf020740f98586a353aeacc1c1/users/604da253c7904c48b3693484caf63938/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:38.084972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cbb2-6294-4e89-a86e-a9104c1c5665 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.085267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cbb2-6294-4e89-a86e-a9104c1c5665 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.085841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cbb2-6294-4e89-a86e-a9104c1c5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.115203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f93916c0-7911-48ed-8d65-8d6570f275a1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.116522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f93916c0-7911-48ed-8d65-8d6570f275a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.208393 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 808/1607] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.209807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.210098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.210369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.240983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] MFA Rules not processed for user `874dee0f13df4727acd31d5c93d31ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.242263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.246790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8797cbb2-6294-4e89-a86e-a9104c1c5665 None None] MFA Rules not processed for user `ecd5513ec3344d4fa1da80247a88cf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.248036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8797cbb2-6294-4e89-a86e-a9104c1c5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.264851 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:38.295371 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:38.328104 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 800/1608] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.329588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d6fd-a32f-49d0-ae73-e6daff8fc29e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.329885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d6fd-a32f-49d0-ae73-e6daff8fc29e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.330167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d6fd-a32f-49d0-ae73-e6daff8fc29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.330430 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 809/1609] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.331914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.348015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5f43-d3b9-4342-87fa-3af638074ce3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.353133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a8741-7af8-4cc0-90bf-45f1604e896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.354038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8741-7af8-4cc0-90bf-45f1604e896e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.354317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8741-7af8-4cc0-90bf-45f1604e896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.354619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8741-7af8-4cc0-90bf-45f1604e896e admin admin] PATH_INFO: `/v3/projects/8da5cec61555493c84ee2f6eb46c4fc8/users/5eccda4fd5e9491b8f2f31abc6e92ed8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.364418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fa10d6fd-a32f-49d0-ae73-e6daff8fc29e None None] MFA Rules not processed for user `8f8e48049c4449ccb6ddb744250e7e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.365685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa10d6fd-a32f-49d0-ae73-e6daff8fc29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.375447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8741-7af8-4cc0-90bf-45f1604e896e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da5cec61555493c84ee2f6eb46c4fc8, user_id=5eccda4fd5e9491b8f2f31abc6e92ed8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.381121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8741-7af8-4cc0-90bf-45f1604e896e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.400932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 810/1610] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:38 2022] PUT /identity/v3/projects/8da5cec61555493c84ee2f6eb46c4fc8/users/5eccda4fd5e9491b8f2f31abc6e92ed8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:38.402867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d79b-6a37-496b-b09c-e13fb21c780a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.403156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d79b-6a37-496b-b09c-e13fb21c780a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.403594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d79b-6a37-496b-b09c-e13fb21c780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.459943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c951d79b-6a37-496b-b09c-e13fb21c780a None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.460181 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 801/1611] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.461280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c951d79b-6a37-496b-b09c-e13fb21c780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.462520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.463097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.463569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.497737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] MFA Rules not processed for user `604da253c7904c48b3693484caf63938`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.498997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.568992 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 811/1612] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.570813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.571108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.571390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.580214 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 802/1613] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.581905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.588613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.615452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] MFA Rules not processed for user `aec8411581244013aaee015b17bb8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.617351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.642431 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:38.669889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0fe29-20de-4201-a021-5afbe6dda0cb None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.677514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.678357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.678684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.678962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.694917 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 812/1614] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.696076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.732240 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:38.747479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.748929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.760151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 803/1615] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:38.760791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.766892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec890-8e88-47a1-a7a6-bcf06a63760e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.771010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a0b5-6fce-4c0a-b78b-4b82d1a375c2 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.771956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab56b5-d168-4918-a3f4-84b752132c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.772799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab56b5-d168-4918-a3f4-84b752132c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.773152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab56b5-d168-4918-a3f4-84b752132c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.773464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab56b5-d168-4918-a3f4-84b752132c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.774229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab56b5-d168-4918-a3f4-84b752132c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.776280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab56b5-d168-4918-a3f4-84b752132c31 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.777019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.778039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.778538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.778986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.779853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.782591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.809967 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 813/1616] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:38.811754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.812115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.812542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.815301 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 804/1617] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:38.816446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.849345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] MFA Rules not processed for user `5eccda4fd5e9491b8f2f31abc6e92ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:38.851017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:38.893191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793d486-4733-467b-b950-2a9595917f07 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:38.898821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:38.899519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:38.899964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:38.900315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:38.901261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:38.903830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:38.939859 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 814/1618] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:38.939859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.947743 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 805/1619] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:38.947743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:38.950221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe310fb-3ea8-4ad7-9794-73bdb286a58f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.026094 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:39.033032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.033539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.033802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.034135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.034895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.036773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.067556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fbc30-2c8b-4dfe-bfbc-674e9eb92570 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.072819 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 815/1620] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:38 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.073725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.078908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.080403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.080926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.081216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.118346 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:39.161392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.161913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc05e6-af3c-408b-a83e-f35554421dd3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.163236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.168771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.169725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.170211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.170749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.171694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.173893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.174586 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 806/1621] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:39.175774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.186849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0b8a5-eb60-462f-b1dc-886034a7e015 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.194091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.195682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.196195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.196700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.198262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.203639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.249258 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 816/1622] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.249258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.251464 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 807/1623] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.252247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.283456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f58d31-0008-4426-a3a2-f187d8a3768b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.336876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eee8b-deeb-4a83-8650-0d50d0a33396 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.342717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.344137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.344137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.344575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.345484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.348433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.378622 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 817/1624] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.381982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.382838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.383204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.383349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.383653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.384523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.387601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.397503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cb1f6-f0e3-4a84-8e98-9f8317f5c40b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.404934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.406839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.407136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.407468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.408430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.410785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.425047 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 808/1625] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.428968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.439514 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 818/1626] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/users => generated 306 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.440528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.454653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac673-58d9-4b53-9040-3958b3685dc5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.514260 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:39.536650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5c7d3-e98f-4d30-97d9-0ff4c4ea8749 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.551345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.552213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.552747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.553084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.554299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.570201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.588146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.589002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.589357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.589711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.590656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.593741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.612637 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 819/1627] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:39.614229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.620955 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 809/1628] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.622795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.629167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cb43b-8b56-4002-b889-332528d956fb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.635747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.636597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.637595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.637884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.638765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.641004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.645825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fc0c-79dd-4064-adda-0044d594cdf3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.653381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.655152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.655550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.656538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.657674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.659622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.686053 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 820/1629] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/users => generated 297 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.688058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.691770 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 810/1630] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:39.694545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.710907 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:39.713009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e9698-71cb-4da6-8240-a876dd79d28b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.719016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.719742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.720031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.720310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.721405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.722326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac930d-99ef-488e-8122-9077cbb072e9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.723155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.741809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.742447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.742769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.743088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.743753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.745981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.759654 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 811/1631] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:39.761942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.794087 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 821/1632] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:39 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:39.799451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.815402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d2dd-b6ac-49ff-ac20-f1804e388845 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.830472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cf192-1176-4f64-b6b2-8c30c829725c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.834739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.836655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.836951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.837236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] PATH_INFO: `/v3/projects/fc607d723c324305b680b73588aa3e35/users/4e806cedbec04a928da4847139f28ef3/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.846998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.847696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.847986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.848265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.849542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.853917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.883721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc607d723c324305b680b73588aa3e35, user_id=4e806cedbec04a928da4847139f28ef3, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.890970 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 822/1633] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:39.892248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.893588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.904781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f3fc5-b6b2-417c-bc5b-f50a260abff3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:39.915644 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 812/1634] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:39 2022] PUT /identity/v3/projects/fc607d723c324305b680b73588aa3e35/users/4e806cedbec04a928da4847139f28ef3/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:39.917011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.933786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:39.933786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:39.933786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:39.945743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:39.946721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:39.948537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:39.969004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 823/1635] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:39.971096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:39.993780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488442-1481-48e1-b030-f7b2c1266d99 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.019292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091998ed-937e-4430-aba8-6f205deccce6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.026689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.028465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.028908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.029260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] PATH_INFO: `/v3/projects/5cd74fb565f84766937bfc0313ef721c/users/48fd2ab7b86b4864b4afd829c3c734bf/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.076552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd74fb565f84766937bfc0313ef721c, user_id=48fd2ab7b86b4864b4afd829c3c734bf, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.084061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.112235 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 813/1636] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:39 2022] PUT /identity/v3/projects/5cd74fb565f84766937bfc0313ef721c/users/48fd2ab7b86b4864b4afd829c3c734bf/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:40.113194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.142208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.143722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.144234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.144718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] PATH_INFO: `/v3/projects/f31c9e61898e4b438a6ff56feb4f600d/users/f507f38caedc422196a139dadc6f8856/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.181504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31c9e61898e4b438a6ff56feb4f600d, user_id=f507f38caedc422196a139dadc6f8856, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.185727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.208794 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 824/1637] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:39 2022] PUT /identity/v3/projects/f31c9e61898e4b438a6ff56feb4f600d/users/f507f38caedc422196a139dadc6f8856/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:40.208794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.313965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ed29-6c32-4de2-b468-a6d9d662945c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.360820 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:40.395133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d9d81-1380-43c7-aa7a-96617f89e138 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.409723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.410650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.410939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.411220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] PATH_INFO: `/v3/projects/7e98daf639af4d7181e19ab57220fb4a/users/2f8674d876eb4c3caba51b7d20a5b359/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.445570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.447721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.448488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.452160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.452491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e98daf639af4d7181e19ab57220fb4a, user_id=2f8674d876eb4c3caba51b7d20a5b359, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.453973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.456972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.459144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.484447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 814/1638] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:40.485931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.502346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ae96-695f-44d4-80fe-0eb82ba212c2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.508450 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 825/1639] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:40 2022] PUT /identity/v3/projects/7e98daf639af4d7181e19ab57220fb4a/users/2f8674d876eb4c3caba51b7d20a5b359/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:40.508450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.607920 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:40.647265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.647543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.647827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.648110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.648880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.650586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.670412 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 815/1640] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:40.671412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.682897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6c987-ef80-4f14-beb4-83b7f3362627 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.683055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055aedbb-8a2f-41ea-9b15-7ad5f75173dd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.689414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.690268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.690635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.690819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.691026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.691831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.693695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.693901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.694005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.694237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] PATH_INFO: `/v3/projects/6251d5c8807948a48b3af744869eba88/users/9e62e50712c246aaa29c5f16ac7f54a6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.710260 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 816/1641] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:40.711200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.717066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6251d5c8807948a48b3af744869eba88, user_id=9e62e50712c246aaa29c5f16ac7f54a6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.720827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.723414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215da6-50b0-4332-b20a-cd14e1aeb7e2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.728987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.729769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.730086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.730324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.731302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.743390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.750569 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 826/1642] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:40 2022] PUT /identity/v3/projects/6251d5c8807948a48b3af744869eba88/users/9e62e50712c246aaa29c5f16ac7f54a6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:40.751815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.767186 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 817/1643] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:40.767186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.794924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7140-83a7-4767-b767-77bc0acfde55 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.869804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307a76a-c4ff-46ce-b9b6-39fa005be21e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.879383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.880712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.881106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.881310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] PATH_INFO: `/v3/projects/b6d37e429f1945f98b9a5fd128e77af8/users/9ebe87606efb4df6b29c4da565e61022/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.887800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.888491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.888777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.889057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.889806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.892251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.913921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d37e429f1945f98b9a5fd128e77af8, user_id=9ebe87606efb4df6b29c4da565e61022, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.914367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 818/1644] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:40.915506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.920497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.929071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8dc54-cd84-42ff-b5e3-7171bccdb153 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:40.935448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:40.935774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:40.935977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:40.938343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] PATH_INFO: `/v3/projects/fc607d723c324305b680b73588aa3e35/users/4e806cedbec04a928da4847139f28ef3/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:40.938980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc607d723c324305b680b73588aa3e35, user_id=4e806cedbec04a928da4847139f28ef3, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:40.941760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:40.942198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 827/1645] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:40 2022] PUT /identity/v3/projects/b6d37e429f1945f98b9a5fd128e77af8/users/9ebe87606efb4df6b29c4da565e61022/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:40.943257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.962644 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 819/1646] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:40 2022] PUT /identity/v3/projects/fc607d723c324305b680b73588aa3e35/users/4e806cedbec04a928da4847139f28ef3/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:40.965002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:40.988663 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:41.046965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585b5b-8e5a-420d-80f7-ce5019a2a25e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.073676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e01b-2513-4299-a693-dba52ab31568 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.080193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.081172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.081536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.081903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.082890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.085615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.099239 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 820/1647] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:41.101109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:41.129070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9582ed-d8fb-48a1-8e2f-51afab811949 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.139576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.141467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.145507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.146033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] PATH_INFO: `/v3/projects/f31c9e61898e4b438a6ff56feb4f600d/users/f507f38caedc422196a139dadc6f8856/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.152229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31c9e61898e4b438a6ff56feb4f600d, user_id=f507f38caedc422196a139dadc6f8856, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.158432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.160251 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:41.190694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 821/1648] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:41 2022] PUT /identity/v3/projects/f31c9e61898e4b438a6ff56feb4f600d/users/f507f38caedc422196a139dadc6f8856/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:41.190694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:41.219818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.221506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.222149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.222675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] PATH_INFO: `/v3/projects/5cd74fb565f84766937bfc0313ef721c/users/48fd2ab7b86b4864b4afd829c3c734bf/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.225950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd74fb565f84766937bfc0313ef721c, user_id=48fd2ab7b86b4864b4afd829c3c734bf, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.228375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.242967 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 828/1649] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:40 2022] PUT /identity/v3/projects/5cd74fb565f84766937bfc0313ef721c/users/48fd2ab7b86b4864b4afd829c3c734bf/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:41.243753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:41.332287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87e1f-c9d0-4382-9900-24b179337251 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.381457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760f16-2a50-4058-9ac4-f7663ca49a6e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.387426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.388519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.388862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.389214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] PATH_INFO: `/v3/projects/7e98daf639af4d7181e19ab57220fb4a/users/2f8674d876eb4c3caba51b7d20a5b359/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.392404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e98daf639af4d7181e19ab57220fb4a, user_id=2f8674d876eb4c3caba51b7d20a5b359, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.396286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.413476 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 829/1650] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:41 2022] PUT /identity/v3/projects/7e98daf639af4d7181e19ab57220fb4a/users/2f8674d876eb4c3caba51b7d20a5b359/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:41.414337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:41.471440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.472024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.472413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.472822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.517401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a4361-616c-4038-8324-c9c2d7cf75f4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.520260 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:41.528517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12f7b9-67d4-4936-9037-2020a64fd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.529933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12f7b9-67d4-4936-9037-2020a64fd6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.530442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12f7b9-67d4-4936-9037-2020a64fd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.531036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12f7b9-67d4-4936-9037-2020a64fd6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.532608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12f7b9-67d4-4936-9037-2020a64fd6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.536920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12f7b9-67d4-4936-9037-2020a64fd6a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.556166 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 830/1651] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:41.557613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ede68-2fa5-4461-8f21-a4903ca85140 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.557723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.557905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ede68-2fa5-4461-8f21-a4903ca85140 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.558192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ede68-2fa5-4461-8f21-a4903ca85140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.560058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.575923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 822/1652] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:41.578273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:41.593458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484aa2b-9fc3-4c9e-83a5-adfab82a2a39 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:41.601759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c638f-450a-4732-91b8-94fc13f5bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:41.604849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c638f-450a-4732-91b8-94fc13f5bc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.605143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c638f-450a-4732-91b8-94fc13f5bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.605457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c638f-450a-4732-91b8-94fc13f5bc62 admin admin] PATH_INFO: `/v3/projects/6251d5c8807948a48b3af744869eba88/users/9e62e50712c246aaa29c5f16ac7f54a6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.610769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-149ede68-2fa5-4461-8f21-a4903ca85140 None None] MFA Rules not processed for user `4e806cedbec04a928da4847139f28ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:41.612089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-149ede68-2fa5-4461-8f21-a4903ca85140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:41.614767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c638f-450a-4732-91b8-94fc13f5bc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6251d5c8807948a48b3af744869eba88, user_id=9e62e50712c246aaa29c5f16ac7f54a6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:41.619905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c638f-450a-4732-91b8-94fc13f5bc62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:41.653543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 823/1653] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:41 2022] PUT /identity/v3/projects/6251d5c8807948a48b3af744869eba88/users/9e62e50712c246aaa29c5f16ac7f54a6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:41.655028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ea19-c9d9-4913-b8c1-f3d5879526d7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.655321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ea19-c9d9-4913-b8c1-f3d5879526d7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.655624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ea19-c9d9-4913-b8c1-f3d5879526d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.721723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f658ea19-c9d9-4913-b8c1-f3d5879526d7 None None] MFA Rules not processed for user `f507f38caedc422196a139dadc6f8856`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:41.729050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f658ea19-c9d9-4913-b8c1-f3d5879526d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:41.741605 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:41.766780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 831/1654] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:41.766780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.766780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.766780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.817032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] MFA Rules not processed for user `48fd2ab7b86b4864b4afd829c3c734bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:41.817990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:41.953423 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 824/1655] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:41.955512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:41.956467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:41.957215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:41.995888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] MFA Rules not processed for user `2f8674d876eb4c3caba51b7d20a5b359`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:41.997798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:41.999977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 832/1656] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:42.000892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:42.106324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db981df3-4ccd-4672-a554-3d8c7269da5e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:42.113314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e6fa-9edb-47ce-b25d-12e43ec70725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:42.114305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e6fa-9edb-47ce-b25d-12e43ec70725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.114684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e6fa-9edb-47ce-b25d-12e43ec70725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.115009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e6fa-9edb-47ce-b25d-12e43ec70725 admin admin] PATH_INFO: `/v3/projects/b6d37e429f1945f98b9a5fd128e77af8/users/9ebe87606efb4df6b29c4da565e61022/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.117684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16e6fa-9edb-47ce-b25d-12e43ec70725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d37e429f1945f98b9a5fd128e77af8, user_id=9ebe87606efb4df6b29c4da565e61022, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:42.120646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16e6fa-9edb-47ce-b25d-12e43ec70725 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:42.136896 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 833/1657] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:41 2022] PUT /identity/v3/projects/b6d37e429f1945f98b9a5fd128e77af8/users/9ebe87606efb4df6b29c4da565e61022/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:42.140228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d272c-b15c-432f-a5d4-c124cab789f3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.141269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d272c-b15c-432f-a5d4-c124cab789f3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.141758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d272c-b15c-432f-a5d4-c124cab789f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.149579 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 825/1658] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:42.149579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:42.179791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-067d272c-b15c-432f-a5d4-c124cab789f3 None None] MFA Rules not processed for user `9e62e50712c246aaa29c5f16ac7f54a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:42.181059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-067d272c-b15c-432f-a5d4-c124cab789f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:42.231637 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:42.322590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afd950-3ded-4c55-ba7d-1a30f49f1a9c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:42.333261 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:42.341367 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 834/1659] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:42.343394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f419-8417-43aa-bf5d-13ed554759f2 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.344066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f419-8417-43aa-bf5d-13ed554759f2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.344557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f419-8417-43aa-bf5d-13ed554759f2 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.346476 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 835/1660] 10.222.0.77 () {54 vars in 961 bytes} [Mon Jul 11 14:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:42.347987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f017-9bb7-4479-a4da-3fb0b112a143 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.348812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f017-9bb7-4479-a4da-3fb0b112a143 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.349545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f017-9bb7-4479-a4da-3fb0b112a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.406044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f4e7f017-9bb7-4479-a4da-3fb0b112a143 None None] MFA Rules not processed for user `9ebe87606efb4df6b29c4da565e61022`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:42.409611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f4e7f017-9bb7-4479-a4da-3fb0b112a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:42.496834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:42.497513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.497793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.498091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.526599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 836/1661] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:42.528995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.529612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.530047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.554730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:42.556376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:42.570358 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 837/1662] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Jul 11 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:42.580519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:42.599173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542a023-d9f2-4aee-8bb3-b433f4f1abf3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:42.607211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:42.608409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.609949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.609949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.612901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:42.614816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:42.629286 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 826/1663] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:42.694430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:42.696072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:42.721601 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 838/1664] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:42.782426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:42.807050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:42.813547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51148ba2-1c8d-432a-873b-3e77386fc8ff service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:42.820940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae950abf-e53f-4fd6-a4d1-38ad4da02210 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:42.828319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:42.830413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.831339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.832067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.834316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:42.835572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:42.836911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:42.837527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:42.921733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:42.924280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:42.926394 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:42.929507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:42.931739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:42.936713 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 839/1665] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:42.949618 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 827/1666] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:43.033384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:43.042887 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:43.061069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe34118-8efb-4792-9806-98b2fdb9d540 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:43.070204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:43.071055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.071336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.071663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.072097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:43.085132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd9cb5-9a3d-4502-9a90-e68051be1392 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:43.091827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:43.092526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.092818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.093142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.107356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:43.109585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:43.133637 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 828/1667] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:43.167876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:43.170224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:43.185849 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 840/1668] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:43.207446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:43.252164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:43.347138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6878-23a8-4301-a679-377a398148d7 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:43.352648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:43.354329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.354895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.355488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] PATH_INFO: `/v3/users/aec8411581244013aaee015b17bb8f8f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.357266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec8411581244013aaee015b17bb8f8f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:43.359887 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:45:43.359887 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:45:43.359887 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:45:43.362095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:43.443791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f954c-117b-40ff-9d5c-49e498e6d780 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:43.456118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:43.457028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.457308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.457579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] PATH_INFO: `/v3/users/874dee0f13df4727acd31d5c93d31ca1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.459498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=874dee0f13df4727acd31d5c93d31ca1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:43.466321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:43.473461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec8411581244013aaee015b17bb8f8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.510778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec8411581244013aaee015b17bb8f8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.534887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec8411581244013aaee015b17bb8f8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.550285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec8411581244013aaee015b17bb8f8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.551488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec8411581244013aaee015b17bb8f8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.569278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 829/1669] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:43 2022] DELETE /identity/v3/users/aec8411581244013aaee015b17bb8f8f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:43.570684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:43.572187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:43.590127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874dee0f13df4727acd31d5c93d31ca1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.590922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874dee0f13df4727acd31d5c93d31ca1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.638593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874dee0f13df4727acd31d5c93d31ca1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.640083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874dee0f13df4727acd31d5c93d31ca1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.733079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4e0ac76-78d8-4d89-a4c0-414dcd20ec2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874dee0f13df4727acd31d5c93d31ca1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:43.760509 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:43.795948 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 841/1670] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:43 2022] DELETE /identity/v3/users/874dee0f13df4727acd31d5c93d31ca1 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:45:43.804429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d738-36cb-4e6b-bed9-a46367e3534f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:43.805811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d738-36cb-4e6b-bed9-a46367e3534f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:43.807002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d738-36cb-4e6b-bed9-a46367e3534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:43.815757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467f87-2f30-49bb-8c28-0ecdb77fd3fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:43.859347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2c61d738-36cb-4e6b-bed9-a46367e3534f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:43.864206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c61d738-36cb-4e6b-bed9-a46367e3534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:43.906691 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:44.040922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.042017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.042583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.045396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.050170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.086781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 842/1671] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:44.094696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.095263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.095662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.124125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:44.125632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.136223 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 843/1672] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:44.137265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:44.138625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.186262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.190132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ffcbb-e80f-475b-bfb3-8bb60984ecd7 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.212365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7e2db-4234-46c7-978e-0ac3fa93cfbd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:44.216409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c41f6d-ed77-44cc-83e4-5f4205e04a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.216798 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 830/1673] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:44.217184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41f6d-ed77-44cc-83e4-5f4205e04a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.217475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41f6d-ed77-44cc-83e4-5f4205e04a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.217753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41f6d-ed77-44cc-83e4-5f4205e04a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.221019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2ab4-fbd3-4e63-ad25-50904017146f None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.221836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2ab4-fbd3-4e63-ad25-50904017146f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.222964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2ab4-fbd3-4e63-ad25-50904017146f None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.226297 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 831/1674] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:45:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:44.227954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2ab4-fbd3-4e63-ad25-50904017146f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:44.230775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c41f6d-ed77-44cc-83e4-5f4205e04a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.232433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c41f6d-ed77-44cc-83e4-5f4205e04a73 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.244838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 844/1675] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:44.246376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.246878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.247169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.251970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2ab4-fbd3-4e63-ad25-50904017146f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:44.268432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.269543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.269875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:44.276083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.277391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.280294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.316182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.321442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.361653 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 832/1676] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:44.426113 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 845/1677] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:44.463470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:44.465222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.514521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:44.516655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.529655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c1d2c-8d86-4282-805a-0393d7420b95 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:44.569926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.573974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.575680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d03d2f-7f8d-484d-8980-1abaf041ea06 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:44.576761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.577513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.594053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.597528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.598001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.600359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] PATH_INFO: `/v3/users/5eccda4fd5e9491b8f2f31abc6e92ed8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.605195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eccda4fd5e9491b8f2f31abc6e92ed8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.609256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.612279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.614535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.648237 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 833/1678] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:44.758668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eccda4fd5e9491b8f2f31abc6e92ed8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:44.760171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eccda4fd5e9491b8f2f31abc6e92ed8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:44.765339 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:44.800223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eccda4fd5e9491b8f2f31abc6e92ed8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:44.803134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eccda4fd5e9491b8f2f31abc6e92ed8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:44.823490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f271dd1-867d-4a1f-8b1f-50f7c9c594d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eccda4fd5e9491b8f2f31abc6e92ed8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:44.835847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:44.837963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:44.874278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcbe54-29a0-427a-bc67-39b7fc5a9d20 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:44.887022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:44.894707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.894707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.894707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] PATH_INFO: `/v3/users/604da253c7904c48b3693484caf63938` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.895449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=604da253c7904c48b3693484caf63938)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:44.895796 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 846/1679] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:44 2022] DELETE /identity/v3/users/5eccda4fd5e9491b8f2f31abc6e92ed8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:44.900469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:44.901002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4453-35c2-48a9-855f-a833a26428b4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:44.901794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4453-35c2-48a9-855f-a833a26428b4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:44.903398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4453-35c2-48a9-855f-a833a26428b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:44.957686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-781b4453-35c2-48a9-855f-a833a26428b4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:44.957686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-781b4453-35c2-48a9-855f-a833a26428b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.067318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604da253c7904c48b3693484caf63938'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:45.123251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604da253c7904c48b3693484caf63938'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:45.132305 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:45.167305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604da253c7904c48b3693484caf63938'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:45.184964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604da253c7904c48b3693484caf63938'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:45.192684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604da253c7904c48b3693484caf63938'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:45.199283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 847/1680] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:45.201657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181912-1c91-4c22-bf5b-43339c155800 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.202160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181912-1c91-4c22-bf5b-43339c155800 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.203004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181912-1c91-4c22-bf5b-43339c155800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.228007 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 834/1681] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:44 2022] DELETE /identity/v3/users/604da253c7904c48b3693484caf63938 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:45.231737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:45.236573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.300767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68181912-1c91-4c22-bf5b-43339c155800 None None] MFA Rules not processed for user `98c5142aba9a49bc8138fa10974c4ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:45.303385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68181912-1c91-4c22-bf5b-43339c155800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.407864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da2cc-5f76-4f26-bbe7-38944dcdeb4d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:45.424541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:45.430908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.430908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.430908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.505849 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 848/1682] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:45.511506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa386-11c9-4150-9867-8986c566b538 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.511850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa386-11c9-4150-9867-8986c566b538 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.512212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa386-11c9-4150-9867-8986c566b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.604653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-80afa386-11c9-4150-9867-8986c566b538 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:45.609098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80afa386-11c9-4150-9867-8986c566b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.656549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:45.660336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:45.686595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 835/1683] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:45.689435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:45.699456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.729719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6bff-b4f3-4be5-a165-80a4ed4edc50 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:45.754277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:45.754848 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:45.755295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.755628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.755884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.756645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:45.763171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:45.793889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 849/1684] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:45.794740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa386-11c9-4150-9867-8986c566b538 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:45.801116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80afa386-11c9-4150-9867-8986c566b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.810397 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 836/1685] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:45 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:45.811428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:45.815558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.836792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa386-11c9-4150-9867-8986c566b538 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:45.939135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a542c-10b0-4b1f-bc48-67f96fde76f8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:45.948259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:45.950177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.950702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.951490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.953903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:45.962962 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:45.989165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:45.990041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:45.990327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:45.990636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] PATH_INFO: `/v3/projects/bf468174e57f430686162dc3609aee30` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:45.992083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf468174e57f430686162dc3609aee30)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:45.993117 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:45:45.993117 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:45:45.993117 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:45:45.994348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.088655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.091640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.108365 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 837/1686] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:46.109870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:46.111438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.118828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf468174e57f430686162dc3609aee30', 'request_id': 'req-30317235-5eec-46a8-a52a-2f0bd81676d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.131033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dae5d-67d3-4d96-90c7-f3643b05d5b1 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:46.136429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf468174e57f430686162dc3609aee30', 'request_id': 'req-30317235-5eec-46a8-a52a-2f0bd81676d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.153192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf468174e57f430686162dc3609aee30', 'request_id': 'req-30317235-5eec-46a8-a52a-2f0bd81676d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.185946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] The token cache is being invalidate because project bf468174e57f430686162dc3609aee30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:46.187091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.188368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.190693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 850/1687] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:45 2022] DELETE /identity/v3/projects/bf468174e57f430686162dc3609aee30 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:46.191627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:46.193108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.260944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:46.262150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.262627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.262912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] PATH_INFO: `/v3/projects/bc47065b015e49349f0aa74a18e3f569` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.264533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc47065b015e49349f0aa74a18e3f569)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.266955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.322038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30317235-5eec-46a8-a52a-2f0bd81676d0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:46.328642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:46.329680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.330190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.330752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.333984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.344911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc47065b015e49349f0aa74a18e3f569', 'request_id': 'req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.352447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc47065b015e49349f0aa74a18e3f569', 'request_id': 'req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.354186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.355914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.362107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc47065b015e49349f0aa74a18e3f569', 'request_id': 'req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.367358 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 851/1688] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:46.368433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:46.370033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.387028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] The token cache is being invalidate because project bc47065b015e49349f0aa74a18e3f569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:46.387370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.388117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f14bb792-9dbb-4f5a-bc26-bb51dbac30b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.391493 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 838/1689] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:46 2022] DELETE /identity/v3/projects/bc47065b015e49349f0aa74a18e3f569 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:46.393464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742dbec-2f3e-4efb-aa8c-2b4dd58275f6 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.393769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742dbec-2f3e-4efb-aa8c-2b4dd58275f6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.394837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742dbec-2f3e-4efb-aa8c-2b4dd58275f6 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.397227 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 839/1690] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:46.398318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742dbec-2f3e-4efb-aa8c-2b4dd58275f6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:46.400383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8742dbec-2f3e-4efb-aa8c-2b4dd58275f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.409198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61cbf1-693a-47f4-b6d8-36938ce800a3 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:46.462759 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:46.464721 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:46.509774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742dbec-2f3e-4efb-aa8c-2b4dd58275f6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:46.516234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:46.517332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.517805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.518177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] PATH_INFO: `/v3/users/4e806cedbec04a928da4847139f28ef3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.520078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e806cedbec04a928da4847139f28ef3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.523863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.549653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:46.550602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.551146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.551530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.552367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.556103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.594295 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 852/1691] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:46 2022] POST /identity/v3/users => generated 308 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:46.595590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:46.597651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.621139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd384-371a-433c-8d2e-a9812a409741 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:46.622130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e806cedbec04a928da4847139f28ef3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.628494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:46.629628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.629913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.630799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] PATH_INFO: `/v3/projects/8da5cec61555493c84ee2f6eb46c4fc8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.632199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da5cec61555493c84ee2f6eb46c4fc8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:46.634853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:46.641759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e806cedbec04a928da4847139f28ef3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.655816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e806cedbec04a928da4847139f28ef3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.676634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e806cedbec04a928da4847139f28ef3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.677662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e806cedbec04a928da4847139f28ef3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.695660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 840/1692] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:46 2022] DELETE /identity/v3/users/4e806cedbec04a928da4847139f28ef3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:46.696660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:46.701575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.737598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da5cec61555493c84ee2f6eb46c4fc8', 'request_id': 'req-7c073d00-2d61-4b77-a2bb-72ace376113e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.760219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da5cec61555493c84ee2f6eb46c4fc8', 'request_id': 'req-7c073d00-2d61-4b77-a2bb-72ace376113e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.772806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da5cec61555493c84ee2f6eb46c4fc8', 'request_id': 'req-7c073d00-2d61-4b77-a2bb-72ace376113e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.795682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] The token cache is being invalidate because project 8da5cec61555493c84ee2f6eb46c4fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:46.796912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.798808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7c073d00-2d61-4b77-a2bb-72ace376113e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:46.806255 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 853/1693] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:46 2022] DELETE /identity/v3/projects/8da5cec61555493c84ee2f6eb46c4fc8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:46.806255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:46.808723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:46.810083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:46.844714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:46.846935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:46.889698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed197a5-53b2-4d0a-9afa-3dd38bf99e88 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.015089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.016489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.016968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.017448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] PATH_INFO: `/v3/users/9e62e50712c246aaa29c5f16ac7f54a6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.018996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e62e50712c246aaa29c5f16ac7f54a6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.022247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.028740 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:47.029676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 854/1694] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:47.030901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.033161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.057211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3701e57-f4bc-4bf0-9e43-f4b5831efcf2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.064096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.065152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.065637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.066113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.067115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.069072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.084831 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 855/1695] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:47.086049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.088169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.106125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3502d-d1fe-4cff-a2a0-13f9f4e29ae8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.120577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.121950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e62e50712c246aaa29c5f16ac7f54a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.124069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.125070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.125424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] PATH_INFO: `/v3/users/e0ec5422bbdd43dd95578a02f0d842fe` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.127410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ec5422bbdd43dd95578a02f0d842fe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.129727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.159100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e62e50712c246aaa29c5f16ac7f54a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.170978 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:47.181084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e62e50712c246aaa29c5f16ac7f54a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.195830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e62e50712c246aaa29c5f16ac7f54a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.196648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e62e50712c246aaa29c5f16ac7f54a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.209878 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 841/1696] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:46 2022] DELETE /identity/v3/users/9e62e50712c246aaa29c5f16ac7f54a6 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:47.211458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.213279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.247331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ec5422bbdd43dd95578a02f0d842fe'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.251705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ec5422bbdd43dd95578a02f0d842fe'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.280290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ec5422bbdd43dd95578a02f0d842fe'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.287219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ec5422bbdd43dd95578a02f0d842fe'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.305130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ec5422bbdd43dd95578a02f0d842fe'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.335656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 856/1697] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:47 2022] DELETE /identity/v3/users/e0ec5422bbdd43dd95578a02f0d842fe => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:47.336877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.339094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.362757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a620977-221d-4086-a54e-4a12be8f51b4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.435379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015fef-4d08-45fc-83ee-16f0b445f07a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.441108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.441874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.442166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.442447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] PATH_INFO: `/v3/projects/7596d2cf020740f98586a353aeacc1c1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.443869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7596d2cf020740f98586a353aeacc1c1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.445901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.447804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.449326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.450350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.453772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] PATH_INFO: `/v3/users/9ebe87606efb4df6b29c4da565e61022` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.456262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebe87606efb4df6b29c4da565e61022)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.458547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.541162 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:47.542252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7596d2cf020740f98586a353aeacc1c1', 'request_id': 'req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.555946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7596d2cf020740f98586a353aeacc1c1', 'request_id': 'req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.565797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7596d2cf020740f98586a353aeacc1c1', 'request_id': 'req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.578736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebe87606efb4df6b29c4da565e61022'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.596709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] The token cache is being invalidate because project 7596d2cf020740f98586a353aeacc1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:47.597014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.597764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.599725 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 857/1698] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:47 2022] DELETE /identity/v3/projects/7596d2cf020740f98586a353aeacc1c1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:47.600326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.609929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.616107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebe87606efb4df6b29c4da565e61022'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.628753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebe87606efb4df6b29c4da565e61022'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.641713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebe87606efb4df6b29c4da565e61022'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.643711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebe87606efb4df6b29c4da565e61022'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:47.686239 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 842/1699] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:47 2022] DELETE /identity/v3/users/9ebe87606efb4df6b29c4da565e61022 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:47.691787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.694081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.709960 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:47.820989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ee19c-78e9-4eb3-b24a-7eb7fc23aecc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.849348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58996a3e-07c0-4817-9ea5-12342855f72e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:47.866746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.868213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.868682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.869152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] PATH_INFO: `/v3/projects/dbaa7f1dfbd441c0a37b8c899ed00a0b/users/8589b1b6f413475e96a7905ad0b54118/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.901420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaa7f1dfbd441c0a37b8c899ed00a0b, user_id=8589b1b6f413475e96a7905ad0b54118, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.904743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.924278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 843/1700] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:47 2022] PUT /identity/v3/projects/dbaa7f1dfbd441c0a37b8c899ed00a0b/users/8589b1b6f413475e96a7905ad0b54118/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:47.925495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:47.928772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.940603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:47.942162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.942667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.943126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:47.945553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:47.969870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:47.973593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03820c5a-51b8-4dd0-be6c-c09a45647eac service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:47.996278 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 858/1701] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:47.999267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:47.999267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:47.999636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.019182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f1ccf-e075-4be0-a7ad-52a8da2bf22c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.032810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:48.033771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.034074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.035315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.035788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.036500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] PATH_INFO: `/v3/projects/fc607d723c324305b680b73588aa3e35` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.039081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc607d723c324305b680b73588aa3e35)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.043064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.046561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 859/1702] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:48.048318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.050714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.069439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ff70-816f-4524-9a86-9eb9ee25ab07 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.084196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.085136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.085424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.085708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] PATH_INFO: `/v3/users/2f8674d876eb4c3caba51b7d20a5b359` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.087988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8674d876eb4c3caba51b7d20a5b359)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.090460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.181763 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:48.199507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8674d876eb4c3caba51b7d20a5b359'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.200216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8674d876eb4c3caba51b7d20a5b359'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.216025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc607d723c324305b680b73588aa3e35', 'request_id': 'req-048df469-b505-43d8-aa9d-7680bc30062b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.223048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8674d876eb4c3caba51b7d20a5b359'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.223897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8674d876eb4c3caba51b7d20a5b359'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.224963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc607d723c324305b680b73588aa3e35', 'request_id': 'req-048df469-b505-43d8-aa9d-7680bc30062b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.232970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8674d876eb4c3caba51b7d20a5b359'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.236751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc607d723c324305b680b73588aa3e35', 'request_id': 'req-048df469-b505-43d8-aa9d-7680bc30062b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.258667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] The token cache is being invalidate because project fc607d723c324305b680b73588aa3e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:48.259102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.259821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.261927 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 860/1704] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:48 2022] DELETE /identity/v3/users/2f8674d876eb4c3caba51b7d20a5b359 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:48.263980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.265837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 844/1704] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:47 2022] DELETE /identity/v3/projects/fc607d723c324305b680b73588aa3e35 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:48.269724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.274916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.277753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.343253 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:48.400433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6544-29b5-4725-a492-ab32fdcd0459 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.408370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.410761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.411541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.412189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] PATH_INFO: `/v3/projects/6251d5c8807948a48b3af744869eba88` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.414394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6251d5c8807948a48b3af744869eba88)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.418249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.434295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df469-b505-43d8-aa9d-7680bc30062b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.445198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.446275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.447766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.448242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.450806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.455206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.482282 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 845/1705] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:48.484338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.488029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.526109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6251d5c8807948a48b3af744869eba88', 'request_id': 'req-f97f884a-408b-434d-9608-3ddb9acb91da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.541445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6251d5c8807948a48b3af744869eba88', 'request_id': 'req-f97f884a-408b-434d-9608-3ddb9acb91da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.559635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6251d5c8807948a48b3af744869eba88', 'request_id': 'req-f97f884a-408b-434d-9608-3ddb9acb91da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.587206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] The token cache is being invalidate because project 6251d5c8807948a48b3af744869eba88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:48.587520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.588522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.590880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 861/1706] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:48 2022] DELETE /identity/v3/projects/6251d5c8807948a48b3af744869eba88 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:48.591956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.593496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.627577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7171b36-786b-4ff9-adf0-83c474cc620c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.677504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f884a-408b-434d-9608-3ddb9acb91da admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:48.689768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.690696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.690977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.691251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] PATH_INFO: `/v3/projects/b6d37e429f1945f98b9a5fd128e77af8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.692688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d37e429f1945f98b9a5fd128e77af8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.694951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.698554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:48.699365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.699725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.700054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.704276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.722834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:48.724402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37474aff-bc9a-4b2b-a162-755e75ba4a60 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:48.742369 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 846/1707] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:48.747864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.748709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.750435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.772634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d37e429f1945f98b9a5fd128e77af8', 'request_id': 'req-4f592b53-401e-4c77-8cdc-fa3dcf01d755'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.784239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d37e429f1945f98b9a5fd128e77af8', 'request_id': 'req-4f592b53-401e-4c77-8cdc-fa3dcf01d755'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.790858 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:48.795170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d37e429f1945f98b9a5fd128e77af8', 'request_id': 'req-4f592b53-401e-4c77-8cdc-fa3dcf01d755'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.797061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] MFA Rules not processed for user `ecd5513ec3344d4fa1da80247a88cf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:48.798636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.837032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] The token cache is being invalidate because project b6d37e429f1945f98b9a5fd128e77af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:48.837394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.838092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f592b53-401e-4c77-8cdc-fa3dcf01d755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:48.840034 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:48.841682 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 862/1708] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:48 2022] DELETE /identity/v3/projects/b6d37e429f1945f98b9a5fd128e77af8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:48.846304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc17e-6efc-48e6-8480-a9e9e89ed335 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:48.847015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc17e-6efc-48e6-8480-a9e9e89ed335 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:48.847505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc17e-6efc-48e6-8480-a9e9e89ed335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:48.893513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7ffdc17e-6efc-48e6-8480-a9e9e89ed335 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:48.896048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7ffdc17e-6efc-48e6-8480-a9e9e89ed335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:48.965772 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 847/1709] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:48.966906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:48.969870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.062035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9842b2-064e-4323-81c5-1846aa54b87a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:49.069252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:49.070312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.070649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.071081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] PATH_INFO: `/v3/projects/dbaa7f1dfbd441c0a37b8c899ed00a0b/users/8589b1b6f413475e96a7905ad0b54118/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.074023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaa7f1dfbd441c0a37b8c899ed00a0b, user_id=8589b1b6f413475e96a7905ad0b54118, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:49.078632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:49.091969 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 863/1710] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:49.093995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c87a0-a757-450d-a58b-b01fbaf424b6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.094283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c87a0-a757-450d-a58b-b01fbaf424b6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.094588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c87a0-a757-450d-a58b-b01fbaf424b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.105302 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 848/1711] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:48 2022] PUT /identity/v3/projects/dbaa7f1dfbd441c0a37b8c899ed00a0b/users/8589b1b6f413475e96a7905ad0b54118/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:49.107937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:49.127820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1a2c87a0-a757-450d-a58b-b01fbaf424b6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:49.128918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.130616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a2c87a0-a757-450d-a58b-b01fbaf424b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.337033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9487-6239-41dc-bc47-dc264ad75c2a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:49.346021 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 864/1712] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:49.349221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.349718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.351451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.353018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:49.353957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.354249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.354564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] PATH_INFO: `/v3/projects/7e98daf639af4d7181e19ab57220fb4a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.360014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e98daf639af4d7181e19ab57220fb4a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:49.362121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:49.404400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:49.407284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.424728 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 865/1713] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:49.428309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:49.430339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.499205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e98daf639af4d7181e19ab57220fb4a', 'request_id': 'req-bd125d70-4bfa-453a-82db-d255ba0e8981'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.512612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e98daf639af4d7181e19ab57220fb4a', 'request_id': 'req-bd125d70-4bfa-453a-82db-d255ba0e8981'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.516091 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:49.527585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e98daf639af4d7181e19ab57220fb4a', 'request_id': 'req-bd125d70-4bfa-453a-82db-d255ba0e8981'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.547946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] The token cache is being invalidate because project 7e98daf639af4d7181e19ab57220fb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:49.548256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.549068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bd125d70-4bfa-453a-82db-d255ba0e8981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.551060 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 849/1714] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:49 2022] DELETE /identity/v3/projects/7e98daf639af4d7181e19ab57220fb4a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:49.552565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.552857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.553468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.579531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:49.580875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.587851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654e66-6dca-4737-a923-9ce19dfa745c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:49.612822 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:49.666024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 850/1715] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:49.670929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:49.672835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.679079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:49.680080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.680566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.681105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.683481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.688184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c3f6-85b3-46a9-82a5-b2bf8c5c1867 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:49.697684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:49.698639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.699162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.699162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] PATH_INFO: `/v3/projects/f6768e8c5a234adb8892c51f92d69fc5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.701169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6768e8c5a234adb8892c51f92d69fc5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:49.704684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:49.819237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:49.821170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f272-bf97-40c0-ac1e-ea81cb33e7fb service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:49.829460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6768e8c5a234adb8892c51f92d69fc5', 'request_id': 'req-7b427370-38de-4014-9714-7eb9eb7dae31'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.835608 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 866/1716] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:49.837570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b5167-381e-4fc0-ae79-8b4285f7eda1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.837989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b5167-381e-4fc0-ae79-8b4285f7eda1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.838370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b5167-381e-4fc0-ae79-8b4285f7eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.848206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6768e8c5a234adb8892c51f92d69fc5', 'request_id': 'req-7b427370-38de-4014-9714-7eb9eb7dae31'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.862875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6768e8c5a234adb8892c51f92d69fc5', 'request_id': 'req-7b427370-38de-4014-9714-7eb9eb7dae31'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.879899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-278b5167-381e-4fc0-ae79-8b4285f7eda1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:49.881342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-278b5167-381e-4fc0-ae79-8b4285f7eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:49.884989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] The token cache is being invalidate because project f6768e8c5a234adb8892c51f92d69fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:49.885291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.886046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b427370-38de-4014-9714-7eb9eb7dae31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:49.888122 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 851/1717] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:49 2022] DELETE /identity/v3/projects/f6768e8c5a234adb8892c51f92d69fc5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:49.890585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:49.891039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:49.891261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:49.939123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:49.940848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.039136 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 867/1718] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:50.041680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.042299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.042807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.076843 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 852/1719] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:50.078463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.080286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.082995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:50.084235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.094677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790e3f4-8cc0-46ed-b640-aea1fc97b10b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.096515 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 868/1720] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:50.097406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.099443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.101724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.102426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.102753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.103122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.104637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:50.104962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.107087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd2b6-4015-4f50-a266-e2a76f0d7641 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.118140 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:50.124945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a46029-677e-4d15-abee-abb2d2e3e6a3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.130160 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 853/1721] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:50.132104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c93ad-7ce9-4c4d-9a8d-8396042c1d5e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.133048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c93ad-7ce9-4c4d-9a8d-8396042c1d5e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.133872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c93ad-7ce9-4c4d-9a8d-8396042c1d5e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.137538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 854/1722] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:45:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:50.138449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c93ad-7ce9-4c4d-9a8d-8396042c1d5e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.145282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.146878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.147916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.149506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] PATH_INFO: `/v3/users/d39426571cd344b3b9e7f3a0d2773e6e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.151622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39426571cd344b3b9e7f3a0d2773e6e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.154317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.155220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c93ad-7ce9-4c4d-9a8d-8396042c1d5e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.166655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.167793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.168092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.168425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.169308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:50.169627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.174268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.208666 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 855/1723] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:50.209755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.224252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1b7e-718e-41cb-b6ef-bd5e2f8867d1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.229930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.230664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.231173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.231458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.232834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:50.233155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.234900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e3f0-bfd5-4a53-b836-5d56da52f53e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.255700 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 856/1724] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:50.255700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.255700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.256217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39426571cd344b3b9e7f3a0d2773e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:50.256377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.256532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39426571cd344b3b9e7f3a0d2773e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:50.257378 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:50.279233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:50.281426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39426571cd344b3b9e7f3a0d2773e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:50.282034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.282202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39426571cd344b3b9e7f3a0d2773e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:50.295270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1766f4b1-a1b3-47d5-ac73-99d70cddefc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39426571cd344b3b9e7f3a0d2773e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:50.296483 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 857/1725] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:50.297719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.299398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.321452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 869/1726] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:50 2022] DELETE /identity/v3/users/d39426571cd344b3b9e7f3a0d2773e6e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:50.326906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0983f-bd85-4057-a81c-f43f8b363338 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.329399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272ffc-83e4-4284-a115-963229517ece None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.330848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272ffc-83e4-4284-a115-963229517ece None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.331570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272ffc-83e4-4284-a115-963229517ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.373081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-58272ffc-83e4-4284-a115-963229517ece None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:50.376911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58272ffc-83e4-4284-a115-963229517ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.501422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.502627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.502924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.503207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.504289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.507756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.581780 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 858/1727] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/projects => generated 401 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:50.582731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.588456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.627472 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 870/1728] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:50.629156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272ffc-83e4-4284-a115-963229517ece None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.634981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58272ffc-83e4-4284-a115-963229517ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.687676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272ffc-83e4-4284-a115-963229517ece None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.728931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8214-2bc5-4d30-88fd-7b3f8de3f30e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:50.736844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.738161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.738889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.739185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.740007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.742291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.821362 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 859/1729] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:50.821561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:50.822351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.822765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.822869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.823130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.823917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:50.825979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:50.895562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 871/1730] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/projects => generated 383 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:50.895562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:50.953828 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:51.022698 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:51.024791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e15820-87d9-45be-9ceb-68a874ced6eb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.079206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fcd5d-e56b-4052-ab22-c4d2dadb4a23 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.103354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.106628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.107247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.107951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.113597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.116054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.217353 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 872/1731] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/users => generated 301 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:51.221616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.233136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.234662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:51.235179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.235599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.235997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.236953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:51.237703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.239528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.260961 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 860/1732] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:51.263011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.295399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283bca7-c570-4d7c-9a11-54d1bb6b94f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.311289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.311719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.312007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.312317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.313133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.315538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.359971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 861/1733] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:51 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:51.362044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.386924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e999e33-f0d2-4f5a-9edd-f0a163b3690a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.404544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.410134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.410860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.412400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.417288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.422485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.465807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76720c4b-ac06-408e-848b-402f82742031 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.474432 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 862/1734] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:51 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:51.481811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.483056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.485311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.486422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:51.486924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.487290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.519297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860951-0442-46e0-a0f9-0656a67b556b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.535479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.536474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.536865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.537184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] PATH_INFO: `/v3/projects/b9edda9802af44d8a98cea08662d4938` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.538747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9edda9802af44d8a98cea08662d4938)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.543057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.645304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9edda9802af44d8a98cea08662d4938', 'request_id': 'req-01425d21-bc3a-4196-975f-3c8833766010'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:51.662689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9edda9802af44d8a98cea08662d4938', 'request_id': 'req-01425d21-bc3a-4196-975f-3c8833766010'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:51.683573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9edda9802af44d8a98cea08662d4938', 'request_id': 'req-01425d21-bc3a-4196-975f-3c8833766010'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:51.700545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.703617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.719500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] The token cache is being invalidate because project b9edda9802af44d8a98cea08662d4938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:45:51.720021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:51.721436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:51.723639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 873/1735] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:51.724812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.731273 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 863/1736] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:45:51 2022] DELETE /identity/v3/projects/b9edda9802af44d8a98cea08662d4938 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:51.731273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.733077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:51.744424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de525-7d9b-46f6-b8fe-26ef5da0c58c service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.797748 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:51.841395 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:51.864931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.865131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.865329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.865618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.866443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.869664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.886683 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 874/1737] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:51.890266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.892777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:51.913291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d74f-2cb9-43c9-ad69-e0b591eef882 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.920842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425d21-bc3a-4196-975f-3c8833766010 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:51.928856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.931221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.932597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.932937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.933797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.936263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e7f2-6cb5-46a5-bd99-456569d2714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:51.937677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e7f2-6cb5-46a5-bd99-456569d2714b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:51.937973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e7f2-6cb5-46a5-bd99-456569d2714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:51.938258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e7f2-6cb5-46a5-bd99-456569d2714b admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:51.940054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.944270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4e7f2-6cb5-46a5-bd99-456569d2714b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:51.945967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4e7f2-6cb5-46a5-bd99-456569d2714b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:51.965137 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 875/1738] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:51.967008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:51.972100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:52.004707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac417c4-273c-48bf-a4f3-5c7f3a2fe562 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.020270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.022357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.022900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.023207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.024001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.029353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.038194 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 864/1739] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:51 2022] POST /identity/v3/projects => generated 393 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:52.042298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.046396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.046396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.059890 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 876/1740] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:52.060994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.073862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:52.097296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:52.097596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:52.109725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce400f99-fa8f-454a-aebd-3d9f551f15b8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.243564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.244287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.244581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.244863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.245785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.249664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.267629 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 865/1741] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:52.279772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 877/1742] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:52.279772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.281731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.295564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347618e-56ff-46d6-9670-ab197a88d2f6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.299561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77911-f665-4503-8a5c-76d77c774734 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.304548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.305766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.306732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.307456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.308618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.310847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.319858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3b4d-844e-452a-856e-4ed9555cf0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.321535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3b4d-844e-452a-856e-4ed9555cf0fc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.322059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3b4d-844e-452a-856e-4ed9555cf0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.322577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3b4d-844e-452a-856e-4ed9555cf0fc admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.323683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3b4d-844e-452a-856e-4ed9555cf0fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.325866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3b4d-844e-452a-856e-4ed9555cf0fc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.345951 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 866/1743] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:52.347534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.386173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091559fb-ceff-4b57-94ff-b37338c59b25 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.387054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 878/1744] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:52 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:52.390261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.392287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.393189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.400916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.401871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.403515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.403991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.404921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.410088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.433200 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 867/1745] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:52.435020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.447335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:52.448643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:52.468760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db823-2427-42bb-9634-15d0721df367 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.472662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 879/1746] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:52.481333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.497382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.498309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.498640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.498962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] PATH_INFO: `/v3/projects/d59f916a3a344699895d986405bc1864/users/263ca4f832e24d0e823cf76fd436b9d4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.523424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98c7e-a318-4959-ab32-8797dd15dc32 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.532061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.533430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.535076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.535076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] PATH_INFO: `/v3/projects/d9dc67252b914e1c9533922b83036762/users/24cbee1f0b7a4f31b87b0c74df032aea/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.552126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59f916a3a344699895d986405bc1864, user_id=263ca4f832e24d0e823cf76fd436b9d4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.555233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.559227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dc67252b914e1c9533922b83036762, user_id=24cbee1f0b7a4f31b87b0c74df032aea, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.566870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.579833 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 868/1747] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:52 2022] PUT /identity/v3/projects/d59f916a3a344699895d986405bc1864/users/263ca4f832e24d0e823cf76fd436b9d4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:52.591402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.596151 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 880/1748] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:52 2022] PUT /identity/v3/projects/d9dc67252b914e1c9533922b83036762/users/24cbee1f0b7a4f31b87b0c74df032aea/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:52.597654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.740961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdafe3-9f47-4e90-8293-a3eb8481b9fe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.751553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c5b5-6ca5-476b-a57d-018ac6cbd501 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.775496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e612c5-571d-4f78-b3ed-cd3126efae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.777063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e612c5-571d-4f78-b3ed-cd3126efae34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.777382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e612c5-571d-4f78-b3ed-cd3126efae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.777653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e612c5-571d-4f78-b3ed-cd3126efae34 admin admin] PATH_INFO: `/v3/projects/fa195684c200448899a3318ed478b4a4/users/6e786e70a07b447a873a3e45cd20c56f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.780633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.781398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.781688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.781970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.782886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.784832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.799940 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:52.818083 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 869/1749] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:52.820437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:52.839553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e612c5-571d-4f78-b3ed-cd3126efae34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa195684c200448899a3318ed478b4a4, user_id=6e786e70a07b447a873a3e45cd20c56f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.841679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2404a81-1234-41fb-b4fa-7c4d6b71a4a2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:52.842447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e612c5-571d-4f78-b3ed-cd3126efae34 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.855427 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:52.862128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:52.862980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.863263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.863586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.864563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:45:52.864883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:52.868274 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 881/1750] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:52 2022] PUT /identity/v3/projects/fa195684c200448899a3318ed478b4a4/users/6e786e70a07b447a873a3e45cd20c56f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:52.872132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.872426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.873216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.879189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c418-a5e0-4518-b129-cca6ae7d18fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:52.898268 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 870/1751] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:52.900369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdc0d-7698-4cc0-822a-08c787c2640f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:52.900705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdc0d-7698-4cc0-822a-08c787c2640f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:52.901179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdc0d-7698-4cc0-822a-08c787c2640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:52.938973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] MFA Rules not processed for user `263ca4f832e24d0e823cf76fd436b9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:52.941135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:52.947914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-40bfdc0d-7698-4cc0-822a-08c787c2640f None None] MFA Rules not processed for user `24cbee1f0b7a4f31b87b0c74df032aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:52.949175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40bfdc0d-7698-4cc0-822a-08c787c2640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:53.111124 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 882/1752] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:53.111963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.114988 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 871/1753] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:53.123067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b798-550a-4d83-bee7-fed639b52a13 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.123597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b798-550a-4d83-bee7-fed639b52a13 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.124884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b798-550a-4d83-bee7-fed639b52a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.183799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-51b4b798-550a-4d83-bee7-fed639b52a13 None None] MFA Rules not processed for user `6e786e70a07b447a873a3e45cd20c56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:53.185203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-51b4b798-550a-4d83-bee7-fed639b52a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:53.196513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e78eb-3772-46e8-9014-8828f879de8c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.203624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.204349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.204640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.204923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.205966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.207801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.226768 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 883/1754] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:53.227725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.242670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b3197-5116-4e04-a833-e97f11d890da admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.250404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.251426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.251725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.252012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.252729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.254720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.273099 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 872/1755] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:53.279169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91aa86-22f9-40aa-9b92-3ffcc7f17067 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.279726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91aa86-22f9-40aa-9b92-3ffcc7f17067 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.280006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91aa86-22f9-40aa-9b92-3ffcc7f17067 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.281900 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 873/1756] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:45:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:53.283533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91aa86-22f9-40aa-9b92-3ffcc7f17067 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.298631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91aa86-22f9-40aa-9b92-3ffcc7f17067 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.299391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 884/1757] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:53.300360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.393696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d345e67-3345-4e82-88d5-11b2e28815de admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.396327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.397429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.397915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.398338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.400259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.400478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.400946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.401675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.401675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.402194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.403703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.404636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.411452 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:53.420290 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:53.449845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 874/1758] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:53.450917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.456827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:53.471239 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 885/1759] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:53.473960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.584390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f597-b264-40fc-95ea-473e7ba2401d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.649052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8366ad-837e-4250-bd60-87826be4e71f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.667353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.668430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.668828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.669214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] PATH_INFO: `/v3/projects/cf1d1e9208774b7bb5db110951b4fd41/users/14009e6b6fa045a28719e38b9eca6e2f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.701669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1d1e9208774b7bb5db110951b4fd41, user_id=14009e6b6fa045a28719e38b9eca6e2f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.705477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.708729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.709863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.710395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.711377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.713987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:53.731393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.734225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d133-32fa-48c4-ab9c-c9feb4ca454c service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.746102 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 886/1760] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:53 2022] PUT /identity/v3/projects/cf1d1e9208774b7bb5db110951b4fd41/users/14009e6b6fa045a28719e38b9eca6e2f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:53.758692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:53.762285 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 875/1761] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:53.764988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.766552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.768015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.820522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:53.822880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:53.879730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7b6d-f81c-48ea-8893-f065cd5c259a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:53.887903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:53.888963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:53.891081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:53.891368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:53.892114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:53.894121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:53.951093 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 887/1762] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:53.951093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.039554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 876/1763] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:54.040669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.062058 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:54.071638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1c72-47f6-47b9-9752-90bec3877b45 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.079774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887be27-e40c-422e-9980-acf0b9b46878 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.083286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.086575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.089076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.089442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.092311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.103954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.105875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e64b3-ae74-4b70-b3fd-38cee0b7124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.106607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e64b3-ae74-4b70-b3fd-38cee0b7124c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.106896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e64b3-ae74-4b70-b3fd-38cee0b7124c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.107177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e64b3-ae74-4b70-b3fd-38cee0b7124c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.107899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e64b3-ae74-4b70-b3fd-38cee0b7124c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.117398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e64b3-ae74-4b70-b3fd-38cee0b7124c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.140996 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:54.168178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 877/1764] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:54 2022] POST /identity/v3/users => generated 308 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:54.169135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.191041 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 888/1765] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:53 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:54.193217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.202742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.203684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.209871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f771ed-d614-4d4c-ad09-e76a4f632e4d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.226047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.226786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.227078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.227364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.228223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.230581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.241606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] MFA Rules not processed for user `14009e6b6fa045a28719e38b9eca6e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:54.243107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:54.277555 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 878/1766] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:54 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:54.278420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.305201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c6afd-c007-41ad-be14-39d76107a33f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.317209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.317813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.318099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.318379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.319117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.321619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.370325 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 879/1767] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:54 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:54.371394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.378165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:54.453789 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 889/1768] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:54.460905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.495547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fec995-ea6c-4f3b-b9d4-3f608abea3ec None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.510787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.511494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.511953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.512239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.514006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.516490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.519374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e5f5-bf79-4343-9b61-3db17a654afd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.526254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.526961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.527358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.527642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.531262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 890/1769] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:54.532085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.547756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5382ba6-84c6-4701-b664-60a4d7641a4e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.556613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.557402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.557981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.558269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.559764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.561733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.579724 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 891/1770] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:54.580676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.595819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a0468-8352-45be-b730-dce6b1e36f20 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.610674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.614966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.616741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.617373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.621040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.627221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.675055 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 892/1771] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:54.677409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.705943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63397a5-c635-4ed0-bd18-9e5810c20fdf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.706374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.708027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.720138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.721975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.723545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.724983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.726994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.730809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.748639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 880/1772] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:54.749626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.773689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6b0a5-cb84-443e-b0bc-287257f92d65 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.792523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.793102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.793394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.794118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.794874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.796964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:54.815323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 893/1773] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:54.819406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.867934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d17d-976c-443c-822f-94f0ef87d0ce admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:54.880870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:54.881859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:54.882148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:54.882427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] PATH_INFO: `/v3/projects/4c3211f2437f483e88eb1d5a9deac06b/users/a8d2c23f408e47d58999c88627b18298/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:54.883773 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 881/1774] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:54 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:54.884843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:54.941537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3211f2437f483e88eb1d5a9deac06b, user_id=a8d2c23f408e47d58999c88627b18298, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:54.953318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.003061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 894/1775] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:54 2022] PUT /identity/v3/projects/4c3211f2437f483e88eb1d5a9deac06b/users/a8d2c23f408e47d58999c88627b18298/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:55.006239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.012087 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:55.080666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6ab2-dfe9-441a-94a1-0f823150321d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.175005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5f432-31cc-406b-9d1a-3814f8c5f0b0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.192272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.193915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.194434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.194992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] PATH_INFO: `/v3/projects/5018447f81ca46efab9e5c9dde5963d1/users/337b2d7590a74b3c94c393746d7b2d7c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.226185 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:55.234949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.236159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.237006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.237939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.240101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5018447f81ca46efab9e5c9dde5963d1, user_id=337b2d7590a74b3c94c393746d7b2d7c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.240608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.244976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.253980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.289420 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 882/1776] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:55.298139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.303166 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 895/1777] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:55 2022] PUT /identity/v3/projects/5018447f81ca46efab9e5c9dde5963d1/users/337b2d7590a74b3c94c393746d7b2d7c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:55.303166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.346353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72229841-37d0-4ba9-9cc4-5ba78f2002d0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.512609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.514283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.515006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.515639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] PATH_INFO: `/v3/projects/80fd3719116b45bf89239cc6eceabd15/users/0a54caca9afc4d36b2ee2f8e59c15906/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.535698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb1aa-0cc8-455f-852d-a6fbc2049b8d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.547361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fd3719116b45bf89239cc6eceabd15, user_id=0a54caca9afc4d36b2ee2f8e59c15906, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.553021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.554202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.554323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.554725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.555222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.556534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.567139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.581132 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 883/1778] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:55 2022] PUT /identity/v3/projects/80fd3719116b45bf89239cc6eceabd15/users/0a54caca9afc4d36b2ee2f8e59c15906/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:55.582717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.656241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 896/1779] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:55 2022] POST /identity/v3/users => generated 303 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:55.656241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.670358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197d15-cc59-4dac-b5ff-90bf76b532f2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.678216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.679405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.679855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.680401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.681397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.684666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.699120 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 884/1780] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:55.701096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.706775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c8fef-453d-40e2-802b-491ecbec6306 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.713914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.719891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.721792 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:55.721955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.728544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] PATH_INFO: `/v3/projects/0146c1a6200a489bba0678cafd811142/users/8c23b07915b44a599b24f69a34a46076/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.739020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c7e21-5d8f-42e8-8ae3-dba52b74729d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.752703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.753055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.753279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.753707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.754488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.757861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.779867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0146c1a6200a489bba0678cafd811142, user_id=8c23b07915b44a599b24f69a34a46076, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.784529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.789018 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 885/1781] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:55.790178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.804373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f38fb-8918-4d74-8d83-cc2672b93ad3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.825566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 897/1782] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:55 2022] PUT /identity/v3/projects/0146c1a6200a489bba0678cafd811142/users/8c23b07915b44a599b24f69a34a46076/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:55.827110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.897060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.897960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.898256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.898561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.899314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.902523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.922577 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 886/1783] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:55.923554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:55.935382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed384d5-98e1-4e60-ac2a-75466eee2c80 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:55.941682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:55.942275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:55.942729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:55.942893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] PATH_INFO: `/v3/projects/4c3211f2437f483e88eb1d5a9deac06b/users/a8d2c23f408e47d58999c88627b18298/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:55.945362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3211f2437f483e88eb1d5a9deac06b, user_id=a8d2c23f408e47d58999c88627b18298, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:55.949068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:55.976383 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 887/1784] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:55 2022] PUT /identity/v3/projects/4c3211f2437f483e88eb1d5a9deac06b/users/a8d2c23f408e47d58999c88627b18298/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:55.977118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:56.031380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1ce7-ef77-4a8d-8d0f-94440b003c23 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:56.174119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1629bc-ead6-4270-8705-488d097be171 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:56.189776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600784a-2687-411e-9831-590b873b50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:56.190974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600784a-2687-411e-9831-590b873b50f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.191263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600784a-2687-411e-9831-590b873b50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.191545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600784a-2687-411e-9831-590b873b50f2 admin admin] PATH_INFO: `/v3/projects/5018447f81ca46efab9e5c9dde5963d1/users/337b2d7590a74b3c94c393746d7b2d7c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.194957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600784a-2687-411e-9831-590b873b50f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5018447f81ca46efab9e5c9dde5963d1, user_id=337b2d7590a74b3c94c393746d7b2d7c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:56.199554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600784a-2687-411e-9831-590b873b50f2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:56.211034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:56.211888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.212293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.212804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.213701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:56.216666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:56.219495 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:56.234620 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 888/1785] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:55 2022] PUT /identity/v3/projects/5018447f81ca46efab9e5c9dde5963d1/users/337b2d7590a74b3c94c393746d7b2d7c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:56.234620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514271f9-f24d-4ccf-aa9e-74e0691b65c5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.234620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514271f9-f24d-4ccf-aa9e-74e0691b65c5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.234620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514271f9-f24d-4ccf-aa9e-74e0691b65c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.271469 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 898/1786] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:56.272447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:56.293073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e7b2-de43-4f47-a8a1-adcbacf90d96 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:56.295700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-514271f9-f24d-4ccf-aa9e-74e0691b65c5 None None] MFA Rules not processed for user `8c23b07915b44a599b24f69a34a46076`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:56.296917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-514271f9-f24d-4ccf-aa9e-74e0691b65c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:56.433371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb494417-91cc-4de5-aa50-b77813658517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:56.434653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494417-91cc-4de5-aa50-b77813658517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.434950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494417-91cc-4de5-aa50-b77813658517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.435233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494417-91cc-4de5-aa50-b77813658517 admin admin] PATH_INFO: `/v3/projects/80fd3719116b45bf89239cc6eceabd15/users/0a54caca9afc4d36b2ee2f8e59c15906/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.438319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb494417-91cc-4de5-aa50-b77813658517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fd3719116b45bf89239cc6eceabd15, user_id=0a54caca9afc4d36b2ee2f8e59c15906, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:56.441135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb494417-91cc-4de5-aa50-b77813658517 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:56.457938 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:56.458313 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 889/1788] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:56.460832 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 899/1787] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:56 2022] PUT /identity/v3/projects/80fd3719116b45bf89239cc6eceabd15/users/0a54caca9afc4d36b2ee2f8e59c15906/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:56.462295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.462750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.463144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.463566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.463869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.464157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.513900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] MFA Rules not processed for user `337b2d7590a74b3c94c393746d7b2d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:56.516990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:56.521772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] MFA Rules not processed for user `a8d2c23f408e47d58999c88627b18298`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:56.524566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:56.685488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 890/1789] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:56.687321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:56.700438 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 900/1790] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:56.705024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:56.826795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f4fe3-e9b3-4d2c-b722-489d9eff9557 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:56.841958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd3f4-021b-4adf-8174-cacd80dabb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:56.842757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd3f4-021b-4adf-8174-cacd80dabb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.843043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd3f4-021b-4adf-8174-cacd80dabb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.843320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd3f4-021b-4adf-8174-cacd80dabb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.844038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bd3f4-021b-4adf-8174-cacd80dabb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:56.845958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bd3f4-021b-4adf-8174-cacd80dabb78 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:56.856532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c04d9-80a4-4856-80a5-2b2c327412a3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:56.866955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:56.867887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.868176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.868457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] PATH_INFO: `/v3/projects/4d9e57abb2b4468fb85d8b8412835d67/users/652c442498b042be8bba0a921dca36ea/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.909851 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 901/1791] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:45:56 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:56.911999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:56.912477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:56.912905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:56.914468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9e57abb2b4468fb85d8b8412835d67, user_id=652c442498b042be8bba0a921dca36ea, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:56.921953 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:56.934662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:56.954878 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 891/1792] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:56 2022] PUT /identity/v3/projects/4d9e57abb2b4468fb85d8b8412835d67/users/652c442498b042be8bba0a921dca36ea/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:56.956308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:56.958591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:56.966155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] MFA Rules not processed for user `0a54caca9afc4d36b2ee2f8e59c15906`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:56.968352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:57.102289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eb54a-53ad-45cb-a60c-af483319e0c3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.105043 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 902/1793] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:57.108625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.110618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:57.115934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.117036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.117658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.119176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.127424 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:57.161449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e5b0d-5503-4073-a567-c085f24189f2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.179618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.181307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.181307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.181307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.304868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.309768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.333229 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 892/1794] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:57.341383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.355445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.360652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.388348 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 903/1795] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:57.390137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.493072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fe222-e3a3-4305-b7e5-ef8898c14112 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.500836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.501647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.501774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0892-670c-4e18-84e7-84479f9048d7 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.502111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.502600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.503368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.505713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.507666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3c53-40f1-4bb2-ac9a-fa7b59cb6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.508426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3c53-40f1-4bb2-ac9a-fa7b59cb6568 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.508767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3c53-40f1-4bb2-ac9a-fa7b59cb6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.509048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3c53-40f1-4bb2-ac9a-fa7b59cb6568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.509943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3c53-40f1-4bb2-ac9a-fa7b59cb6568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.511626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3c53-40f1-4bb2-ac9a-fa7b59cb6568 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.545406 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 904/1796] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:57.545406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.545406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.545406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.546396 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 893/1797] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:45:57 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:45:57.547428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.580819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acd904-e349-4f11-9e9b-4ffa299e0a75 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.593298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.593976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.594263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.594596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.600554 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:57.614174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.615542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.643674 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 894/1798] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:57.645120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:57.646768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:57.647017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.676500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc94a-fa79-49e6-a35f-9c2789e36c95 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.696304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.697194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.697635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.698064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.774148 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 905/1799] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:57.775197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.778125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.780699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.792978 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 895/1800] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:57.793879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.809385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3147ed-f7d6-4e8f-8ff1-9dfa299609b3 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.814232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2d965-2539-45a5-8260-d7fc68d1fd05 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:57.821339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7711e-276c-4b66-a8a2-486641d0148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.821339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7711e-276c-4b66-a8a2-486641d0148d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.823548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7711e-276c-4b66-a8a2-486641d0148d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.823548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7711e-276c-4b66-a8a2-486641d0148d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.824325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7711e-276c-4b66-a8a2-486641d0148d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.825128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6469af-5d69-42c5-b601-0ae152e537a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:57.826551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6469af-5d69-42c5-b601-0ae152e537a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.827530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6469af-5d69-42c5-b601-0ae152e537a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.827944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6469af-5d69-42c5-b601-0ae152e537a9 admin admin] PATH_INFO: `/v3/projects/4d9e57abb2b4468fb85d8b8412835d67/users/652c442498b042be8bba0a921dca36ea/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.830741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6469af-5d69-42c5-b601-0ae152e537a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9e57abb2b4468fb85d8b8412835d67, user_id=652c442498b042be8bba0a921dca36ea, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:57.833315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7711e-276c-4b66-a8a2-486641d0148d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.834199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6469af-5d69-42c5-b601-0ae152e537a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:57.848126 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 896/1801] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:57.849381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 906/1802] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:57 2022] PUT /identity/v3/projects/4d9e57abb2b4468fb85d8b8412835d67/users/652c442498b042be8bba0a921dca36ea/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:57.849506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.849769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.850055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.851411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec624f6-f9e1-4349-a8ee-096c4667612f None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:57.851851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec624f6-f9e1-4349-a8ee-096c4667612f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:57.852282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec624f6-f9e1-4349-a8ee-096c4667612f None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:57.853739 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 907/1803] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:45:57.855953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec624f6-f9e1-4349-a8ee-096c4667612f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:57.870952 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:57.925439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] MFA Rules not processed for user `8589b1b6f413475e96a7905ad0b54118`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:57.927794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:58.029549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec624f6-f9e1-4349-a8ee-096c4667612f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.036399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff66334-264e-46f2-b43b-860d04cec6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.037579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff66334-264e-46f2-b43b-860d04cec6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.038020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff66334-264e-46f2-b43b-860d04cec6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.038444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff66334-264e-46f2-b43b-860d04cec6bc admin admin] PATH_INFO: `/v3/projects/9f8d99fad9ba4fa78e7b1f2917c7fc64/users/ff7a2d105dc74a1cbf856e334c47dabb/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.061002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff66334-264e-46f2-b43b-860d04cec6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8d99fad9ba4fa78e7b1f2917c7fc64, user_id=ff7a2d105dc74a1cbf856e334c47dabb, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.064867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff66334-264e-46f2-b43b-860d04cec6bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.084941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 908/1804] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:57 2022] PUT /identity/v3/projects/9f8d99fad9ba4fa78e7b1f2917c7fc64/users/ff7a2d105dc74a1cbf856e334c47dabb/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:58.086082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.086430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.086740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.132294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] MFA Rules not processed for user `652c442498b042be8bba0a921dca36ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:58.134032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:58.144874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 897/1805] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:58.146013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:45:58.239774 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:58.262606 n-d-master-1 devstack@keystone.service[80990]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 11 14:45:58.263151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:58.275104 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 909/1806] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:58.276205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:58.281001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:58.348657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798cd24-c3d2-44d7-b4d0-c7f6e669d116 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.383061 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:58.416295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '337b2d7590a74b3c94c393746d7b2d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5018447f81ca46efab9e5c9dde5963d1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.417285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.417695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.418047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] PATH_INFO: `/v3/projects/d9dc67252b914e1c9533922b83036762` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.419884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9dc67252b914e1c9533922b83036762)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.425909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.428405 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 898/1807] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:45:58 2022] GET /identity/v3/projects/d9dc67252b914e1c9533922b83036762 => generated 375 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:45:58.429655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:58.460242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9b5f2-1e1f-45ef-a198-1c4c4527aed2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.476220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.476904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.477193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.477477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.529704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9dd2-6d9e-4444-8120-25455c3ac019 tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.537987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.538821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.539636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.539993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.541062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.543848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.563059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 899/1808] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:45:58.563059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:58.563355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.564411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.586473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 910/1809] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:45:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:45:58.587737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:58.695620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15f3b2-d61c-46d8-a216-e7e809f06b62 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.702680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.704994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.705537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.706001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.709692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:58.788711 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:58.811575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022066f7-d77c-48a3-9322-b0fd2afa2a2d service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.839596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a58399-2e64-4483-9f56-14c1b16f0a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.840337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a58399-2e64-4483-9f56-14c1b16f0a47 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.840652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a58399-2e64-4483-9f56-14c1b16f0a47 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.840992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a58399-2e64-4483-9f56-14c1b16f0a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.849544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.851266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.882551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a58399-2e64-4483-9f56-14c1b16f0a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.883826 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 900/1810] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:58.884861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:58.896107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a58399-2e64-4483-9f56-14c1b16f0a47 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.913493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424b1c9-d0a1-40b1-b14f-4daf8e342bdd service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:58.933001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad10d42-45de-4271-9f2d-f968f3d92a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:58.936669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad10d42-45de-4271-9f2d-f968f3d92a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.937177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad10d42-45de-4271-9f2d-f968f3d92a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.937623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad10d42-45de-4271-9f2d-f968f3d92a56 admin admin] PATH_INFO: `/v3/projects/9f8d99fad9ba4fa78e7b1f2917c7fc64/users/ff7a2d105dc74a1cbf856e334c47dabb/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.941397 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 911/1811] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:58.945291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad10d42-45de-4271-9f2d-f968f3d92a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8d99fad9ba4fa78e7b1f2917c7fc64, user_id=ff7a2d105dc74a1cbf856e334c47dabb, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:58.955403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad10d42-45de-4271-9f2d-f968f3d92a56 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:58.973409 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:58.991468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:58.991763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:58.992067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:58.996694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 901/1812] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:45:58 2022] PUT /identity/v3/projects/9f8d99fad9ba4fa78e7b1f2917c7fc64/users/ff7a2d105dc74a1cbf856e334c47dabb/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:59.007867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.008362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.008932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.081085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] MFA Rules not processed for user `ff7a2d105dc74a1cbf856e334c47dabb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:59.086762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.093037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:59.094342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.245688 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 912/1813] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Jul 11 14:45:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:59.246635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:59.286147 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 902/1814] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:59.288446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:59.460186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecde198-fae2-4118-98b7-93e856d59b47 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:59.463329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4be0fc-700f-4d3f-a822-e83a5c0a7a84 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:59.471854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:59.473880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.473880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.474732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] PATH_INFO: `/v3/users/6e786e70a07b447a873a3e45cd20c56f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.478030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e786e70a07b447a873a3e45cd20c56f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:59.478542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:59.479260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.479535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.479813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.480848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:59.615199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:59.616972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:59.626749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e786e70a07b447a873a3e45cd20c56f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:59.634261 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 913/1815] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:59.635426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:59.648510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e786e70a07b447a873a3e45cd20c56f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:59.654614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6444-5374-40f3-9400-b3808b0f2e3a service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:59.664067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8eb86-d746-4fb7-9d5b-6679aee2e702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:59.664933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8eb86-d746-4fb7-9d5b-6679aee2e702 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.665283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8eb86-d746-4fb7-9d5b-6679aee2e702 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.665700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8eb86-d746-4fb7-9d5b-6679aee2e702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.669516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e786e70a07b447a873a3e45cd20c56f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:59.689025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e786e70a07b447a873a3e45cd20c56f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:59.691026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e786e70a07b447a873a3e45cd20c56f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:45:59.693569 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:59.709152 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:59.716062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 903/1816] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:59 2022] DELETE /identity/v3/users/6e786e70a07b447a873a3e45cd20c56f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:45:59.717316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:59.724650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.779170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8eb86-d746-4fb7-9d5b-6679aee2e702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:59.784356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8eb86-d746-4fb7-9d5b-6679aee2e702 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:59.811368 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 914/1817] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:59.812816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab62f-3501-4385-9167-46101691cb66 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.813093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab62f-3501-4385-9167-46101691cb66 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.813452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab62f-3501-4385-9167-46101691cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.831487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310db44a-aaeb-4bce-b661-9ad9c0832248 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:59.837995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:59.839348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:59.839894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:59.840382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:59.844363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-adfab62f-3501-4385-9167-46101691cb66 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:59.845877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-adfab62f-3501-4385-9167-46101691cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.860413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:59.892070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:59.895959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:59.946315 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 904/1818] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:59.975699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:59.977410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:00.054650 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 915/1819] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:00.056226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfab62f-3501-4385-9167-46101691cb66 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:00.060504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-adfab62f-3501-4385-9167-46101691cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:00.134581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d475b-94e6-4b01-9735-d48a6addc3e7 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:00.142747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:00.144208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:00.145179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:00.145579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] PATH_INFO: `/v3/users/14009e6b6fa045a28719e38b9eca6e2f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:00.148368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14009e6b6fa045a28719e38b9eca6e2f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:00.151338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:00.298648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14009e6b6fa045a28719e38b9eca6e2f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:00.312927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfab62f-3501-4385-9167-46101691cb66 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:00.327569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:00.328423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:00.328834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:00.329238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:00.339873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:00.344463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14009e6b6fa045a28719e38b9eca6e2f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:00.360941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14009e6b6fa045a28719e38b9eca6e2f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:00.375333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14009e6b6fa045a28719e38b9eca6e2f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:00.376044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14009e6b6fa045a28719e38b9eca6e2f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:00.392694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 905/1820] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:45:59 2022] DELETE /identity/v3/users/14009e6b6fa045a28719e38b9eca6e2f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:00.396340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:00.403318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:00.464480 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:00.498177 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:00.530449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:00.539239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc37a-23b6-4356-8852-004ecf7048ce service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:00.617332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 916/1821] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:00.620018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66d8a-3201-403c-9af1-a0625f381651 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:00.628320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66d8a-3201-403c-9af1-a0625f381651 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:00.629013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66d8a-3201-403c-9af1-a0625f381651 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:00.632563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709ebe-8d39-4a34-8bf0-db6a45b43fa1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:00.635321 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 917/1822] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:00 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:00.638284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:00.643072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:00.644010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:00.660928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:00.662356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:00.665666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:00.667100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:00.679043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:00.724530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:00.730017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:00.967808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:00.973576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:00.996974 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 918/1823] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:01.000285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:01.007527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:01.022473 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 906/1824] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:01.024000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:01.028652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:01.062676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593272-56ec-4e7d-a4c1-25c181ccc65d service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:01.074324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:01.075209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:01.076128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:01.078695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:01.104283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:01.107176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:01.139084 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 907/1825] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:01.181465 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 11 14:46:01.182674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:01.189058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:01.383656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15c491-df21-4871-a3f5-e96c241905fc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:01.396545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '337b2d7590a74b3c94c393746d7b2d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5018447f81ca46efab9e5c9dde5963d1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:01.398811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:01.402064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:01.402564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] PATH_INFO: `/v3/projects/d9dc67252b914e1c9533922b83036762` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:01.404702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9dc67252b914e1c9533922b83036762)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:01.408934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:01.417359 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 919/1826] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:00 2022] GET /identity/v3/projects/d9dc67252b914e1c9533922b83036762 => generated 375 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:02.260801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:02.262476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.291687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5672c5b-7c54-4e68-a4aa-91e53c55a7a8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:02.312921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:02.314040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.314319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.322852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] PATH_INFO: `/v3/users/263ca4f832e24d0e823cf76fd436b9d4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.335269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=263ca4f832e24d0e823cf76fd436b9d4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:02.340165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:02.342126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.351427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:02.400407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa99a-a69b-443a-b044-74318e09b54c tempest-FlavorsAccessTestJSON-2127090746 tempest-FlavorsAccessTestJSON-2127090746-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:02.431424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:02.432310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.432599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.432876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] PATH_INFO: `/v3/projects/fa195684c200448899a3318ed478b4a4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.447560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa195684c200448899a3318ed478b4a4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:02.449807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:02.518997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263ca4f832e24d0e823cf76fd436b9d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.547783 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:02.549335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263ca4f832e24d0e823cf76fd436b9d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.580783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263ca4f832e24d0e823cf76fd436b9d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.614866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263ca4f832e24d0e823cf76fd436b9d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.616216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263ca4f832e24d0e823cf76fd436b9d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.625371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa195684c200448899a3318ed478b4a4', 'request_id': 'req-317cd12d-04b3-4481-8efb-c14f43880ec7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.646684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa195684c200448899a3318ed478b4a4', 'request_id': 'req-317cd12d-04b3-4481-8efb-c14f43880ec7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.655747 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 908/1827] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:02 2022] DELETE /identity/v3/users/263ca4f832e24d0e823cf76fd436b9d4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:02.656706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa195684c200448899a3318ed478b4a4', 'request_id': 'req-317cd12d-04b3-4481-8efb-c14f43880ec7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.659385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:02.662377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.688134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] The token cache is being invalidate because project fa195684c200448899a3318ed478b4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:02.688719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.691307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.697609 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 920/1828] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:02 2022] DELETE /identity/v3/projects/fa195684c200448899a3318ed478b4a4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:02.699161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:02.706655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.749568 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:02.825202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50595c79-9343-486c-84dc-142f476a0596 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:02.838019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:02.839577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd12d-04b3-4481-8efb-c14f43880ec7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:02.846532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:02.847377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.847668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.850109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] PATH_INFO: `/v3/users/24cbee1f0b7a4f31b87b0c74df032aea` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.850109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24cbee1f0b7a4f31b87b0c74df032aea)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:02.853528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.853528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.853528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] PATH_INFO: `/v3/projects/cf1d1e9208774b7bb5db110951b4fd41` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.870700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1d1e9208774b7bb5db110951b4fd41)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:02.876435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:02.886805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:02.997505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24cbee1f0b7a4f31b87b0c74df032aea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:02.998729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24cbee1f0b7a4f31b87b0c74df032aea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.027116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24cbee1f0b7a4f31b87b0c74df032aea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.029350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24cbee1f0b7a4f31b87b0c74df032aea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.061067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79ad017d-85c8-49b6-be98-e1b0b3e3fc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24cbee1f0b7a4f31b87b0c74df032aea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.062997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1d1e9208774b7bb5db110951b4fd41', 'request_id': 'req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.076066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1d1e9208774b7bb5db110951b4fd41', 'request_id': 'req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.089214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1d1e9208774b7bb5db110951b4fd41', 'request_id': 'req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.116000 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 921/1829] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:02 2022] DELETE /identity/v3/users/24cbee1f0b7a4f31b87b0c74df032aea => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:03.117707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675857-b485-4bcc-9da4-daee6b656ef4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:03.117796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675857-b485-4bcc-9da4-daee6b656ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:03.118075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675857-b485-4bcc-9da4-daee6b656ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:03.119877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] The token cache is being invalidate because project cf1d1e9208774b7bb5db110951b4fd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:03.120179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.124711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.133398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 909/1830] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:02 2022] DELETE /identity/v3/projects/cf1d1e9208774b7bb5db110951b4fd41 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:03.133398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:03.137554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:03.196834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-23675857-b485-4bcc-9da4-daee6b656ef4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:03.205820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23675857-b485-4bcc-9da4-daee6b656ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:03.333511 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:03.334098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a3f0-d545-4d7d-bf4e-5b3dc5786acc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:03.483536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 922/1831] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:03.486081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:03.486081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:03.488224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:03.547841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:03.550214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:03.550516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:03.551608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:03.552824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] PATH_INFO: `/v3/users/0a54caca9afc4d36b2ee2f8e59c15906` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:03.556751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:03.558747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a54caca9afc4d36b2ee2f8e59c15906)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:03.564085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:03.585868 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:03.586798 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 923/1832] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:03.593566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:03.604084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:03.668737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a776-bdf6-4f6a-aa2b-c35cfd8e892b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:03.699105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:03.717126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:03.717470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:03.717771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] PATH_INFO: `/v3/users/652c442498b042be8bba0a921dca36ea` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:03.722720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=652c442498b042be8bba0a921dca36ea)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:03.734919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:03.770933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a54caca9afc4d36b2ee2f8e59c15906'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.822011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a54caca9afc4d36b2ee2f8e59c15906'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.828843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652c442498b042be8bba0a921dca36ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.829948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652c442498b042be8bba0a921dca36ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.850096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a54caca9afc4d36b2ee2f8e59c15906'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.855828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652c442498b042be8bba0a921dca36ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.857325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652c442498b042be8bba0a921dca36ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.871148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a54caca9afc4d36b2ee2f8e59c15906'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.872536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e87bf543-01a9-4882-9c30-38ce0e36156c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a54caca9afc4d36b2ee2f8e59c15906'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.874429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652c442498b042be8bba0a921dca36ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:03.889720 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 910/1833] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:03 2022] DELETE /identity/v3/users/0a54caca9afc4d36b2ee2f8e59c15906 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:03.891319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9d24-4625-48ec-99f8-dd0333562b5e None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:03.891669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9d24-4625-48ec-99f8-dd0333562b5e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:03.891997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9d24-4625-48ec-99f8-dd0333562b5e None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:03.899147 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 911/1834] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:46:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:03.900125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9d24-4625-48ec-99f8-dd0333562b5e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:03.909906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c7bd9d24-4625-48ec-99f8-dd0333562b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:03.954336 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 924/1835] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:03 2022] DELETE /identity/v3/users/652c442498b042be8bba0a921dca36ea => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:03.955485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:03.957280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.111862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9d24-4625-48ec-99f8-dd0333562b5e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:04.215827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dac39-eb34-4aba-85b8-e057d2db77cf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:04.224396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:04.225158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:04.225554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:04.225796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:04.230605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.317746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:04.320849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:04.321493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:04.321844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:04.329023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.354866 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:04.391174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:04.393842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36309655-4ab8-446e-82b9-21786d36d31e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:04.430567 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 925/1836] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:04.433936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:04.434232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:04.436182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:04.476064 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:04.476659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:04.477358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.506456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:04.508248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:04.544774 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 912/1837] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:04.646233 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 926/1838] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:46:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:04.707741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:04.711077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:04.760004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204870b8-8fe0-43eb-b28b-18d4217ae2fb service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:04.778981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:04.781005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:04.781723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:04.782483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:04.805138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:04.809119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:04.853918 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 913/1839] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:05.825411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:05.828330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:05.893255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700652b1-3f25-4bf9-8bd9-1e90719c01be None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:05.902313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:05.903493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:05.904245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:05.905172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] PATH_INFO: `/v3/projects/4d9e57abb2b4468fb85d8b8412835d67` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:05.907475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:05.909023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9e57abb2b4468fb85d8b8412835d67)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:05.909157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:05.943755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:05.973023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f6727-c032-42b9-897f-abafac9606a0 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:05.985091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:05.986161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:05.986554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:05.986989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] PATH_INFO: `/v3/projects/80fd3719116b45bf89239cc6eceabd15` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:05.992770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fd3719116b45bf89239cc6eceabd15)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:05.995589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:06.161943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9e57abb2b4468fb85d8b8412835d67', 'request_id': 'req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.193285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9e57abb2b4468fb85d8b8412835d67', 'request_id': 'req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.247452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9e57abb2b4468fb85d8b8412835d67', 'request_id': 'req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.248006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fd3719116b45bf89239cc6eceabd15', 'request_id': 'req-de1e6667-2829-4b65-b1c9-61e0687aefb9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.288188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fd3719116b45bf89239cc6eceabd15', 'request_id': 'req-de1e6667-2829-4b65-b1c9-61e0687aefb9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.306084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] The token cache is being invalidate because project 4d9e57abb2b4468fb85d8b8412835d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:06.309262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.310371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fd3719116b45bf89239cc6eceabd15', 'request_id': 'req-de1e6667-2829-4b65-b1c9-61e0687aefb9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.318156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.323137 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 927/1840] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:05 2022] DELETE /identity/v3/projects/4d9e57abb2b4468fb85d8b8412835d67 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:06.330031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:06.332235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:06.352237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] The token cache is being invalidate because project 80fd3719116b45bf89239cc6eceabd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:06.352887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.354626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de1e6667-2829-4b65-b1c9-61e0687aefb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.358104 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 914/1841] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:05 2022] DELETE /identity/v3/projects/80fd3719116b45bf89239cc6eceabd15 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:06.362082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b95d-5043-45ef-b1d4-e9550e524f5e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:06.362693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b95d-5043-45ef-b1d4-e9550e524f5e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:06.363261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b95d-5043-45ef-b1d4-e9550e524f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:06.410888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3f53b95d-5043-45ef-b1d4-e9550e524f5e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:06.431612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f53b95d-5043-45ef-b1d4-e9550e524f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:06.515910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f33c9-1ab6-4b1e-a12f-a5cdc0845c58 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:06.526558 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:06.646117 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 915/1842] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:06.647958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d0b3-584f-42f0-9976-62b13f108398 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:06.649255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d0b3-584f-42f0-9976-62b13f108398 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:06.649255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d0b3-584f-42f0-9976-62b13f108398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:06.704042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bb85d0b3-584f-42f0-9976-62b13f108398 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:06.705590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bb85d0b3-584f-42f0-9976-62b13f108398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:06.734580 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 916/1843] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:06.734580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39d6d-0655-4b4e-bb00-5ab0572d4859 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:06.734580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39d6d-0655-4b4e-bb00-5ab0572d4859 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:06.734580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39d6d-0655-4b4e-bb00-5ab0572d4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:06.775631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8ec39d6d-0655-4b4e-bb00-5ab0572d4859 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:06.777261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ec39d6d-0655-4b4e-bb00-5ab0572d4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:06.780565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:06.786945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:06.787520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:06.788804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] PATH_INFO: `/v3/projects/d59f916a3a344699895d986405bc1864` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:06.793330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59f916a3a344699895d986405bc1864)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:06.800013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:06.838400 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 917/1844] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:06.840029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:06.847279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:06.847741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:06.892678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:06.895699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:06.934066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59f916a3a344699895d986405bc1864', 'request_id': 'req-26820661-7122-41d3-96fc-1192a51dc991'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.944773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59f916a3a344699895d986405bc1864', 'request_id': 'req-26820661-7122-41d3-96fc-1192a51dc991'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.952635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59f916a3a344699895d986405bc1864', 'request_id': 'req-26820661-7122-41d3-96fc-1192a51dc991'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.980888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] The token cache is being invalidate because project d59f916a3a344699895d986405bc1864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:06.981327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.983297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:06.988344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 928/1845] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:06 2022] DELETE /identity/v3/projects/d59f916a3a344699895d986405bc1864 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:06.989353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:06.990846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.028456 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:07.078406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 918/1846] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:07.080086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:07.084616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.121178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a1d9-8b51-4344-a7a5-60118d731b35 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.139194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.141385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.141798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.144197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.145662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:07.146661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.154222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:07.193968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 919/1847] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:07.196190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:07.202561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.214543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26820661-7122-41d3-96fc-1192a51dc991 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.221285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.223025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.223535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.224145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] PATH_INFO: `/v3/projects/d9dc67252b914e1c9533922b83036762` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.226446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9dc67252b914e1c9533922b83036762)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.229093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:07.275249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fc6d3-cacb-4916-9124-790855564ced admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.299164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.300892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.301513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.302109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] PATH_INFO: `/v3/users/a8d2c23f408e47d58999c88627b18298` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.304702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d2c23f408e47d58999c88627b18298)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.308918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:07.345949 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:07.382006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9dc67252b914e1c9533922b83036762', 'request_id': 'req-53fec306-2eb8-4ffb-846e-123e702647f8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.401827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9dc67252b914e1c9533922b83036762', 'request_id': 'req-53fec306-2eb8-4ffb-846e-123e702647f8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.425348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9dc67252b914e1c9533922b83036762', 'request_id': 'req-53fec306-2eb8-4ffb-846e-123e702647f8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.452122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d2c23f408e47d58999c88627b18298'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.467340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] The token cache is being invalidate because project d9dc67252b914e1c9533922b83036762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:07.467687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.468308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.470172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 929/1848] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:06 2022] DELETE /identity/v3/projects/d9dc67252b914e1c9533922b83036762 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:07.470796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:07.475382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.489931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d2c23f408e47d58999c88627b18298'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.503975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d2c23f408e47d58999c88627b18298'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.525183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d2c23f408e47d58999c88627b18298'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.527521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d745d8a-ca53-480a-9363-a8df5e22883e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d2c23f408e47d58999c88627b18298'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:07.581780 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 920/1849] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:07 2022] DELETE /identity/v3/users/a8d2c23f408e47d58999c88627b18298 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:07.584477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.587395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.590228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.624746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec306-2eb8-4ffb-846e-123e702647f8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.696051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] MFA Rules not processed for user `98c5142aba9a49bc8138fa10974c4ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:07.698698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.856626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.857273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.857628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.858679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.859221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:07.859619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.861289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:07.893595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 921/1850] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:07.893849 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 930/1851] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:07.893984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:07.894153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:07.894293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.907763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:07.939436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5a2b-0d54-4233-893d-a362782c6016 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.942957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732b39f-8b32-45ce-bcad-e4153a6c8b8d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:07.965035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.965994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:07.966905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.968355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:07.969812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.970464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:07.971254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] PATH_INFO: `/v3/users/337b2d7590a74b3c94c393746d7b2d7c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.971757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:07.974371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.975289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] RBAC: Authorizing `identity:delete_user(user_id=337b2d7590a74b3c94c393746d7b2d7c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:07.980723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:07.983185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:08.062727 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 922/1852] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:07 2022] POST /identity/v3/projects => generated 411 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:08.063792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:08.067482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:08.157905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337b2d7590a74b3c94c393746d7b2d7c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.159155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337b2d7590a74b3c94c393746d7b2d7c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.202626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337b2d7590a74b3c94c393746d7b2d7c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.203828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337b2d7590a74b3c94c393746d7b2d7c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.207017 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:08.235262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337b2d7590a74b3c94c393746d7b2d7c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.238616 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:08.299011 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 931/1853] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:07 2022] DELETE /identity/v3/users/337b2d7590a74b3c94c393746d7b2d7c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:08.300358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:08.312659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:08.398274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe95c-e43d-4e45-921c-e6e57cb201af admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:08.498801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:08.499803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:08.500092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:08.500627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:08.501461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:08.503778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:08.539533 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 923/1854] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:08 2022] POST /identity/v3/projects => generated 389 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:08.540543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:08.542681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:08.551756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c37553-b6b6-4df5-a021-d6d01534bbae admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:08.641207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a53d14-c59b-498a-ad4e-d78a9427cace admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:08.647366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:08.648335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:08.648690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:08.649075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] PATH_INFO: `/v3/projects/4c3211f2437f483e88eb1d5a9deac06b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:08.650918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3211f2437f483e88eb1d5a9deac06b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:08.653034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:08.715587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:08.717793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:08.718889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:08.720488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:08.729420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:08.739454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:08.785021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3211f2437f483e88eb1d5a9deac06b', 'request_id': 'req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.817858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3211f2437f483e88eb1d5a9deac06b', 'request_id': 'req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.826963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 932/1855] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:08 2022] POST /identity/v3/users => generated 306 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:08.830279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:08.838947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:08.844708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3211f2437f483e88eb1d5a9deac06b', 'request_id': 'req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.848042 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:08.856852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a0427-20c3-4a57-b866-8ddb7265c33a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:08.890438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] The token cache is being invalidate because project 4c3211f2437f483e88eb1d5a9deac06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:08.890761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.896056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:08.901554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 924/1856] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:08 2022] DELETE /identity/v3/projects/4c3211f2437f483e88eb1d5a9deac06b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:08.904648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:08.911309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:08.945464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93e751-81ae-4576-a5cd-511ec7a9d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:08.946371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93e751-81ae-4576-a5cd-511ec7a9d056 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:08.946898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93e751-81ae-4576-a5cd-511ec7a9d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:08.947930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93e751-81ae-4576-a5cd-511ec7a9d056 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:08.950758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93e751-81ae-4576-a5cd-511ec7a9d056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:08.955365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93e751-81ae-4576-a5cd-511ec7a9d056 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.013598 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 933/1857] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:08 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:09.013598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6681db-7d8d-4b0f-bbf5-a28bc7889705 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.013598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6681db-7d8d-4b0f-bbf5-a28bc7889705 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.013598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6681db-7d8d-4b0f-bbf5-a28bc7889705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.050413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1d6681db-7d8d-4b0f-bbf5-a28bc7889705 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.051721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1d6681db-7d8d-4b0f-bbf5-a28bc7889705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.067687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba29ab-f33d-4ca3-b4d8-e8eb3c42b81b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.079860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.080681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.081045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.081342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.082681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.084667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.090001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 934/1858] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:09.091552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.091852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.092477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.100545 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:09.124390 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 925/1859] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:09.127073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.129577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.143157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.147127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.148951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4af081-5ed5-4f65-ac98-7e138c69a185 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.157461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f87bb-1d64-4fe8-ac13-3ca391d42b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.158529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f87bb-1d64-4fe8-ac13-3ca391d42b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.159009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f87bb-1d64-4fe8-ac13-3ca391d42b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.159372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f87bb-1d64-4fe8-ac13-3ca391d42b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.160483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f87bb-1d64-4fe8-ac13-3ca391d42b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.163076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f87bb-1d64-4fe8-ac13-3ca391d42b11 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.188450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 926/1860] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:09.190195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.191966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.192461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.240169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.246727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.288259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 927/1861] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:09.289690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.294004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 935/1862] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:09.295279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.309328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997c13-a39c-4ce9-a4b7-1815c647dc98 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.321076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb5d28-5f4b-4b3c-9b1a-3633f51b5fc2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.322560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.327269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.327540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.327835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.328622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.330664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.341585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.344143 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 928/1863] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:09.344368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.344911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.345092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.345638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.347444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.355236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.356295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b73215-745f-458d-a633-cc6387f18175 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.362474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.363347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.363632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.363928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.364661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:09.365032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.366764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.386757 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 929/1864] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:09.387686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.389857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.405158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0dec7-4448-4dfa-b4cf-cd4a53dfd4ce admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.414823 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 936/1865] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:09.415130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.415327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.415495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.415495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.415495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] PATH_INFO: `/v3/projects/5018447f81ca46efab9e5c9dde5963d1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.415495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5018447f81ca46efab9e5c9dde5963d1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.416113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.440246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f1441-48bc-4edb-8bfd-f2b26e9de811 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.446085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.447129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.448037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.448403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] PATH_INFO: `/v3/projects/107137231769464ca1cf8c578134b6e2/users/13fbe6fa1fe443a8a50d141e722ec64c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.468380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=107137231769464ca1cf8c578134b6e2, user_id=13fbe6fa1fe443a8a50d141e722ec64c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.471140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.480157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5018447f81ca46efab9e5c9dde5963d1', 'request_id': 'req-ca5a9cf0-543c-43a7-986b-134e550b6c1e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.486171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5018447f81ca46efab9e5c9dde5963d1', 'request_id': 'req-ca5a9cf0-543c-43a7-986b-134e550b6c1e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.486487 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 937/1866] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:09 2022] PUT /identity/v3/projects/107137231769464ca1cf8c578134b6e2/users/13fbe6fa1fe443a8a50d141e722ec64c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:09.491633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.493960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.494973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5018447f81ca46efab9e5c9dde5963d1', 'request_id': 'req-ca5a9cf0-543c-43a7-986b-134e550b6c1e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.508482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] The token cache is being invalidate because project 5018447f81ca46efab9e5c9dde5963d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:09.508769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.509441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.511118 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 930/1867] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:09 2022] DELETE /identity/v3/projects/5018447f81ca46efab9e5c9dde5963d1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:09.512073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.513524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.551100 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:09.564299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a2457-4edc-44ab-986c-546055941b1f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.568988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.569769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.570414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.570414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.572427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.584684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.586152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.587528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a9cf0-543c-43a7-986b-134e550b6c1e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.595696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 938/1868] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:09.596535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.597919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.671382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f670c-3350-4398-ae7d-1ee83813dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.672350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f670c-3350-4398-ae7d-1ee83813dd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.672648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f670c-3350-4398-ae7d-1ee83813dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.672969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f670c-3350-4398-ae7d-1ee83813dd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.673643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f670c-3350-4398-ae7d-1ee83813dd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.675857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f670c-3350-4398-ae7d-1ee83813dd4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.686628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a9f8f-5e44-42d9-96f5-3e843fee3938 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.694216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f354cb-3291-4c3f-bcbb-d43344fe5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.695549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f354cb-3291-4c3f-bcbb-d43344fe5f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.695828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f354cb-3291-4c3f-bcbb-d43344fe5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.696102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f354cb-3291-4c3f-bcbb-d43344fe5f34 admin admin] PATH_INFO: `/v3/projects/4f02abe1a515468781292d1fb4104c04/users/f6f2035f95ef4cb39fc1f6a41d314bad/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.713781 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 931/1869] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:09.716127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.716551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.716890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.718867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f354cb-3291-4c3f-bcbb-d43344fe5f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f02abe1a515468781292d1fb4104c04, user_id=f6f2035f95ef4cb39fc1f6a41d314bad, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.721945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f354cb-3291-4c3f-bcbb-d43344fe5f34 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.748452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 939/1870] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:09 2022] PUT /identity/v3/projects/4f02abe1a515468781292d1fb4104c04/users/f6f2035f95ef4cb39fc1f6a41d314bad/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:09.752102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb813f-7dab-4049-91ab-7cbf5c7b785e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.752102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb813f-7dab-4049-91ab-7cbf5c7b785e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.752102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb813f-7dab-4049-91ab-7cbf5c7b785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.753478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] MFA Rules not processed for user `13fbe6fa1fe443a8a50d141e722ec64c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.754776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.760866 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:09.777767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-abeb813f-7dab-4049-91ab-7cbf5c7b785e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.779184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-abeb813f-7dab-4049-91ab-7cbf5c7b785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.851557 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 932/1871] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:09.851557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.905457 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 940/1872] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:09.907550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.908078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.908740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.936627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:09.938472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.940900 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:09.964107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f37c0-4dc6-4597-9ea8-6879263520d4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.971255 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 941/1873] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:09.972075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf47fb-f51e-4d92-ab61-b7732953caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.972566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.972927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf47fb-f51e-4d92-ab61-b7732953caae admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.973422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf47fb-f51e-4d92-ab61-b7732953caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.974232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf47fb-f51e-4d92-ab61-b7732953caae admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.974361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.975019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf47fb-f51e-4d92-ab61-b7732953caae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.978295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf47fb-f51e-4d92-ab61-b7732953caae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.000081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a074c8-889d-4fd7-95e9-5dcbfdc73223 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.005939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.006731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.007001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.007278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.008367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.010242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.020919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 933/1874] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:10.025014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.026008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.026772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.061129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 942/1875] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:09 2022] POST /identity/v3/projects => generated 411 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:10.062266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.065436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:10.077247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:10.078599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:10.182647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ed66-fc6b-42f1-82bf-339a43883570 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.186373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.187205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.187451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.187797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.207899 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 934/1876] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:10.209302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.223140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41160de0-6b6a-47aa-a686-2ec8a169153c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.227960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.228726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.229009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.229285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.230087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.231805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.244497 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 935/1877] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:10.245773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.260992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd23d14-bfdd-499a-9637-c115c2a954c1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.266643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.267332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.267671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.267956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.268659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.270658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.273389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.274871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.287991 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 943/1878] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:10.288917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.297246 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 936/1879] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:10 2022] POST /identity/v3/users => generated 312 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:10.298184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.310523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9bc25-6a2a-47c4-ac7d-519c1d868c78 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.314249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82aea-60e8-4fd4-a50f-05c802743f4a service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.316749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.317459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.317756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.318017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.318804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.320775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.324653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.325919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.327391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.327877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.328868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:10.329334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.331361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.335570 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 937/1880] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:10.336457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.359852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12920f-1350-4c76-a82d-ea6e7349e584 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.369265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.369980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.370165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.370453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.371277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.373954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.378298 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 944/1881] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:10.380541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.396937 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 938/1882] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:10.398380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.412670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aaa85-d5a2-48ab-bc99-2f19c4956a1e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.417281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb640-b34e-4f86-a60a-240a6d09a9da admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.419312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.421049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.426586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.428391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] PATH_INFO: `/v3/projects/f1cd79e5e7b240f3ae3115cbf1994bb6/users/14df0945349e405eaccad55bd735ec03/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.438905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.441050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.441803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.442405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.443448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.445816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.448568 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:10.467710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cd79e5e7b240f3ae3115cbf1994bb6, user_id=14df0945349e405eaccad55bd735ec03, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.480532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.484038 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 939/1883] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:10 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:10.485063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.517617 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 945/1884] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:10 2022] PUT /identity/v3/projects/f1cd79e5e7b240f3ae3115cbf1994bb6/users/14df0945349e405eaccad55bd735ec03/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:10.518672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.630104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019696f-b2f9-4aae-9d8e-37e641dbb4d4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.660133 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:10.662115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27795e4-520c-442e-9273-a7f7c50a7fee admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.668340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f7694-fc59-472d-857f-db598ee27f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.669389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7694-fc59-472d-857f-db598ee27f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.670802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7694-fc59-472d-857f-db598ee27f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.671795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7694-fc59-472d-857f-db598ee27f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.672865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f7694-fc59-472d-857f-db598ee27f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.675469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f7694-fc59-472d-857f-db598ee27f77 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.725654 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 946/1885] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:10 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:10.725654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.726020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.726282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.759666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.761904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.762522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.763159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] PATH_INFO: `/v3/projects/93866ee5c79a4cec99837e55f392b7eb/users/fdf44005908c4e7e8fed9d083e09c2ce/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.794364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93866ee5c79a4cec99837e55f392b7eb, user_id=fdf44005908c4e7e8fed9d083e09c2ce, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.794364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.796167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] MFA Rules not processed for user `14df0945349e405eaccad55bd735ec03`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:10.797533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:10.819414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 940/1886] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:10 2022] PUT /identity/v3/projects/93866ee5c79a4cec99837e55f392b7eb/users/fdf44005908c4e7e8fed9d083e09c2ce/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:10.820672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.918477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c55-b5b9-4db5-bc56-0693345de89a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.932375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.933115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.933432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.933717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.937660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.939867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.962831 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 941/1887] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:10.962831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:10.974041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6b5f-4636-4db7-9968-e3007d550649 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:10.980033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:10.981074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:10.981374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:10.981777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:10.983240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:10.985639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:10.999819 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 947/1888] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:11.000392 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 942/1889] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:11.004233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.004642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.019160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d165c1-adaa-4442-ba76-4f7a7a3531e9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.025326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d73d5-e30b-4d1e-8353-3e4682019ef0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.027276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.028491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.029271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.029785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.031268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.033732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.041635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.042438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.042805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.043107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.043883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.051371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.070719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 948/1890] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:11.071831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.085420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92d7d-5e3f-4485-bbe0-812d323613d5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.094030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.095745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.096339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.097056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] PATH_INFO: `/v3/projects/93866ee5c79a4cec99837e55f392b7eb/users/fdf44005908c4e7e8fed9d083e09c2ce/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.099687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93866ee5c79a4cec99837e55f392b7eb, user_id=fdf44005908c4e7e8fed9d083e09c2ce, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.103803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.114175 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 943/1891] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:11 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:11.116480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.136184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 949/1892] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:11 2022] PUT /identity/v3/projects/93866ee5c79a4cec99837e55f392b7eb/users/fdf44005908c4e7e8fed9d083e09c2ce/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:11.137672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.245330 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:11.288344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a512e3-0e3a-4f55-9bd1-5f1ffb980f18 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.305751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f9beb-fe43-45e6-b54f-2b3bcb2a660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.306510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f9beb-fe43-45e6-b54f-2b3bcb2a660d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.306799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f9beb-fe43-45e6-b54f-2b3bcb2a660d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.307074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f9beb-fe43-45e6-b54f-2b3bcb2a660d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.307788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f9beb-fe43-45e6-b54f-2b3bcb2a660d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.307911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e4532-fc88-490b-a49f-94f44642c216 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.314074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f9beb-fe43-45e6-b54f-2b3bcb2a660d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.319894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.320841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.321282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.321573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] PATH_INFO: `/v3/projects/c263c02039f240acb5e2fb2ed4319526/users/8d028d30d8434e8b9588075dca2a215d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.340298 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:11.354328 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 950/1893] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:11 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:11.357711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c263c02039f240acb5e2fb2ed4319526, user_id=8d028d30d8434e8b9588075dca2a215d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.359584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561f3b-cadd-4a75-a2d3-12630c84707b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.359876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561f3b-cadd-4a75-a2d3-12630c84707b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.360161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561f3b-cadd-4a75-a2d3-12630c84707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.365393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.394788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 944/1894] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:11 2022] PUT /identity/v3/projects/c263c02039f240acb5e2fb2ed4319526/users/8d028d30d8434e8b9588075dca2a215d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:11.397307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.406008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-63561f3b-cadd-4a75-a2d3-12630c84707b None None] MFA Rules not processed for user `fdf44005908c4e7e8fed9d083e09c2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:11.407362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-63561f3b-cadd-4a75-a2d3-12630c84707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:11.549522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5943e-7013-457e-b884-1357e18600c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.557675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.558389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.559579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.559579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.559912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.562172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 951/1895] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:11 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:11.563960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.564264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.564621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.568061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.590209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 945/1896] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:11.591810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.594930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:11.672901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] MFA Rules not processed for user `8d028d30d8434e8b9588075dca2a215d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:11.675347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:11.773706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac9a8d-2a93-46bb-9aa0-3f6f4130b112 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.782114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.783192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.783677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.784168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.816177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.818287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.851835 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 952/1897] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:11.866536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.867429 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 946/1898] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:11.868394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.905641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47d0bb-ccb6-4abd-a417-ee54e370ac79 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.910289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7796b-1e39-44e1-adbd-8f94469b8fdc service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:11.912029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.913375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.913659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.914624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] PATH_INFO: `/v3/projects/5e3e2d01a9324236a000a9519fd857e2/users/11c309f2bc2e483bbdab778864affdd6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.929629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:11.931527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:11.931937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:11.932590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:11.933593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.935119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3e2d01a9324236a000a9519fd857e2, user_id=11c309f2bc2e483bbdab778864affdd6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:11.939846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.940840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:11.967180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 953/1899] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:11 2022] PUT /identity/v3/projects/5e3e2d01a9324236a000a9519fd857e2/users/11c309f2bc2e483bbdab778864affdd6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:11.967180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:11.971891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:12.003349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 947/1900] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:11 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:12.004577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.044235 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:12.130479 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:12.147107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1004-b3db-45b4-b6db-9b557fb1eabb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.160990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcf929-28ae-4a59-9826-0614be94838f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.175584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.176828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.177341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.177837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.178977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.181075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.207011 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 948/1901] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:12.208481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.227184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06135ed-866f-4764-877e-bd517459dee4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.237078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.237776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.238895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.240121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.240935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.244214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.276329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af94537-0af9-476e-9969-4c987310bfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.277485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af94537-0af9-476e-9969-4c987310bfbc service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.277842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af94537-0af9-476e-9969-4c987310bfbc service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.278603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af94537-0af9-476e-9969-4c987310bfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.298733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 949/1902] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:12 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:12.299768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.317593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c063ce-fcd2-4044-baf7-9c04032515b7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.332144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.333110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.333392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.333670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] PATH_INFO: `/v3/projects/5e3e2d01a9324236a000a9519fd857e2/users/11c309f2bc2e483bbdab778864affdd6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.338789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3e2d01a9324236a000a9519fd857e2, user_id=11c309f2bc2e483bbdab778864affdd6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.343277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.374001 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 950/1903] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:12 2022] PUT /identity/v3/projects/5e3e2d01a9324236a000a9519fd857e2/users/11c309f2bc2e483bbdab778864affdd6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:12.374945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.423441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af94537-0af9-476e-9969-4c987310bfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.426299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af94537-0af9-476e-9969-4c987310bfbc service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.446470 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 954/1904] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:12.461890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.467862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.468166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.575998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] MFA Rules not processed for user `11c309f2bc2e483bbdab778864affdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:12.582347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:12.584819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579baff-eb75-4207-934b-f8d3027b3b9f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.598841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.600949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.601379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.601774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.603745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.607451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.640820 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 951/1905] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:12.642533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.675061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3be9-9c69-40b4-b196-0851aafe5855 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.689172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.693677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.694661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.695571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] PATH_INFO: `/v3/users/13fbe6fa1fe443a8a50d141e722ec64c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.698400 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:12.700762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fbe6fa1fe443a8a50d141e722ec64c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.710357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.740465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 955/1906] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:12.741535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.761970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4cf7-a001-4ab9-a8fa-95483bd830dc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:12.784971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:12.785969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:12.786323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:12.786636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] PATH_INFO: `/v3/projects/ade2d5424e5f4264a8cb2c6a994ade6a/users/14f2977d77a542409ada210665312237/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:12.857243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fbe6fa1fe443a8a50d141e722ec64c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:12.890551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fbe6fa1fe443a8a50d141e722ec64c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:12.897519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade2d5424e5f4264a8cb2c6a994ade6a, user_id=14f2977d77a542409ada210665312237, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:12.904699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:12.913474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fbe6fa1fe443a8a50d141e722ec64c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:12.939586 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 956/1907] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:12 2022] PUT /identity/v3/projects/ade2d5424e5f4264a8cb2c6a994ade6a/users/14f2977d77a542409ada210665312237/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:12.943540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.944376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fbe6fa1fe443a8a50d141e722ec64c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:12.946099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fbe6fa1fe443a8a50d141e722ec64c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:12.970694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 952/1908] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:12 2022] DELETE /identity/v3/users/13fbe6fa1fe443a8a50d141e722ec64c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:12.972945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:12.984124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:13.021025 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:13.115007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4765e-743a-4823-a542-6cf51ad1b158 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:13.122559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25cec3-5f8c-42b1-b83d-adb262027ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:13.124734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cec3-5f8c-42b1-b83d-adb262027ace admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:13.126215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cec3-5f8c-42b1-b83d-adb262027ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:13.126885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cec3-5f8c-42b1-b83d-adb262027ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:13.128217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25cec3-5f8c-42b1-b83d-adb262027ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:13.131866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25cec3-5f8c-42b1-b83d-adb262027ace admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:13.155823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 953/1909] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:13.155823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:13.155823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:13.155823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:13.176377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:13.177888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:13.194088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f48f-c354-4b39-bdd5-0b1ac46ae9a3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:13.202329 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 954/1910] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:13.203591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:13.226544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbb35-69a3-47c9-88d7-470ab175cb43 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:13.235827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:13.237789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:13.238164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:13.238431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] PATH_INFO: `/v3/projects/ade2d5424e5f4264a8cb2c6a994ade6a/users/14f2977d77a542409ada210665312237/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:13.241659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade2d5424e5f4264a8cb2c6a994ade6a, user_id=14f2977d77a542409ada210665312237, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:13.244941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:13.278343 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 955/1911] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:13 2022] PUT /identity/v3/projects/ade2d5424e5f4264a8cb2c6a994ade6a/users/14f2977d77a542409ada210665312237/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:13.291044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:13.293351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:13.342172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:13.343159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:13.343450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:13.343780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:13.347835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:13.401370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd103cc-328e-429b-84bb-4261bbc5ca3f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:13.409836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:13.410870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:13.411232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:13.411578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:13.454610 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:13.484232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:13.486018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca61f-b07e-4dda-9f57-fe6a19a2c8df service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:13.501263 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 957/1912] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:13.502874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:13.503312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:13.503821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:13.519395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:13.521052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:13.556890 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 956/1913] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:13.558128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] MFA Rules not processed for user `14f2977d77a542409ada210665312237`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:13.559619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:13.770196 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 958/1914] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:13.796953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:13.798419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:13.932887 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:14.029065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13231-4225-4fff-b3e6-7154e012a1e2 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:14.049381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:14.050201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:14.050547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:14.050825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:14.066556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:14.068236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:14.079805 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 957/1915] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:14.194364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:14.195892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:14.272559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c79f-90c4-4e00-8055-69c1bd8d67ed None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:14.314203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:14.321275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:14.322218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:14.323609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] PATH_INFO: `/v3/projects/107137231769464ca1cf8c578134b6e2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:14.349672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107137231769464ca1cf8c578134b6e2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:14.353369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:14.495778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107137231769464ca1cf8c578134b6e2', 'request_id': 'req-69931f4a-d77a-4669-8f76-5764c17361d1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.510678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107137231769464ca1cf8c578134b6e2', 'request_id': 'req-69931f4a-d77a-4669-8f76-5764c17361d1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.522625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107137231769464ca1cf8c578134b6e2', 'request_id': 'req-69931f4a-d77a-4669-8f76-5764c17361d1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.543071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] The token cache is being invalidate because project 107137231769464ca1cf8c578134b6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:14.543611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.545307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.551281 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 959/1916] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:14 2022] DELETE /identity/v3/projects/107137231769464ca1cf8c578134b6e2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:14.557975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:14.613177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058b3c-69ef-4299-abfd-0e9ff964dc8d service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:14.716001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:14.718015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:14.800086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:14.800086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:14.800086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:14.800086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] PATH_INFO: `/v3/users/fdf44005908c4e7e8fed9d083e09c2ce` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:14.800946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf44005908c4e7e8fed9d083e09c2ce)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:14.803167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:14.902011 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:14.907816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf44005908c4e7e8fed9d083e09c2ce'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.908824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69931f4a-d77a-4669-8f76-5764c17361d1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:14.919167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:14.920273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:14.921010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:14.921497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] PATH_INFO: `/v3/users/14df0945349e405eaccad55bd735ec03` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:14.924466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14df0945349e405eaccad55bd735ec03)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:14.926783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:14.929300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf44005908c4e7e8fed9d083e09c2ce'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.961874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf44005908c4e7e8fed9d083e09c2ce'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.977263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf44005908c4e7e8fed9d083e09c2ce'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.978463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf44005908c4e7e8fed9d083e09c2ce'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:14.989320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 958/1917] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:14 2022] DELETE /identity/v3/users/fdf44005908c4e7e8fed9d083e09c2ce => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:15.024704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14df0945349e405eaccad55bd735ec03'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.025659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14df0945349e405eaccad55bd735ec03'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.048106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:15.048336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14df0945349e405eaccad55bd735ec03'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.049774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.055228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14df0945349e405eaccad55bd735ec03'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.072615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5fc70b-3dda-4fa9-96a2-e250ea279b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14df0945349e405eaccad55bd735ec03'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.113990 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 960/1918] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:14 2022] DELETE /identity/v3/users/14df0945349e405eaccad55bd735ec03 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:15.120082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:15.120694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:15.121961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:15.155127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:15.158541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.206918 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:15.235745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453a78-0889-4dff-b606-a796f87e05f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:15.346331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 961/1919] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:15.358813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:15.360309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:15.360848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:15.361416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] PATH_INFO: `/v3/users/8d028d30d8434e8b9588075dca2a215d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:15.362989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:15.363463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d028d30d8434e8b9588075dca2a215d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:15.365081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.366992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:15.523083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8d182-8833-4bd7-88ed-96e5eadda364 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:15.527288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d028d30d8434e8b9588075dca2a215d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.528402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:15.529446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:15.529850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:15.530245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:15.541619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:15.543721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:15.555878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d028d30d8434e8b9588075dca2a215d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.565889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 962/1920] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:15.570106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:15.574117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.585589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d028d30d8434e8b9588075dca2a215d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.640080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a01f-6e1e-480f-b396-2759dfaaf94c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:15.652488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d028d30d8434e8b9588075dca2a215d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.653577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dce99e4d-233a-4b07-a215-2d90ba376801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d028d30d8434e8b9588075dca2a215d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.656917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:15.660402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:15.662342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 959/1921] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:15 2022] DELETE /identity/v3/users/8d028d30d8434e8b9588075dca2a215d => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:15.663413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:15.665393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] PATH_INFO: `/v3/projects/93866ee5c79a4cec99837e55f392b7eb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:15.667928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:15.668489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:15.669034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:15.669642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93866ee5c79a4cec99837e55f392b7eb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:15.679646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:15.705085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:15.708555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.734286 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:15.882674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93866ee5c79a4cec99837e55f392b7eb', 'request_id': 'req-b25e78e2-c570-4651-a75b-89692825a16c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.890397 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 960/1922] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:15.908520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93866ee5c79a4cec99837e55f392b7eb', 'request_id': 'req-b25e78e2-c570-4651-a75b-89692825a16c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.912350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:15.915261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.942912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93866ee5c79a4cec99837e55f392b7eb', 'request_id': 'req-b25e78e2-c570-4651-a75b-89692825a16c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.982119 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:15.991153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] The token cache is being invalidate because project 93866ee5c79a4cec99837e55f392b7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:15.991501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.992896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b25e78e2-c570-4651-a75b-89692825a16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:15.994892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 963/1923] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:15 2022] DELETE /identity/v3/projects/93866ee5c79a4cec99837e55f392b7eb => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:16.001046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e6a6-7b07-4b45-8c58-dc3e17ae11ee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.001625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e6a6-7b07-4b45-8c58-dc3e17ae11ee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.002186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e6a6-7b07-4b45-8c58-dc3e17ae11ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.064276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-58d2e6a6-7b07-4b45-8c58-dc3e17ae11ee None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:16.066748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58d2e6a6-7b07-4b45-8c58-dc3e17ae11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:16.084402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c2dc3-2d00-43c3-a884-08f3c74ee703 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:16.181589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:16.182308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.182781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.183074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.185262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:16.240055 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 964/1924] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:16.250789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.251789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.252428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.296423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:16.301505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:16.332743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:16.337734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:16.338333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 965/1925] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:16.339593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:16.377205 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 961/1926] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:16.378918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8a15-3313-401b-82ec-876397c0abec None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:16.395706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:16.396572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.396929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.397280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.398122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:16.399086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:16.400424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:16.442972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 966/1927] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:16.449705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:16.467302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74fcca-b673-4a86-a51e-272586bec959 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:16.473545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:16.474246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.474589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.474876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.475593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:16.477726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:16.559032 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 962/1928] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:16 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:16.566026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:16.583854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:16.587403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:16.588037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1dc6-f071-43b4-adc6-ae3f34a7cc5d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:16.756150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d55f7-4595-4040-aca9-7641d1393c04 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:16.756458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:16.758761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.758761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.759200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.761271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:16.762845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:16.763077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:16.764674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.764958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.765234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] PATH_INFO: `/v3/projects/f1cd79e5e7b240f3ae3115cbf1994bb6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.766637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cd79e5e7b240f3ae3115cbf1994bb6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:16.768720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:16.772105 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:16.818732 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 967/1929] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:16 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:16.821168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:16.839754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9da72-e81e-471f-b9ca-973b848c5d72 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:16.847078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cd79e5e7b240f3ae3115cbf1994bb6', 'request_id': 'req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:16.857074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cd79e5e7b240f3ae3115cbf1994bb6', 'request_id': 'req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:16.860562 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:16.869275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cd79e5e7b240f3ae3115cbf1994bb6', 'request_id': 'req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:16.903536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] The token cache is being invalidate because project f1cd79e5e7b240f3ae3115cbf1994bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:16.904180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:16.909605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:16.917366 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 963/1930] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:16 2022] DELETE /identity/v3/projects/f1cd79e5e7b240f3ae3115cbf1994bb6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:16.919087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:16.925656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:16.969390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:16.972869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:16.973306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:16.973814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:16.975260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:16.980921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:17.007807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 968/1931] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:17.008847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:17.010869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:17.065078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85304fc3-4ea2-4092-9f2b-a6551c1a8ab3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:17.073015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:17.074062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:17.074378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:17.074763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:17.075517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:17.078692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:17.092198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733fa5-4f9c-4483-8fcf-e74fe580b1fe admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:17.097052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:17.097954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:17.098244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:17.098531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] PATH_INFO: `/v3/users/11c309f2bc2e483bbdab778864affdd6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:17.099137 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 969/1932] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:17.103315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c309f2bc2e483bbdab778864affdd6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:17.103865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:17.107120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:17.121483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8b799-35f6-436f-b2b3-8b79379b7cab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:17.134125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839a248-33f2-4f51-9667-18ee00fa31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:17.135290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839a248-33f2-4f51-9667-18ee00fa31c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:17.136386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839a248-33f2-4f51-9667-18ee00fa31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:17.137310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839a248-33f2-4f51-9667-18ee00fa31c9 admin admin] PATH_INFO: `/v3/projects/0ab7b0f040a34884a505446f24b559f9/users/e19446b18b4548fba728e2f38cadc689/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:17.173471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839a248-33f2-4f51-9667-18ee00fa31c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab7b0f040a34884a505446f24b559f9, user_id=e19446b18b4548fba728e2f38cadc689, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:17.177984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839a248-33f2-4f51-9667-18ee00fa31c9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:17.198263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c309f2bc2e483bbdab778864affdd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.205585 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 970/1933] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:17 2022] PUT /identity/v3/projects/0ab7b0f040a34884a505446f24b559f9/users/e19446b18b4548fba728e2f38cadc689/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:17.219660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:17.220121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:17.220764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:17.260015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] MFA Rules not processed for user `e19446b18b4548fba728e2f38cadc689`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:17.261983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:17.263272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c309f2bc2e483bbdab778864affdd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.279527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c309f2bc2e483bbdab778864affdd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.307978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c309f2bc2e483bbdab778864affdd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.309922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c309f2bc2e483bbdab778864affdd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.324950 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 964/1934] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:16 2022] DELETE /identity/v3/users/11c309f2bc2e483bbdab778864affdd6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:17.343985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:17.351228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:17.377658 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:17.424700 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 971/1935] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:17.437697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:17.440598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:17.579991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf3920-1ca7-445b-8ed4-fb674ace8802 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:17.603580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:17.604464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:17.604756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:17.605048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] PATH_INFO: `/v3/projects/c263c02039f240acb5e2fb2ed4319526` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:17.615282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c263c02039f240acb5e2fb2ed4319526)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:17.617268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:17.728843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528d74b-41fe-4048-9d86-76afd1482e12 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:17.762246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:17.765477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:17.765935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:17.770296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:17.778220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:17.780419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c263c02039f240acb5e2fb2ed4319526', 'request_id': 'req-23f19af9-f8b2-4605-b438-00875b3bc84a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.781686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:17.791548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c263c02039f240acb5e2fb2ed4319526', 'request_id': 'req-23f19af9-f8b2-4605-b438-00875b3bc84a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.820233 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:17.835120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c263c02039f240acb5e2fb2ed4319526', 'request_id': 'req-23f19af9-f8b2-4605-b438-00875b3bc84a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.861820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] The token cache is being invalidate because project c263c02039f240acb5e2fb2ed4319526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:17.862472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.863726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:17.869602 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 965/1936] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:17 2022] DELETE /identity/v3/projects/c263c02039f240acb5e2fb2ed4319526 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:17.871459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:17.875381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:17.875813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 972/1937] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:17 2022] POST /identity/v3/projects => generated 393 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:17.881051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:17.884023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:18.091050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e542f01-e56a-43f5-bf38-3dc43cc2b6f3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.097426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f19af9-f8b2-4605-b438-00875b3bc84a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.106009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.106343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.106666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.106950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.108209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.112672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.115487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.116398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.116685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.116967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] PATH_INFO: `/v3/users/14f2977d77a542409ada210665312237` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.121195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f2977d77a542409ada210665312237)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.123853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.167279 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 973/1938] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:17 2022] POST /identity/v3/users => generated 303 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:18.173662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.208726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432e77-3e01-4b49-8dd3-993e60818968 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.217245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.218037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.218355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.218722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.219762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.222095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.244765 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 974/1939] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:46:18.246161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.249214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:18.261384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f2977d77a542409ada210665312237'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.263182 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:18.284745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d3614-773e-434f-bfd8-b87e5648c30c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.292105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f2977d77a542409ada210665312237'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.293772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.295943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.296438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.296950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] PATH_INFO: `/v3/projects/5e3e2d01a9324236a000a9519fd857e2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.308435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3e2d01a9324236a000a9519fd857e2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.309970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f2977d77a542409ada210665312237'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.313475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.326824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f2977d77a542409ada210665312237'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.327886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f2977d77a542409ada210665312237'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.340637 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 966/1940] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:17 2022] DELETE /identity/v3/users/14f2977d77a542409ada210665312237 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:18.341990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.358439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:18.459612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3e2d01a9324236a000a9519fd857e2', 'request_id': 'req-3ad551d1-474e-46dc-87ec-b4ac07307c75'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.479089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63350-c664-498d-bf93-50759e066f82 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.480283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3e2d01a9324236a000a9519fd857e2', 'request_id': 'req-3ad551d1-474e-46dc-87ec-b4ac07307c75'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.496466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3e2d01a9324236a000a9519fd857e2', 'request_id': 'req-3ad551d1-474e-46dc-87ec-b4ac07307c75'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.521831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] The token cache is being invalidate because project 5e3e2d01a9324236a000a9519fd857e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:18.522128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.522979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3ad551d1-474e-46dc-87ec-b4ac07307c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:18.525007 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 975/1941] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:18 2022] DELETE /identity/v3/projects/5e3e2d01a9324236a000a9519fd857e2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:18.535761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e794ed0-48ad-4530-8944-02b279fbd3a8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.536106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e794ed0-48ad-4530-8944-02b279fbd3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.536419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e794ed0-48ad-4530-8944-02b279fbd3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.577235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.578178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.578470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.579304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] PATH_INFO: `/v3/projects/12eb4c057e6541dda06f9f28846a6d9f/users/8f0f126c45224f33bf96597436c98de3/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.594996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3e794ed0-48ad-4530-8944-02b279fbd3a8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:18.598418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3e794ed0-48ad-4530-8944-02b279fbd3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:18.608095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12eb4c057e6541dda06f9f28846a6d9f, user_id=8f0f126c45224f33bf96597436c98de3, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.615183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.618039 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 976/1942] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:18.627503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.628322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.628852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.646871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 967/1943] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:18 2022] PUT /identity/v3/projects/12eb4c057e6541dda06f9f28846a6d9f/users/8f0f126c45224f33bf96597436c98de3/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:18.652798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.659273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:18.679888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:18.682196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:18.776761 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:18.801161 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:18.816148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e57096-9d9b-4542-aaa5-b5ee98d88bc9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.845441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.846177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.846470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.848584 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 977/1944] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:18.849324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.850838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.858627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.867947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.881998 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 968/1945] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:18.888377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.902723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74fa47-0d11-474e-b920-ac8d0d08f5dd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.903140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399423a-3e60-4a99-9453-7c32824e4020 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.909636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.910700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.911037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.911350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.912088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9948a-0e57-4165-9ecf-3005ce778473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:18.912300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:18.912798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.913862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9948a-0e57-4165-9ecf-3005ce778473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.914369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9948a-0e57-4165-9ecf-3005ce778473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.915196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9948a-0e57-4165-9ecf-3005ce778473 admin admin] PATH_INFO: `/v3/projects/12eb4c057e6541dda06f9f28846a6d9f/users/8f0f126c45224f33bf96597436c98de3/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.915307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.917826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9948a-0e57-4165-9ecf-3005ce778473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12eb4c057e6541dda06f9f28846a6d9f, user_id=8f0f126c45224f33bf96597436c98de3, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:18.924435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9948a-0e57-4165-9ecf-3005ce778473 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:18.941221 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 969/1947] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:18 2022] PUT /identity/v3/projects/12eb4c057e6541dda06f9f28846a6d9f/users/8f0f126c45224f33bf96597436c98de3/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:18.943733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910005a8-d5a3-4cf5-8d9f-4aea1c2b3d58 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.944556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910005a8-d5a3-4cf5-8d9f-4aea1c2b3d58 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.945113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910005a8-d5a3-4cf5-8d9f-4aea1c2b3d58 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.947724 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 970/1948] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:46:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:18.950615 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 978/1948] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:18.952353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:18.953316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:18.953904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:18.954656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:18.964144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230d57c-4687-4949-be05-5c57e8317ea0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:18.993793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] MFA Rules not processed for user `8f0f126c45224f33bf96597436c98de3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:18.995790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.066523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22620b-b7cf-40af-a45d-a9b4a60b6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.067549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22620b-b7cf-40af-a45d-a9b4a60b6f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.070058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22620b-b7cf-40af-a45d-a9b4a60b6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.070383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22620b-b7cf-40af-a45d-a9b4a60b6f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.071630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22620b-b7cf-40af-a45d-a9b4a60b6f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.078063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22620b-b7cf-40af-a45d-a9b4a60b6f24 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.140058 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 979/1949] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:18 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:19.141414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baba47-6106-4d51-80a7-0fdf42ba8bee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.141708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baba47-6106-4d51-80a7-0fdf42ba8bee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.141990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baba47-6106-4d51-80a7-0fdf42ba8bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.190175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f6baba47-6106-4d51-80a7-0fdf42ba8bee None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:19.191565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6baba47-6106-4d51-80a7-0fdf42ba8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.225910 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 971/1950] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:19.226837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.269545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562f78-9eea-45f2-a071-0e364c1a693b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:19.333988 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 980/1951] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:19.336157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.336453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.336737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.367597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] MFA Rules not processed for user `e19446b18b4548fba728e2f38cadc689`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:19.370714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.376313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8cbee-33d1-45d2-a199-08cf328d92f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.377102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8cbee-33d1-45d2-a199-08cf328d92f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.377392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8cbee-33d1-45d2-a199-08cf328d92f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.377669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8cbee-33d1-45d2-a199-08cf328d92f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.378464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8cbee-33d1-45d2-a199-08cf328d92f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.380516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8cbee-33d1-45d2-a199-08cf328d92f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.432501 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 972/1952] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:19 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:19.432501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.432792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.433620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.450708 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:19.466342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 981/1953] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:19.467483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.468924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.487643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] MFA Rules not processed for user `f6f2035f95ef4cb39fc1f6a41d314bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:19.489241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.500248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6e03e-8295-4733-bcdd-e7a47f9ebcff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:19.509257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.510033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.510318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.510699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.524405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.528617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.548167 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 982/1954] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:19.549192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.565706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc3d7-3e10-49ae-bd30-d8808d3969d7 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:19.580206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.580934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.581218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.581492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.582241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.591413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.604661 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:19.621210 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 983/1955] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:19.628669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.652767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0cb8-fafd-49ec-8569-3f5f0fc3ad36 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:19.677803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.681384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.681691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.682598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.682889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.690535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.697340 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 973/1956] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:19.707315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.713519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 984/1957] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:46:19.726473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0a4c3-8fa6-4837-b8f6-08ca0a12a989 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:19.733561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.734369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.734595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.735066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.735494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.738101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.755925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.759470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d8482-680b-46f9-a7cd-fe185568fd5f service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.761378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a17732-0511-49b2-8da9-c699f5656756 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:19.768384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:19.769572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.769859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.770140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] PATH_INFO: `/v3/projects/b96cbc37e8fb4f06aaa41de74a098ff1/users/da58e3760a3241ed8f7b810721f93438/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.783725 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 974/1958] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:19.816696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96cbc37e8fb4f06aaa41de74a098ff1, user_id=da58e3760a3241ed8f7b810721f93438, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:19.819983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:19.847574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 985/1959] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:19 2022] PUT /identity/v3/projects/b96cbc37e8fb4f06aaa41de74a098ff1/users/da58e3760a3241ed8f7b810721f93438/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:19.859575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:19.859934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:19.860636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:19.873900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:19.880297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:19.925544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] MFA Rules not processed for user `da58e3760a3241ed8f7b810721f93438`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:19.926959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:20.055629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f532c-16e5-451e-ab43-26e0a1ffc2c3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:20.067131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:20.068640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.069409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.069975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] PATH_INFO: `/v3/projects/ade2d5424e5f4264a8cb2c6a994ade6a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:20.076888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade2d5424e5f4264a8cb2c6a994ade6a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:20.081883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:20.109523 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 975/1960] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:20.110732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:20.113111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:20.197948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade2d5424e5f4264a8cb2c6a994ade6a', 'request_id': 'req-477bd218-2910-4031-a661-b258f29499fc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:20.219136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade2d5424e5f4264a8cb2c6a994ade6a', 'request_id': 'req-477bd218-2910-4031-a661-b258f29499fc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:20.235398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade2d5424e5f4264a8cb2c6a994ade6a', 'request_id': 'req-477bd218-2910-4031-a661-b258f29499fc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:20.262397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] The token cache is being invalidate because project ade2d5424e5f4264a8cb2c6a994ade6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:20.262397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:20.265063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:20.273431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 986/1961] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:19 2022] DELETE /identity/v3/projects/ade2d5424e5f4264a8cb2c6a994ade6a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:20.273431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:20.275636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:20.308826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d55fc-9242-42f4-9dc2-8db7c63d162e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:20.353104 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:20.431380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bd218-2910-4031-a661-b258f29499fc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:20.438842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cb731-54a1-42b0-b718-825d82c92982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:20.439571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb731-54a1-42b0-b718-825d82c92982 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.439863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb731-54a1-42b0-b718-825d82c92982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.440143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb731-54a1-42b0-b718-825d82c92982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:20.440922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cb731-54a1-42b0-b718-825d82c92982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:20.442619 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:20.444382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cb731-54a1-42b0-b718-825d82c92982 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:20.494225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:20.496059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.498144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.499861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:20.501390 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 987/1962] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:20 2022] POST /identity/v3/projects => generated 389 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:20.503687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184e72-79a1-4794-972f-46d5a073ce8b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.504552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184e72-79a1-4794-972f-46d5a073ce8b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.505139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184e72-79a1-4794-972f-46d5a073ce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:20.505764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:20.622342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68184e72-79a1-4794-972f-46d5a073ce8b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:20.626568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68184e72-79a1-4794-972f-46d5a073ce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:20.769308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:20.779697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:20.798841 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 976/1963] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:20.799415 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 988/1964] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:20.800928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.801213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.801496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:20.807211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:20.842800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b70a48-1317-49cf-9184-faec40c514d8 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:20.860516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:20.861779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:20.861900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a5fb-9690-4d8c-a746-05028e44d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:20.862674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a5fb-9690-4d8c-a746-05028e44d7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.862965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a5fb-9690-4d8c-a746-05028e44d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.863497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a5fb-9690-4d8c-a746-05028e44d7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:20.864505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6a5fb-9690-4d8c-a746-05028e44d7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:20.867307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6a5fb-9690-4d8c-a746-05028e44d7a1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:20.940580 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 977/1965] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:20 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:20.952006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:20.952586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:20.953110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.000028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:21.001301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:21.019410 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 989/1966] 10.222.0.84 () {58 vars in 1015 bytes} [Mon Jul 11 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:21.020517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.028278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 978/1967] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:21.033339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.047920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be65dd-f1af-4b45-b808-35784800fc07 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.055209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.056181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.056488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.056776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.057498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.062824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.074552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 990/1968] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:21.075158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8bad-d210-4a18-80c7-00b72acb8e89 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.079631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.091988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.091988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.094031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.094031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.094031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:21.094031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.098929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.105226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a511-3864-43e4-8353-156872ba96d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.119606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.120537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.120988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.121279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] PATH_INFO: `/v3/projects/3774549322ba48e48cd24622f588a107/users/05709dede68e42939e77c88a6e5f6280/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.136441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 979/1969] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:21.137343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.142260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:21.164253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3e40c-f53e-4c65-b4c5-8326fed8d1a4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.165958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3774549322ba48e48cd24622f588a107, user_id=05709dede68e42939e77c88a6e5f6280, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.168442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.169438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.170325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.170742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.176049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.180318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.181658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.199482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 980/1970] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:21.200473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.210618 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 991/1971] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:21 2022] PUT /identity/v3/projects/3774549322ba48e48cd24622f588a107/users/05709dede68e42939e77c88a6e5f6280/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:21.212175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.214958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148bb7f-f2ae-4c0a-9066-5035c3000d7f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.257898 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:21.327420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1229c31-f8d8-436d-956e-2dab96e8e2ed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.327534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.327534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.327534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.327534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.328767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.329453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.330911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.330911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.330911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.332062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.332973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.333685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.348972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 992/1972] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:21.350704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.362740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2104-0d21-4d58-9de8-fb3f988b8b5a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.370608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342190-e4c2-421e-9b0d-3d797cae0fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.372158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342190-e4c2-421e-9b0d-3d797cae0fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.372449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342190-e4c2-421e-9b0d-3d797cae0fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.372755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342190-e4c2-421e-9b0d-3d797cae0fbf admin admin] PATH_INFO: `/v3/projects/3774549322ba48e48cd24622f588a107/users/05709dede68e42939e77c88a6e5f6280/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.375578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342190-e4c2-421e-9b0d-3d797cae0fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3774549322ba48e48cd24622f588a107, user_id=05709dede68e42939e77c88a6e5f6280, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.381813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342190-e4c2-421e-9b0d-3d797cae0fbf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.384530 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 981/1973] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:21 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:21.387162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.394901 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 993/1974] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:21 2022] PUT /identity/v3/projects/3774549322ba48e48cd24622f588a107/users/05709dede68e42939e77c88a6e5f6280/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:21.406591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.406986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.407384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.425773 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:21.447483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] MFA Rules not processed for user `05709dede68e42939e77c88a6e5f6280`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:21.449662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:21.476877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec7ed-a51e-42c5-9555-cedb12b2ea9e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.598750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.600231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.600231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.600231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.601320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.603088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.642978 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 982/1975] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:21 2022] POST /identity/v3/users => generated 281 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:21.647790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.678675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66017-4802-4396-aa9d-0f28e65a1717 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.692129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 994/1976] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:21.697160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.699508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.699907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.700667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.702645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.703989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.705677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:21.708304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.755367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 983/1977] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:21.759006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.784333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb460c-3036-4764-bf86-51c3937e3589 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.808993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.811119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.814023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.815433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.817163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.823526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.874580 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 984/1978] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:21.876076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:21.899197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c827fb-a484-4b38-b0c6-09717bca0c0b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.912154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0f9b-0556-4ce2-a252-dfad9f4062d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.913160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0f9b-0556-4ce2-a252-dfad9f4062d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.913974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0f9b-0556-4ce2-a252-dfad9f4062d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.914278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0f9b-0556-4ce2-a252-dfad9f4062d8 admin admin] PATH_INFO: `/v3/projects/d7605245706d45b5903c67ba7a91b2a0/users/21271ab0786241dc89fccc9a6d83996a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.948821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0f9b-0556-4ce2-a252-dfad9f4062d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7605245706d45b5903c67ba7a91b2a0, user_id=21271ab0786241dc89fccc9a6d83996a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:21.951946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0f9b-0556-4ce2-a252-dfad9f4062d8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:21.953529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b65aa-5874-4cd8-aef0-380164ef29e4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:21.972768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:21.977740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.978754 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 985/1979] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:21 2022] PUT /identity/v3/projects/d7605245706d45b5903c67ba7a91b2a0/users/21271ab0786241dc89fccc9a6d83996a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:21.982055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.983981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:21.989678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:21.990006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:21.990256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:22.006420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:22.010195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:22.033911 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 995/1980] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:22.053589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] MFA Rules not processed for user `21271ab0786241dc89fccc9a6d83996a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:22.055583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:22.220668 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 986/1981] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:22.226828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:22.247442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5997a-7ade-4118-a2f9-6c91fff0247b service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:22.315923 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:22.476467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:22.477155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:22.477438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:22.477716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:22.478428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:22.480436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:22.575122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:22.583444 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:22.589895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 996/1982] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:22 2022] POST /identity/v3/projects => generated 361 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:22.594011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:22.610809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08ff7-fb05-4a2e-8f82-ddad5970ac5c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:22.775519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1ad6-a319-418f-a60e-406317aaf119 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:22.787951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:22.788926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:22.789288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:22.790742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:22.791946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:22.792203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:22.793115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:22.793428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:22.793917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] PATH_INFO: `/v3/users/da58e3760a3241ed8f7b810721f93438` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:22.794090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:22.796146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da58e3760a3241ed8f7b810721f93438)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:22.801194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:22.840882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 997/1983] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:22 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:22.849204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:22.931155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575884fb-e246-40fd-876b-689cc8f35ec2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:22.952261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985d7e-c2fa-4d04-b6b6-25714ddc051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:22.956691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985d7e-c2fa-4d04-b6b6-25714ddc051f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:22.957555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985d7e-c2fa-4d04-b6b6-25714ddc051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:22.957849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985d7e-c2fa-4d04-b6b6-25714ddc051f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:22.958799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985d7e-c2fa-4d04-b6b6-25714ddc051f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:22.964373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985d7e-c2fa-4d04-b6b6-25714ddc051f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:22.987210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da58e3760a3241ed8f7b810721f93438'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:22.994121 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 998/1984] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:23.000785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612cd80-842f-45ba-b33f-89085f33fe0d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.001226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612cd80-842f-45ba-b33f-89085f33fe0d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.001607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612cd80-842f-45ba-b33f-89085f33fe0d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.006923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 999/1985] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:46:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:23.007991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612cd80-842f-45ba-b33f-89085f33fe0d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:23.034968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612cd80-842f-45ba-b33f-89085f33fe0d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:23.044562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da58e3760a3241ed8f7b810721f93438'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:23.053180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665bc49-935a-4353-8825-b4a141b44520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:23.054286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bc49-935a-4353-8825-b4a141b44520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.054706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bc49-935a-4353-8825-b4a141b44520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.055090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bc49-935a-4353-8825-b4a141b44520 admin admin] PATH_INFO: `/v3/projects/4099cc1844de4602a8dfa19404e03f9e/users/0a91af25668c4c0cb166ded91c225598/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.069635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da58e3760a3241ed8f7b810721f93438'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:23.091088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665bc49-935a-4353-8825-b4a141b44520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4099cc1844de4602a8dfa19404e03f9e, user_id=0a91af25668c4c0cb166ded91c225598, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:23.093287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da58e3760a3241ed8f7b810721f93438'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:23.094239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11e0e56c-6eab-4d4a-a5d3-25a5b7d232c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da58e3760a3241ed8f7b810721f93438'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:23.095146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665bc49-935a-4353-8825-b4a141b44520 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:23.121602 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 987/1986] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:22 2022] DELETE /identity/v3/users/da58e3760a3241ed8f7b810721f93438 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:23.126913 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1000/1987] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:23 2022] PUT /identity/v3/projects/4099cc1844de4602a8dfa19404e03f9e/users/0a91af25668c4c0cb166ded91c225598/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:23.129821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.129821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.129821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.130116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.130116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.130116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.205530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:23.206868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.213149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:23.215890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.369667 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:23.392392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1001/1988] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:23.393710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:23.399243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.414100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e730194-ab2f-4dd3-85f7-66c3422050cc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:23.419522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:23.421034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.421457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.421871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.422798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:23.424671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:23.434682 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 988/1989] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:23.437802 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1002/1990] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:23.443522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:23.444106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:23.450041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.461483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c663f49-5bd2-45d3-a083-5f73984ccc8c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:23.468717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1698b85-450f-4dd6-995e-a98c153aaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:23.469898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698b85-450f-4dd6-995e-a98c153aaef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.470519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698b85-450f-4dd6-995e-a98c153aaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.470947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698b85-450f-4dd6-995e-a98c153aaef3 admin admin] PATH_INFO: `/v3/projects/4099cc1844de4602a8dfa19404e03f9e/users/0a91af25668c4c0cb166ded91c225598/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.473344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1698b85-450f-4dd6-995e-a98c153aaef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4099cc1844de4602a8dfa19404e03f9e, user_id=0a91af25668c4c0cb166ded91c225598, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:23.477078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1698b85-450f-4dd6-995e-a98c153aaef3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:23.502189 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1003/1991] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:23 2022] PUT /identity/v3/projects/4099cc1844de4602a8dfa19404e03f9e/users/0a91af25668c4c0cb166ded91c225598/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:23.522159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.523152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.523956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.540090 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:23.615190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] MFA Rules not processed for user `0a91af25668c4c0cb166ded91c225598`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:23.617100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.721588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8e6b7-c0f6-47c1-acd9-3883c1a5cb77 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:23.818743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:23.820159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.820682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.821335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.829281 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1004/1992] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:23.831636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:23.834096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.909476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:23.911113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:23.924337 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 989/1993] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:24.000853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:24.002673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:24.122296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25ed6-11be-462f-9af8-7485f9d9f426 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:24.148726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:24.149761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:24.150100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:24.150675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:24.178918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:24.179932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:24.186374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec076-813d-4042-9290-c4d088d1e7c8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:24.205968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5e682-b6d0-489c-a8ff-5f4a5cbce9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:24.206586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e682-b6d0-489c-a8ff-5f4a5cbce9b1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:24.206846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e682-b6d0-489c-a8ff-5f4a5cbce9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:24.207128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e682-b6d0-489c-a8ff-5f4a5cbce9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:24.217375 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1005/1994] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:24.231521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5e682-b6d0-489c-a8ff-5f4a5cbce9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:24.233226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5e682-b6d0-489c-a8ff-5f4a5cbce9b1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:24.259857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 990/1995] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:25.415613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:25.444967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e36b-2fa8-4f1c-b919-01da5dda179c service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:25.459733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:25.460917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:25.472860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:25.473230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] PATH_INFO: `/v3/users/21271ab0786241dc89fccc9a6d83996a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:25.474777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21271ab0786241dc89fccc9a6d83996a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:25.477495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:25.611066 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:25.630049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21271ab0786241dc89fccc9a6d83996a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:25.630693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21271ab0786241dc89fccc9a6d83996a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:25.660387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21271ab0786241dc89fccc9a6d83996a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:25.661173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21271ab0786241dc89fccc9a6d83996a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:25.676741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21271ab0786241dc89fccc9a6d83996a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:25.702306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1006/1996] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:25 2022] DELETE /identity/v3/users/21271ab0786241dc89fccc9a6d83996a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:25.706797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:25.707430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:25.708439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:25.744350 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:25.759995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:25.765079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:25.909363 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 991/1997] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:25.945593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:25.951765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:26.068237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c09c1-ebe8-4fe5-8333-51dc578c0f39 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:26.075195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:26.075936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:26.077039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:26.077338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:26.105562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:26.112680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:26.138096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1007/1998] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:26.511751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:26.513491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:26.541305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220ca9-ff4d-4413-9451-7acd23fe0c13 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:26.554417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:26.555406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:26.555692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:26.556035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] PATH_INFO: `/v3/projects/b96cbc37e8fb4f06aaa41de74a098ff1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:26.559348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96cbc37e8fb4f06aaa41de74a098ff1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:26.563133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:26.687755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96cbc37e8fb4f06aaa41de74a098ff1', 'request_id': 'req-7bcc3c1c-01e3-400c-8e00-0cde11351d18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:26.705824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96cbc37e8fb4f06aaa41de74a098ff1', 'request_id': 'req-7bcc3c1c-01e3-400c-8e00-0cde11351d18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:26.726802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96cbc37e8fb4f06aaa41de74a098ff1', 'request_id': 'req-7bcc3c1c-01e3-400c-8e00-0cde11351d18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:26.749244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] The token cache is being invalidate because project b96cbc37e8fb4f06aaa41de74a098ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:26.750934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:26.753702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:26.760009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 992/1999] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:26 2022] DELETE /identity/v3/projects/b96cbc37e8fb4f06aaa41de74a098ff1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:26.764635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:26.785495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2742-0d1d-4f89-a1b2-0c64052a2591 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:26.927357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:26.928392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:26.928685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:26.928971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] PATH_INFO: `/v3/users/05709dede68e42939e77c88a6e5f6280` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:26.932017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05709dede68e42939e77c88a6e5f6280)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:26.934030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:27.105768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05709dede68e42939e77c88a6e5f6280'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.106542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05709dede68e42939e77c88a6e5f6280'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.132160 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:27.142795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05709dede68e42939e77c88a6e5f6280'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.143019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05709dede68e42939e77c88a6e5f6280'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.152598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05709dede68e42939e77c88a6e5f6280'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.172497 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1008/2000] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:26 2022] DELETE /identity/v3/users/05709dede68e42939e77c88a6e5f6280 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:27.655282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:27.656830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:27.696287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc3c1c-01e3-400c-8e00-0cde11351d18 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:27.780629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:27.781551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:27.781848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:27.782132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] PATH_INFO: `/v3/projects/d7605245706d45b5903c67ba7a91b2a0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:27.783564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7605245706d45b5903c67ba7a91b2a0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:27.785580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:27.845506 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:27.871438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7605245706d45b5903c67ba7a91b2a0', 'request_id': 'req-e4aee5b5-ccd7-4764-80da-f991aec980e2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.881138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7605245706d45b5903c67ba7a91b2a0', 'request_id': 'req-e4aee5b5-ccd7-4764-80da-f991aec980e2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.893583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7605245706d45b5903c67ba7a91b2a0', 'request_id': 'req-e4aee5b5-ccd7-4764-80da-f991aec980e2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.955752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] The token cache is being invalidate because project d7605245706d45b5903c67ba7a91b2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:27.957228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.963043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:27.974128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 993/2001] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:27 2022] DELETE /identity/v3/projects/d7605245706d45b5903c67ba7a91b2a0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:27.976967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:27.979543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:28.026009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c524d4-219c-4e35-9288-83f92b26ca22 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:28.276533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:28.281242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:28.313796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:28.315165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:28.316330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:28.316922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] PATH_INFO: `/v3/users/0a91af25668c4c0cb166ded91c225598` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:28.321731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a91af25668c4c0cb166ded91c225598)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:28.324598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:28.449380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a91af25668c4c0cb166ded91c225598'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.450126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a91af25668c4c0cb166ded91c225598'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.469770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a91af25668c4c0cb166ded91c225598'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.470844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a91af25668c4c0cb166ded91c225598'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.484708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed381d3c-9374-4903-af26-474c292f9140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a91af25668c4c0cb166ded91c225598'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.502780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1009/2002] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:27 2022] DELETE /identity/v3/users/0a91af25668c4c0cb166ded91c225598 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:28.606434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aee5b5-ccd7-4764-80da-f991aec980e2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:28.768926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:28.769925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:28.770243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:28.770590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] PATH_INFO: `/v3/projects/3774549322ba48e48cd24622f588a107` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:28.772473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3774549322ba48e48cd24622f588a107)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:28.776787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:28.909987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3774549322ba48e48cd24622f588a107', 'request_id': 'req-4d8945e6-079e-449d-85c1-869cd9fe284f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.921309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3774549322ba48e48cd24622f588a107', 'request_id': 'req-4d8945e6-079e-449d-85c1-869cd9fe284f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.933489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3774549322ba48e48cd24622f588a107', 'request_id': 'req-4d8945e6-079e-449d-85c1-869cd9fe284f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.948218 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:28.960531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] The token cache is being invalidate because project 3774549322ba48e48cd24622f588a107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:28.960968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.962256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d8945e6-079e-449d-85c1-869cd9fe284f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:28.967946 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 994/2003] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:28 2022] DELETE /identity/v3/projects/3774549322ba48e48cd24622f588a107 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:28.973375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:28.974800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:28.975375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.002105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:29.004920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:29.095284 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:29.111372 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1010/2004] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:29.119716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.120225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.120582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.146891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:29.149501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:29.164734 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 995/2005] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:29.169878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:29.184011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0124b-4f91-4c95-a8f5-5550c50ab048 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:29.202246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:29.204882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.205726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.206443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.208815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:29.210385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:29.217574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:29.257710 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1011/2006] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:29.260226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:29.288410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe20d8-b1ec-423c-9795-b90b2a43a0ed None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:29.303400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:29.304861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.305582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.306173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.307996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:29.318516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:29.456495 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 996/2007] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:29 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:29.463825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:29.515656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6efe-9d98-4264-9b78-2b4bfbbdbe6f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:29.692861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:29.693607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.693870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.694648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.696083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:29.699473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:29.749878 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1012/2008] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:29 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:29.752916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:29.787292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b46a4f-babc-4cfb-beda-14fdfbaaa58f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:29.794621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:29.795421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.795788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.796141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.796985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:29.801701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:29.817993 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 997/2009] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:29.822129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:29.850264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05fcb5-ec68-4f56-9e98-08c19786cb1b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:29.856607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef0f22-ff83-461d-aaa3-be24171a1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:29.857438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef0f22-ff83-461d-aaa3-be24171a1ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.857768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef0f22-ff83-461d-aaa3-be24171a1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.858057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef0f22-ff83-461d-aaa3-be24171a1ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.858853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef0f22-ff83-461d-aaa3-be24171a1ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:29.860576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef0f22-ff83-461d-aaa3-be24171a1ea4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:29.873482 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1013/2010] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:29.878735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:29.892960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5e6a-51cd-4db8-a753-66b4fd67f9c2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:29.900719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:29.902106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.902519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.902925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] PATH_INFO: `/v3/projects/43823dd717a24efdaf57302317a821e4/users/b0e9269c55ce43e9b3240c1c4a96f6f6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.923545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43823dd717a24efdaf57302317a821e4, user_id=b0e9269c55ce43e9b3240c1c4a96f6f6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:29.927635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:29.948770 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 998/2011] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:29 2022] PUT /identity/v3/projects/43823dd717a24efdaf57302317a821e4/users/b0e9269c55ce43e9b3240c1c4a96f6f6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:29.960093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:29.960296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:29.960579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:29.998117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] MFA Rules not processed for user `b0e9269c55ce43e9b3240c1c4a96f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:29.999868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:30.109869 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1014/2012] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:30.113461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:30.295497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f302-c519-43e3-b53e-c248d3529fa3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:30.317162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:30.317924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.318201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.318442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.319251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:30.327595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:30.391831 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 999/2013] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:30 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:30.392717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:30.395540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:30.396987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:30.513807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51015c41-d7ff-4121-8266-5bb897bc0113 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:30.543938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1e39d-4ca6-4726-b01e-1ed25bc622ae admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:30.554699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:30.556616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:30.557444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.557690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.558157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.558263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.558583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.559031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] PATH_INFO: `/v3/projects/4099cc1844de4602a8dfa19404e03f9e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.560647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:30.566184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4099cc1844de4602a8dfa19404e03f9e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:30.570306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:30.570861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:30.598981 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1000/2014] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:30 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:30.605150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:30.618239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee646f1b-5963-436b-906c-81a85869f694 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:30.625403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:30.626110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.626395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.626779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.627561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:30.630225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:30.633397 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:30.668559 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1001/2015] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:30.677588 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:30.679369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:30.681243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4099cc1844de4602a8dfa19404e03f9e', 'request_id': 'req-468447e0-24b2-4844-925b-d3db90f6e106'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:30.696834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ab8b-6b8f-407d-bf01-be1f3b477fc6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:30.697111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4099cc1844de4602a8dfa19404e03f9e', 'request_id': 'req-468447e0-24b2-4844-925b-d3db90f6e106'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:30.707716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4099cc1844de4602a8dfa19404e03f9e', 'request_id': 'req-468447e0-24b2-4844-925b-d3db90f6e106'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:30.726487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] The token cache is being invalidate because project 4099cc1844de4602a8dfa19404e03f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:30.726907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:30.727785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-468447e0-24b2-4844-925b-d3db90f6e106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:30.729889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1015/2016] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:30 2022] DELETE /identity/v3/projects/4099cc1844de4602a8dfa19404e03f9e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:30.737141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842b3e-610c-465a-a1e0-613796ef2630 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.737970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842b3e-610c-465a-a1e0-613796ef2630 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.738475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842b3e-610c-465a-a1e0-613796ef2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.782026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f9842b3e-610c-465a-a1e0-613796ef2630 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:30.785888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f9842b3e-610c-465a-a1e0-613796ef2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:30.800298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:30.808039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.812334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.813097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] PATH_INFO: `/v3/projects/e1defab0e11f4b349a525916424d1b4b/users/353f2b767ee3436f87cf8b7e950edf6f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.835642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1defab0e11f4b349a525916424d1b4b, user_id=353f2b767ee3436f87cf8b7e950edf6f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:30.838060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:30.879612 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1002/2017] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:30 2022] PUT /identity/v3/projects/e1defab0e11f4b349a525916424d1b4b/users/353f2b767ee3436f87cf8b7e950edf6f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:30.881424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:30.885207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:30.902476 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1016/2018] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:30.922140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:30.924775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:30.926579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:30.985828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:30.991225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:31.064995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bf607-19a6-4832-8cac-702fd95b678c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.084311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.087485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.089659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.090326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.093621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.097248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.129889 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1003/2019] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:31.137170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.162097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e972-bf6e-4660-b344-9a02e690c2b1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.171111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1017/2020] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:31.176568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.178066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.179938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.180318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.180799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] PATH_INFO: `/v3/projects/e1defab0e11f4b349a525916424d1b4b/users/353f2b767ee3436f87cf8b7e950edf6f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.191015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ebd53-b836-413a-8bfd-569587cae9a4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.194405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1defab0e11f4b349a525916424d1b4b, user_id=353f2b767ee3436f87cf8b7e950edf6f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.198167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.199343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.199825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.200545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.203546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:31.204391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.210399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9182d9f-0286-4677-863e-a3a85c19c60c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.212284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.242129 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1004/2021] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:31 2022] PUT /identity/v3/projects/e1defab0e11f4b349a525916424d1b4b/users/353f2b767ee3436f87cf8b7e950edf6f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:31.242882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1018/2022] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:46:31.243767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.253911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785309c8-dd68-4e47-baa4-285210f7be02 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.254630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785309c8-dd68-4e47-baa4-285210f7be02 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.255105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785309c8-dd68-4e47-baa4-285210f7be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.305548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-785309c8-dd68-4e47-baa4-285210f7be02 None None] MFA Rules not processed for user `353f2b767ee3436f87cf8b7e950edf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:31.308131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-785309c8-dd68-4e47-baa4-285210f7be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:31.415880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa9c60-20e1-424b-a798-e02a21056a79 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.427090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.427783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.428066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.428342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.429209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.433969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.449405 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:31.470590 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:31.511177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1005/2023] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:31 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:31.515973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.522684 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1019/2024] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:31.537509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.537803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.538185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.619225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] MFA Rules not processed for user `b0e9269c55ce43e9b3240c1c4a96f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:31.624223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:31.772247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf181-946e-48bb-ac39-58eda78750d1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.780838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.781470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.781703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.781987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.782879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.785529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.827061 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1006/2025] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:31 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:31.831388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.850614 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1020/2026] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:31.853354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b719-799b-476a-9cdb-32e6db4a9158 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.864029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.866876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:31.878577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.879935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.879935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.880185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.882426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.884097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.913899 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1007/2027] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:31.914475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.943393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6aff7-b4a5-4967-8597-345e97fc121c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.953564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.954866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.955417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.955908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:31.956993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:31.958691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:31.974728 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1008/2028] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:31.979215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:31.991387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce9264-22ea-47fc-a46b-b78cf1f53b38 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:31.996515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bbb7e-d325-453f-9c3f-8e6451008c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:31.998356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bbb7e-d325-453f-9c3f-8e6451008c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:31.998731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bbb7e-d325-453f-9c3f-8e6451008c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:31.999032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bbb7e-d325-453f-9c3f-8e6451008c46 admin admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065/users/e9e3b8a329784debba22a3b810135b6b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.021366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bbb7e-d325-453f-9c3f-8e6451008c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5c02a54fd641168e97571035e16065, user_id=e9e3b8a329784debba22a3b810135b6b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:32.022322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd174ed6-eaf7-4e9b-898b-dd474373686f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:32.024724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bbb7e-d325-453f-9c3f-8e6451008c46 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:32.030516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:32.031538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.031832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.032430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.034809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:32.048496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:32.050294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:32.052547 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1009/2029] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:31 2022] PUT /identity/v3/projects/dd5c02a54fd641168e97571035e16065/users/e9e3b8a329784debba22a3b810135b6b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:32.063533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069d20-889a-4878-a0fe-d18050855351 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.064055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069d20-889a-4878-a0fe-d18050855351 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.064331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069d20-889a-4878-a0fe-d18050855351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.080155 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1021/2030] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:32.113600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d1069d20-889a-4878-a0fe-d18050855351 None None] MFA Rules not processed for user `e9e3b8a329784debba22a3b810135b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:32.115726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d1069d20-889a-4878-a0fe-d18050855351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:32.284283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1010/2031] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:32.290694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:32.307791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6fc4-135e-4177-9262-237a7fd0712c service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:32.375676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce3992-0396-441b-9751-ad9b168c6841 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.376198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce3992-0396-441b-9751-ad9b168c6841 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.376603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce3992-0396-441b-9751-ad9b168c6841 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.379457 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1011/2032] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:46:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:32.412697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.413852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.414620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.419885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:32.421304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.421969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.422545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.424194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:32.428369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:32.474681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:32.477436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:32.492774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1022/2033] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:32 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:32.494163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:32.505830 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:32.530908 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:32.685640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f197ec-5e8f-4de4-8940-7e9466229323 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:32.708246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:32.709463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.709971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.712701 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1012/2034] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:32.713453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:32.714377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.715254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:32.720258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:32.732479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:32.759554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40434f8b-48ea-4343-84d5-661272776b03 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:32.766717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:32.768856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:32.770722 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1023/2035] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:32 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:32.770908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:32.771080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] PATH_INFO: `/v3/users/f6f2035f95ef4cb39fc1f6a41d314bad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:32.772617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:32.773713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f2035f95ef4cb39fc1f6a41d314bad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:32.776042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:32.780078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:32.866449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f2035f95ef4cb39fc1f6a41d314bad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:32.886325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f2035f95ef4cb39fc1f6a41d314bad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:32.897645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f2035f95ef4cb39fc1f6a41d314bad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:32.913273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f2035f95ef4cb39fc1f6a41d314bad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:32.915297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f2035f95ef4cb39fc1f6a41d314bad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:32.937529 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1013/2036] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:32 2022] DELETE /identity/v3/users/f6f2035f95ef4cb39fc1f6a41d314bad => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:32.939483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:32.941769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:32.979701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083104-77e4-40c8-a24e-21f6d2fe8aeb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.139766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.140866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.141326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.141767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.144391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.148845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf4bd-975a-48c0-a068-df6f49d19213 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.158830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.159669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.160977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.161450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.162071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.162698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.164252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.174700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.179506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1024/2037] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:33.194230 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1014/2038] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:33.202109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:33.223397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eace8-8525-4287-b2b5-163a93956dd3 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.242256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.245717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.245717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.245717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] PATH_INFO: `/v3/projects/6a4216eb41d84bf0a20bafc78ceac242/users/f1ba2d92568044eaa24a8ea2a854ecc8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.287941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4216eb41d84bf0a20bafc78ceac242, user_id=f1ba2d92568044eaa24a8ea2a854ecc8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.291493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.321053 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1025/2039] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:33 2022] PUT /identity/v3/projects/6a4216eb41d84bf0a20bafc78ceac242/users/f1ba2d92568044eaa24a8ea2a854ecc8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:33.328134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:33.374173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca5f4-0af1-4847-b03d-72baeefd3040 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.421119 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:33.469766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.470817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.471067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.471232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.472078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.473906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.491312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1015/2040] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:33.492682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:33.501198 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:33.529075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b10a-368f-436f-b395-97ca10c7a730 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.545638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa6301-a49f-4813-aec9-79fc9268895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.546669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa6301-a49f-4813-aec9-79fc9268895b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.547059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa6301-a49f-4813-aec9-79fc9268895b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.547577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa6301-a49f-4813-aec9-79fc9268895b admin admin] PATH_INFO: `/v3/projects/6a4216eb41d84bf0a20bafc78ceac242/users/f1ba2d92568044eaa24a8ea2a854ecc8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.555754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:33.556643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.561561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa6301-a49f-4813-aec9-79fc9268895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4216eb41d84bf0a20bafc78ceac242, user_id=f1ba2d92568044eaa24a8ea2a854ecc8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.565768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa6301-a49f-4813-aec9-79fc9268895b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.598117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a501b-14e3-4071-b6fc-97827f246083 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:33.621549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1026/2041] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:33 2022] PUT /identity/v3/projects/6a4216eb41d84bf0a20bafc78ceac242/users/f1ba2d92568044eaa24a8ea2a854ecc8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:33.632961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663c36f-8d62-4edd-ad9d-3716641612dc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.633271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663c36f-8d62-4edd-ad9d-3716641612dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.635015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663c36f-8d62-4edd-ad9d-3716641612dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.697643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4663c36f-8d62-4edd-ad9d-3716641612dc None None] MFA Rules not processed for user `f1ba2d92568044eaa24a8ea2a854ecc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:33.699000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4663c36f-8d62-4edd-ad9d-3716641612dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:33.725205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:33.726404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.727170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.727797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] PATH_INFO: `/v3/projects/4f02abe1a515468781292d1fb4104c04` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:33.730093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f02abe1a515468781292d1fb4104c04)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:33.733878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:33.862863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f02abe1a515468781292d1fb4104c04', 'request_id': 'req-a74d9669-99e9-4cc4-b7cd-10ae54330b75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:33.867249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1027/2042] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:33.883467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f02abe1a515468781292d1fb4104c04', 'request_id': 'req-a74d9669-99e9-4cc4-b7cd-10ae54330b75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:33.908071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f02abe1a515468781292d1fb4104c04', 'request_id': 'req-a74d9669-99e9-4cc4-b7cd-10ae54330b75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:33.940943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] The token cache is being invalidate because project 4f02abe1a515468781292d1fb4104c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:33.941473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:33.943818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:33.947185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1016/2043] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:33 2022] DELETE /identity/v3/projects/4f02abe1a515468781292d1fb4104c04 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:33.954882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98aad-8e24-4259-b5b6-3683f8f7ff8a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:33.955099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98aad-8e24-4259-b5b6-3683f8f7ff8a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:33.955484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98aad-8e24-4259-b5b6-3683f8f7ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.000971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-61c98aad-8e24-4259-b5b6-3683f8f7ff8a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:34.002588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-61c98aad-8e24-4259-b5b6-3683f8f7ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:34.029434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.032035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:34.143241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1028/2044] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:34.144749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.145188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.145453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.161515 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:34.172790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:34.176014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:34.195528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1029/2045] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:34.197588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.212104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d9669-99e9-4cc4-b7cd-10ae54330b75 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.215506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6b4e7-0e6c-4931-a31b-69ef6ce45495 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.223852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.224987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.225443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.225893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.226205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.227224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:34.227382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.227750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.229295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.229856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.230827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.235277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:34.263847 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1030/2046] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:46:34.269388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.294335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b11a7-037d-4200-a441-cfea0718070f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.302229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.303554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.305519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.306432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.308054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.312552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.385706 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1031/2047] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:34 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:34.391192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.425178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.427992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d077831-e436-4dfc-a03a-81cec3ae2dd5 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.443918 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:34.449840 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1017/2048] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:34.486987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485e6a-c735-4671-a7b8-800f85c61c05 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.487515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485e6a-c735-4671-a7b8-800f85c61c05 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.487966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485e6a-c735-4671-a7b8-800f85c61c05 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.491920 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1018/2049] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:34.505663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485e6a-c735-4671-a7b8-800f85c61c05 None None] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:34.536558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c7150-b72b-4e9d-9631-e6f79ee3c1a3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.542389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.543167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.543484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.543821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.544972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.547197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.605117 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1032/2050] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:34 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:34.610252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.631814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8dd0-74e2-49f0-bb60-12f2ed5ce805 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.645702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.647857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.648573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.649116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.650385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.652509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.671680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1033/2051] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:34.672988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485e6a-c735-4671-a7b8-800f85c61c05 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.677208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.699022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980f07-4ec0-4c32-bcf7-f7044fe2a1a8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.708135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.709320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.709839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.710341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.711448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.714846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.741129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1034/2052] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:34.748881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:34.769306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b74dbc-45d5-4114-a833-587bb50a028c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.784786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce2f1-33c2-462f-82b7-91d69e0621c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.791572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce2f1-33c2-462f-82b7-91d69e0621c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.791912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce2f1-33c2-462f-82b7-91d69e0621c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.792346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce2f1-33c2-462f-82b7-91d69e0621c7 admin admin] PATH_INFO: `/v3/projects/bc5d9e6092e640d6b258e5d0e172870d/users/a72b6a0b89a54de4a3c2835f462b7069/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.802408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485e6a-c735-4671-a7b8-800f85c61c05 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:34.810459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5fa5f-dddd-4aba-8a97-4b874e49ac23 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:34.811556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5fa5f-dddd-4aba-8a97-4b874e49ac23 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.811906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5fa5f-dddd-4aba-8a97-4b874e49ac23 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.812196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5fa5f-dddd-4aba-8a97-4b874e49ac23 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.813646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5fa5f-dddd-4aba-8a97-4b874e49ac23 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.816040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5fa5f-dddd-4aba-8a97-4b874e49ac23 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.818095 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1019/2053] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:34 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:46:34.835377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce2f1-33c2-462f-82b7-91d69e0621c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5d9e6092e640d6b258e5d0e172870d, user_id=a72b6a0b89a54de4a3c2835f462b7069, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:34.838307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce2f1-33c2-462f-82b7-91d69e0621c7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:34.870362 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1035/2054] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:34 2022] PUT /identity/v3/projects/bc5d9e6092e640d6b258e5d0e172870d/users/a72b6a0b89a54de4a3c2835f462b7069/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:34.878426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.879589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.879589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.929293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac270-19a8-4371-8a1e-4dc756b2b464 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:34.929819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac270-19a8-4371-8a1e-4dc756b2b464 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:34.930306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac270-19a8-4371-8a1e-4dc756b2b464 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:34.942973 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1036/2055] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:34 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:34.944208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac270-19a8-4371-8a1e-4dc756b2b464 None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:34.964228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:34.966900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:35.010042 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:35.119797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1020/2056] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:35.141425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:35.144147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:35.173601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac270-19a8-4371-8a1e-4dc756b2b464 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:35.328081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e92b-f7d3-40c1-84d4-64d125f7d181 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:35.334543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac270-19a8-4371-8a1e-4dc756b2b464 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:35.340961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1799d-1983-44aa-b0b7-ccd5f11090c9 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:35.341213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:35.341994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:35.342439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:35.342631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1799d-1983-44aa-b0b7-ccd5f11090c9 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:35.342949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:35.343373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1799d-1983-44aa-b0b7-ccd5f11090c9 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:35.343916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1799d-1983-44aa-b0b7-ccd5f11090c9 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:35.345803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1799d-1983-44aa-b0b7-ccd5f11090c9 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:35.348673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1799d-1983-44aa-b0b7-ccd5f11090c9 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:35.351818 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1037/2057] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:34 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:46:35.360732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:35.361455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:35.374616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1021/2058] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:35.529118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea115c2-9d53-435c-b0ec-4c8f0e0b1693 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:35.529673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea115c2-9d53-435c-b0ec-4c8f0e0b1693 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:35.530143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea115c2-9d53-435c-b0ec-4c8f0e0b1693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:35.560268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fea115c2-9d53-435c-b0ec-4c8f0e0b1693 None None] MFA Rules not processed for user `e9e3b8a329784debba22a3b810135b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:35.562476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fea115c2-9d53-435c-b0ec-4c8f0e0b1693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:35.571710 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:35.665088 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1038/2059] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:35.949659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:35.969025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275e1d-9339-473c-b76b-c22cf1d1d5e9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:35.976446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:35.977393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:35.977914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:35.978875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:35.982682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:36.002151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:36.005210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:36.023256 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1022/2060] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:37.126467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0ca2a-8ad1-4aa1-bf58-d5919462e1aa None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.127080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0ca2a-8ad1-4aa1-bf58-d5919462e1aa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.127515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0ca2a-8ad1-4aa1-bf58-d5919462e1aa None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.130965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1039/2061] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:37.141857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:37.160225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:37.178414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be018e-b508-4d50-b629-6c9cba671f13 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:37.186108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:37.187492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.188024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.188534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.190372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:37.193133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:37.207831 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1023/2062] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:37 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:37.641377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa838b-b42e-41d8-81ad-1b6643abcb21 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.641893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa838b-b42e-41d8-81ad-1b6643abcb21 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.642121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa838b-b42e-41d8-81ad-1b6643abcb21 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.644407 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1040/2063] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:37.650630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:37.666841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:37.693963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d147f01-2284-450c-8bd6-13d7f62e7c6d tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:37.699703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:37.702122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.702429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.702750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.704149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:37.706364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:37.725196 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1024/2064] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:37 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:37.907753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30046-8d42-46c3-88a1-c25c8343500d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.908487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30046-8d42-46c3-88a1-c25c8343500d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.909628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30046-8d42-46c3-88a1-c25c8343500d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.912683 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1041/2065] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:37.919366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:37.920998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:37.949654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:37.969390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a3c58-e01f-4d3b-a8d7-461e38d67321 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:37.976300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:37.977312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.980657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.981183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.983071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:37.986033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:37.988396 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1025/2066] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:37 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:38.132907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a40692-1d2f-4975-9fbf-f77452316255 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:38.132907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a40692-1d2f-4975-9fbf-f77452316255 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:38.133769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a40692-1d2f-4975-9fbf-f77452316255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:38.170587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b5a40692-1d2f-4975-9fbf-f77452316255 None None] MFA Rules not processed for user `e9e3b8a329784debba22a3b810135b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:38.170587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b5a40692-1d2f-4975-9fbf-f77452316255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:38.197397 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1042/2067] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:39.287938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:39.291940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:39.310474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ada05-0f64-47ca-ba6e-6ec2117e0efc None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:39.311345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ada05-0f64-47ca-ba6e-6ec2117e0efc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:39.311345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ada05-0f64-47ca-ba6e-6ec2117e0efc None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:39.314020 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1043/2068] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:39.324418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ada05-0f64-47ca-ba6e-6ec2117e0efc None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:39.332042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb6ee-bc5b-4323-8ddc-54126158b420 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:39.344001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:39.344593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ada05-0f64-47ca-ba6e-6ec2117e0efc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:39.350698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:39.351392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:39.351896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] PATH_INFO: `/v3/users/8c23b07915b44a599b24f69a34a46076` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:39.354060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c23b07915b44a599b24f69a34a46076)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:39.357854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:39.378674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ada05-0f64-47ca-ba6e-6ec2117e0efc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:39.391663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db7e6-f669-4a8f-a037-7eca6f8a9786 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:39.393762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db7e6-f669-4a8f-a037-7eca6f8a9786 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:39.394636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db7e6-f669-4a8f-a037-7eca6f8a9786 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:39.395408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db7e6-f669-4a8f-a037-7eca6f8a9786 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:39.398342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db7e6-f669-4a8f-a037-7eca6f8a9786 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:39.404611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db7e6-f669-4a8f-a037-7eca6f8a9786 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:39.428353 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1044/2069] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:39 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:46:39.466467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c23b07915b44a599b24f69a34a46076'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:39.490939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c23b07915b44a599b24f69a34a46076'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:39.506871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c23b07915b44a599b24f69a34a46076'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:39.519034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c23b07915b44a599b24f69a34a46076'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:39.520176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c23b07915b44a599b24f69a34a46076'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:39.523333 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:39.540762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1026/2070] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:39 2022] DELETE /identity/v3/users/8c23b07915b44a599b24f69a34a46076 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:39.541237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e26ea-f298-4c87-a155-27306f427a46 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:39.541665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e26ea-f298-4c87-a155-27306f427a46 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:39.542185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e26ea-f298-4c87-a155-27306f427a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:39.588782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-034e26ea-f298-4c87-a155-27306f427a46 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:39.592299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-034e26ea-f298-4c87-a155-27306f427a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:39.701972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1045/2071] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:39.767716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:39.770130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:39.911946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f77f-5529-46b5-8a43-affecd75c8c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:39.919969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:39.921406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:39.922011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:39.922622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:39.954796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:39.960140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:40.004561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1027/2072] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:40.387432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9f76c-a8e7-4277-823b-d76809fb520a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:40.388854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9f76c-a8e7-4277-823b-d76809fb520a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:40.389297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9f76c-a8e7-4277-823b-d76809fb520a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:40.392151 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1046/2073] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:40.398269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:40.400652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:40.656719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:40.664372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:40.941916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a530-ef94-4b88-86de-683655285a6e service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:40.949933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a1d30-47cc-41cd-84b0-53d78912149a tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:40.951765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1d30-47cc-41cd-84b0-53d78912149a tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:40.952102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1d30-47cc-41cd-84b0-53d78912149a tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:40.952393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1d30-47cc-41cd-84b0-53d78912149a tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:40.954101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a1d30-47cc-41cd-84b0-53d78912149a tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:40.957389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a1d30-47cc-41cd-84b0-53d78912149a tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:40.960063 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1028/2074] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:40 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:41.083613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9f76c-a8e7-4277-823b-d76809fb520a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:41.115798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9f76c-a8e7-4277-823b-d76809fb520a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:41.137349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:41.139309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.139832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.140315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.145034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.250676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:41.253812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716eaad-80ed-41cb-b74e-6c5755aa3f7d service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:41.270617 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1047/2075] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:41.312225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.312596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.312811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.337603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] MFA Rules not processed for user `e19446b18b4548fba728e2f38cadc689`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:41.339265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.415530 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:41.458592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73aa0-3bf3-4fec-9eb5-a44b9d2ee8c2 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.459379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73aa0-3bf3-4fec-9eb5-a44b9d2ee8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.459379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73aa0-3bf3-4fec-9eb5-a44b9d2ee8c2 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.461936 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1048/2076] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:46:41.470097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73aa0-3bf3-4fec-9eb5-a44b9d2ee8c2 None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:41.473855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1029/2077] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:41.499872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73aa0-3bf3-4fec-9eb5-a44b9d2ee8c2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:41.532521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73aa0-3bf3-4fec-9eb5-a44b9d2ee8c2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:41.536814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5fad-c893-4b54-bcb3-75a3840debb1 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:41.561166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5fad-c893-4b54-bcb3-75a3840debb1 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.562486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5fad-c893-4b54-bcb3-75a3840debb1 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.562931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5fad-c893-4b54-bcb3-75a3840debb1 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.567129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5fad-c893-4b54-bcb3-75a3840debb1 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:41.570824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5fad-c893-4b54-bcb3-75a3840debb1 tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:41.574116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1049/2078] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:41 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:41.704496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:41.714632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.779575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.779881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.780310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.797689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea1b40-bb0a-4e43-8f89-f14e308cae18 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:41.808434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:41.812843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:41.813361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:41.814159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] PATH_INFO: `/v3/projects/0146c1a6200a489bba0678cafd811142` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:41.816089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] MFA Rules not processed for user `e9e3b8a329784debba22a3b810135b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:41.818159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0146c1a6200a489bba0678cafd811142)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:41.822030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:41.822705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:41.932942 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:41.962806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0146c1a6200a489bba0678cafd811142', 'request_id': 'req-982d5281-9507-4f9c-9c36-3e0b1c979b0e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:41.978238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0146c1a6200a489bba0678cafd811142', 'request_id': 'req-982d5281-9507-4f9c-9c36-3e0b1c979b0e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:41.999350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0146c1a6200a489bba0678cafd811142', 'request_id': 'req-982d5281-9507-4f9c-9c36-3e0b1c979b0e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.038871 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1050/2079] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:42.039118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] The token cache is being invalidate because project 0146c1a6200a489bba0678cafd811142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:42.039118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.040893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.049987 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1030/2080] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:41 2022] DELETE /identity/v3/projects/0146c1a6200a489bba0678cafd811142 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:42.050454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:42.071262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe644f0-6d2d-4c5d-b5b5-650f91c1355a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:42.271590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:42.272538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:42.272822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:42.273095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] PATH_INFO: `/v3/users/ff7a2d105dc74a1cbf856e334c47dabb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:42.275583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7a2d105dc74a1cbf856e334c47dabb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:42.277755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:42.412589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7a2d105dc74a1cbf856e334c47dabb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.414624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7a2d105dc74a1cbf856e334c47dabb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.456722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7a2d105dc74a1cbf856e334c47dabb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.459465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7a2d105dc74a1cbf856e334c47dabb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.496130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d993627-3d66-4e63-a31b-149201e9b23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7a2d105dc74a1cbf856e334c47dabb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:42.515196 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1051/2081] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:42 2022] DELETE /identity/v3/users/ff7a2d105dc74a1cbf856e334c47dabb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:43.347992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:43.349786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:43.389539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5281-9507-4f9c-9c36-3e0b1c979b0e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:43.566176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:43.567553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:43.568107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:43.568542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] PATH_INFO: `/v3/users/8f8e48049c4449ccb6ddb744250e7e9d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:43.571263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8e48049c4449ccb6ddb744250e7e9d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:43.573585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:43.646486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:43.647567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:43.648001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:43.649634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1052/2082] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:46:43.660673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:46:43.663081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:43.798447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8e48049c4449ccb6ddb744250e7e9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:43.824728 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:43.846544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8e48049c4449ccb6ddb744250e7e9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:43.853150 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:43.868830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8e48049c4449ccb6ddb744250e7e9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:43.882138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:43.885749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8e48049c4449ccb6ddb744250e7e9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:43.886409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:43.886613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8e48049c4449ccb6ddb744250e7e9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:43.898488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1031/2083] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:43 2022] DELETE /identity/v3/users/8f8e48049c4449ccb6ddb744250e7e9d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:43.898488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:43.901252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.082270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea122-42c5-4b04-8d14-ce0f11951042 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:44.088762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:44.089773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.090080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.090380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] PATH_INFO: `/v3/projects/9f8d99fad9ba4fa78e7b1f2917c7fc64` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.093897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8d99fad9ba4fa78e7b1f2917c7fc64)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:44.096758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56555a-c6fa-4c25-830e-94f1c9d40917 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:44.097546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:44.250738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8d99fad9ba4fa78e7b1f2917c7fc64', 'request_id': 'req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.278716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8d99fad9ba4fa78e7b1f2917c7fc64', 'request_id': 'req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.307235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8d99fad9ba4fa78e7b1f2917c7fc64', 'request_id': 'req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.364585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] The token cache is being invalidate because project 9f8d99fad9ba4fa78e7b1f2917c7fc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:44.366473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.371224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-66cf5f2e-c8d9-4dd9-933f-f24a4c918a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.374447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1032/2084] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:43 2022] DELETE /identity/v3/projects/9f8d99fad9ba4fa78e7b1f2917c7fc64 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:44.381494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb368a-61ca-4dfc-ad76-995ab961293c tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ba2d92568044eaa24a8ea2a854ecc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4216eb41d84bf0a20bafc78ceac242', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:44.381959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.382536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.383119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.390192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb368a-61ca-4dfc-ad76-995ab961293c tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.391784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb368a-61ca-4dfc-ad76-995ab961293c tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.392348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb368a-61ca-4dfc-ad76-995ab961293c tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.394258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb368a-61ca-4dfc-ad76-995ab961293c tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:44.399531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb368a-61ca-4dfc-ad76-995ab961293c tempest-QuotasAdminNegativeTest-762299260 tempest-QuotasAdminNegativeTest-762299260-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:44.402780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1053/2085] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:46:43 2022] GET /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 383 bytes in 742 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:46:44.405553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26791-7d63-4c2f-bb89-26e2b47695a6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.406296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26791-7d63-4c2f-bb89-26e2b47695a6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.407262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26791-7d63-4c2f-bb89-26e2b47695a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.437021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-18f26791-7d63-4c2f-bb89-26e2b47695a6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:44.439338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18f26791-7d63-4c2f-bb89-26e2b47695a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.463722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:44.465299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.518920 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1054/2086] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:44.534254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.534895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.535375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.605112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:44.607238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1033/2087] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:44.608359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.620286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:44.622715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.661160 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:44.665611 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1055/2088] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:44.670780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:44.675839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:44.734690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839467-6224-48f3-a0f3-0568700a845e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:44.745616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:44.748306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.749144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.749786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] PATH_INFO: `/v3/users/e9e3b8a329784debba22a3b810135b6b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.752068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72f19c-0fb2-494a-a40a-58e3483e6e72 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:44.759822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e3b8a329784debba22a3b810135b6b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:44.773427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:44.779200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:44.779503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:44.779792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:44.786649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:44.842898 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:44.883675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:44.888335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:44.890983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e3b8a329784debba22a3b810135b6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.893711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e3b8a329784debba22a3b810135b6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.918973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e3b8a329784debba22a3b810135b6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.919880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e3b8a329784debba22a3b810135b6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.932465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5916c8-b768-4731-bc16-475f2d095e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e3b8a329784debba22a3b810135b6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:44.952947 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1034/2089] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:44.961949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.008967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86cc9-862f-4dd4-ade9-54af7fca9e09 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.021783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.022469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.025720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.026046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.026839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:45.027004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1056/2090] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:44 2022] DELETE /identity/v3/users/e9e3b8a329784debba22a3b810135b6b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:45.027181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.034039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.035688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.036227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.037230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.057940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1035/2091] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:45.063947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.079105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:45.102808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:45.106589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:45.119659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa0b49-9a63-4e82-b76c-e98405c7e105 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.314675 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1057/2092] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:46:45.375482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.377700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:45.381295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.382009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.382701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.386061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.389503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.395399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.481815 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1036/2093] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:45 2022] POST /identity/v3/projects => generated 387 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:45.484845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.628954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67d94d-689d-4214-950e-a7ba1e5f3bba None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.715494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69195f-2e3d-48d2-808d-7b3c7130ebc7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.738553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.739213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.739508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.741767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.741984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.750692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.751569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.752564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.752775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.752936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.769121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.771101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.790217 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1058/2094] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:45.791564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.793159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:45.799711 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1037/2095] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:45 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:45.804615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.809142 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:45.822609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26eff5-0bde-4001-87b9-54659bd897fb service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.830041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.831375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.831666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.831955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] PATH_INFO: `/v3/users/ecd5513ec3344d4fa1da80247a88cf38` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.833440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd5513ec3344d4fa1da80247a88cf38)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.836160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.838238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cecf4-1369-4413-acd7-c6afe89e9a30 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.853086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.853984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.854410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.854913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.856681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.863451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.912883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1038/2096] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:45.914649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:45.959350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d10dc9-fcbd-41d8-bce3-102f368d16c6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:45.964516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd5513ec3344d4fa1da80247a88cf38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:45.965251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd5513ec3344d4fa1da80247a88cf38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:45.990648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:45.991960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:45.992850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:45.993394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:45.994754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:45.998561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:45.998851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd5513ec3344d4fa1da80247a88cf38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:46.001070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd5513ec3344d4fa1da80247a88cf38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:46.013274 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:46.016672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-16515168-0721-4fb4-81fb-d51fd800ed6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd5513ec3344d4fa1da80247a88cf38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:46.070545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1059/2098] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:45 2022] DELETE /identity/v3/users/ecd5513ec3344d4fa1da80247a88cf38 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:46.070816 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1039/2098] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:46.075621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71430a93-b419-4be0-a2cd-3d3eb7e07455 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.076268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71430a93-b419-4be0-a2cd-3d3eb7e07455 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.076762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71430a93-b419-4be0-a2cd-3d3eb7e07455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.078946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.086353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.149589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea26c81-1273-4ce4-a755-7095f5da7cd0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:46.161677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-71430a93-b419-4be0-a2cd-3d3eb7e07455 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:46.167383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-71430a93-b419-4be0-a2cd-3d3eb7e07455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.299513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:46.302185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.302742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.303035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] PATH_INFO: `/v3/projects/dcfe8877823c4489a3a51cbe76e3949d/users/d5c2e4a58067426e8677c4298f423155/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.333340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfe8877823c4489a3a51cbe76e3949d, user_id=d5c2e4a58067426e8677c4298f423155, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:46.343896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:46.354328 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1060/2099] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:46.370193 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1040/2100] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:46 2022] PUT /identity/v3/projects/dcfe8877823c4489a3a51cbe76e3949d/users/d5c2e4a58067426e8677c4298f423155/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:46.381872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.382169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.382446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.418279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.421053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.442978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] MFA Rules not processed for user `d5c2e4a58067426e8677c4298f423155`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:46.444260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.589625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972679-e88d-4500-839f-6b4dc9083348 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:46.612268 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1061/2101] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:46.614481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.615866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:46.616595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.616951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.617965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.625130 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:46.772689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:46.777230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:46.779487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367714d-2417-4aab-aeb7-8db18571c812 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:46.799763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:46.800924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.801544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.801987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.802930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:46.809636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:46.827176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1041/2102] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:46.828641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.830664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.849134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47240-bf00-42a6-9794-92b245234b67 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:46.855904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:46.857810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.858343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.858865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] PATH_INFO: `/v3/projects/895c69e056de462e9a3f0ff0a6c15527` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.861896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895c69e056de462e9a3f0ff0a6c15527)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:46.865955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:46.874372 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1062/2103] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:46 2022] POST /identity/v3/projects => generated 389 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:46.875655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.953763 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:47.003180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895c69e056de462e9a3f0ff0a6c15527', 'request_id': 'req-0e766abf-73af-47cc-b3d3-b5adca942091'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.016404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895c69e056de462e9a3f0ff0a6c15527', 'request_id': 'req-0e766abf-73af-47cc-b3d3-b5adca942091'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.032663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895c69e056de462e9a3f0ff0a6c15527', 'request_id': 'req-0e766abf-73af-47cc-b3d3-b5adca942091'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.050295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ce02-c9db-418e-89f3-f105392d0b79 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.061370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] The token cache is being invalidate because project 895c69e056de462e9a3f0ff0a6c15527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:47.062855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.066716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.067444 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1042/2104] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:46 2022] DELETE /identity/v3/projects/895c69e056de462e9a3f0ff0a6c15527 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:47.073770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:47.080128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:47.213447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.214364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.214895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.215481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.216433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.220257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.265585 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1063/2105] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:46 2022] POST /identity/v3/users => generated 301 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:47.276395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:47.282611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:47.307907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e766abf-73af-47cc-b3d3-b5adca942091 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.318736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.320552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea03cf-1a79-4a72-9cc9-ce32ef19aa69 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.320936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.321424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.321947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] PATH_INFO: `/v3/users/f507f38caedc422196a139dadc6f8856` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.324207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f507f38caedc422196a139dadc6f8856)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.327889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.335241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.337413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.341310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.341762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.342992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.354884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.414307 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1064/2106] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:47.420373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:47.453247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f507f38caedc422196a139dadc6f8856'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.455452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249cfa1-c4c5-43cc-9202-33149468130a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.469566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.470726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.471133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.471855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] PATH_INFO: `/v3/projects/68dfb57455174ae59b990b75423c4b03/users/d9a1fd0da0774097a4dbce9ffb1e40b8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.510678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f507f38caedc422196a139dadc6f8856'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.519580 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:47.533661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dfb57455174ae59b990b75423c4b03, user_id=d9a1fd0da0774097a4dbce9ffb1e40b8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.536809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.543050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f507f38caedc422196a139dadc6f8856'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.559564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f507f38caedc422196a139dadc6f8856'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.561445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f507f38caedc422196a139dadc6f8856'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:47.564047 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1065/2107] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:47 2022] PUT /identity/v3/projects/68dfb57455174ae59b990b75423c4b03/users/d9a1fd0da0774097a4dbce9ffb1e40b8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:47.568136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:47.570194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:47.601172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1043/2108] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:47 2022] DELETE /identity/v3/users/f507f38caedc422196a139dadc6f8856 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:47.602226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:47.604550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:47.663804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31aea1-b9da-4f30-b9c5-eac5800a8e45 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.724783 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:47.808587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d78f-8d18-4de5-9362-88f6812f5a95 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.833209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.834050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.834339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.837048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.838021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.842028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.849138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.850290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.850626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.850908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] PATH_INFO: `/v3/projects/dd5c02a54fd641168e97571035e16065` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.856243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5c02a54fd641168e97571035e16065)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.868160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:47.890716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1044/2109] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:47.892508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:47.930960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a626f-ba28-4e21-be9a-1956dec2bf58 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:47.947900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:47.948982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:47.949210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:47.949481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] PATH_INFO: `/v3/projects/68dfb57455174ae59b990b75423c4b03/users/d9a1fd0da0774097a4dbce9ffb1e40b8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:47.958241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dfb57455174ae59b990b75423c4b03, user_id=d9a1fd0da0774097a4dbce9ffb1e40b8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:47.960751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:48.018649 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1045/2110] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:47 2022] PUT /identity/v3/projects/68dfb57455174ae59b990b75423c4b03/users/d9a1fd0da0774097a4dbce9ffb1e40b8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:48.018649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:48.018933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5c02a54fd641168e97571035e16065', 'request_id': 'req-1bb6351c-89f5-4e40-bf98-3a4687b70c65'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.021968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.034085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5c02a54fd641168e97571035e16065', 'request_id': 'req-1bb6351c-89f5-4e40-bf98-3a4687b70c65'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.070322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5c02a54fd641168e97571035e16065', 'request_id': 'req-1bb6351c-89f5-4e40-bf98-3a4687b70c65'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.103563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] The token cache is being invalidate because project dd5c02a54fd641168e97571035e16065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:48.103889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.106945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1bb6351c-89f5-4e40-bf98-3a4687b70c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.108842 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1066/2111] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:47 2022] DELETE /identity/v3/projects/dd5c02a54fd641168e97571035e16065 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:48.110566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:48.110914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:48.111219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:48.181282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] MFA Rules not processed for user `d9a1fd0da0774097a4dbce9ffb1e40b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:48.188335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.228033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f303229-3f02-4fd7-9242-d57a99e09ae1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:48.243947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:48.245016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:48.247430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:48.247782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] PATH_INFO: `/v3/projects/2dcc68d8d7564969b5fca32eab506e04` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:48.250248 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:48.251748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcc68d8d7564969b5fca32eab506e04)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:48.259731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:48.402576 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1067/2112] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:48.403272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:48.405251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcc68d8d7564969b5fca32eab506e04', 'request_id': 'req-b924c941-0923-4cbd-9a67-1298d8768c38'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.410069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.421617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcc68d8d7564969b5fca32eab506e04', 'request_id': 'req-b924c941-0923-4cbd-9a67-1298d8768c38'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.438961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcc68d8d7564969b5fca32eab506e04', 'request_id': 'req-b924c941-0923-4cbd-9a67-1298d8768c38'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.450785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74099aa2-f710-4525-93d7-97e3ffbf18e9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:48.465199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] The token cache is being invalidate because project 2dcc68d8d7564969b5fca32eab506e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:48.465841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.466377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.477004 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1046/2113] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:48 2022] DELETE /identity/v3/projects/2dcc68d8d7564969b5fca32eab506e04 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:48.478980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:48.482384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.659531 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:48.688806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:48.692751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:48.693301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:48.693717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] PATH_INFO: `/v3/users/f1ba2d92568044eaa24a8ea2a854ecc8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:48.699020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ba2d92568044eaa24a8ea2a854ecc8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:48.708682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:48.719814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924c941-0923-4cbd-9a67-1298d8768c38 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:48.741517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:48.742202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:48.742535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:48.742813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:48.748908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.855236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ba2d92568044eaa24a8ea2a854ecc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.856761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ba2d92568044eaa24a8ea2a854ecc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.858677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:48.861029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:48.877009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1047/2114] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:48.879562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ba2d92568044eaa24a8ea2a854ecc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.880702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ba2d92568044eaa24a8ea2a854ecc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.890030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:48.893011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4753dc78-c7b4-4629-9e4e-3fb887eb5240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ba2d92568044eaa24a8ea2a854ecc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:48.894138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.936036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd078bad-abeb-429b-90ca-df0335aadca4 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:48.945594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:48.946810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:48.946810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:48.947094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] PATH_INFO: `/v3/users/48fd2ab7b86b4864b4afd829c3c734bf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:48.950594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fd2ab7b86b4864b4afd829c3c734bf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:48.952835 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1068/2115] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:48 2022] DELETE /identity/v3/users/f1ba2d92568044eaa24a8ea2a854ecc8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:48.957471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:48.958928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:48.960020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:48.960899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.040845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] MFA Rules not processed for user `a72b6a0b89a54de4a3c2835f462b7069`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:49.046108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.075656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fd2ab7b86b4864b4afd829c3c734bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.124357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fd2ab7b86b4864b4afd829c3c734bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.149425 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:49.160506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fd2ab7b86b4864b4afd829c3c734bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.181624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fd2ab7b86b4864b4afd829c3c734bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.197571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fd2ab7b86b4864b4afd829c3c734bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.231693 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1048/2116] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:48 2022] DELETE /identity/v3/users/48fd2ab7b86b4864b4afd829c3c734bf => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:49.232399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:49.241465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.261241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1069/2117] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:49.263475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:49.279587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.389947 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:49.414276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918184c-f385-4c4b-84a6-cabc4311fa43 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:49.422359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:49.423731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.423731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.423944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] PATH_INFO: `/v3/projects/f31c9e61898e4b438a6ff56feb4f600d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.425490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31c9e61898e4b438a6ff56feb4f600d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:49.427797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:49.516899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26fab-71ac-4dc7-a609-9254e25099f5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:49.520249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31c9e61898e4b438a6ff56feb4f600d', 'request_id': 'req-9f4e1f9d-3164-43fb-954e-25a493600f00'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.536469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31c9e61898e4b438a6ff56feb4f600d', 'request_id': 'req-9f4e1f9d-3164-43fb-954e-25a493600f00'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.555046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31c9e61898e4b438a6ff56feb4f600d', 'request_id': 'req-9f4e1f9d-3164-43fb-954e-25a493600f00'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.586807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] The token cache is being invalidate because project f31c9e61898e4b438a6ff56feb4f600d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:49.587147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.587800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f4e1f9d-3164-43fb-954e-25a493600f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:49.593291 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1049/2118] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:49 2022] DELETE /identity/v3/projects/f31c9e61898e4b438a6ff56feb4f600d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:49.595275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12b13d-ea5d-40d5-a1cc-d1b4dff2a22d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.595722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12b13d-ea5d-40d5-a1cc-d1b4dff2a22d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.596017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12b13d-ea5d-40d5-a1cc-d1b4dff2a22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.635622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2d12b13d-ea5d-40d5-a1cc-d1b4dff2a22d None None] MFA Rules not processed for user `a72b6a0b89a54de4a3c2835f462b7069`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:49.637568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2d12b13d-ea5d-40d5-a1cc-d1b4dff2a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.656397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:49.657476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.657476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.657703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.671134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.859197 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1050/2119] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:49.868692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ea818-bd66-49ee-82c3-778b1662d308 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.869688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ea818-bd66-49ee-82c3-778b1662d308 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.869967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ea818-bd66-49ee-82c3-778b1662d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.928860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6d9ea818-bd66-49ee-82c3-778b1662d308 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:49.935479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6d9ea818-bd66-49ee-82c3-778b1662d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.964975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:49.969131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:49.974714 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:49.984519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1070/2120] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:49.985885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:49.987591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.008021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cfb88-b696-450a-8d57-4f70a8d881ee service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:50.016948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:50.020399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.020709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.021115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.025315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.038930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:50.040873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:50.104003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1071/2121] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:50.106606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:50.114876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.217130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1051/2122] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:50.221953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.222406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.222801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.329525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:50.330977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.359529 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1052/2123] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:50.361888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:50.363355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.381824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7faa6-8c95-495f-b9ba-21df65d2798d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:50.392587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:50.396022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fe9f9-4fc3-4bdc-bfdc-19547608a075 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:50.396729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.397511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.397700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] PATH_INFO: `/v3/projects/5cd74fb565f84766937bfc0313ef721c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.400146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd74fb565f84766937bfc0313ef721c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:50.402198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:50.402539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:50.406309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.408914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.409311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] PATH_INFO: `/v3/projects/6a4216eb41d84bf0a20bafc78ceac242` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.411228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4216eb41d84bf0a20bafc78ceac242)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:50.414239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:50.456161 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:50.522316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4216eb41d84bf0a20bafc78ceac242', 'request_id': 'req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.536823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd74fb565f84766937bfc0313ef721c', 'request_id': 'req-73a3f6dc-bd8c-4aef-81ec-1987166ef522'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.547034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4216eb41d84bf0a20bafc78ceac242', 'request_id': 'req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.555895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd74fb565f84766937bfc0313ef721c', 'request_id': 'req-73a3f6dc-bd8c-4aef-81ec-1987166ef522'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.560128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4216eb41d84bf0a20bafc78ceac242', 'request_id': 'req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.590775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd74fb565f84766937bfc0313ef721c', 'request_id': 'req-73a3f6dc-bd8c-4aef-81ec-1987166ef522'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.618116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] The token cache is being invalidate because project 6a4216eb41d84bf0a20bafc78ceac242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:50.618603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.621390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.632201 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1072/2124] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:50 2022] DELETE /identity/v3/projects/6a4216eb41d84bf0a20bafc78ceac242 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:50.633928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:50.639477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.641339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] The token cache is being invalidate because project 5cd74fb565f84766937bfc0313ef721c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:50.641762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.643371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73a3f6dc-bd8c-4aef-81ec-1987166ef522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:50.648318 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1053/2125] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:50 2022] DELETE /identity/v3/projects/5cd74fb565f84766937bfc0313ef721c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:50.652837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ac7a5-1106-49cd-98f1-f893058a5938 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.654022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ac7a5-1106-49cd-98f1-f893058a5938 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.655888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ac7a5-1106-49cd-98f1-f893058a5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.729193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5b8ac7a5-1106-49cd-98f1-f893058a5938 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:50.733862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5b8ac7a5-1106-49cd-98f1-f893058a5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.837383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e883-6ac0-4e09-b2fb-3cce5a8e40bc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:50.871656 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:50.895777 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1054/2126] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:50.897160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.897454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.897737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.967291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:50.972233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:50.975238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:50.976243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:50.976589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:50.977013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:50.978088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:50.985636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:50.988296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99697204-02f8-4070-9904-aab2fb1e4e07 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.018999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1055/2127] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:51.020465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.025588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.040945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417a35-f24b-48f9-a72c-768f6e82ed69 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.041877 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1073/2128] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:51.049837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4518-cd49-42ea-aa88-cb38942d182e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.050323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4518-cd49-42ea-aa88-cb38942d182e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.050640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4518-cd49-42ea-aa88-cb38942d182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.072239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.073625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.073917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.074193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] PATH_INFO: `/v3/users/d5c2e4a58067426e8677c4298f423155` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.079001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c2e4a58067426e8677c4298f423155)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.081823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.111631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e3df4518-cd49-42ea-aa88-cb38942d182e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:51.113000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e3df4518-cd49-42ea-aa88-cb38942d182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.141076 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1074/2129] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:51.142672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.142965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.143250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.200919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:51.202484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.222918 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1075/2130] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:51.223933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.231924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.247391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c2e4a58067426e8677c4298f423155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:51.262482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51637f-da16-4a22-b377-38f9993125d9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.282706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.283434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.283747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.284118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.292754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.295405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.318705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c2e4a58067426e8677c4298f423155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:51.347039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c2e4a58067426e8677c4298f423155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:51.368087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c2e4a58067426e8677c4298f423155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:51.369011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c2e4a58067426e8677c4298f423155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:51.380901 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1076/2131] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:51.380901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.383542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.386726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1056/2132] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:51 2022] DELETE /identity/v3/users/d5c2e4a58067426e8677c4298f423155 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:51.387941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.391998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.499879 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:51.589713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ebfa3-1e3a-462f-ac88-89c91e7df8d4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.696642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3239d8-9848-4e0f-b629-b3a25db85a79 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.697271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.697970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.698256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.698562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.701625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:51.702330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.703145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.704101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.704485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.704742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.705024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.707524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.725388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1077/2133] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:51.725388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.728411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.774523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3256-50a1-48ba-bab7-0e2539638b91 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.780113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.780943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.781557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.781925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.782955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:51.783484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.785270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.806971 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1078/2134] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:51.807955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.811971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.827511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3596-91fd-4cc5-9ef1-20f0315de036 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.833644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240f8a4-46b0-46ae-a4a2-e8b266b86a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.834327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240f8a4-46b0-46ae-a4a2-e8b266b86a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.834690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240f8a4-46b0-46ae-a4a2-e8b266b86a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.837099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240f8a4-46b0-46ae-a4a2-e8b266b86a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.838007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240f8a4-46b0-46ae-a4a2-e8b266b86a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.840072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240f8a4-46b0-46ae-a4a2-e8b266b86a95 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.860668 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:51.862319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.868543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.880907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1079/2135] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/users => generated 292 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:51.882361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.882705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.882995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.897794 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1057/2136] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:51.898417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.906600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:51.907850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:51.915461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf495e-f2f6-4067-9b88-fb748d729289 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.918051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1080/2137] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:51.924278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:51.937928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3451bd-447f-45ad-8241-121dffc7afff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:51.938404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.939485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.940002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.940519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.941481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.944161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:51.945289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:51.945780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:51.946129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:51.947337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:51.949713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:51.949873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.006953 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1081/2138] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:52.008741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.017922 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1058/2139] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:51 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:52.019632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.024465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:52.173012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7637a-2422-4d02-a1f6-c376a47d22cd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.192712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7593-f92b-4d39-bc6e-03b69cba241e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.218107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.218863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.219374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.219658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.317924 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:52.363069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.363768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.364049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.364324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.367071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.368834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.391106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.392918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.400242 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1082/2140] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:52.400242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.415353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1059/2141] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:52.418086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.420754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee027-d3fe-405c-916d-4b608df1739e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.433879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5449-7212-4a88-a527-b485babc6362 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.436486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b6b7a-34b2-4f0a-95b0-7e6f264a8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.437530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6b7a-34b2-4f0a-95b0-7e6f264a8489 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.437890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6b7a-34b2-4f0a-95b0-7e6f264a8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.438851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6b7a-34b2-4f0a-95b0-7e6f264a8489 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.440188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6b7a-34b2-4f0a-95b0-7e6f264a8489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.443795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6b7a-34b2-4f0a-95b0-7e6f264a8489 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.454896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.462102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.463442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.468434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.469609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.472364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.488081 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1083/2142] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:52 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:52.491407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e116-e5b0-49db-958c-dd593521928c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.491790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e116-e5b0-49db-958c-dd593521928c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.492136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e116-e5b0-49db-958c-dd593521928c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.494023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1084/2143] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:46:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:46:52.494886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e116-e5b0-49db-958c-dd593521928c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.520670 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1060/2144] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:52 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:52.526082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.529783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e116-e5b0-49db-958c-dd593521928c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.539616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4875ea7-9329-49dc-918c-3fc22cc726ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.541922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875ea7-9329-49dc-918c-3fc22cc726ad admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.542923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875ea7-9329-49dc-918c-3fc22cc726ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.543457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875ea7-9329-49dc-918c-3fc22cc726ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.544939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4875ea7-9329-49dc-918c-3fc22cc726ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.546365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564173c-42c6-45b4-95cf-7ba093097bc8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.547328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4875ea7-9329-49dc-918c-3fc22cc726ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.561633 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1085/2145] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:52.563667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.564158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.564639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.567569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.568810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.568810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.569007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.575742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.578530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.604315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:52.605237 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1061/2146] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:52.606512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.607405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:52.619242 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1086/2147] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:46:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:52.621036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.634728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121786-e74d-48a8-bd3b-c19483d42787 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.642242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddbb9f-f37b-4c11-a09f-f6ebd76b9fd1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.646908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.647749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.650450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.650995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.651705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.653806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.654159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.654842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.655590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] PATH_INFO: `/v3/projects/280258fe4e194b7f8244c22356b8658e/users/db784ab6f91241ac89d92732196e7aae/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.662742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.679674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] RBAC: Authorizing `identity:create_grant(project_id=280258fe4e194b7f8244c22356b8658e, user_id=db784ab6f91241ac89d92732196e7aae, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.683670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.703572 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1062/2148] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:52.703572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.710207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1087/2149] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:52 2022] PUT /identity/v3/projects/280258fe4e194b7f8244c22356b8658e/users/db784ab6f91241ac89d92732196e7aae/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:52.711344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:52.743736 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:52.750235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1055d-c026-4a8f-b521-e0420e640d0f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.839528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c309-5204-4b36-9e30-021693a1156a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:52.846553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0418a-897e-4909-bd34-407db9b4b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.847528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0418a-897e-4909-bd34-407db9b4b418 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.847818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0418a-897e-4909-bd34-407db9b4b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.848100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0418a-897e-4909-bd34-407db9b4b418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.849068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0418a-897e-4909-bd34-407db9b4b418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.851194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0418a-897e-4909-bd34-407db9b4b418 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.883294 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1088/2150] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:52.883294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.883294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.883827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.884397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:52.885104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:52.887803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:52.888663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:52.901387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:52.905194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:52.926132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] MFA Rules not processed for user `db784ab6f91241ac89d92732196e7aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:52.929496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:52.931402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1063/2151] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:52.933340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.026216 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1089/2152] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:53.027776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.061141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea926a0-3ea1-4f1c-8492-8ae4a7205d5f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.078533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.079471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.079611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92afb9-7392-4aaf-9a2d-9dc15db82b4e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.082641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.082918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] PATH_INFO: `/v3/projects/02fef5a066a54d209555356044ab0d81/users/f4fb9a3eacf448578b8ba8a8cb7f33c0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.086438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.087694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.088087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.088513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.111803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.115060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.152990 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1064/2153] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:53.157913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fef5a066a54d209555356044ab0d81, user_id=f4fb9a3eacf448578b8ba8a8cb7f33c0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.164202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.167729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.203370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f982ab-7849-4fc9-98b9-d862675e8fec service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.213941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1090/2154] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:53 2022] PUT /identity/v3/projects/02fef5a066a54d209555356044ab0d81/users/f4fb9a3eacf448578b8ba8a8cb7f33c0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:53.215817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.286985 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:53.379153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d2fc-5d89-47bc-bcb9-80d10d1f1e9f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.383215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.384221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.384579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.384926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] PATH_INFO: `/v3/projects/eece3d6288104a5a9d787a173f8b9160/users/a25081b046d84439bcbab729783efed4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.389885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8423b-0786-482c-8aea-6fb073c57c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.390253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8423b-0786-482c-8aea-6fb073c57c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.390664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8423b-0786-482c-8aea-6fb073c57c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.390950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8423b-0786-482c-8aea-6fb073c57c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.407134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eece3d6288104a5a9d787a173f8b9160, user_id=a25081b046d84439bcbab729783efed4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.410476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.429264 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1065/2155] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:53 2022] PUT /identity/v3/projects/eece3d6288104a5a9d787a173f8b9160/users/a25081b046d84439bcbab729783efed4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:53.430380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.432834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:53.436514 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:53.503129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8423b-0786-482c-8aea-6fb073c57c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.504809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8423b-0786-482c-8aea-6fb073c57c40 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.520537 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1091/2156] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:53.523184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa1ee-5f0c-43a3-9c60-3adb10112260 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.523574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa1ee-5f0c-43a3-9c60-3adb10112260 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.523995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa1ee-5f0c-43a3-9c60-3adb10112260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.536547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677a1de-e00c-40c8-84f6-5fe352e8d9f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.544248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.545201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.545486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.545765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] PATH_INFO: `/v3/projects/dcfe8877823c4489a3a51cbe76e3949d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.547979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfe8877823c4489a3a51cbe76e3949d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.552184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.557539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e48fa1ee-5f0c-43a3-9c60-3adb10112260 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:53.559874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e48fa1ee-5f0c-43a3-9c60-3adb10112260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:53.571953 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1092/2157] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:53.573664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.574031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.574458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.615038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfe8877823c4489a3a51cbe76e3949d', 'request_id': 'req-7671235d-d0ac-4c4f-850e-c0966cd66eb3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:53.615752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] MFA Rules not processed for user `a25081b046d84439bcbab729783efed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:53.617349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:53.621697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfe8877823c4489a3a51cbe76e3949d', 'request_id': 'req-7671235d-d0ac-4c4f-850e-c0966cd66eb3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:53.637837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfe8877823c4489a3a51cbe76e3949d', 'request_id': 'req-7671235d-d0ac-4c4f-850e-c0966cd66eb3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:53.654880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] The token cache is being invalidate because project dcfe8877823c4489a3a51cbe76e3949d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:53.655195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:53.669529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:53.678457 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1066/2158] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:53 2022] DELETE /identity/v3/projects/dcfe8877823c4489a3a51cbe76e3949d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:53.679532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.681701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:53.759598 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1093/2159] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:53.767113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:53.768807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:53.770053 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:53.790256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671235d-d0ac-4c4f-850e-c0966cd66eb3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.795807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.796313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.796607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.797188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.799409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:53.880043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc2d22-86a8-49be-a62b-9a1f23ba9440 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:53.893150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:53.894217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.894541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.894907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] PATH_INFO: `/v3/users/d9a1fd0da0774097a4dbce9ffb1e40b8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.898666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a1fd0da0774097a4dbce9ffb1e40b8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.904858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:53.906419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5366af-4baf-43c8-b56f-e4dcf8f2cb4b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.914160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:53.934712 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1067/2160] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:53.937056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:53.937308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:53.937741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:53.971220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] MFA Rules not processed for user `b0e9269c55ce43e9b3240c1c4a96f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:53.973586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:54.040493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a1fd0da0774097a4dbce9ffb1e40b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.041323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a1fd0da0774097a4dbce9ffb1e40b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.042659 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:54.083711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a1fd0da0774097a4dbce9ffb1e40b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.084477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a1fd0da0774097a4dbce9ffb1e40b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.099545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a1fd0da0774097a4dbce9ffb1e40b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.141580 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1094/2161] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:53 2022] DELETE /identity/v3/users/d9a1fd0da0774097a4dbce9ffb1e40b8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:54.141580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.144181 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1068/2162] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:54.144807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:54.149238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.154845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:54.209551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117451e-4919-4ef2-b3f4-3c51e5d7234a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:54.304776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849abbc-0312-403d-bb03-2564d18cb56d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:54.312470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:54.313448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:54.313923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:54.314379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:54.315525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:54.317857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:54.373995 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1095/2163] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:54 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:54.380415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.445997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:54.447053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:54.447449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:54.447822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] PATH_INFO: `/v3/users/db784ab6f91241ac89d92732196e7aae` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:54.450717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db784ab6f91241ac89d92732196e7aae)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:54.453303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:54.519050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6008a-caa8-4ffb-986f-e281e0f6f45f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:54.526027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:54.527150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:54.528408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:54.528882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:54.529783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:54.532211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:54.563514 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:54.566977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1096/2164] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:54 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:54.569971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.579723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db784ab6f91241ac89d92732196e7aae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.592993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207fd9-35d1-4412-82c1-30bc5c0fd218 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:54.606650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db784ab6f91241ac89d92732196e7aae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.611935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:54.612745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:54.613106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:54.613463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:54.614297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:54.616118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:54.619193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db784ab6f91241ac89d92732196e7aae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.631897 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1097/2165] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:54.637928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db784ab6f91241ac89d92732196e7aae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.638253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.639270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0cb75711-e979-45f2-bf2f-47edfd95332d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db784ab6f91241ac89d92732196e7aae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:54.653136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1069/2166] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:54 2022] DELETE /identity/v3/users/db784ab6f91241ac89d92732196e7aae => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:54.658032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:54.658314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:54.658636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:54.666160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568304-5781-457b-8ad9-3b86eb8aaec9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:54.681193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:54.682458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:54.772352 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:54.818827 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1070/2167] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:54.841277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.844085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:54.884294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:54.887846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:54.888519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:54.890460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] PATH_INFO: `/v3/projects/a5de6ac2da744844bd5a72ba4f069c25/users/26351842711d4a02a03049596eef1585/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:54.937462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5de6ac2da744844bd5a72ba4f069c25, user_id=26351842711d4a02a03049596eef1585, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:54.947703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:54.974340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc8ac-8e86-4b2d-bc66-907b610b4d2c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:54.975315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1098/2168] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:54 2022] PUT /identity/v3/projects/a5de6ac2da744844bd5a72ba4f069c25/users/26351842711d4a02a03049596eef1585/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:54.981459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:54.984044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:55.104027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:55.107039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:55.107575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:55.108117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:55.158245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdea72c-4b60-4520-9ff6-ae2ea1e2f97e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:55.165473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:55.166549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:55.166942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:55.167321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:55.168288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:55.170614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:55.191848 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:55.192602 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1099/2169] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:46:55.199450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:55.224160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed601f1-b30e-486a-ac0c-027997001268 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:55.260888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0423bd5-293f-46fd-8ffb-aa8a84919963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:55.263660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0423bd5-293f-46fd-8ffb-aa8a84919963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:55.264162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0423bd5-293f-46fd-8ffb-aa8a84919963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:55.264650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0423bd5-293f-46fd-8ffb-aa8a84919963 admin admin] PATH_INFO: `/v3/projects/a5de6ac2da744844bd5a72ba4f069c25/users/26351842711d4a02a03049596eef1585/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:55.267311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0423bd5-293f-46fd-8ffb-aa8a84919963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5de6ac2da744844bd5a72ba4f069c25, user_id=26351842711d4a02a03049596eef1585, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:55.272742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0423bd5-293f-46fd-8ffb-aa8a84919963 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:55.274107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:55.277306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:55.290323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1100/2170] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:55 2022] PUT /identity/v3/projects/a5de6ac2da744844bd5a72ba4f069c25/users/26351842711d4a02a03049596eef1585/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:55.307693 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1071/2171] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:55.309549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:55.310004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:55.310414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:55.373984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] MFA Rules not processed for user `26351842711d4a02a03049596eef1585`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:55.377305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:55.629914 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1101/2172] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:55.677311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:55.678919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:55.806423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:55.808084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:55.855186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2548-97d9-48d0-821d-27f059c72246 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:55.864141 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:56.013788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2449-846b-4a20-9ba6-c0e59782fe9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:56.015397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2449-846b-4a20-9ba6-c0e59782fe9d service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.015780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2449-846b-4a20-9ba6-c0e59782fe9d service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.016064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2449-846b-4a20-9ba6-c0e59782fe9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.028918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774b058-780c-4993-9bee-3d0eeef26293 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:56.040638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba2449-846b-4a20-9ba6-c0e59782fe9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:56.042786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba2449-846b-4a20-9ba6-c0e59782fe9d service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:56.057658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:56.060735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.066125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.066125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] PATH_INFO: `/v3/projects/68dfb57455174ae59b990b75423c4b03` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.069275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dfb57455174ae59b990b75423c4b03)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:56.073035 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1072/2173] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:56.094911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:56.260891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dfb57455174ae59b990b75423c4b03', 'request_id': 'req-01c11bc7-d58e-41e0-b17b-49b17f8ee064'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.282337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dfb57455174ae59b990b75423c4b03', 'request_id': 'req-01c11bc7-d58e-41e0-b17b-49b17f8ee064'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.298300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dfb57455174ae59b990b75423c4b03', 'request_id': 'req-01c11bc7-d58e-41e0-b17b-49b17f8ee064'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.328405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] The token cache is being invalidate because project 68dfb57455174ae59b990b75423c4b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:56.328838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.331224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.335020 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1102/2174] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:55 2022] DELETE /identity/v3/projects/68dfb57455174ae59b990b75423c4b03 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:56.340765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab8f2-bf7c-4066-8229-55bc6a59650a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.341076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab8f2-bf7c-4066-8229-55bc6a59650a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.341370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab8f2-bf7c-4066-8229-55bc6a59650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.354679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:56.356460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:56.407763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-93dab8f2-bf7c-4066-8229-55bc6a59650a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:56.413798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-93dab8f2-bf7c-4066-8229-55bc6a59650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:56.522489 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:56.548507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c11bc7-d58e-41e0-b17b-49b17f8ee064 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:56.557836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:56.568352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.569588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1073/2175] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:56.571419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.572649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] PATH_INFO: `/v3/projects/280258fe4e194b7f8244c22356b8658e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.577926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.578196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.578484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.585909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280258fe4e194b7f8244c22356b8658e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:56.597685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:56.632379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:56.634438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:56.690363 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1074/2176] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:56.695445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:56.724138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007311-ed34-40f2-8ee0-a3825ab4af12 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:56.775150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280258fe4e194b7f8244c22356b8658e', 'request_id': 'req-0d8d083a-52c4-4345-a182-500a847a4433'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.782785 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:56.794613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280258fe4e194b7f8244c22356b8658e', 'request_id': 'req-0d8d083a-52c4-4345-a182-500a847a4433'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.810636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280258fe4e194b7f8244c22356b8658e', 'request_id': 'req-0d8d083a-52c4-4345-a182-500a847a4433'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.836022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] The token cache is being invalidate because project 280258fe4e194b7f8244c22356b8658e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:56.836311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.837042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d8d083a-52c4-4345-a182-500a847a4433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:56.839012 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1103/2177] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:56 2022] DELETE /identity/v3/projects/280258fe4e194b7f8244c22356b8658e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:56.854384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b50f6-af53-4c8f-b1f5-fa0f216cadd7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.855513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b50f6-af53-4c8f-b1f5-fa0f216cadd7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.861297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b50f6-af53-4c8f-b1f5-fa0f216cadd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.906137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e12b50f6-af53-4c8f-b1f5-fa0f216cadd7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:56.918077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e12b50f6-af53-4c8f-b1f5-fa0f216cadd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:56.952865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:56.954443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.954936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.955402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.956427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:56.956915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:56.958865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:56.985488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1075/2178] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:56.990273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:56.995191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:57.032922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d79206-2c7e-402f-af2d-e3521f27d1f0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:57.045216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:57.045914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.046201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.046479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.047359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:57.049367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:57.069303 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1104/2179] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:57.079107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.079461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.079684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.110441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:57.122817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:57.132402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1076/2180] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:56 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:57.136836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.148308 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1105/2181] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:57.153214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.169203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6a44c-65ff-4c6e-ab25-b7c8444df15f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:57.292259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ef92-7640-428b-8659-48832b148d37 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:57.301142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:57.302485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.302945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.303234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.303973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:57.306327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:57.347769 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1077/2182] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:57 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:57.354344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.356866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:57.357577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.357831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.358103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.359656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:46:57.359656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:57.377770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:57.391511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823619c5-c57e-4b03-956d-fe0fc032b70b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:57.399639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1106/2183] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:46:57.400775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.403137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:57.417713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:57.418013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ded4b-47b9-4f0b-829c-bf0a10155d81 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:57.419001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.419334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.419565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.420334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:57.422020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:57.445325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:57.449525 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1078/2184] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:46:57.450427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.451333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.455738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.456954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] PATH_INFO: `/v3/users/a25081b046d84439bcbab729783efed4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.460834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25081b046d84439bcbab729783efed4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:57.469318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:57.475465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e2c8-07d9-4487-85a7-0892e656497d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:57.491226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:57.492277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:57.492277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:57.492552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:57.493341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:57.495392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:57.571963 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1079/2185] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:57 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:57.573461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.605281 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:57.638956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25081b046d84439bcbab729783efed4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:57.640421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25081b046d84439bcbab729783efed4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:57.685792 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=12,keystone:SELECT=88 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:57.688378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25081b046d84439bcbab729783efed4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:57.690979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25081b046d84439bcbab729783efed4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:57.721315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25081b046d84439bcbab729783efed4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:57.765866 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1107/2186] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:57 2022] DELETE /identity/v3/users/a25081b046d84439bcbab729783efed4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:57.767525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:57.773424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:57.811551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c6021-3ac8-4ec9-b65c-faa4512f1fcf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.019284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d7352-8f74-41f0-adec-3ea938ed66a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.020927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d7352-8f74-41f0-adec-3ea938ed66a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.022220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d7352-8f74-41f0-adec-3ea938ed66a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.022871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d7352-8f74-41f0-adec-3ea938ed66a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.023978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d7352-8f74-41f0-adec-3ea938ed66a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.025730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d7352-8f74-41f0-adec-3ea938ed66a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.045543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222d7c-2327-4f74-aae4-32148c5d35ff admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.049871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1080/2187] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:58.051420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.051741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.051989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.071251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.071960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.072248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.072529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.073247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.080408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.098292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:58.099554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:58.118370 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1108/2188] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:57 2022] POST /identity/v3/users => generated 288 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:58.119244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.122163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1081/2189] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:58.123523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.126407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:58.151181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c4e9-e302-411f-96f9-fcdbf57b9775 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.153364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277144-7367-492f-862e-b922b2c64305 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.157742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.158641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.158932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.159237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.159964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.160383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.161574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.161765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.162265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.162778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] PATH_INFO: `/v3/projects/4216b36fb42f452eac154b8d19e8b4fe/users/fa86581ec16846aba9ec611c062a6646/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.175388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1082/2190] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:58.176386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.182419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:58.186639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4216b36fb42f452eac154b8d19e8b4fe, user_id=fa86581ec16846aba9ec611c062a6646, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.189920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.212607 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1109/2191] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:58 2022] PUT /identity/v3/projects/4216b36fb42f452eac154b8d19e8b4fe/users/fa86581ec16846aba9ec611c062a6646/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:58.213508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.307510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93159483-e9aa-4860-8c4c-a4d3e5908f66 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.384871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16a32-ac10-4870-b2a4-16827289f170 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.397929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3747e4b-2e7a-49ab-acf5-d6e1a2f66b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.398716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3747e4b-2e7a-49ab-acf5-d6e1a2f66b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.399013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3747e4b-2e7a-49ab-acf5-d6e1a2f66b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.399292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3747e4b-2e7a-49ab-acf5-d6e1a2f66b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.400058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3747e4b-2e7a-49ab-acf5-d6e1a2f66b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.405858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3747e4b-2e7a-49ab-acf5-d6e1a2f66b65 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.406052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.406629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.407241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.407542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.424989 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:58.431479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.434054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1110/2192] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:58.434396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.435532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.435834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.436117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.478887 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1083/2193] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:58.479751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.500749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350ea43-040f-4f5c-aa32-cad61fc5b3fb service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.505071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] MFA Rules not processed for user `fa86581ec16846aba9ec611c062a6646`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:58.506685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:58.520858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d035c6-60cf-45a3-9f0b-1508082f4439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.521838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d035c6-60cf-45a3-9f0b-1508082f4439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.522125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d035c6-60cf-45a3-9f0b-1508082f4439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.522401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d035c6-60cf-45a3-9f0b-1508082f4439 admin admin] PATH_INFO: `/v3/projects/b769e3e9a15946208442a597c8d40b98/users/58e0aaefad444a238fe5f4bef2075e51/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.561571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d035c6-60cf-45a3-9f0b-1508082f4439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b769e3e9a15946208442a597c8d40b98, user_id=58e0aaefad444a238fe5f4bef2075e51, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.566138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d035c6-60cf-45a3-9f0b-1508082f4439 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.595988 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:58.601027 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1084/2194] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:58 2022] PUT /identity/v3/projects/b769e3e9a15946208442a597c8d40b98/users/58e0aaefad444a238fe5f4bef2075e51/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:58.612455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.612960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.613530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.677370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] MFA Rules not processed for user `58e0aaefad444a238fe5f4bef2075e51`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:58.679675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:58.692983 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1111/2195] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:58.696349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.721826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464a27-41f2-4395-a3a5-bfede0de2f1c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:58.864700 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1085/2196] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:58.868628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:58.897346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:58.898145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:58.898458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:58.898799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:58.899848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:58.901722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:58.985997 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1112/2197] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:58 2022] POST /identity/v3/projects => generated 393 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:46:58.987509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.008718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c18d4e-4582-4878-89c1-73796370c652 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.067657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974df113-9190-468b-81b5-3fcb6a2402f5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.079607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.080502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.080911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.081273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.082093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.084728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.112005 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1113/2198] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:58 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:59.120762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.151007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550623d2-6ce4-4064-ba7f-a3d35d72cad6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.159934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.160644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.161540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.162246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.164817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.167810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.175278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.175989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.175989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.175989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.176672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.185647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.189917 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1114/2199] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:46:59.191801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.210979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb139-ecc8-4af0-9336-4c8a7359b934 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.215043 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:59.225361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.226322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.226661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.226945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] PATH_INFO: `/v3/projects/8ad342b341964b7a9010d29c6d90e075/users/eabb1f1346914b09a05d8031b683a9de/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.252695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad342b341964b7a9010d29c6d90e075, user_id=eabb1f1346914b09a05d8031b683a9de, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.255998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.269336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1086/2200] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:46:58 2022] POST /identity/v3/projects => generated 373 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:59.275534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.285369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1115/2201] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:59 2022] PUT /identity/v3/projects/8ad342b341964b7a9010d29c6d90e075/users/eabb1f1346914b09a05d8031b683a9de/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:59.286939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.319420 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:59.481111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4022-9113-41a9-8aae-2472440c590d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.502606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d53fd-fa3b-4b81-8d2a-d6d6e7ccc991 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.510038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.511322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.512833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.513336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.514903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.516774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.531867 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1116/2202] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:59.538606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.559174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb261a-6569-4d17-a991-ec7d8777cfcf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.565944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b640b4-7e76-48f5-a39e-c1b53097c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.568317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b640b4-7e76-48f5-a39e-c1b53097c198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.568935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b640b4-7e76-48f5-a39e-c1b53097c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.569471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b640b4-7e76-48f5-a39e-c1b53097c198 admin admin] PATH_INFO: `/v3/projects/8ad342b341964b7a9010d29c6d90e075/users/eabb1f1346914b09a05d8031b683a9de/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.572700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b640b4-7e76-48f5-a39e-c1b53097c198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad342b341964b7a9010d29c6d90e075, user_id=eabb1f1346914b09a05d8031b683a9de, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.578588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b640b4-7e76-48f5-a39e-c1b53097c198 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.604923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1117/2203] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:59 2022] PUT /identity/v3/projects/8ad342b341964b7a9010d29c6d90e075/users/eabb1f1346914b09a05d8031b683a9de/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:59.625599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.626087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.626476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.632112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.632809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.633090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.633360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.634063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.636073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.684816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] MFA Rules not processed for user `eabb1f1346914b09a05d8031b683a9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:59.686374 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1087/2204] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:46:59 2022] POST /identity/v3/users => generated 293 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:46:59.689758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:59.690323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.745866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35194c-72db-4ca2-9fa4-4ec3b32f2717 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.817158 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1118/2205] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:59.851446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.854242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:59.916563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.918621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.919026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.919318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:59.920261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:59.922900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:59.941547 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1088/2206] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:46:59.946229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:59.961761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703c1d-32a3-4e76-9fd9-10d6a5225099 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:59.971759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:59.972320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:59.972676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:59.973735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] PATH_INFO: `/v3/projects/5b91d5179ea948869547d557423df074/users/54c798976bb84845984a3617348ea98d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.009255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd5046-d07b-415a-aa19-780056ec9725 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.012697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b91d5179ea948869547d557423df074, user_id=54c798976bb84845984a3617348ea98d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.017464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.021472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.022613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.023106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.023570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.042810 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:00.048742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.052136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.073460 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1089/2207] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:46:59 2022] PUT /identity/v3/projects/5b91d5179ea948869547d557423df074/users/54c798976bb84845984a3617348ea98d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:00.082909 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1119/2208] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:00.087119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.281677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b12763-612b-46bf-9dc7-a7c97a3746b7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.307294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.308126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.308420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.308934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.314540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.316536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.348411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.360077 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1090/2209] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:00.360705 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:00.364364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.372204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05660-2bd7-4e70-bad1-dfef05033c23 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.374975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.395246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59412229-09c5-436d-981f-e90c6739f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.396464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59412229-09c5-436d-981f-e90c6739f20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.396464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59412229-09c5-436d-981f-e90c6739f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.396722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59412229-09c5-436d-981f-e90c6739f20a admin admin] PATH_INFO: `/v3/projects/5b91d5179ea948869547d557423df074/users/54c798976bb84845984a3617348ea98d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.410300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59412229-09c5-436d-981f-e90c6739f20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b91d5179ea948869547d557423df074, user_id=54c798976bb84845984a3617348ea98d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.420331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59412229-09c5-436d-981f-e90c6739f20a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.425206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0092-1f71-417a-818f-3a2f1e1c365f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.435714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.436933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.436933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.437203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] PATH_INFO: `/v3/projects/eece3d6288104a5a9d787a173f8b9160` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.440875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eece3d6288104a5a9d787a173f8b9160)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.442695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.458462 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1120/2210] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:00 2022] PUT /identity/v3/projects/5b91d5179ea948869547d557423df074/users/54c798976bb84845984a3617348ea98d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:00.459529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.459832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.460120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.523359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] MFA Rules not processed for user `54c798976bb84845984a3617348ea98d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:00.524806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.581070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eece3d6288104a5a9d787a173f8b9160', 'request_id': 'req-d277484a-2993-4d13-9ca7-2e4e814b6d46'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.595705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eece3d6288104a5a9d787a173f8b9160', 'request_id': 'req-d277484a-2993-4d13-9ca7-2e4e814b6d46'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.610797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eece3d6288104a5a9d787a173f8b9160', 'request_id': 'req-d277484a-2993-4d13-9ca7-2e4e814b6d46'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.638646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] The token cache is being invalidate because project eece3d6288104a5a9d787a173f8b9160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:00.640333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.642522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.650612 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1091/2211] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:00 2022] DELETE /identity/v3/projects/eece3d6288104a5a9d787a173f8b9160 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:00.656120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.664401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.707860 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1121/2212] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:00.760768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.765332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.803555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277484a-2993-4d13-9ca7-2e4e814b6d46 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.812805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.814950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.815276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.815927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] PATH_INFO: `/v3/users/26351842711d4a02a03049596eef1585` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.818991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=26351842711d4a02a03049596eef1585)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.822375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.864024 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:00.918382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e11a1-67e7-4099-9ac9-32ec4d94951d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.920835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26351842711d4a02a03049596eef1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.940973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26351842711d4a02a03049596eef1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.951733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26351842711d4a02a03049596eef1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.968105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26351842711d4a02a03049596eef1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.968926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26351842711d4a02a03049596eef1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:00.979322 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1092/2213] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:00 2022] DELETE /identity/v3/users/26351842711d4a02a03049596eef1585 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:01.064100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:01.064887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:01.065177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:01.065454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:01.067705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:01.084451 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:01.233428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:01.236626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:01.265096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1122/2214] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:01.374337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:01.376146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:01.426685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:01.428310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:01.467031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537bc21-4f90-4191-83da-ee769e5006bb service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:01.553951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150b160-84e2-41d9-93a5-9885388d64ad admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:01.586012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:01.586961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:01.589061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:01.589500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] PATH_INFO: `/v3/users/fa86581ec16846aba9ec611c062a6646` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:01.593440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa86581ec16846aba9ec611c062a6646)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:01.596433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:01.675655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:01.678860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:01.680785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:01.681732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:01.687998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:01.704758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa86581ec16846aba9ec611c062a6646'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:01.744256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa86581ec16846aba9ec611c062a6646'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:01.775707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa86581ec16846aba9ec611c062a6646'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:01.793181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:01.795169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa86581ec16846aba9ec611c062a6646'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:01.795404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:01.797219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1ea83d74-4e1a-48ee-932e-aa2b478d88ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa86581ec16846aba9ec611c062a6646'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:01.812307 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1093/2215] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:01 2022] DELETE /identity/v3/users/fa86581ec16846aba9ec611c062a6646 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:01.825146 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1123/2216] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:01.830076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:01.830606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:01.831019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:01.867415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:01.869338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:01.897440 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:01.942835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:01.945328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:01.977398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15593-fc94-4b7a-8feb-8250b5293395 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:02.078568 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1094/2217] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:02.097324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:02.098842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:02.106820 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:02.161227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:02.162133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:02.162431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:02.162729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] PATH_INFO: `/v3/projects/a5de6ac2da744844bd5a72ba4f069c25` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:02.165735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5de6ac2da744844bd5a72ba4f069c25)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:02.167739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:02.288260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0eb6-6da4-43e3-a779-6f61f0f7cda2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:02.295412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbbb07-88d4-4e36-b136-29f944ff6a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:02.296077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbbb07-88d4-4e36-b136-29f944ff6a6c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:02.296593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbbb07-88d4-4e36-b136-29f944ff6a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:02.297176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbbb07-88d4-4e36-b136-29f944ff6a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:02.311470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbbb07-88d4-4e36-b136-29f944ff6a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:02.314470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbbb07-88d4-4e36-b136-29f944ff6a6c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:02.333633 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1095/2218] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:02.388616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5de6ac2da744844bd5a72ba4f069c25', 'request_id': 'req-5cf8539d-4ac8-45f5-8e83-78240f57faaf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:02.406604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5de6ac2da744844bd5a72ba4f069c25', 'request_id': 'req-5cf8539d-4ac8-45f5-8e83-78240f57faaf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:02.429595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5de6ac2da744844bd5a72ba4f069c25', 'request_id': 'req-5cf8539d-4ac8-45f5-8e83-78240f57faaf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:02.467621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] The token cache is being invalidate because project a5de6ac2da744844bd5a72ba4f069c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:02.467621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:02.468324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5cf8539d-4ac8-45f5-8e83-78240f57faaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:02.470880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1124/2219] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:01 2022] DELETE /identity/v3/projects/a5de6ac2da744844bd5a72ba4f069c25 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:02.476711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:02.477254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:02.477254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:02.533089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:02.540590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:02.744030 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1096/2220] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:02.753730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:02.754587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:02.754587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:02.792535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:02.794117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:02.818101 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1125/2221] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:02.822428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:02.848390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca6f02-0cf6-49df-8e24-54de8334ab9c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:02.873408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:02.876593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:02.877691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:02.878850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:02.882386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:02.883526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:02.889247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:02.913830 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1097/2222] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:02.914878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:02.931668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8c39-f8b1-4d18-baaa-f8c87e6fffad None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:02.951708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:02.960533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:02.960850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:02.961135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:02.964741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:02.969741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.018544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.022956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.063398 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1126/2223] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:02 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:03.072596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192537e1-2fd5-4557-ab6e-baed155b7dca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:03.072809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.179709 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:03.205543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edab79-9d5e-4965-b8e0-939e9115cccc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:03.210513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:03.211456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.212497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.213096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] PATH_INFO: `/v3/users/58e0aaefad444a238fe5f4bef2075e51` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.213740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:03.214776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.215966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e0aaefad444a238fe5f4bef2075e51)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:03.216277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.217139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.218257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:03.221732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.223723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.267116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1127/2224] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:03 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:03.267116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.269213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.290219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622596c5-9b9c-4eed-82b0-86ae5c0e906f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:03.299290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:03.300736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.301298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.301877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] PATH_INFO: `/v3/projects/4216b36fb42f452eac154b8d19e8b4fe` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.305500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4216b36fb42f452eac154b8d19e8b4fe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:03.309265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.334346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e0aaefad444a238fe5f4bef2075e51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.362439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e0aaefad444a238fe5f4bef2075e51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.383246 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:03.391818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e0aaefad444a238fe5f4bef2075e51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.403935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4216b36fb42f452eac154b8d19e8b4fe', 'request_id': 'req-a7584a92-bf0f-41d6-a792-c81417dcaecd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.415255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e0aaefad444a238fe5f4bef2075e51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.415584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4216b36fb42f452eac154b8d19e8b4fe', 'request_id': 'req-a7584a92-bf0f-41d6-a792-c81417dcaecd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.416194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e0aaefad444a238fe5f4bef2075e51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.433232 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1098/2225] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:03 2022] DELETE /identity/v3/users/58e0aaefad444a238fe5f4bef2075e51 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:03.436017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4216b36fb42f452eac154b8d19e8b4fe', 'request_id': 'req-a7584a92-bf0f-41d6-a792-c81417dcaecd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.437738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.439461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.472139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] The token cache is being invalidate because project 4216b36fb42f452eac154b8d19e8b4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:03.473086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.474524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7584a92-bf0f-41d6-a792-c81417dcaecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.479065 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1128/2226] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:03 2022] DELETE /identity/v3/projects/4216b36fb42f452eac154b8d19e8b4fe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:03.479065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.479065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.479403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.509291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:03.510703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.567305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82878f6-a8cb-4a5c-90c1-9567cb78ff47 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:03.608763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:03.615328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.616181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.616339 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1129/2227] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:03.617645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.619769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.623782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.630461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:03.637544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.639997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00cd0-6493-4e1f-86f4-afcb24a9c656 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:03.647080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:03.648592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.649107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.649841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] PATH_INFO: `/v3/users/eabb1f1346914b09a05d8031b683a9de` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.651780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabb1f1346914b09a05d8031b683a9de)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:03.654289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.688344 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1099/2228] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:03.688344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.696155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.743405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabb1f1346914b09a05d8031b683a9de'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.745041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabb1f1346914b09a05d8031b683a9de'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.780455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabb1f1346914b09a05d8031b683a9de'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.781291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabb1f1346914b09a05d8031b683a9de'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.797326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabb1f1346914b09a05d8031b683a9de'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:03.814017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c6308-7ac2-48e7-9738-6ae4b176ba43 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:03.820366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:03.822216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:03.823290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:03.823410 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1130/2229] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:03 2022] DELETE /identity/v3/users/eabb1f1346914b09a05d8031b683a9de => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:03.824932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:03.828803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:03.830823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.835732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:03.874576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:03.880485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:03.908821 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1100/2230] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:03.925397 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:04.009855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cae3ba-f5c6-4abb-821a-b75e9485b9f5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:04.026867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cdaec-d1b9-477d-ba29-5b924929b633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:04.030190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cdaec-d1b9-477d-ba29-5b924929b633 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:04.031065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cdaec-d1b9-477d-ba29-5b924929b633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:04.031730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cdaec-d1b9-477d-ba29-5b924929b633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:04.034743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cdaec-d1b9-477d-ba29-5b924929b633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:04.040310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cdaec-d1b9-477d-ba29-5b924929b633 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:04.075527 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1131/2231] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:04.083129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:04.094937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac423b-25e9-4730-b6ba-d81ff8113aa6 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:04.115714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:04.117250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:04.117751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:04.118185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] PATH_INFO: `/v3/projects/68c501453ddc43fd94399c9ef56ede67/users/95220b51119941dfbe6e9c35b8708c7d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:04.122036 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:04.148611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c501453ddc43fd94399c9ef56ede67, user_id=95220b51119941dfbe6e9c35b8708c7d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:04.153040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:04.183266 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1101/2232] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:04 2022] PUT /identity/v3/projects/68c501453ddc43fd94399c9ef56ede67/users/95220b51119941dfbe6e9c35b8708c7d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:04.202879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:04.203388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:04.203886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:04.265463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] MFA Rules not processed for user `95220b51119941dfbe6e9c35b8708c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:04.267081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:04.438562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1132/2233] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:04.446439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:04.651712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee0edf-dca4-4088-af4d-6036927a565b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:04.663120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:04.665229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:04.665229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:04.665565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:04.666114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:04.668360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:04.728195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:04.729337 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1102/2234] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:04 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:04.773469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88bfc3-ef8c-4732-acfe-cfc89f9b2ecd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:04.887113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:04.893394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:04.940507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:04.942109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:04.942653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:04.943138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:04.944675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:04.949157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.002629 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1133/2235] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:04 2022] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:05.003531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.041414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866f440-12af-4f2f-b5de-6569ccc70df4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.106423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.120158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.120834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.121898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.123235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.126612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e8d21-4f54-467a-b351-90814391e864 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.128667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.135638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.136731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.137112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.137517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] PATH_INFO: `/v3/projects/8ad342b341964b7a9010d29c6d90e075` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.139582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad342b341964b7a9010d29c6d90e075)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.142197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.170021 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1134/2236] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:05.174129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.201439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f37d2e-a6d6-485d-9c40-b3e442e470d2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.206675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.208054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.208708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.209053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] PATH_INFO: `/v3/projects/4bc302cb274b41cca6b6e1aa4b6c8c1a/users/7c0422e697e34294829f1a547f36ae9c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.245030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc302cb274b41cca6b6e1aa4b6c8c1a, user_id=7c0422e697e34294829f1a547f36ae9c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.249662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.276027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad342b341964b7a9010d29c6d90e075', 'request_id': 'req-7440627e-623d-4d86-abdc-d190aa7b1394'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.281859 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1135/2237] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:05 2022] PUT /identity/v3/projects/4bc302cb274b41cca6b6e1aa4b6c8c1a/users/7c0422e697e34294829f1a547f36ae9c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:05.285801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.287418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad342b341964b7a9010d29c6d90e075', 'request_id': 'req-7440627e-623d-4d86-abdc-d190aa7b1394'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.303359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad342b341964b7a9010d29c6d90e075', 'request_id': 'req-7440627e-623d-4d86-abdc-d190aa7b1394'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.319028 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:05.323181 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:05.360940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] The token cache is being invalidate because project 8ad342b341964b7a9010d29c6d90e075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:05.361399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.364681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7440627e-623d-4d86-abdc-d190aa7b1394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.373208 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1103/2238] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:04 2022] DELETE /identity/v3/projects/8ad342b341964b7a9010d29c6d90e075 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:05.374946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.377749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.379719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.395533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3d62f-d023-43f0-8f1d-8bad78e37ebd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.403172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.403885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.404167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.404442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.405181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.407050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.423691 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1136/2239] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:05.431497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.434387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.476969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:05.482867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.493068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f7951-a6fd-4a2f-b886-c5e4911fc0d8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.503354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c450e7-dec6-4f8e-a9a4-66283c5676ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.503744 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1104/2240] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:05.506726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c450e7-dec6-4f8e-a9a4-66283c5676ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.507017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c450e7-dec6-4f8e-a9a4-66283c5676ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.507298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c450e7-dec6-4f8e-a9a4-66283c5676ca admin admin] PATH_INFO: `/v3/projects/4bc302cb274b41cca6b6e1aa4b6c8c1a/users/7c0422e697e34294829f1a547f36ae9c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.511624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c450e7-dec6-4f8e-a9a4-66283c5676ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc302cb274b41cca6b6e1aa4b6c8c1a, user_id=7c0422e697e34294829f1a547f36ae9c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.513180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.518131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c450e7-dec6-4f8e-a9a4-66283c5676ca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.523332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.548684 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1137/2241] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:05 2022] PUT /identity/v3/projects/4bc302cb274b41cca6b6e1aa4b6c8c1a/users/7c0422e697e34294829f1a547f36ae9c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:05.550390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6423-a954-413b-ae61-c5f1f9c9f4ed None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.550727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6423-a954-413b-ae61-c5f1f9c9f4ed None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.551007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6423-a954-413b-ae61-c5f1f9c9f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.555871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928240-9c69-4120-a465-0db2b9dc2457 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.572442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-340d6423-a954-413b-ae61-c5f1f9c9f4ed None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:05.573757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-340d6423-a954-413b-ae61-c5f1f9c9f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.661642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.662911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.663203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.663485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] PATH_INFO: `/v3/projects/b769e3e9a15946208442a597c8d40b98` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.666061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b769e3e9a15946208442a597c8d40b98)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.668829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.712198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1138/2242] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:05.714062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.715122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.715748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.754050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] MFA Rules not processed for user `7c0422e697e34294829f1a547f36ae9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:05.755835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b769e3e9a15946208442a597c8d40b98', 'request_id': 'req-f873a615-d67a-47ea-a535-cf2f285652e1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.756871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.763673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b769e3e9a15946208442a597c8d40b98', 'request_id': 'req-f873a615-d67a-47ea-a535-cf2f285652e1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.774537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b769e3e9a15946208442a597c8d40b98', 'request_id': 'req-f873a615-d67a-47ea-a535-cf2f285652e1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.790579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] The token cache is being invalidate because project b769e3e9a15946208442a597c8d40b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:05.791042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.791777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:05.797688 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1105/2243] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:05 2022] DELETE /identity/v3/projects/b769e3e9a15946208442a597c8d40b98 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:05.799433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.801304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.867725 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1139/2244] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:05.867725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:05.869672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.910621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a615-d67a-47ea-a535-cf2f285652e1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:05.917405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:05.918685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.918974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.919270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.920066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:05.920441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:05.922354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05035a14-3659-4130-89e8-46393a6eaa4a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:05.936676 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:05.943117 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1106/2245] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:05.946483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:05.946956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:05.947254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:05.970447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] MFA Rules not processed for user `95220b51119941dfbe6e9c35b8708c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:05.971748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:05.983782 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:06.023565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3c5b9-b30a-4511-b8a3-6f0617660cf4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.036606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.037518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.037804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.038074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] PATH_INFO: `/v3/users/54c798976bb84845984a3617348ea98d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.039341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c798976bb84845984a3617348ea98d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.041713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.118411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1107/2246] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:06.132687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:06.157899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c798976bb84845984a3617348ea98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:06.159563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c798976bb84845984a3617348ea98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:06.166259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b6709-fcfb-4c8e-9faf-6b10d3f2d0df None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.179908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.180719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.184676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.185010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.186113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.187710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c798976bb84845984a3617348ea98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:06.188567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.188689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c798976bb84845984a3617348ea98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:06.206729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c798976bb84845984a3617348ea98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:06.227424 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1140/2247] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:05 2022] DELETE /identity/v3/users/54c798976bb84845984a3617348ea98d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:06.228439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:06.232491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:06.235328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1108/2248] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:06 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:06.240784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:06.248693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:06.455493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779ab57-647e-4e72-a09d-3a40e7a89f61 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.469000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60565c-9350-4482-bc36-c1c3871b3819 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.483237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.485112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.487115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.488218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.489134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.493468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.536621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1109/2249] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:06 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:06.538303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:06.550584 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:06.553759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c9eb-3dee-4883-9942-319c37c12bc4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.568313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.569648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.570109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.570676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.571649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.574099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.615873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.616880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.616880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.617119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.623406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:06.634526 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1110/2250] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:06.639595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:06.669920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea80b6-f700-47e1-84da-3dfc6d6c7419 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.679573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.680648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.681194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.682623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.688289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.690864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.712620 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1111/2251] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:06.717188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:06.743101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170475-83ce-42c9-b31f-0f1a12107bdf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:06.750882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:06.753485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.753937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.754289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] PATH_INFO: `/v3/projects/81c9be33346b431db8dd827fd33f1e43/users/0f1db17e1fcd448f95650bfd6e0fc45f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.775476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.777759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376955-0785-4e03-ad17-e20c91df87f4 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.780900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c9be33346b431db8dd827fd33f1e43, user_id=0f1db17e1fcd448f95650bfd6e0fc45f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:06.801040 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1141/2252] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:06.817393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:06.858238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1112/2253] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:06 2022] PUT /identity/v3/projects/81c9be33346b431db8dd827fd33f1e43/users/0f1db17e1fcd448f95650bfd6e0fc45f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:06.870105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78342f44-682f-4038-936a-b97e771aac79 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:06.870468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78342f44-682f-4038-936a-b97e771aac79 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:06.870760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78342f44-682f-4038-936a-b97e771aac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:06.937860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-78342f44-682f-4038-936a-b97e771aac79 None None] MFA Rules not processed for user `0f1db17e1fcd448f95650bfd6e0fc45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:06.939045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-78342f44-682f-4038-936a-b97e771aac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:07.095933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:07.097944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:07.107892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1142/2254] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:07.112247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78342f44-682f-4038-936a-b97e771aac79 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:07.238399 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:07.263225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78342f44-682f-4038-936a-b97e771aac79 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:07.276292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:07.282427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.283133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.283778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.293783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:07.299674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc938a0-9985-456d-85b5-fdbc97ff3571 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:07.300538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:07.318533 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:07.323268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:07.324641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.325150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.325783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] PATH_INFO: `/v3/projects/5b91d5179ea948869547d557423df074` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.329482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b91d5179ea948869547d557423df074)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:07.334093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:07.366381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1143/2255] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:07 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:07.372581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:07.451182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b91d5179ea948869547d557423df074', 'request_id': 'req-9f910bf9-e85e-4921-919d-38ed46944327'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:07.467286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b91d5179ea948869547d557423df074', 'request_id': 'req-9f910bf9-e85e-4921-919d-38ed46944327'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:07.483837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b91d5179ea948869547d557423df074', 'request_id': 'req-9f910bf9-e85e-4921-919d-38ed46944327'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:07.521566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] The token cache is being invalidate because project 5b91d5179ea948869547d557423df074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:07.523348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:07.524259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9f910bf9-e85e-4921-919d-38ed46944327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:07.526787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1113/2256] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:07 2022] DELETE /identity/v3/projects/5b91d5179ea948869547d557423df074 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:07.532251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9cbf-d48e-4704-9820-d553a40ce04e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.533570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9cbf-d48e-4704-9820-d553a40ce04e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.534422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9cbf-d48e-4704-9820-d553a40ce04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.540907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af18a1-c431-472d-8259-97b415f74c54 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:07.609204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-932a9cbf-d48e-4704-9820-d553a40ce04e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:07.612626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-932a9cbf-d48e-4704-9820-d553a40ce04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:07.707561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:07.709374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.710026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.710814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.713126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:07.718175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:07.769217 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1144/2257] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:07 2022] POST /identity/v3/users => generated 295 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:07.772828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:07.778106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:07.779060 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1114/2258] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:07.787663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.788118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.789212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.814361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770eb46-2293-49a3-8c87-849a397d2d28 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:07.827531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf62c4d-0961-4a12-8d94-73ba36b61487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:07.828319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf62c4d-0961-4a12-8d94-73ba36b61487 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.830185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf62c4d-0961-4a12-8d94-73ba36b61487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.830587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf62c4d-0961-4a12-8d94-73ba36b61487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.831454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf62c4d-0961-4a12-8d94-73ba36b61487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:07.834696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:07.835834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf62c4d-0961-4a12-8d94-73ba36b61487 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:07.837261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:07.859756 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1145/2259] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:07.861727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.862138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.862508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.886012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1115/2260] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:07.888079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:07.918426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352bc39-8ed7-4030-8068-5c93d8f3151f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:07.936788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:07.937720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:07.939038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:07.939902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] PATH_INFO: `/v3/projects/8380e90ad3f94bb3bfb689af280c5623/users/2bb2273335b44f23be97fd40477056ec/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:07.958876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] MFA Rules not processed for user `f4fb9a3eacf448578b8ba8a8cb7f33c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:07.961017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:07.973446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8380e90ad3f94bb3bfb689af280c5623, user_id=2bb2273335b44f23be97fd40477056ec, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:07.979826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.038368 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1116/2261] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:07 2022] PUT /identity/v3/projects/8380e90ad3f94bb3bfb689af280c5623/users/2bb2273335b44f23be97fd40477056ec/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:08.038368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.111125 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1146/2262] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:08.112273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.123801 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:08.139944 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:08.153181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137eedb-5332-47dc-bc3d-80d0c5dc8758 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.183958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f099f90-eda0-491d-a11d-4fe02b7d1df0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.194776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.195481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.199493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.199800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.203351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:08.203684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.207757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.242884 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1117/2263] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:08.242884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.245106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:08.271375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a48a7-a663-4463-807e-53dfe4905b54 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.285503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.285808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.286090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.286380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.287230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.289238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.315152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.317565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.318033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.318832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.320404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.326405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.338204 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1118/2264] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:08 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:08.343221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.355642 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1147/2265] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:08.360491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.380375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047af23-7b44-43e9-a748-dd8ec65c234c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.512991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709c0b-0743-48ba-aabd-75ef760db349 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.524911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.528123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.528499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.528743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.529497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.548859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.549086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.550879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.551660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.552799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.569666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.595983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.656692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1148/2266] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:08 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:08.658734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.661233 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1119/2267] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:08 2022] POST /identity/v3/projects => generated 379 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:08.662900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.698791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc7940-0e23-4ab1-b3b1-91bc84d8d694 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.899097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffa82-f699-40cb-8308-9138bd16fd5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:08.913803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.914754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.915222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.915504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] PATH_INFO: `/v3/projects/8380e90ad3f94bb3bfb689af280c5623/users/2bb2273335b44f23be97fd40477056ec/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.918448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8380e90ad3f94bb3bfb689af280c5623, user_id=2bb2273335b44f23be97fd40477056ec, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.920124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647fe11-e8ba-428a-93ae-4cce3938c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:08.920842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fe11-e8ba-428a-93ae-4cce3938c028 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.921130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fe11-e8ba-428a-93ae-4cce3938c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.921296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.921450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fe11-e8ba-428a-93ae-4cce3938c028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:08.922153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647fe11-e8ba-428a-93ae-4cce3938c028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:08.939058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647fe11-e8ba-428a-93ae-4cce3938c028 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:08.966301 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1149/2268] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:08 2022] PUT /identity/v3/projects/8380e90ad3f94bb3bfb689af280c5623/users/2bb2273335b44f23be97fd40477056ec/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:08.967422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:08.976845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1120/2269] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:08.978237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:08.978712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:08.978876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.067854 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:09.074374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] MFA Rules not processed for user `2bb2273335b44f23be97fd40477056ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:09.079982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:09.163171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f8a7-6dae-4391-9bf0-9bcd28ca995e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.175580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.176803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.176949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.177337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.178133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.185347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.191543 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:09.238104 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1150/2270] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:08 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:09.239078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.264875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5c340-c183-406f-98a7-ad0f2ddf37be admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.286290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.287240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.287528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.287809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] PATH_INFO: `/v3/projects/026cf9c830294a99bde1468fbd1acec9/users/ab1cc3df201a44528353bea5e1c15714/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.338274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=026cf9c830294a99bde1468fbd1acec9, user_id=ab1cc3df201a44528353bea5e1c15714, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.341805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.371431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1151/2271] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:09 2022] PUT /identity/v3/projects/026cf9c830294a99bde1468fbd1acec9/users/ab1cc3df201a44528353bea5e1c15714/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:09.372345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.391401 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1121/2272] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:09.392731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.414087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1348a0-fc7e-416b-86b3-b6eed0e44ee4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.488808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b1a9-5468-4c95-bbb4-a7f3113bc35e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.495919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dece63-2da5-4fcd-a40b-cae3604dadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.496619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dece63-2da5-4fcd-a40b-cae3604dadd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.496910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dece63-2da5-4fcd-a40b-cae3604dadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.497315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dece63-2da5-4fcd-a40b-cae3604dadd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.498082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dece63-2da5-4fcd-a40b-cae3604dadd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.500659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dece63-2da5-4fcd-a40b-cae3604dadd5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.517051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1152/2273] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:09.523589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.523869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.524304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.550109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] MFA Rules not processed for user `0f1db17e1fcd448f95650bfd6e0fc45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:09.552152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:09.605992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.606804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.607163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.607509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.608344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.610336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.628867 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1122/2274] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:09.629912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.647586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def7055-841e-4456-94a2-8d11a0585198 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.656077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.658126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.658559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.658952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.659890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.663960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.678930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1123/2275] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:09.680380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.689639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1153/2276] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:09.690698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.702672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc5d5-eb76-46d4-a805-26fbefb6989f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.711949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.713144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.713592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.714030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] PATH_INFO: `/v3/projects/026cf9c830294a99bde1468fbd1acec9/users/ab1cc3df201a44528353bea5e1c15714/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.717549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a074f-8504-4ebc-9be5-05ba5fee0885 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:09.718590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] RBAC: Authorizing `identity:create_grant(project_id=026cf9c830294a99bde1468fbd1acec9, user_id=ab1cc3df201a44528353bea5e1c15714, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.724385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.747953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9825e-0542-4c5e-ba8f-daecd762a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:09.750129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9825e-0542-4c5e-ba8f-daecd762a0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.751864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9825e-0542-4c5e-ba8f-daecd762a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.752396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9825e-0542-4c5e-ba8f-daecd762a0fe admin admin] PATH_INFO: `/v3/projects/2a1be5d5e3054f9093cb679230d60fbf/users/f016755d30774c539c95eb40a68b5346/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.776117 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1124/2277] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:09 2022] PUT /identity/v3/projects/026cf9c830294a99bde1468fbd1acec9/users/ab1cc3df201a44528353bea5e1c15714/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:09.777830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:09.782057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:09.841598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9825e-0542-4c5e-ba8f-daecd762a0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1be5d5e3054f9093cb679230d60fbf, user_id=f016755d30774c539c95eb40a68b5346, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:09.850566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9825e-0542-4c5e-ba8f-daecd762a0fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:09.905447 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1154/2278] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:09 2022] PUT /identity/v3/projects/2a1be5d5e3054f9093cb679230d60fbf/users/f016755d30774c539c95eb40a68b5346/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:09.921291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:09.923102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:09.925515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:09.961122 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:10.015036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942793bd-d4c2-457b-b893-7bc4409c54df admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:10.020061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] MFA Rules not processed for user `f016755d30774c539c95eb40a68b5346`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:10.023411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:10.117483 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:10.259312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:10.264794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:10.266090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:10.266632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:10.278938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:10.279325 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1155/2279] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:10.280977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:10.528068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:10.543171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8bfe6-e699-4d9d-8966-1ef5a1f5ab17 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:10.571369 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1125/2280] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:10.573864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:10.576840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:10.577272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:10.618066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89128aa5-77ab-4b46-983c-ab3c9679e871 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:10.619099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] MFA Rules not processed for user `98c5142aba9a49bc8138fa10974c4ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:10.620449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:10.652649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:10.653997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:10.655558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:10.656057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:10.662584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:10.681827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:10.853565 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1156/2281] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:10 2022] POST /identity/v3/projects => generated 377 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:10.858344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:10.881183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1126/2282] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:11.074655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa7da-7ff0-4331-9aba-fc2727041db1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:11.081123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:11.082034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.082323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.082634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:11.083336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:11.097165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:11.146527 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1157/2283] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:10 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:11.149705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:11.168315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e869e9-7305-49fe-a09e-3cbef10ce36c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:11.189982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:11.190702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.191465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.191465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:11.192015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:11.193690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:11.218100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1127/2284] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:11.222304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:11.236866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4871f-d462-43fc-b9fd-80718e296fd8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:11.241841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:11.242800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.243106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.243362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] PATH_INFO: `/v3/projects/c50da5fd6808483b8488c18c63140248/users/b239b64cab5742d0b3c756ac8c98f8a8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:11.305303 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:11.334702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50da5fd6808483b8488c18c63140248, user_id=b239b64cab5742d0b3c756ac8c98f8a8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:11.341611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:11.374443 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1158/2285] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:11 2022] PUT /identity/v3/projects/c50da5fd6808483b8488c18c63140248/users/b239b64cab5742d0b3c756ac8c98f8a8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:11.374710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:11.396902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f710-3530-40d9-8cd1-8c21eaac7e38 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:11.546283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834b7d2-d77c-4a3f-a1d8-2bc68d3a38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:11.546924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b7d2-d77c-4a3f-a1d8-2bc68d3a38e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.547208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b7d2-d77c-4a3f-a1d8-2bc68d3a38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.547486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b7d2-d77c-4a3f-a1d8-2bc68d3a38e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:11.548230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834b7d2-d77c-4a3f-a1d8-2bc68d3a38e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:11.550061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834b7d2-d77c-4a3f-a1d8-2bc68d3a38e9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:11.552603 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:11.567875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:11.570115 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1128/2286] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:11.582905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916fae-6126-440f-adaf-e37fa5ebf2ae admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:11.596244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29be80-7a2f-4fe7-860e-cb52b7db8200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:11.597608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29be80-7a2f-4fe7-860e-cb52b7db8200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.598148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29be80-7a2f-4fe7-860e-cb52b7db8200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.598622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29be80-7a2f-4fe7-860e-cb52b7db8200 admin admin] PATH_INFO: `/v3/projects/c50da5fd6808483b8488c18c63140248/users/b239b64cab5742d0b3c756ac8c98f8a8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:11.601643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29be80-7a2f-4fe7-860e-cb52b7db8200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50da5fd6808483b8488c18c63140248, user_id=b239b64cab5742d0b3c756ac8c98f8a8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:11.606164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29be80-7a2f-4fe7-860e-cb52b7db8200 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:11.621458 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1159/2287] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:11 2022] PUT /identity/v3/projects/c50da5fd6808483b8488c18c63140248/users/b239b64cab5742d0b3c756ac8c98f8a8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:11.633397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.633606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.633891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:11.708665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] MFA Rules not processed for user `b239b64cab5742d0b3c756ac8c98f8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:11.723744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:11.903411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1129/2288] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:11.976108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:11.976401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:11.976670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:12.024777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] MFA Rules not processed for user `0f1db17e1fcd448f95650bfd6e0fc45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:12.026040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:12.222989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1160/2289] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:12.318122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:12.553134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea975-4bfd-4705-8227-97f4babc8c35 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:12.568693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5dfbd-d16d-4c82-bdbf-66ef0882d58a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:12.569281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5dfbd-d16d-4c82-bdbf-66ef0882d58a service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:12.570301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5dfbd-d16d-4c82-bdbf-66ef0882d58a service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:12.570301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5dfbd-d16d-4c82-bdbf-66ef0882d58a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:12.592251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5dfbd-d16d-4c82-bdbf-66ef0882d58a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:12.596013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5dfbd-d16d-4c82-bdbf-66ef0882d58a service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:12.623750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1130/2290] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:15.289549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:15.515472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a518331-47bc-4e9e-8794-b6462a4f62b2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:15.522639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:15.523724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:15.524148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:15.524530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] PATH_INFO: `/v3/users/f016755d30774c539c95eb40a68b5346` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:15.527981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f016755d30774c539c95eb40a68b5346)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:15.530275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:15.644802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f016755d30774c539c95eb40a68b5346'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:15.645617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f016755d30774c539c95eb40a68b5346'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:15.676857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f016755d30774c539c95eb40a68b5346'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:15.678064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f016755d30774c539c95eb40a68b5346'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:15.695737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f016755d30774c539c95eb40a68b5346'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:15.715677 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:15.719932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1161/2291] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:15 2022] DELETE /identity/v3/users/f016755d30774c539c95eb40a68b5346 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:15.726028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:15.726668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:15.727331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:15.765088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:15.767423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:16.002483 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1131/2292] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:16.219869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:16.224232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:16.433773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072beb2-ffbc-418c-90d1-264071c6baa6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:16.445176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232102e-21a8-46b8-ac6f-51b81514236f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:16.446378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232102e-21a8-46b8-ac6f-51b81514236f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:16.448275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232102e-21a8-46b8-ac6f-51b81514236f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:16.449796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232102e-21a8-46b8-ac6f-51b81514236f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:16.476669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232102e-21a8-46b8-ac6f-51b81514236f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:16.482423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232102e-21a8-46b8-ac6f-51b81514236f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:16.509428 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1162/2293] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:18.986544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:18.989724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:19.024954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5eb69-4525-4fb1-9c1f-33d1c3054d68 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:19.037651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:19.037651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:19.037651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:19.037651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] PATH_INFO: `/v3/users/e19446b18b4548fba728e2f38cadc689` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:19.042128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19446b18b4548fba728e2f38cadc689)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:19.044576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:19.056902 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:19.143014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19446b18b4548fba728e2f38cadc689'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:19.164344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19446b18b4548fba728e2f38cadc689'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:19.193812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19446b18b4548fba728e2f38cadc689'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:19.213023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19446b18b4548fba728e2f38cadc689'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:19.214921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19446b18b4548fba728e2f38cadc689'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:19.258621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1132/2294] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:18 2022] DELETE /identity/v3/users/e19446b18b4548fba728e2f38cadc689 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:19.263820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779988f-01db-40a1-b797-56656c252199 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:19.265866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779988f-01db-40a1-b797-56656c252199 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:19.266658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779988f-01db-40a1-b797-56656c252199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:19.322568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f779988f-01db-40a1-b797-56656c252199 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:19.327689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f779988f-01db-40a1-b797-56656c252199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:19.458463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1163/2295] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:19.497791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:19.500918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:19.740326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ffd52-4114-4a24-b6c1-ff28ed2a47d9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:19.747403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:19.748512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:19.749184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:19.749721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:19.778755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:19.780919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:19.798911 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1133/2296] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:19.913745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779988f-01db-40a1-b797-56656c252199 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:19.915616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f779988f-01db-40a1-b797-56656c252199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:19.946413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779988f-01db-40a1-b797-56656c252199 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:19.961115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:19.962265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:19.962799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:19.963267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] PATH_INFO: `/v3/projects/2a1be5d5e3054f9093cb679230d60fbf` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:19.965087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1be5d5e3054f9093cb679230d60fbf)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:19.968015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:20.094996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1be5d5e3054f9093cb679230d60fbf', 'request_id': 'req-8460da06-c6d5-4745-914d-af2f3320d4db'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.108638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1be5d5e3054f9093cb679230d60fbf', 'request_id': 'req-8460da06-c6d5-4745-914d-af2f3320d4db'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.119252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1be5d5e3054f9093cb679230d60fbf', 'request_id': 'req-8460da06-c6d5-4745-914d-af2f3320d4db'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.136949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] The token cache is being invalidate because project 2a1be5d5e3054f9093cb679230d60fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:20.137670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.138610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.140819 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1164/2297] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:19 2022] DELETE /identity/v3/projects/2a1be5d5e3054f9093cb679230d60fbf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:20.144780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:20.160678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647fb4e-d6e4-47b4-8fc0-84d60cc00c06 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:20.338462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:20.339605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:20.340023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:20.340405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] PATH_INFO: `/v3/users/b239b64cab5742d0b3c756ac8c98f8a8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:20.341926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b239b64cab5742d0b3c756ac8c98f8a8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:20.348453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:20.441280 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:20.491796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b239b64cab5742d0b3c756ac8c98f8a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.531363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b239b64cab5742d0b3c756ac8c98f8a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.556699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b239b64cab5742d0b3c756ac8c98f8a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.584183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b239b64cab5742d0b3c756ac8c98f8a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.585409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b239b64cab5742d0b3c756ac8c98f8a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:20.596581 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1134/2298] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:20 2022] DELETE /identity/v3/users/b239b64cab5742d0b3c756ac8c98f8a8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:21.872035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:21.874659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:21.946818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460da06-c6d5-4745-914d-af2f3320d4db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:22.049892 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:22.189344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:22.195911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:22.196501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:22.203557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] PATH_INFO: `/v3/projects/0ab7b0f040a34884a505446f24b559f9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:22.208255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab7b0f040a34884a505446f24b559f9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:22.212229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:22.361197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab7b0f040a34884a505446f24b559f9', 'request_id': 'req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.381951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab7b0f040a34884a505446f24b559f9', 'request_id': 'req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.395856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab7b0f040a34884a505446f24b559f9', 'request_id': 'req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.424547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] The token cache is being invalidate because project 0ab7b0f040a34884a505446f24b559f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:22.425252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.427283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.433741 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1165/2299] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:21 2022] DELETE /identity/v3/projects/0ab7b0f040a34884a505446f24b559f9 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:22.435587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:22.438784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:22.484861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bca61-0bc1-412c-afb0-8c03afd7f3b5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:22.695711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:22.704443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:22.705309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:22.706173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] PATH_INFO: `/v3/users/8f0f126c45224f33bf96597436c98de3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:22.708545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0f126c45224f33bf96597436c98de3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:22.717960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:22.932095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0f126c45224f33bf96597436c98de3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.997014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0f126c45224f33bf96597436c98de3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.024114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0f126c45224f33bf96597436c98de3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.076037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0f126c45224f33bf96597436c98de3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.076997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c66ae9f0-08d3-424d-ad99-d06aa6544e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0f126c45224f33bf96597436c98de3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.090215 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1135/2300] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:22 2022] DELETE /identity/v3/users/8f0f126c45224f33bf96597436c98de3 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:23.768325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.771356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:23.799263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e84cc-ce82-40ee-b1c8-1338bf4f17c8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.930231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.931323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.932224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.932224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] PATH_INFO: `/v3/projects/c50da5fd6808483b8488c18c63140248` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.937785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50da5fd6808483b8488c18c63140248)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.943126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:24.033876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50da5fd6808483b8488c18c63140248', 'request_id': 'req-4e8cf191-be7a-4841-8609-f8fcb104c396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:24.046739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50da5fd6808483b8488c18c63140248', 'request_id': 'req-4e8cf191-be7a-4841-8609-f8fcb104c396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:24.048951 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:24.057171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50da5fd6808483b8488c18c63140248', 'request_id': 'req-4e8cf191-be7a-4841-8609-f8fcb104c396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:24.082711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] The token cache is being invalidate because project c50da5fd6808483b8488c18c63140248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:24.083303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:24.084473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e8cf191-be7a-4841-8609-f8fcb104c396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:24.098346 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1166/2301] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:23 2022] DELETE /identity/v3/projects/c50da5fd6808483b8488c18c63140248 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:24.100041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:24.100605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:24.100688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:24.133783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:24.138886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:24.188928 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:24.311153 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1136/2302] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:24.323916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:24.324255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:24.324608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:24.372738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:24.377224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:24.396327 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1167/2303] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:24.400369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:24.420029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3610ef-0868-4f6b-95b9-35bb09ee0c41 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:24.430466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:24.431608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:24.432105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:24.433189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:24.434295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:24.434904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:24.438154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:24.525326 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1137/2304] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:47:24.530204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:24.551357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6427-b05f-4159-91ff-718cecc8e6ea None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:24.565603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:24.566297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:24.566605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:24.566893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:24.567779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:24.587630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:24.677365 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1168/2305] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:24 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:24.678035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:24.697510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d4cbf-3dd8-414f-95a7-b32aa22d5502 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:24.855747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:24.858748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:24.984837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:24.985658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:24.985917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:24.986246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:24.987042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:24.999240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.056970 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1138/2306] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:24 2022] POST /identity/v3/users => generated 286 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:25.062405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:25.100502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba927-e04d-4756-9ce3-406cdb9946f0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:25.113562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:25.114900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.115458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.116143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.117533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:25.119854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.164560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23465-c5a9-4111-a992-ae5662941242 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:25.169109 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1139/2307] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:25.176564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:25.192424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:25.195674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.196770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.197086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] PATH_INFO: `/v3/projects/12eb4c057e6541dda06f9f28846a6d9f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.202548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12eb4c057e6541dda06f9f28846a6d9f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:25.205979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2454b-9b08-4354-8de1-8ab2fefdd616 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:25.208403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.228339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:25.229050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.229345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.229770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.243717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:25.248171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.296005 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1140/2308] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:25.304116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:25.325439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a2370-48d0-4dde-ac8a-1013911b880a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:25.359643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12eb4c057e6541dda06f9f28846a6d9f', 'request_id': 'req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:25.381971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12eb4c057e6541dda06f9f28846a6d9f', 'request_id': 'req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:25.393433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12eb4c057e6541dda06f9f28846a6d9f', 'request_id': 'req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:25.414765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] The token cache is being invalidate because project 12eb4c057e6541dda06f9f28846a6d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:25.415139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:25.419010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f4cfa3c9-1bb3-46c3-948f-cb2e1cabd357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:25.427953 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1169/2309] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:24 2022] DELETE /identity/v3/projects/12eb4c057e6541dda06f9f28846a6d9f => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:25.429673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c080ca-cd7e-4e08-b42b-ff08c73ef2d8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.429996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c080ca-cd7e-4e08-b42b-ff08c73ef2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.430325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c080ca-cd7e-4e08-b42b-ff08c73ef2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.467808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8f017-69eb-4be9-8764-4e11645cab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:25.469118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f017-69eb-4be9-8764-4e11645cab25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.469616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f017-69eb-4be9-8764-4e11645cab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.470137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f017-69eb-4be9-8764-4e11645cab25 admin admin] PATH_INFO: `/v3/projects/3a6f5d726c264f8a8fd9ac80db9f96da/users/321d02bf4aa24b25821999d04d290dd3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.470836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a4c080ca-cd7e-4e08-b42b-ff08c73ef2d8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:25.472150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4c080ca-cd7e-4e08-b42b-ff08c73ef2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:25.497232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f017-69eb-4be9-8764-4e11645cab25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6f5d726c264f8a8fd9ac80db9f96da, user_id=321d02bf4aa24b25821999d04d290dd3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:25.500732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f017-69eb-4be9-8764-4e11645cab25 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.514331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1170/2310] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:25.516124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.516419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.516698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.542761 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:25.550031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1141/2311] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:25 2022] PUT /identity/v3/projects/3a6f5d726c264f8a8fd9ac80db9f96da/users/321d02bf4aa24b25821999d04d290dd3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:25.553851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:25.556298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:25.563185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.563480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.563768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.615052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] MFA Rules not processed for user `321d02bf4aa24b25821999d04d290dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:25.616320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:25.617641 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:25.669487 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1171/2312] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:25.671683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:25.693640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e31dc-f1a6-49bd-89a1-b69b9beb503f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:25.707097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:25.708350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.709436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.710977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.712686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:25.714891 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1142/2313] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:25.715316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:25.718991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.752623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1172/2314] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:25.753489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:25.781919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3cf5b-43ff-4aad-91e8-66c3e79bf1dc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:25.793593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:25.795385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:25.795800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:25.796520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:25.797838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:25.802119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:25.915909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:25.928426 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1143/2315] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:25 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:25.961420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5a744-671c-4aa8-860d-f68cb434a3ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:26.126333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:26.128516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:26.176488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:26.179925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:26.179925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:26.180322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:26.181154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:26.208636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:26.286825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1173/2316] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:25 2022] POST /identity/v3/users => generated 292 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:26.298283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:26.328903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf74586-4bed-40cb-a784-a1c2859d3878 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:26.344040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:26.344976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:26.345716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:26.345716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:26.346338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:26.350613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:26.389753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf2c6-b175-4149-ba73-555eafa8d685 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:26.404181 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1174/2317] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:26.410096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:26.419703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:26.421894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:26.422722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:26.423363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:26.441291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f609d61-7a0f-440d-8f59-e33ad029a3f9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:26.451429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:26.452493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:26.452852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:26.453320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:26.454813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:26.457867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:26.498446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1175/2318] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:26.503753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:26.546334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34111598-ef63-41d3-83ed-80489ffefd6b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:26.555690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63095fb4-326a-4eef-b58e-52f325ef5e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:26.556112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63095fb4-326a-4eef-b58e-52f325ef5e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:26.557171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63095fb4-326a-4eef-b58e-52f325ef5e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:26.557991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63095fb4-326a-4eef-b58e-52f325ef5e03 admin admin] PATH_INFO: `/v3/projects/e4733e3e78a5499dbdecfe80680719f6/users/8c9e190ac4fd457fac81ff0b04bf87c4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:26.600999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63095fb4-326a-4eef-b58e-52f325ef5e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4733e3e78a5499dbdecfe80680719f6, user_id=8c9e190ac4fd457fac81ff0b04bf87c4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:26.603851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63095fb4-326a-4eef-b58e-52f325ef5e03 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:26.607338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:26.612303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:26.639211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1176/2319] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:26 2022] PUT /identity/v3/projects/e4733e3e78a5499dbdecfe80680719f6/users/8c9e190ac4fd457fac81ff0b04bf87c4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:26.639211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:26.639523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:26.639739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:26.659696 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1144/2320] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:26.721228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:26.722107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:26.876351 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:26.883087 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1177/2321] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:26.890364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:26.899904 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:26.908107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af5978-5b42-4da5-a211-5b28ad653360 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:27.097506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:27.098211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.098516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.098797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.099550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:27.101496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:27.166527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1145/2322] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:26 2022] POST /identity/v3/projects => generated 383 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:27.168020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:27.215717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2269232-01ce-4c1b-913e-8943858f67a4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:27.415823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:27.416681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.424928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.425347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.426265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:27.429865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:27.501006 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1178/2323] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:27 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:27.501287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:27.521428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5efda-8311-4682-9d33-951d5d3d4047 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:27.531235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:27.532358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.532358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.532700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.533537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:27.535325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:27.563546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:27.565021 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1146/2324] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:27.584183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a172d-51b7-452c-9218-0d098b2cb213 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:27.603635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:27.604763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.605267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.605555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] PATH_INFO: `/v3/projects/a98fd0e0234146938deb8788aa25e7a5/users/5dafac00d5374f049f55ace60265dd95/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.630994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98fd0e0234146938deb8788aa25e7a5, user_id=5dafac00d5374f049f55ace60265dd95, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:27.636110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:27.661922 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1179/2325] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:27 2022] PUT /identity/v3/projects/a98fd0e0234146938deb8788aa25e7a5/users/5dafac00d5374f049f55ace60265dd95/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:27.667497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:27.684761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16533-2f6c-4bf3-94df-dfb3bdecf0a2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:27.793575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6c98-6290-421f-bc13-8962ad71514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:27.794518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6c98-6290-421f-bc13-8962ad71514a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.794837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6c98-6290-421f-bc13-8962ad71514a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.795117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6c98-6290-421f-bc13-8962ad71514a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.795876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6c98-6290-421f-bc13-8962ad71514a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:27.797706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6c98-6290-421f-bc13-8962ad71514a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:27.826128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1147/2326] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:27.826790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:27.853122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6f31-0226-46c1-9c8d-8255ec43cd11 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:27.861230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5107658-8bc1-4e1a-9dbc-c8fefdd68723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:27.868520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5107658-8bc1-4e1a-9dbc-c8fefdd68723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.869052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5107658-8bc1-4e1a-9dbc-c8fefdd68723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.869350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5107658-8bc1-4e1a-9dbc-c8fefdd68723 admin admin] PATH_INFO: `/v3/projects/a98fd0e0234146938deb8788aa25e7a5/users/5dafac00d5374f049f55ace60265dd95/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.873651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5107658-8bc1-4e1a-9dbc-c8fefdd68723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98fd0e0234146938deb8788aa25e7a5, user_id=5dafac00d5374f049f55ace60265dd95, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:27.877961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5107658-8bc1-4e1a-9dbc-c8fefdd68723 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:27.909439 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1180/2327] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:27 2022] PUT /identity/v3/projects/a98fd0e0234146938deb8788aa25e7a5/users/5dafac00d5374f049f55ace60265dd95/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:27.911009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:27.911246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:27.911446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:27.958007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] MFA Rules not processed for user `5dafac00d5374f049f55ace60265dd95`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:27.959711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:28.103968 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:28.132218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6fec4-0472-4aed-bb78-d5369127cf83 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:28.132560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6fec4-0472-4aed-bb78-d5369127cf83 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:28.132842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6fec4-0472-4aed-bb78-d5369127cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:28.134177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1148/2328] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:28.160850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-93a6fec4-0472-4aed-bb78-d5369127cf83 None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:28.162105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93a6fec4-0472-4aed-bb78-d5369127cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:28.258564 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1181/2329] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:28.549506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:28.638481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99023c4-14a9-44f2-adf1-ef9e8fe839e9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:28.645717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:28.646363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:28.646715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:28.646988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:28.656937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:28.658637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:28.682969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1149/2330] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:30.067808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:30.068766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:30.069276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:30.121688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] MFA Rules not processed for user `ab1cc3df201a44528353bea5e1c15714`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:30.123465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:30.262054 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:30.320256 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1182/2331] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:31.054756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:31.057131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:31.074164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26173d24-3e0e-4d32-b16f-fa6bfdd9003f service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:31.086529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:31.088285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:31.089182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:31.090007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:31.093872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:31.217335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:31.221736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1de4-56e3-4cc7-9c04-293afdd27881 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:31.254226 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1150/2332] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:33.433687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.435346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:33.578934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7f556-2c10-4cf7-ac97-503b61e3e18c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.585226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.586146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.586436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.586761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] PATH_INFO: `/v3/users/321d02bf4aa24b25821999d04d290dd3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.588236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=321d02bf4aa24b25821999d04d290dd3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.590417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.706383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321d02bf4aa24b25821999d04d290dd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.710146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321d02bf4aa24b25821999d04d290dd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.743873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321d02bf4aa24b25821999d04d290dd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.746229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321d02bf4aa24b25821999d04d290dd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.770437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321d02bf4aa24b25821999d04d290dd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.798619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1183/2333] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:33 2022] DELETE /identity/v3/users/321d02bf4aa24b25821999d04d290dd3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:33.802961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.803521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.803521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.829976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:33.832791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:33.939710 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1151/2334] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:33.964372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.966229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.004689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.006146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.035025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9253-2df6-4bf5-8993-8c2afc222a72 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.047632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.049032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.049576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.050084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] PATH_INFO: `/v3/users/b0e9269c55ce43e9b3240c1c4a96f6f6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.051704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e9269c55ce43e9b3240c1c4a96f6f6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.058242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.107786 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:34.123957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecbc86-a7d7-4205-89bf-f9d285ea1f5a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.134852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc51f-c320-4ddf-8d0b-922c3ee839e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.135700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc51f-c320-4ddf-8d0b-922c3ee839e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.136059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc51f-c320-4ddf-8d0b-922c3ee839e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.136755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc51f-c320-4ddf-8d0b-922c3ee839e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.163057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bc51f-c320-4ddf-8d0b-922c3ee839e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.165028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bc51f-c320-4ddf-8d0b-922c3ee839e0 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.166301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e9269c55ce43e9b3240c1c4a96f6f6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.192562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1184/2335] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:34.194957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e9269c55ce43e9b3240c1c4a96f6f6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.212272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e9269c55ce43e9b3240c1c4a96f6f6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.227474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e9269c55ce43e9b3240c1c4a96f6f6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.229691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e9269c55ce43e9b3240c1c4a96f6f6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.271812 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1152/2336] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:34 2022] DELETE /identity/v3/users/b0e9269c55ce43e9b3240c1c4a96f6f6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:34.272054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facfd5-724a-4595-8eb8-fae08bb9b474 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.272282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facfd5-724a-4595-8eb8-fae08bb9b474 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.272390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facfd5-724a-4595-8eb8-fae08bb9b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.300808 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:34.383410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-19facfd5-724a-4595-8eb8-fae08bb9b474 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:34.391732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19facfd5-724a-4595-8eb8-fae08bb9b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.671486 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1185/2337] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:34.716060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.718542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.809045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3dd1d-09f0-40d9-9cde-da89cdc2f2c5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.813730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1459b8-c5ef-4502-b8db-0ede641c64f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.814644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1459b8-c5ef-4502-b8db-0ede641c64f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.815122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1459b8-c5ef-4502-b8db-0ede641c64f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.815547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1459b8-c5ef-4502-b8db-0ede641c64f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.841332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1459b8-c5ef-4502-b8db-0ede641c64f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.843664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1459b8-c5ef-4502-b8db-0ede641c64f8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.874438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1153/2338] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:35.133452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f500e-e841-4db3-a492-97b6606c520b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.134047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f500e-e841-4db3-a492-97b6606c520b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.134471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f500e-e841-4db3-a492-97b6606c520b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.137135 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1186/2339] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:35.152665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.152829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.153016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.187761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:35.189063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.352767 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1154/2340] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:35.375704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f500e-e841-4db3-a492-97b6606c520b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.375704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5e0f500e-e841-4db3-a492-97b6606c520b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.398469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f500e-e841-4db3-a492-97b6606c520b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.408611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.409991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.410650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.411202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.439944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.444284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.468010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.469447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.472622 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1187/2341] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:35.490916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9562-3b1e-46e4-bfbf-4d285e2cc235 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.497361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.498885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.499319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.499741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] PATH_INFO: `/v3/users/a72b6a0b89a54de4a3c2835f462b7069` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.501820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72b6a0b89a54de4a3c2835f462b7069)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.504445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.574481 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:35.603397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72b6a0b89a54de4a3c2835f462b7069'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:35.638100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72b6a0b89a54de4a3c2835f462b7069'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:35.658081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72b6a0b89a54de4a3c2835f462b7069'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:35.670485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72b6a0b89a54de4a3c2835f462b7069'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:35.674848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72b6a0b89a54de4a3c2835f462b7069'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:35.675986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.678878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.698308 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1155/2342] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:35 2022] DELETE /identity/v3/users/a72b6a0b89a54de4a3c2835f462b7069 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:35.775515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e0191-4c72-4f3e-bd0c-1c40c33e9c92 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.970193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.971438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.972787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.973252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] PATH_INFO: `/v3/projects/43823dd717a24efdaf57302317a821e4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.974958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43823dd717a24efdaf57302317a821e4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.978764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.176493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43823dd717a24efdaf57302317a821e4', 'request_id': 'req-d21474da-1112-40be-a66e-171172ab928b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.190414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43823dd717a24efdaf57302317a821e4', 'request_id': 'req-d21474da-1112-40be-a66e-171172ab928b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.201504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43823dd717a24efdaf57302317a821e4', 'request_id': 'req-d21474da-1112-40be-a66e-171172ab928b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.218453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] The token cache is being invalidate because project 43823dd717a24efdaf57302317a821e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:36.219163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.220599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.227706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.229136 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1188/2343] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:35 2022] DELETE /identity/v3/projects/43823dd717a24efdaf57302317a821e4 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:36.229366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.250474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f684510-6e5e-41bd-ba09-4c16b975a672 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:36.339749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:36.340644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.340980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.341263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] PATH_INFO: `/v3/users/353f2b767ee3436f87cf8b7e950edf6f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.342638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] RBAC: Authorizing `identity:delete_user(user_id=353f2b767ee3436f87cf8b7e950edf6f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:36.344652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.463199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353f2b767ee3436f87cf8b7e950edf6f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.471099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.472957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.501605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21474da-1112-40be-a66e-171172ab928b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:36.505051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353f2b767ee3436f87cf8b7e950edf6f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.523349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:36.524683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.525344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.526855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] PATH_INFO: `/v3/projects/3a6f5d726c264f8a8fd9ac80db9f96da` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.530687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6f5d726c264f8a8fd9ac80db9f96da)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:36.536242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.545201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353f2b767ee3436f87cf8b7e950edf6f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.575186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353f2b767ee3436f87cf8b7e950edf6f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.578854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7da67372-0717-42f0-a466-e8999527068b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353f2b767ee3436f87cf8b7e950edf6f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.600437 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:36.622923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1156/2344] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:36 2022] DELETE /identity/v3/users/353f2b767ee3436f87cf8b7e950edf6f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:36.687146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6f5d726c264f8a8fd9ac80db9f96da', 'request_id': 'req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.697622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6f5d726c264f8a8fd9ac80db9f96da', 'request_id': 'req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.733049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6f5d726c264f8a8fd9ac80db9f96da', 'request_id': 'req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.759333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] The token cache is being invalidate because project 3a6f5d726c264f8a8fd9ac80db9f96da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:36.759668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.760882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.763291 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1189/2345] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:36 2022] DELETE /identity/v3/projects/3a6f5d726c264f8a8fd9ac80db9f96da => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:36.774784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076f111-210e-4285-a262-4761cb1a2a9e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.775663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076f111-210e-4285-a262-4761cb1a2a9e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.776263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076f111-210e-4285-a262-4761cb1a2a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.830473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.831865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.834197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b076f111-210e-4285-a262-4761cb1a2a9e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:36.835996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b076f111-210e-4285-a262-4761cb1a2a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.934836 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:36.988253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644fa35-ae56-4c7e-87ba-bdbd78bffefc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.000766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.001658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.001943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.002221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] PATH_INFO: `/v3/projects/bc5d9e6092e640d6b258e5d0e172870d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.003535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5d9e6092e640d6b258e5d0e172870d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.005498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.073936 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1157/2346] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.086476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56145e-e5c8-47e1-8637-e6cb0e268ef4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.087041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56145e-e5c8-47e1-8637-e6cb0e268ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.087565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56145e-e5c8-47e1-8637-e6cb0e268ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.137981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1a56145e-e5c8-47e1-8637-e6cb0e268ef4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.141253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a56145e-e5c8-47e1-8637-e6cb0e268ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.174745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5d9e6092e640d6b258e5d0e172870d', 'request_id': 'req-1035aa6d-7562-43c4-8ae0-83e36dab57d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.185584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5d9e6092e640d6b258e5d0e172870d', 'request_id': 'req-1035aa6d-7562-43c4-8ae0-83e36dab57d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.193411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5d9e6092e640d6b258e5d0e172870d', 'request_id': 'req-1035aa6d-7562-43c4-8ae0-83e36dab57d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.216335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] The token cache is being invalidate because project bc5d9e6092e640d6b258e5d0e172870d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:37.217038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.228165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1035aa6d-7562-43c4-8ae0-83e36dab57d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.233159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1190/2347] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:36 2022] DELETE /identity/v3/projects/bc5d9e6092e640d6b258e5d0e172870d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:37.237010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.237010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.237010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.276782 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1158/2348] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.281245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.281640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.282023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.283335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] MFA Rules not processed for user `f4fb9a3eacf448578b8ba8a8cb7f33c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.284574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.321753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.323790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.333778 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1159/2349] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.335048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.353164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35493-5fa2-4ab3-b5bc-a7ed642e4a84 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.360896 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:37.378910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.380077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.380737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.381912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.383082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:37.384454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.388690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902788-0346-4893-b7f7-ed6e6a750075 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.417778 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1160/2350] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:37.420323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.420899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.421392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.425556 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1191/2351] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.426565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.446077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86913c5-be58-4c31-bd68-c133b48830e1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.452176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.454682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.457572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.458282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.458587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.458874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.459592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.461627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.471660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1161/2352] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.476035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.505338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239819a-f4dc-4fac-95ba-6dec10d40833 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.512310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.513482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.514026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.514139 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1192/2353] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/projects => generated 395 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:37.515089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.517846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:37.518321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.519179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.523800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.568762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1162/2354] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:37.574192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.586294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf123b-3869-47a8-8b52-699f82e63f44 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.632372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729e602-19f2-4c9d-bafe-6e9a41e92c06 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.641782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.642927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.643422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.643904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.644860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.647822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.670981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.672236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.672932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.673821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.681087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.684564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.688762 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1193/2355] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:37.693913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.716895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab048-2953-41d8-8e99-55263b934de6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.734149 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1163/2356] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/projects => generated 395 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:37.738485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.741615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.742297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.742608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.742883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.743622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.745762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.766584 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1194/2357] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:37.768251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.771451 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:37.780606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630717d-8def-4f92-9d5a-fc1a88193a71 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.889173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f67ec-df4c-41d4-b1fc-2584fe804089 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.896033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.897088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.897563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.898029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.898281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.899058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.899357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.900436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.900838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.901668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.903046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.903852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.923623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1195/2358] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:37.924685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.926628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.934031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1164/2359] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:37.935011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.947196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855ddc-4285-46b7-9249-4abbe40ac851 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.953517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e3e6a-ca3d-4eb7-b2f7-699272bb9093 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.958910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.960037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.960345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.960687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] PATH_INFO: `/v3/projects/e1defab0e11f4b349a525916424d1b4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.962099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1defab0e11f4b349a525916424d1b4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.964369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.965024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.966433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.966822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.967175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] PATH_INFO: `/v3/projects/118e0a3efbd14eb7b5e18477a25bfe82/users/8599707377e644b5a083586b2d46654f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.990238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118e0a3efbd14eb7b5e18477a25bfe82, user_id=8599707377e644b5a083586b2d46654f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.993851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.016834 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1165/2360] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:37 2022] PUT /identity/v3/projects/118e0a3efbd14eb7b5e18477a25bfe82/users/8599707377e644b5a083586b2d46654f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:38.017731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.024313 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:38.054615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1defab0e11f4b349a525916424d1b4b', 'request_id': 'req-e93cc19f-5346-491b-afef-488b9d1e8fbc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:38.071258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1defab0e11f4b349a525916424d1b4b', 'request_id': 'req-e93cc19f-5346-491b-afef-488b9d1e8fbc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:38.087138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1defab0e11f4b349a525916424d1b4b', 'request_id': 'req-e93cc19f-5346-491b-afef-488b9d1e8fbc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:38.112173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] The token cache is being invalidate because project e1defab0e11f4b349a525916424d1b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:38.112542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:38.114092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e93cc19f-5346-491b-afef-488b9d1e8fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:38.117211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1196/2361] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:37 2022] DELETE /identity/v3/projects/e1defab0e11f4b349a525916424d1b4b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:38.120990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023b3-7584-4396-9807-9c5edb75cb62 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.121419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023b3-7584-4396-9807-9c5edb75cb62 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.121772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023b3-7584-4396-9807-9c5edb75cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.153386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc44d6-8f4d-4a57-ac57-c4a669f5e890 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.163705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a7a023b3-7584-4396-9807-9c5edb75cb62 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:38.165649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a7a023b3-7584-4396-9807-9c5edb75cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.255127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cf3a8-69f6-4dbc-8133-451e091105c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.255962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf3a8-69f6-4dbc-8133-451e091105c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.256346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf3a8-69f6-4dbc-8133-451e091105c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.256695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf3a8-69f6-4dbc-8133-451e091105c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.257762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cf3a8-69f6-4dbc-8133-451e091105c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.260909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cf3a8-69f6-4dbc-8133-451e091105c4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.281779 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1166/2362] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:38.283116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.283476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.283835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.314068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:38.316830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.337375 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1167/2363] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:38.337375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.337375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.344414 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1197/2364] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:38.346173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.346732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.347219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.348667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc35ea-c67a-44f0-b341-80138307ed76 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.362425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.363930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.364831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.366609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.368310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.376619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.386279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:38.388959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.402125 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1198/2365] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:38.402125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.406473 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1168/2366] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:38.406473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.408465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.418958 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:38.428074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a96bb-274d-49ea-a9ed-365b2aa72b4e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.452035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.453386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.453659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.453952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.456398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:38.456985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.459214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.491721 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1169/2367] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:38.492678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.501743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528ed5-9314-4385-90f4-9652fbd8b003 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.505246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114f94-3b2e-4e18-9700-c180bddef4a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.506280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.506952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.507238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.507516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.514701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa0f1-cd83-41fc-ac4c-692ace547218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.514701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa0f1-cd83-41fc-ac4c-692ace547218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.515063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa0f1-cd83-41fc-ac4c-692ace547218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.515459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa0f1-cd83-41fc-ac4c-692ace547218 admin admin] PATH_INFO: `/v3/projects/ead8b86484c04ed3afd6e9ea3140201d/users/624b18dd77124d02952b6c3e468ff52b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.517924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.520643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.536039 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1199/2368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:38.537376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.550845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbedf5-cf2a-4a14-98df-a4bc7aefe102 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.555132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aa0f1-cd83-41fc-ac4c-692ace547218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead8b86484c04ed3afd6e9ea3140201d, user_id=624b18dd77124d02952b6c3e468ff52b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.557178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.558743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.559033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.559311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.561749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aa0f1-cd83-41fc-ac4c-692ace547218 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.562148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.564175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.589588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1170/2369] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:38 2022] PUT /identity/v3/projects/ead8b86484c04ed3afd6e9ea3140201d/users/624b18dd77124d02952b6c3e468ff52b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:38.604721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.605062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.605472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.612583 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1200/2370] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:38.618203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.681582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] MFA Rules not processed for user `624b18dd77124d02952b6c3e468ff52b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:38.683812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.699316 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:38.747216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52cbd-23b6-4288-b301-abba23bb87be admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.753950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.755433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.755901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.756154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.757098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.759682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.799241 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1171/2371] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:38.811378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1201/2372] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:38.812366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.836746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7489d6-f010-4ebe-9820-e6225d54f43c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.844225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.845619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.845619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.845619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.846252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.848020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.860603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1202/2373] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:38.865355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.888066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288080-8d9e-4294-97e5-780cdcb8b10b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.913847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.914571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.914861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.915138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.915899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.931819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.989540 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1172/2374] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:38.990096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:39.007322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66075b94-9328-4b5c-a533-1f6cc0ac4eb9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:39.021505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb49e98-a468-497c-beb3-ec91b2fd76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:39.024212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb49e98-a468-497c-beb3-ec91b2fd76a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.025208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb49e98-a468-497c-beb3-ec91b2fd76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.025767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb49e98-a468-497c-beb3-ec91b2fd76a9 admin admin] PATH_INFO: `/v3/projects/1466b5aa09bf47d0a83a64044c4c5135/users/9f6f7e23726642dda7d37c007beadb63/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.070053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:39.072772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:39.073490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb49e98-a468-497c-beb3-ec91b2fd76a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1466b5aa09bf47d0a83a64044c4c5135, user_id=9f6f7e23726642dda7d37c007beadb63, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:39.078917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb49e98-a468-497c-beb3-ec91b2fd76a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:39.110604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1203/2375] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:38 2022] PUT /identity/v3/projects/1466b5aa09bf47d0a83a64044c4c5135/users/9f6f7e23726642dda7d37c007beadb63/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:39.120158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.120426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.120614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.184952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] MFA Rules not processed for user `9f6f7e23726642dda7d37c007beadb63`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:39.188577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:39.256546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a279b79-3c86-4301-b794-24142fc083a5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:39.360345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1204/2376] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:39.361591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:39.371525 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:39.441605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081f33f-56fd-4e5e-8b9f-be186159597e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:39.442451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081f33f-56fd-4e5e-8b9f-be186159597e service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.442941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081f33f-56fd-4e5e-8b9f-be186159597e service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.443372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081f33f-56fd-4e5e-8b9f-be186159597e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.530666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d0367-2fb5-4664-bef8-cc92d2484a72 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:39.536124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:39.536814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.537104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.537387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.538285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:39.540398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:39.566692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081f33f-56fd-4e5e-8b9f-be186159597e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:39.570233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081f33f-56fd-4e5e-8b9f-be186159597e service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:39.573196 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:39.592870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1205/2377] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:39 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:39.597768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:39.669325 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1173/2378] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:39.746691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.746943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.747390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.796927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] MFA Rules not processed for user `624b18dd77124d02952b6c3e468ff52b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:39.798305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:39.806592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f28df-9157-408a-97a1-280610429856 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:39.829224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:39.830331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.830834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.831320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.832236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:39.834240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:39.894399 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1206/2379] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:39 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:39.898878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:39.936069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04abc1-8349-4ea7-98c0-a8ffbde28265 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:39.948384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:39.949175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.949465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.949747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:39.950521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:39.953361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:39.967237 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1207/2380] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:39.971667 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1174/2381] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:39.972606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:39.987528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20832-a4a2-4227-a1ac-53a8ab9d4533 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:39.995926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:39.997116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:39.997406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:39.997688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] PATH_INFO: `/v3/projects/81337b5e50544c7288f03b4266b43d80/users/229c4e4a6b5744a29a5f0013562481f5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.024801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81337b5e50544c7288f03b4266b43d80, user_id=229c4e4a6b5744a29a5f0013562481f5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.042404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.085202 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1208/2382] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:39 2022] PUT /identity/v3/projects/81337b5e50544c7288f03b4266b43d80/users/229c4e4a6b5744a29a5f0013562481f5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:40.090312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.109190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159c09e-cce5-4ec4-a512-1191f17cc2f9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:40.206134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd435-2815-4ed5-a41b-643d263e7116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:40.206856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd435-2815-4ed5-a41b-643d263e7116 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.207137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd435-2815-4ed5-a41b-643d263e7116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.207422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd435-2815-4ed5-a41b-643d263e7116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.208925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd435-2815-4ed5-a41b-643d263e7116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.209939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd435-2815-4ed5-a41b-643d263e7116 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.225803 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1175/2383] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:40.230742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.250720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bab64-c1e6-4b82-bb4b-9ae082bef279 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:40.262325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:40.264393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.264923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.265591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] PATH_INFO: `/v3/projects/81337b5e50544c7288f03b4266b43d80/users/229c4e4a6b5744a29a5f0013562481f5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.273289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81337b5e50544c7288f03b4266b43d80, user_id=229c4e4a6b5744a29a5f0013562481f5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.279679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.297548 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1209/2384] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:40 2022] PUT /identity/v3/projects/81337b5e50544c7288f03b4266b43d80/users/229c4e4a6b5744a29a5f0013562481f5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:40.308383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.308383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.308383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.344063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] MFA Rules not processed for user `229c4e4a6b5744a29a5f0013562481f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:40.345395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:40.370056 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:40.504649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.505927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1176/2385] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:40.507514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.527467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904ca0-57de-4137-bbfc-265e722e68df None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:40.533657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:40.534650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.534987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.535335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.536312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:40.537056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.539110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.582650 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1177/2386] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:40.583651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.595927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1ca93-74c1-4352-a38e-565f823d9417 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:40.602411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:40.603610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.603997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.604362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.605559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.606481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc8b9-32af-47b9-a109-94bbb2145510 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:40.609592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.613943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:40.615603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.615897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.616305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] PATH_INFO: `/v3/users/624b18dd77124d02952b6c3e468ff52b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.622480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624b18dd77124d02952b6c3e468ff52b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.627081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.663722 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1178/2387] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:40 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:40.667849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.716775 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:40.721412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624b18dd77124d02952b6c3e468ff52b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:40.723757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624b18dd77124d02952b6c3e468ff52b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:40.755790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624b18dd77124d02952b6c3e468ff52b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:40.756749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624b18dd77124d02952b6c3e468ff52b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:40.773568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e6845e9-5e13-4f54-a99b-46bde0b07de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624b18dd77124d02952b6c3e468ff52b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:40.786213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4eb82-31aa-44a1-93e6-0979d9daa5c4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:40.795604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:40.796350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.796646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.797108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.798004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:40.798387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:40.800712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:40.808358 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1210/2388] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:40 2022] DELETE /identity/v3/users/624b18dd77124d02952b6c3e468ff52b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:40.810836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:40.811149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:40.811436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:40.816539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1179/2389] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:40.840574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:40.841872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:40.913880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:40.916962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:40.968126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1211/2390] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:41.016515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:41.017778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:41.050401 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:41.056834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2edda9-eaec-4bdc-a7cf-3458eac03cae tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:41.197725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806078c-67b5-4f9f-bcd8-a0c87019f020 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:41.202315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:41.203707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:41.204481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:41.204866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:41.206759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f45d55-81e7-4479-a6fd-df01b009e219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:41.207247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:41.207504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45d55-81e7-4479-a6fd-df01b009e219 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:41.208859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45d55-81e7-4479-a6fd-df01b009e219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:41.209163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45d55-81e7-4479-a6fd-df01b009e219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:41.222888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f45d55-81e7-4479-a6fd-df01b009e219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:41.224604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f45d55-81e7-4479-a6fd-df01b009e219 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:41.243220 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1212/2391] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:41.312859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:41.319283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:41.357388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1180/2392] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:41.380402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79457-2c49-45d8-ab51-2795b15f789b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:41.380800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79457-2c49-45d8-ab51-2795b15f789b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:41.381002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79457-2c49-45d8-ab51-2795b15f789b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:41.382524 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1213/2393] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:41.395048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:41.427057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:41.456304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768643c-8a13-4305-9a62-9884a1f47eb1 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:41.488630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:41.491968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:41.492688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:41.492688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:41.498248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=64c1dc9cbc4b463c8d21d1e4d28b478e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:41.509682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:41.511689 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1181/2394] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:41 2022] GET /identity/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e => generated 369 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:47:41.580478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc0c8-8a1d-4dae-9ca1-11d32f79f9f7 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:41.580756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc0c8-8a1d-4dae-9ca1-11d32f79f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:41.581129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc0c8-8a1d-4dae-9ca1-11d32f79f9f7 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:41.583171 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1214/2395] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:41.588850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:41.606068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:41.621717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033dba-2336-42b0-9ee8-1394d72f5ed6 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:41.630297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:41.632487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:41.632995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:41.633581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:41.635533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=64c1dc9cbc4b463c8d21d1e4d28b478e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:41.642870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:41.660921 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1182/2396] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:41 2022] GET /identity/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e => generated 369 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:42.248731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951553-a8b5-4301-8900-3776f01c7036 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.249321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951553-a8b5-4301-8900-3776f01c7036 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.250511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951553-a8b5-4301-8900-3776f01c7036 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.254778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1215/2397] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:42.264317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:42.267305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:42.293622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.311223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38bc90-5ec5-4d32-b9f0-eab99c48be72 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.318091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.319881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.320189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.320480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.321967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=64c1dc9cbc4b463c8d21d1e4d28b478e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:42.325248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:42.341343 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1183/2398] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:42 2022] GET /identity/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e => generated 369 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:42.358605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951553-a8b5-4301-8900-3776f01c7036 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.398075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951553-a8b5-4301-8900-3776f01c7036 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.421332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.422295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.422792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.423167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.425304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64c1dc9cbc4b463c8d21d1e4d28b478e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:42.427559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:42.528496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c1dc9cbc4b463c8d21d1e4d28b478e', 'request_id': 'req-08ba0afe-67a1-4aca-a896-de1a891dc14f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.547005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c1dc9cbc4b463c8d21d1e4d28b478e', 'request_id': 'req-08ba0afe-67a1-4aca-a896-de1a891dc14f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.552919 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:42.556288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c1dc9cbc4b463c8d21d1e4d28b478e', 'request_id': 'req-08ba0afe-67a1-4aca-a896-de1a891dc14f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.580813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] The token cache is being invalidate because project 64c1dc9cbc4b463c8d21d1e4d28b478e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:42.581587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.582808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.599433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1216/2399] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:42 2022] DELETE /identity/v3/projects/64c1dc9cbc4b463c8d21d1e4d28b478e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:42.766194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.772962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:42.805837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131e6d-0312-4422-a567-5db5145c5869 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.960130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.960956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.961324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.961681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.965608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:42.972749 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:43.047879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.050520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.144903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.147901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86c77f-669b-4741-b4a7-8dede25250ab service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.171998 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1184/2400] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:43.361770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0afe-67a1-4aca-a896-de1a891dc14f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.372458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.373743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.374029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.374309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] PATH_INFO: `/v3/projects/ead8b86484c04ed3afd6e9ea3140201d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.383569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead8b86484c04ed3afd6e9ea3140201d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.391106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.512059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead8b86484c04ed3afd6e9ea3140201d', 'request_id': 'req-ea243ffd-a680-4d88-8f4d-18e064084068'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.552701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead8b86484c04ed3afd6e9ea3140201d', 'request_id': 'req-ea243ffd-a680-4d88-8f4d-18e064084068'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.579906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead8b86484c04ed3afd6e9ea3140201d', 'request_id': 'req-ea243ffd-a680-4d88-8f4d-18e064084068'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.598435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] The token cache is being invalidate because project ead8b86484c04ed3afd6e9ea3140201d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:43.598834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.599799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea243ffd-a680-4d88-8f4d-18e064084068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.602771 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1217/2401] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:43 2022] DELETE /identity/v3/projects/ead8b86484c04ed3afd6e9ea3140201d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:43.607343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6d47-d35a-4621-9c7f-c03bf1d1c3b7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.608047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6d47-d35a-4621-9c7f-c03bf1d1c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.608490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6d47-d35a-4621-9c7f-c03bf1d1c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.634021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-59ec6d47-d35a-4621-9c7f-c03bf1d1c3b7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:43.636841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-59ec6d47-d35a-4621-9c7f-c03bf1d1c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.652547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.653183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.653645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.656842 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1218/2402] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:47:43.662662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:43.665496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.771222 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1185/2403] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:43.778750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.779268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.779773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.823357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:43.825150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.837904 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1186/2404] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:43.839491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.841923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.846054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.862150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8ea09-7764-4df6-9185-4ba9de1bc928 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.868892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.870421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.870848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.871293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.872633 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:43.874058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:43.874581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.877819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.904454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1187/2405] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:47:43.905579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.939166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46fc25-4a94-453c-80ed-09f22db520e2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.948150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.949971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.950617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.951217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.953083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.954330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.990013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b7ffe-d2f8-4f41-b7af-738d466b6fb8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.009499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.010859 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1188/2406] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:44.012464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.012760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.013044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/1466b5aa09bf47d0a83a64044c4c5135` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.015958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.017479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=1466b5aa09bf47d0a83a64044c4c5135)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.019636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.021950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1219/2407] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:43 2022] GET /identity/v3/projects/1466b5aa09bf47d0a83a64044c4c5135 => generated 371 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:44.046794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.065604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bd47-698f-4dbd-93c6-57d4df0c6bde tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.173899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e058f-319b-4d59-a06a-8fb8c8974c9d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.191917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.192863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.193366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.193800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.194888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.204459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.219408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.220324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.220918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.220918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.221684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:44.222009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.223776 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:44.224739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.245975 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1220/2408] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:44.250413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.261473 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1189/2409] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:44 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:44.261941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.267766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1934e9-27d6-4f83-89b4-4e65521fb935 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.277101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.278142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.278437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.278780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.279587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e716ef-24c5-40d5-8069-ac37698d3fe7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.279783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.282320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.297696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.298286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.298620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.298946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.299854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.302534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.329980 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1190/2410] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:44.334348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.352498 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1221/2411] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:44 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:44.358010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aaaf9-75ca-409f-aca8-617ec6ad0ae1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.359346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.497761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.498469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.498792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.499121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.499831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.501526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.521848 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1191/2412] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:44.522650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.554418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae027e4-f312-4489-b155-5056b7b9e763 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.571584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1857-559f-47be-aa0d-3769b645a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.572532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1857-559f-47be-aa0d-3769b645a9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.572826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1857-559f-47be-aa0d-3769b645a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.573198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1857-559f-47be-aa0d-3769b645a9d9 admin admin] PATH_INFO: `/v3/projects/440c741054a64fd791cd96cc124d3d22/users/58ce5615a9284a548acea20f6f6e6390/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.619552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a1857-559f-47be-aa0d-3769b645a9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c741054a64fd791cd96cc124d3d22, user_id=58ce5615a9284a548acea20f6f6e6390, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.622376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a1857-559f-47be-aa0d-3769b645a9d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.660588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1192/2413] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:44 2022] PUT /identity/v3/projects/440c741054a64fd791cd96cc124d3d22/users/58ce5615a9284a548acea20f6f6e6390/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:44.668777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.669050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.669333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.677981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d21cfc-ba05-4be4-be2d-dc4d677fe370 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.716088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:44.717395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:44.803642 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:44.859576 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1193/2414] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:44.937515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.939194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.942090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.942717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.944151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:44.944699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.949501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a98d-9b3c-4af4-813c-6496b1165eba tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.968402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.969926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:45.010933 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1222/2415] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 652 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:45.112205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9e551-2855-4645-84b8-0803bce4f924 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:45.122998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681e742-8bd1-403e-bccc-6c7ad318f2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:45.123682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e742-8bd1-403e-bccc-6c7ad318f2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:45.123986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e742-8bd1-403e-bccc-6c7ad318f2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:45.124294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e742-8bd1-403e-bccc-6c7ad318f2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:45.143560 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:45.155380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681e742-8bd1-403e-bccc-6c7ad318f2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:45.157077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681e742-8bd1-403e-bccc-6c7ad318f2b0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:45.177731 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1194/2416] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:45.775100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c78882-be70-4c18-ba36-0ba2e14ff3c3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:45.776906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c78882-be70-4c18-ba36-0ba2e14ff3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:45.777853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c78882-be70-4c18-ba36-0ba2e14ff3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:45.820016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:45.822536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:45.823698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:45.830049 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1195/2417] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:47:45.857927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:45.860302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:45.867392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-19c78882-be70-4c18-ba36-0ba2e14ff3c3 None None] MFA Rules not processed for user `0f1db17e1fcd448f95650bfd6e0fc45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:45.870788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19c78882-be70-4c18-ba36-0ba2e14ff3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:46.055139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:46.103289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63668a-6954-4baf-8c49-1edf984f3218 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:46.110912 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1223/2418] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:46.115070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:46.117473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:46.117715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:46.118183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/508a17d957be41ec948c9bc680ec3443` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:46.123393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=508a17d957be41ec948c9bc680ec3443)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:46.127823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:46.133280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1196/2419] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:45 2022] GET /identity/v3/projects/508a17d957be41ec948c9bc680ec3443 => generated 371 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:46.427648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f01e-cc5a-4afe-89c6-694b9a38306f None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:46.428150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f01e-cc5a-4afe-89c6-694b9a38306f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:46.428636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f01e-cc5a-4afe-89c6-694b9a38306f None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:46.430777 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1224/2420] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:46.439067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:46.468474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:46.484538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18416-2344-4ea5-a985-178f76ee6397 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:46.491177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:46.492298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:46.492843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:46.493831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/508a17d957be41ec948c9bc680ec3443` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:46.496402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=508a17d957be41ec948c9bc680ec3443)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:46.498921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:46.517608 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1197/2421] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:46 2022] GET /identity/v3/projects/508a17d957be41ec948c9bc680ec3443 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:46.585417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f01e-cc5a-4afe-89c6-694b9a38306f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:46.622848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f01e-cc5a-4afe-89c6-694b9a38306f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:46.629111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:46.630170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:46.630750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:46.631223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:46.643794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:46.645587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:46.651355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:46.694676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1225/2422] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:46.699319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:46.711638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037d25-537b-4bbc-b54b-161fb3e9268b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:46.733560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bb099-31f8-4748-94e3-148c2d0b604b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:46.735216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb099-31f8-4748-94e3-148c2d0b604b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:46.739524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb099-31f8-4748-94e3-148c2d0b604b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:46.740904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb099-31f8-4748-94e3-148c2d0b604b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:46.744728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bb099-31f8-4748-94e3-148c2d0b604b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:46.750373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bb099-31f8-4748-94e3-148c2d0b604b tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:46.824726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1198/2423] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:46 2022] POST /identity/v3/users => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:46.827139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:46.841817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3190ab-5b2d-4bb5-a0e0-1625b4b9c0f5 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:46.851338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:46.852455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:46.852956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:46.853497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:46.855770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:46.856251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:46.858840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:46.898729 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1226/2424] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:47.227368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78fa96-924a-4d31-8a11-214554937733 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:47.229547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78fa96-924a-4d31-8a11-214554937733 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:47.230118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78fa96-924a-4d31-8a11-214554937733 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:47.232817 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1199/2425] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:47.240076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:47.262031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:47.276754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dde7e-eda7-4934-9630-accd05415af8 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:47.285766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f72b30-f340-48d0-a0ee-b00fb4ecdd3f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:47.287129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72b30-f340-48d0-a0ee-b00fb4ecdd3f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:47.288369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72b30-f340-48d0-a0ee-b00fb4ecdd3f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:47.289145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72b30-f340-48d0-a0ee-b00fb4ecdd3f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/508a17d957be41ec948c9bc680ec3443` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:47.292296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f72b30-f340-48d0-a0ee-b00fb4ecdd3f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=508a17d957be41ec948c9bc680ec3443)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:47.297056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f72b30-f340-48d0-a0ee-b00fb4ecdd3f tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:47.301265 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1227/2426] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:47 2022] GET /identity/v3/projects/508a17d957be41ec948c9bc680ec3443 => generated 371 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:47.525809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b99f-68f9-424d-b4c0-3bd5ca88948c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:47.526331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b99f-68f9-424d-b4c0-3bd5ca88948c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:47.526938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b99f-68f9-424d-b4c0-3bd5ca88948c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:47.528189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:47.528488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:47.528769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:47.530392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1228/2427] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:47.536016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b99f-68f9-424d-b4c0-3bd5ca88948c None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:47.551746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] MFA Rules not processed for user `95220b51119941dfbe6e9c35b8708c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:47.553549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:47.578819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b99f-68f9-424d-b4c0-3bd5ca88948c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:47.598597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b99f-68f9-424d-b4c0-3bd5ca88948c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:47.605649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:47.606813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:47.607349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:47.607898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/508a17d957be41ec948c9bc680ec3443` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:47.609877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=508a17d957be41ec948c9bc680ec3443)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:47.612892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:47.616174 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1229/2428] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:47 2022] GET /identity/v3/projects/508a17d957be41ec948c9bc680ec3443 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:47:47.669939 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1200/2429] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:47.675630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:47.692664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246291d-dcaf-4bab-a209-652bbfe70c56 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:47.707106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:47.711188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:47.711779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:47.712295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/users/5d719e9cc5e74062a95e8c7ef0abc61d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:47.741628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5d719e9cc5e74062a95e8c7ef0abc61d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:47.745620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:47.859437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d719e9cc5e74062a95e8c7ef0abc61d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:47.864559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d719e9cc5e74062a95e8c7ef0abc61d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:47.898788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d719e9cc5e74062a95e8c7ef0abc61d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:47.900178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d719e9cc5e74062a95e8c7ef0abc61d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:47.911622 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:47.914597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f323bd9-2b21-44ed-84fb-e531d4d0e3f4 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d719e9cc5e74062a95e8c7ef0abc61d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:47.973187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:47.973446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1230/2430] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:47 2022] DELETE /identity/v3/users/5d719e9cc5e74062a95e8c7ef0abc61d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:47.998243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ed79-b1cd-40fa-9beb-9f7370b9e965 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:48.146260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:48.147299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:48.147777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:48.148519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/508a17d957be41ec948c9bc680ec3443` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:48.150352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=508a17d957be41ec948c9bc680ec3443)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:48.153774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:48.162813 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:48.236501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508a17d957be41ec948c9bc680ec3443', 'request_id': 'req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.263549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508a17d957be41ec948c9bc680ec3443', 'request_id': 'req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.275104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508a17d957be41ec948c9bc680ec3443', 'request_id': 'req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.296922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] The token cache is being invalidate because project 508a17d957be41ec948c9bc680ec3443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:48.297593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.298757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.301636 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1201/2431] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:47 2022] DELETE /identity/v3/projects/508a17d957be41ec948c9bc680ec3443 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:49.223278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f17999-d624-47fd-8fed-5661eb7ad2d8 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:49.224119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f17999-d624-47fd-8fed-5661eb7ad2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:49.224551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f17999-d624-47fd-8fed-5661eb7ad2d8 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:49.226426 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1231/2432] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:49.238377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:49.240627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:49.433122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:49.437493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:49.678903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0b2f-9eaf-4774-9214-bce8aa905a78 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:49.691956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:49.692864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:49.697729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:49.698420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/1466b5aa09bf47d0a83a64044c4c5135` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:49.699945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=1466b5aa09bf47d0a83a64044c4c5135)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:49.704712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:49.710729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1202/2433] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:49 2022] GET /identity/v3/projects/1466b5aa09bf47d0a83a64044c4c5135 => generated 371 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:50.118885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4689-e617-4a74-94f5-264841f17112 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.119771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4689-e617-4a74-94f5-264841f17112 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.120661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4689-e617-4a74-94f5-264841f17112 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.122619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1232/2434] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:50.135981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:50.138041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:50.161501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.192006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434de04-f5c6-4c74-9ce5-900e18c4d368 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.212738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.213656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.214298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.214298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/1466b5aa09bf47d0a83a64044c4c5135` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.216966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=1466b5aa09bf47d0a83a64044c4c5135)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.220477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.231588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1203/2435] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:50 2022] GET /identity/v3/projects/1466b5aa09bf47d0a83a64044c4c5135 => generated 371 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:51.068696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c5ce-70b6-4b63-a661-16886b7ce684 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.069341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c5ce-70b6-4b63-a661-16886b7ce684 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.069341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c5ce-70b6-4b63-a661-16886b7ce684 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.070964 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1233/2436] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:47:51.088317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:47:51.106723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:51.128524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654392d-acc5-4fcc-bdb8-4fe8d29af082 tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:51.135886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1243-ac74-48eb-8843-54573741fb2e tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229c4e4a6b5744a29a5f0013562481f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81337b5e50544c7288f03b4266b43d80', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:51.137340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1243-ac74-48eb-8843-54573741fb2e tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.137747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1243-ac74-48eb-8843-54573741fb2e tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.138139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1243-ac74-48eb-8843-54573741fb2e tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] PATH_INFO: `/v3/projects/1466b5aa09bf47d0a83a64044c4c5135` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.140620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1243-ac74-48eb-8843-54573741fb2e tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorizing `identity:get_project(project_id=1466b5aa09bf47d0a83a64044c4c5135)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:51.146020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1243-ac74-48eb-8843-54573741fb2e tempest-QuotasAdminTestJSON-535368775 tempest-QuotasAdminTestJSON-535368775-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:51.153903 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1204/2437] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:47:51 2022] GET /identity/v3/projects/1466b5aa09bf47d0a83a64044c4c5135 => generated 371 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:51.897482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76c5ce-70b6-4b63-a661-16886b7ce684 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:51.899855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8e76c5ce-70b6-4b63-a661-16886b7ce684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:52.129738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76c5ce-70b6-4b63-a661-16886b7ce684 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:52.143864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:52.145308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:52.145775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:52.146206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] PATH_INFO: `/v3/users/9f6f7e23726642dda7d37c007beadb63` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:52.151522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6f7e23726642dda7d37c007beadb63)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:52.153854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:52.242932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6f7e23726642dda7d37c007beadb63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:52.243744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6f7e23726642dda7d37c007beadb63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:52.261557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6f7e23726642dda7d37c007beadb63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:52.262729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6f7e23726642dda7d37c007beadb63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:52.298308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6f7e23726642dda7d37c007beadb63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:52.331041 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1234/2438] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:51 2022] DELETE /identity/v3/users/9f6f7e23726642dda7d37c007beadb63 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:52.331889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c09d-6fa8-4ae1-87a9-40f508753456 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:52.332402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c09d-6fa8-4ae1-87a9-40f508753456 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:52.332499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c09d-6fa8-4ae1-87a9-40f508753456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:52.362748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f154c09d-6fa8-4ae1-87a9-40f508753456 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:52.367102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f154c09d-6fa8-4ae1-87a9-40f508753456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:52.381540 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:52.563033 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1205/2439] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:52.649160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:52.654505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:52.797823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0f93-fc49-4c66-8689-6cbb53818264 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:52.806179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:52.807444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:52.807740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:52.808016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:52.829816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:52.833215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:52.851780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1235/2440] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:55.143037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:55.143583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:55.143583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:55.177633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:55.179619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:55.222989 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:55.264469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] MFA Rules not processed for user `8599707377e644b5a083586b2d46654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:55.265764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:55.413700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d607f1-9c45-4c05-a339-40ec1a5d3cd5 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:55.440226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:55.444669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:55.444959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:55.445320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:55.464062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:55.525631 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1206/2441] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:55.536332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:55.540159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:55.575955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c3f61-a1fd-4e3c-a56e-8ecb6028ef1d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:55.591870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:55.592986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:55.593465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:55.593953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] PATH_INFO: `/v3/projects/1466b5aa09bf47d0a83a64044c4c5135` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:55.596640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1466b5aa09bf47d0a83a64044c4c5135)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:55.598855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:55.697722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1466b5aa09bf47d0a83a64044c4c5135', 'request_id': 'req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:55.698540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:55.700340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eded1c8-625f-4844-856f-21a49c43a8ca service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:55.712013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1466b5aa09bf47d0a83a64044c4c5135', 'request_id': 'req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:55.725774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1466b5aa09bf47d0a83a64044c4c5135', 'request_id': 'req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:55.731530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1236/2442] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:55.733310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e370-af16-473c-a686-69b24022bd51 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:55.733752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e370-af16-473c-a686-69b24022bd51 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:55.734176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e370-af16-473c-a686-69b24022bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:55.750881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] The token cache is being invalidate because project 1466b5aa09bf47d0a83a64044c4c5135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:55.753456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:55.754994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:55.758854 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1207/2443] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:55 2022] DELETE /identity/v3/projects/1466b5aa09bf47d0a83a64044c4c5135 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:55.763695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:55.765480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:55.784247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-af96e370-af16-473c-a686-69b24022bd51 None None] MFA Rules not processed for user `8599707377e644b5a083586b2d46654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:55.785745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-af96e370-af16-473c-a686-69b24022bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:55.840873 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:55.929571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c1f4b-9d41-4ce6-898b-2b1a326bc3ec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:55.949392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1237/2444] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:55.956164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:55.966571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:55.967738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:55.967738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] PATH_INFO: `/v3/users/229c4e4a6b5744a29a5f0013562481f5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:55.975006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229c4e4a6b5744a29a5f0013562481f5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:55.977368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:56.116496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229c4e4a6b5744a29a5f0013562481f5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.146431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229c4e4a6b5744a29a5f0013562481f5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.163505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229c4e4a6b5744a29a5f0013562481f5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.174878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229c4e4a6b5744a29a5f0013562481f5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.175582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229c4e4a6b5744a29a5f0013562481f5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.187982 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1208/2445] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:55 2022] DELETE /identity/v3/users/229c4e4a6b5744a29a5f0013562481f5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:56.291573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e370-af16-473c-a686-69b24022bd51 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:56.294404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-af96e370-af16-473c-a686-69b24022bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:56.400125 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:56.453807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e370-af16-473c-a686-69b24022bd51 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:56.624818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:56.626271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:56.626834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:56.627480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:56.630349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:56.777394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:56.779863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e8df5-eb59-40c7-aac6-b8d0eaf0213c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:56.819143 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1238/2446] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:58.185535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.187160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:58.383068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb51f5-4cec-4969-84ae-a628477159a1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.383631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb51f5-4cec-4969-84ae-a628477159a1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.383631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb51f5-4cec-4969-84ae-a628477159a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.466775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-16cb51f5-4cec-4969-84ae-a628477159a1 None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:58.472052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16cb51f5-4cec-4969-84ae-a628477159a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:58.553084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710f56-0a3e-4fb9-b373-479056652aa2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.581261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.588954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.594222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.594605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] PATH_INFO: `/v3/projects/81337b5e50544c7288f03b4266b43d80` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.604879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81337b5e50544c7288f03b4266b43d80)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.607154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.758719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1239/2447] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:58.813172 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:58.821934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81337b5e50544c7288f03b4266b43d80', 'request_id': 'req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.841347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81337b5e50544c7288f03b4266b43d80', 'request_id': 'req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.864268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81337b5e50544c7288f03b4266b43d80', 'request_id': 'req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.898813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] The token cache is being invalidate because project 81337b5e50544c7288f03b4266b43d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:58.899295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.904441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5361f301-9f1d-4a16-9ac0-fe2fb1f10b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.915190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1209/2448] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:58 2022] DELETE /identity/v3/projects/81337b5e50544c7288f03b4266b43d80 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:58.917468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.918068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.918540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.955802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:58.957244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:59.081846 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:59.175864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.176124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.176350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.196209 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1240/2449] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:59.215505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:59.216834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:59.235778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.244191 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1210/2450] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:59.253158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806c7b-c07a-488c-908b-19b28cbd31b0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.263097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.264174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.264667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.266582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.268942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:59.268942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.270830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.313575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.327568 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1241/2451] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:59.329868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d97378-783b-403f-9d2f-fbf865dc8065 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.335508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.336195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.336650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.338348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.339124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.341373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.388353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1211/2452] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:59 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:59.393168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.430850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538070-da38-4b5e-b3cb-49be29f59d7c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.660620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.661327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.661614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.661898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.662641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.664733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.725980 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1242/2453] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:59 2022] POST /identity/v3/users => generated 288 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:59.727592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.744172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a9d52-023a-4b82-b2e7-cfdfcbbc62d0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.762933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.768536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.769076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.769622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.771211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.777288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.805438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1212/2454] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:59.810119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.827566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6f1de-c5b9-47a3-ae28-14e42d9c7faf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.848260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3400ec9-1352-45f4-88df-77b2efcf3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.848956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400ec9-1352-45f4-88df-77b2efcf3a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.849248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400ec9-1352-45f4-88df-77b2efcf3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.849532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400ec9-1352-45f4-88df-77b2efcf3a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.850819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3400ec9-1352-45f4-88df-77b2efcf3a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.852606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3400ec9-1352-45f4-88df-77b2efcf3a4e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.883915 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1243/2455] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:59.887748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.907298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406781-ce72-4807-8aee-8db20e8333b3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.913460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.915149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.916505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.917020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] PATH_INFO: `/v3/projects/5c945ff42d4e41eb804c639290214fcb/users/e8fd3ff5012242a4805ea0135b273882/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.946059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c945ff42d4e41eb804c639290214fcb, user_id=e8fd3ff5012242a4805ea0135b273882, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.951704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.998079 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1213/2456] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:59 2022] PUT /identity/v3/projects/5c945ff42d4e41eb804c639290214fcb/users/e8fd3ff5012242a4805ea0135b273882/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:59.999852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.000150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.000423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.061350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] MFA Rules not processed for user `e8fd3ff5012242a4805ea0135b273882`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:00.063048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:00.178759 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1244/2457] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:00.184185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:00.300806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e0c5-6145-4a13-8d4c-f89c45623e80 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:00.313409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:00.314538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.314538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.314809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.315848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:00.319084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:00.369927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1214/2458] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:00 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:00.374281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:00.393077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11954e-eee1-44d6-98a0-a20ab7989371 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:00.427368 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:00.514468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:00.517622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.518033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.518418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.519279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:00.521937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:00.577030 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1245/2459] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:00 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:00.581405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:00.603328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07b4d-7806-4924-bbcc-30781df65ce7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:00.630584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:00.631350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.631796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.641591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.642392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:00.655371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:00.702356 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1215/2460] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:00.705349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:00.716547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf5cf-2974-44f7-89d0-25f893662e94 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:00.722740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbcedf-190d-48e1-882b-6ef57224ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:00.724074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbcedf-190d-48e1-882b-6ef57224ea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.724462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbcedf-190d-48e1-882b-6ef57224ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.724840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbcedf-190d-48e1-882b-6ef57224ea97 admin admin] PATH_INFO: `/v3/projects/e743c9865d0d4209a76933096827586e/users/681f78a73d8c43e3b47a01ca2a112fa7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.745774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbcedf-190d-48e1-882b-6ef57224ea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e743c9865d0d4209a76933096827586e, user_id=681f78a73d8c43e3b47a01ca2a112fa7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:00.748847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbcedf-190d-48e1-882b-6ef57224ea97 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:00.782147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1246/2461] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:00 2022] PUT /identity/v3/projects/e743c9865d0d4209a76933096827586e/users/681f78a73d8c43e3b47a01ca2a112fa7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:00.782771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:00.795573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299b31-3bc8-4136-9eb7-9981f746a83a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:00.852434 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:00.875959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:00.876750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.877104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.877451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.878290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:00.880120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:00.884990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.885810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.886174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.904431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1216/2462] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:48:00.906402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:00.920063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bef12-f018-4de3-a7b9-4d637ec010e8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:00.934144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] MFA Rules not processed for user `58ce5615a9284a548acea20f6f6e6390`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:00.935058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c1c7b-d859-4108-9577-700c10d3fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:00.936207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1c7b-d859-4108-9577-700c10d3fbc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:00.936942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1c7b-d859-4108-9577-700c10d3fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:00.938487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1c7b-d859-4108-9577-700c10d3fbc7 admin admin] PATH_INFO: `/v3/projects/e743c9865d0d4209a76933096827586e/users/681f78a73d8c43e3b47a01ca2a112fa7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:00.940644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:00.944950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c1c7b-d859-4108-9577-700c10d3fbc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e743c9865d0d4209a76933096827586e, user_id=681f78a73d8c43e3b47a01ca2a112fa7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:00.951596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c1c7b-d859-4108-9577-700c10d3fbc7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:00.998647 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1217/2463] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:00 2022] PUT /identity/v3/projects/e743c9865d0d4209a76933096827586e/users/681f78a73d8c43e3b47a01ca2a112fa7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:01.090116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.090445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.090776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.176869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] MFA Rules not processed for user `681f78a73d8c43e3b47a01ca2a112fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:01.182971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:01.347882 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1218/2464] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:01.356403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:01.371913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1037f-e5cc-4f53-bf72-25e37175878b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:01.387977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:01.389629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.390786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.392719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.393774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:01.394323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:01.396935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:01.434645 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1219/2465] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:01.437190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:01.443029 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1247/2466] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:01.459205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd92cf-6b44-4b38-b9b7-1e2d292ae2a0 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:01.468809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:01.469773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.470167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.470927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.472060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:01.474785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:01.556545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1220/2467] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:01 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:01.559580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:01.608525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:01.610541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:01.803368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dceaa0-7cf0-4c3b-a6f9-655f6bb59782 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:01.808670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1138e-a453-457c-8b39-eb3e26962e89 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:01.817970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c16e42-7ee6-4124-97f1-af15c9717148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:01.819696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16e42-7ee6-4124-97f1-af15c9717148 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.821162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16e42-7ee6-4124-97f1-af15c9717148 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.831520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16e42-7ee6-4124-97f1-af15c9717148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.868961 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:01.883158 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:01.958466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:01.959648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.959773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.960009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.963849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:01.964176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:01.968526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:01.987090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c16e42-7ee6-4124-97f1-af15c9717148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:01.988890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c16e42-7ee6-4124-97f1-af15c9717148 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:02.000391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1248/2468] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:48:02.013177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1221/2469] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:02.429008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:02.431200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:02.463848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281cb9b-4c03-42a0-bf3f-4dba83a2e92b tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:02.480010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:02.481307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:02.481608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:02.481889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:02.505232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:02.507712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:02.530948 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1249/2470] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:02.554438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7a750-abc7-4abf-8568-51075893b6f5 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:02.555038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7a750-abc7-4abf-8568-51075893b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:02.555138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7a750-abc7-4abf-8568-51075893b6f5 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:02.556555 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1222/2471] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:02.565551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:02.594799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:02.645291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0836a5-95d3-489f-ad05-c0e2d2d710ed service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:02.663083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:02.663979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:02.664261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:02.664536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/projects/b1edc99c972c4902b2d05fb282198ebb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:02.672363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1edc99c972c4902b2d05fb282198ebb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:02.675770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:02.677680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1250/2472] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:02 2022] GET /identity/v3/projects/b1edc99c972c4902b2d05fb282198ebb => generated 369 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:03.044406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b8fba-2385-4a7c-adcf-54782ac9b5d5 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.044406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b8fba-2385-4a7c-adcf-54782ac9b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.044406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b8fba-2385-4a7c-adcf-54782ac9b5d5 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.049429 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1223/2473] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:48:03.070971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:03.097723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.119829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2efa-435c-4087-8d75-034431dfe16d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.133735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.136739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.137566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.138108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/projects/b1edc99c972c4902b2d05fb282198ebb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.139886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1edc99c972c4902b2d05fb282198ebb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.143362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:03.156226 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1251/2474] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:03 2022] GET /identity/v3/projects/b1edc99c972c4902b2d05fb282198ebb => generated 369 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:03.200027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b8fba-2385-4a7c-adcf-54782ac9b5d5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.220447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b8fba-2385-4a7c-adcf-54782ac9b5d5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.237477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.238162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.238654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.238943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.239866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:03.240189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.242320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:03.273868 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1224/2475] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:03.277945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.298810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b691ab-e8f7-436d-bb35-24614c658086 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.321366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa4dce-bb49-4b00-b2e9-cc59d68b756d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.322850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa4dce-bb49-4b00-b2e9-cc59d68b756d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.323479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa4dce-bb49-4b00-b2e9-cc59d68b756d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.323854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa4dce-bb49-4b00-b2e9-cc59d68b756d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.324671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa4dce-bb49-4b00-b2e9-cc59d68b756d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.331532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa4dce-bb49-4b00-b2e9-cc59d68b756d tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:03.387767 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1252/2476] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:03 2022] POST /identity/v3/users => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:03.392549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.407168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538430b-93ae-4ec8-bb8c-f5e17f3ecd9a tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.421656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.422567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.423018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.423790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.424256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:03.424636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.428198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:03.448515 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1225/2477] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:03.469128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bfc5-923f-482d-bc13-400fa986053d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.469705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bfc5-923f-482d-bc13-400fa986053d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.469880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bfc5-923f-482d-bc13-400fa986053d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.472095 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1253/2478] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:03.479248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:03.495292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.506648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e469-122a-40f3-b6af-fbfdbd39fabc tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.518673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.520327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.520616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.520890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/projects/b1edc99c972c4902b2d05fb282198ebb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.524346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1edc99c972c4902b2d05fb282198ebb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.527925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:03.529869 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1226/2479] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:03 2022] GET /identity/v3/projects/b1edc99c972c4902b2d05fb282198ebb => generated 369 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:03.725845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabb37-1633-488b-958a-389b5167dfae None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.726465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabb37-1633-488b-958a-389b5167dfae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.727039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabb37-1633-488b-958a-389b5167dfae None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.729781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1254/2480] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:03.736023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:03.757644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.775731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b190c7-353f-40cf-a23a-c37041c42f10 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.792359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.793259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.793672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.793958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/projects/b1edc99c972c4902b2d05fb282198ebb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.797987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1edc99c972c4902b2d05fb282198ebb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.800144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:03.805459 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1227/2481] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:03 2022] GET /identity/v3/projects/b1edc99c972c4902b2d05fb282198ebb => generated 369 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:03.858115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fabb37-1633-488b-958a-389b5167dfae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:03.886193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fabb37-1633-488b-958a-389b5167dfae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:03.898893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:03.901175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:03.901672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:03.902341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/users/79900301ee7740ad8fcc2c893aada5a6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:03.951257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79900301ee7740ad8fcc2c893aada5a6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:03.954771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:04.050194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79900301ee7740ad8fcc2c893aada5a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.053769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79900301ee7740ad8fcc2c893aada5a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.078398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79900301ee7740ad8fcc2c893aada5a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.079679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79900301ee7740ad8fcc2c893aada5a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.092472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79900301ee7740ad8fcc2c893aada5a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.128890 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1255/2482] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:03 2022] DELETE /identity/v3/users/79900301ee7740ad8fcc2c893aada5a6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:04.129133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:04.131261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:04.165192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a229a-1fd2-4ec9-b37a-eae1674814b6 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:04.272030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '681f78a73d8c43e3b47a01ca2a112fa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e743c9865d0d4209a76933096827586e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:04.272927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:04.273999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:04.274676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] PATH_INFO: `/v3/projects/b1edc99c972c4902b2d05fb282198ebb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:04.277426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1edc99c972c4902b2d05fb282198ebb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:04.280136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:04.356854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1edc99c972c4902b2d05fb282198ebb', 'request_id': 'req-531ff6a3-8859-4cf2-9dd5-365b647a8368'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.365909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1edc99c972c4902b2d05fb282198ebb', 'request_id': 'req-531ff6a3-8859-4cf2-9dd5-365b647a8368'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.378406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1edc99c972c4902b2d05fb282198ebb', 'request_id': 'req-531ff6a3-8859-4cf2-9dd5-365b647a8368'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.397689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] The token cache is being invalidate because project b1edc99c972c4902b2d05fb282198ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:04.398001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.401261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-531ff6a3-8859-4cf2-9dd5-365b647a8368 tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.413639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:04.416769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:04.425808 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1228/2483] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:04 2022] DELETE /identity/v3/projects/b1edc99c972c4902b2d05fb282198ebb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:04.471640 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:04.554480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6e1e7-7d12-4807-917c-c7bba88ab6ba tempest-QuotasAdminTestV236-264396178 tempest-QuotasAdminTestV236-264396178-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:04.651025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:04.652688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:04.652688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:04.653152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] PATH_INFO: `/v3/users/e8fd3ff5012242a4805ea0135b273882` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:04.654651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fd3ff5012242a4805ea0135b273882)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:04.658255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:04.737795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fd3ff5012242a4805ea0135b273882'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.738518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fd3ff5012242a4805ea0135b273882'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.755319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fd3ff5012242a4805ea0135b273882'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.756736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fd3ff5012242a4805ea0135b273882'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.767948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fd3ff5012242a4805ea0135b273882'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:04.795693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:04.796829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:04.797362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:04.805115 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:04.808869 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1256/2484] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:04 2022] DELETE /identity/v3/users/e8fd3ff5012242a4805ea0135b273882 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:04.828644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:04.831533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:05.000445 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1229/2485] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:05.022338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:05.025569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:05.117940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d0d91-ebda-4aab-bbb7-cf6bc2e3e76f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:05.126376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:05.127653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:05.128102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:05.128572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:05.144995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:05.146949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:05.159724 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1257/2486] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:07.509883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:07.512655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:07.535294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9206e0-0f91-470e-a6f7-3bae74d3a351 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:07.554128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:07.555048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:07.555340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:07.555623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] PATH_INFO: `/v3/projects/5c945ff42d4e41eb804c639290214fcb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:07.579738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c945ff42d4e41eb804c639290214fcb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:07.581919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:07.730019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c945ff42d4e41eb804c639290214fcb', 'request_id': 'req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:07.736545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c945ff42d4e41eb804c639290214fcb', 'request_id': 'req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:07.746881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c945ff42d4e41eb804c639290214fcb', 'request_id': 'req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:07.810878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] The token cache is being invalidate because project 5c945ff42d4e41eb804c639290214fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:07.811434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:07.812970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b53c420-1d81-42a0-bf7c-c2da2f9864f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:07.822241 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1230/2487] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:07 2022] DELETE /identity/v3/projects/5c945ff42d4e41eb804c639290214fcb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:07.823350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:07.832599 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:07.846538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871dc7-8ece-43d5-943b-85a8ee045efa service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:07.997428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:07.998345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:07.998673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:07.998952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] PATH_INFO: `/v3/users/681f78a73d8c43e3b47a01ca2a112fa7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:08.002523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681f78a73d8c43e3b47a01ca2a112fa7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:08.004507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:08.097087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681f78a73d8c43e3b47a01ca2a112fa7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:08.097800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681f78a73d8c43e3b47a01ca2a112fa7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:08.112909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681f78a73d8c43e3b47a01ca2a112fa7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:08.113763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681f78a73d8c43e3b47a01ca2a112fa7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:08.123534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681f78a73d8c43e3b47a01ca2a112fa7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:08.159751 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1258/2488] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:07 2022] DELETE /identity/v3/users/681f78a73d8c43e3b47a01ca2a112fa7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:08.239419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb71f-b70e-4ca0-b298-4d1010805fae None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:08.240115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb71f-b70e-4ca0-b298-4d1010805fae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:08.240411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb71f-b70e-4ca0-b298-4d1010805fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:08.273177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ed1bb71f-b70e-4ca0-b298-4d1010805fae None None] MFA Rules not processed for user `58ce5615a9284a548acea20f6f6e6390`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:08.279005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed1bb71f-b70e-4ca0-b298-4d1010805fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:08.412732 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1231/2489] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:08.933503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:08.935927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:09.097644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31110a-6361-4f66-93d7-1290d2b52d43 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.117134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.118883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.119203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.119703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] PATH_INFO: `/v3/projects/e743c9865d0d4209a76933096827586e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.121652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e743c9865d0d4209a76933096827586e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.124260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.216616 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:09.256798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e743c9865d0d4209a76933096827586e', 'request_id': 'req-5f927090-06bc-4af9-a772-c9f534f60992'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.277768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e743c9865d0d4209a76933096827586e', 'request_id': 'req-5f927090-06bc-4af9-a772-c9f534f60992'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.285707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e743c9865d0d4209a76933096827586e', 'request_id': 'req-5f927090-06bc-4af9-a772-c9f534f60992'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.301560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] The token cache is being invalidate because project e743c9865d0d4209a76933096827586e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:09.302048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.302929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f927090-06bc-4af9-a772-c9f534f60992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.305116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1259/2490] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:08 2022] DELETE /identity/v3/projects/e743c9865d0d4209a76933096827586e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:09.311921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.312514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.312663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.343244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:09.345231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:09.399039 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:09.457466 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1232/2491] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:09.466825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.467111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.467397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.499300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:09.500573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:09.510524 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1260/2492] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:09.514873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.527303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea395de-e18f-4496-b8c4-d36844b4b0ce None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.534883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.536104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.536846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.537370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.539263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:09.540233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.543617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.605570 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1233/2493] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:09.606796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.628380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7af31-2d4f-470d-b1ae-03dff95b9de4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.639059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.640078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.640580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.641126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.642067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.644356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.685880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1261/2494] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:09 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:09.689913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.705999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e20329-5c4c-4e1c-b80d-5abf0c551d0e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.826067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.827360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.827360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.827360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.828618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.830286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.861616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1234/2495] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:09 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:09.866934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.885568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a57c-5e0b-4dbb-bdee-3b024a6ea361 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.899859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.901254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.901560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.901846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.902638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.904437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.931906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.933764 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1262/2496] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:09.954405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11df9-60e2-490c-ad83-644ef1abb01e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.961686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59114d4-2d8c-4f67-9547-7f19bc9594a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.962431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59114d4-2d8c-4f67-9547-7f19bc9594a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.962770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59114d4-2d8c-4f67-9547-7f19bc9594a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.963246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59114d4-2d8c-4f67-9547-7f19bc9594a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.964023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59114d4-2d8c-4f67-9547-7f19bc9594a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.966517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59114d4-2d8c-4f67-9547-7f19bc9594a0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.987482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1235/2497] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:09.991546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.003489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f362-32a4-4f16-a060-e8774577d5cf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.008585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.009907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.010209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.010476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] PATH_INFO: `/v3/projects/77e534da09d240938d417886c7446d86/users/81a43fc489684c87b6625682f7032869/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.031564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e534da09d240938d417886c7446d86, user_id=81a43fc489684c87b6625682f7032869, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.035422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.077283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1263/2498] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:09 2022] PUT /identity/v3/projects/77e534da09d240938d417886c7446d86/users/81a43fc489684c87b6625682f7032869/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:10.089797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.089797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.089797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.140914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] MFA Rules not processed for user `81a43fc489684c87b6625682f7032869`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:10.143209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.307948 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1236/2499] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:10.312412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.416730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e24614-ee64-47a6-889f-abe75c423f70 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.425332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.426258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.426675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.427053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.428006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.430069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.475487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.477915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.545042 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1264/2500] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/projects => generated 391 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:10.549284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.574869 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:10.641420 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:10.695804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb50989-8981-4763-bc52-52eff0b16712 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.717283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1a1d-fed7-4c3b-9b70-d2d8bf38e76c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.723797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.724432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.724765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.725051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.725840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.728472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.770772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1265/2501] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/users => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:10.775194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.803678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0a42-bb20-42f5-b51e-29325faee61a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.822140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.823224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.825742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.827638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.831556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.835323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.849293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.850766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.851070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.851930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.858861 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1266/2502] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:10.859550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.860561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.910809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c768b0-89dd-44c6-8ac7-b65771305685 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.925361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.927440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.928011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.928372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] PATH_INFO: `/v3/projects/bd54a00aba8f438f829ac70fbac552ea/users/9d2c2d1c30c64ccdbd00619f75682ae5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.955395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54a00aba8f438f829ac70fbac552ea, user_id=9d2c2d1c30c64ccdbd00619f75682ae5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.962931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:11.002184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1267/2503] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:10 2022] PUT /identity/v3/projects/bd54a00aba8f438f829ac70fbac552ea/users/9d2c2d1c30c64ccdbd00619f75682ae5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:11.003232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:11.105026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:11.106675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:11.138927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1237/2504] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:11.147593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c583a-cc43-4462-9371-555912d11165 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:11.158268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df90871-e587-4c1d-8298-b15f9f23207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:11.159015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df90871-e587-4c1d-8298-b15f9f23207a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:11.159461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df90871-e587-4c1d-8298-b15f9f23207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:11.159738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df90871-e587-4c1d-8298-b15f9f23207a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:11.160480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df90871-e587-4c1d-8298-b15f9f23207a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:11.162078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df90871-e587-4c1d-8298-b15f9f23207a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:11.193956 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1268/2505] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:11.198230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:11.217805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b1de7-534e-4cb5-bab3-96d6b01ac358 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:11.232134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:11.233158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:11.233526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:11.233880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] PATH_INFO: `/v3/projects/bd54a00aba8f438f829ac70fbac552ea/users/9d2c2d1c30c64ccdbd00619f75682ae5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:11.236112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54a00aba8f438f829ac70fbac552ea, user_id=9d2c2d1c30c64ccdbd00619f75682ae5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:11.238899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:11.262165 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1238/2506] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:11 2022] PUT /identity/v3/projects/bd54a00aba8f438f829ac70fbac552ea/users/9d2c2d1c30c64ccdbd00619f75682ae5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:11.275016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:11.276199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:11.276596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:11.316913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] MFA Rules not processed for user `9d2c2d1c30c64ccdbd00619f75682ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:11.318142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:11.446539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1269/2507] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:11.553598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:11.612678 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:11.653895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c1be-ef1c-4f53-8644-3ab026c0624d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:11.661673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:11.662431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:11.662810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:11.663102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:11.739924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:11.742381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:11.753279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1239/2508] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:13.348545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:13.354062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:13.373759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aca8e-b7e8-42fe-ac52-4dea28ce73ea None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:13.379998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d6956-a1b6-4a9d-95c0-ffa698517fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:13.380672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d6956-a1b6-4a9d-95c0-ffa698517fd5 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:13.380958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d6956-a1b6-4a9d-95c0-ffa698517fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:13.381236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d6956-a1b6-4a9d-95c0-ffa698517fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:13.389694 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:13.391884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d6956-a1b6-4a9d-95c0-ffa698517fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:13.394880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d6956-a1b6-4a9d-95c0-ffa698517fd5 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:13.408571 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1270/2509] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:48:19.230433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:19.326393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671322d5-13f0-424b-b147-79e4af0ea4a1 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:19.332568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:19.334038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:19.334424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:19.334898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] PATH_INFO: `/v3/users/81a43fc489684c87b6625682f7032869` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:19.336783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a43fc489684c87b6625682f7032869)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:19.339436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:19.401337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a43fc489684c87b6625682f7032869'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:19.419531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a43fc489684c87b6625682f7032869'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:19.429580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a43fc489684c87b6625682f7032869'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:19.440312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a43fc489684c87b6625682f7032869'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:19.441080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a43fc489684c87b6625682f7032869'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:19.444093 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:19.450180 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1240/2510] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:19 2022] DELETE /identity/v3/users/81a43fc489684c87b6625682f7032869 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:19.456524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:19.457116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:19.457116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:19.480031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:19.481418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:19.584685 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1271/2511] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:19.594627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:19.596241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:19.673361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825d5-3f92-4e09-a6f8-d0599285c356 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:19.678777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:19.679451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:19.679735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:19.680020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:19.690461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:19.691941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:19.703550 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1241/2512] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:48:19.957582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:19.959153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:19.979669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd94e8-13cb-4ee3-a71d-1a6d2b2d2424 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:19.986639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:19.987542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:19.987881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:19.988209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] PATH_INFO: `/v3/projects/77e534da09d240938d417886c7446d86` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:19.990920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e534da09d240938d417886c7446d86)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:19.994079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:20.080225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e534da09d240938d417886c7446d86', 'request_id': 'req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.090474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e534da09d240938d417886c7446d86', 'request_id': 'req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.118943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e534da09d240938d417886c7446d86', 'request_id': 'req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.134871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] The token cache is being invalidate because project 77e534da09d240938d417886c7446d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:20.135245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.136017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.140578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1272/2513] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:19 2022] DELETE /identity/v3/projects/77e534da09d240938d417886c7446d86 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:20.142054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:20.160442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6ddd1-5beb-4a67-acfc-26333aabb399 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:20.288422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:20.289345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:20.289674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:20.290808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] PATH_INFO: `/v3/users/9d2c2d1c30c64ccdbd00619f75682ae5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:20.291600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2c2d1c30c64ccdbd00619f75682ae5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:20.293689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:20.418744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2c2d1c30c64ccdbd00619f75682ae5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.464657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2c2d1c30c64ccdbd00619f75682ae5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.484325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2c2d1c30c64ccdbd00619f75682ae5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.511836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2c2d1c30c64ccdbd00619f75682ae5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.513035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2c2d1c30c64ccdbd00619f75682ae5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:20.545756 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1242/2514] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:20 2022] DELETE /identity/v3/users/9d2c2d1c30c64ccdbd00619f75682ae5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:20.818976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:20.821687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:20.840389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faf99-56fc-41c2-9a48-bd9e9b5dc416 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:20.932696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:20.935398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:21.012256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:21.013084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.013371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.013645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] PATH_INFO: `/v3/users/95220b51119941dfbe6e9c35b8708c7d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.015444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95220b51119941dfbe6e9c35b8708c7d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:21.017441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:21.051783 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:21.075160 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:21.141289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95220b51119941dfbe6e9c35b8708c7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.142005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95220b51119941dfbe6e9c35b8708c7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.164362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95220b51119941dfbe6e9c35b8708c7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.165750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95220b51119941dfbe6e9c35b8708c7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.174548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086729-ea5f-4bba-bc8d-b56fcc2bc7ec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:21.177248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5eb85398-7827-4a0c-a258-5007bfccc909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95220b51119941dfbe6e9c35b8708c7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.193625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:21.194910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.195228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.195526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] PATH_INFO: `/v3/projects/bd54a00aba8f438f829ac70fbac552ea` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.203913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd54a00aba8f438f829ac70fbac552ea)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:21.207508 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1273/2515] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:20 2022] DELETE /identity/v3/users/95220b51119941dfbe6e9c35b8708c7d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:21.207808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:21.209186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.209479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.210061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.240112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:21.241504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:21.332770 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1274/2516] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:21.354127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd54a00aba8f438f829ac70fbac552ea', 'request_id': 'req-819aa161-8b35-425b-b4ed-5fe53bd754ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.356923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:21.360248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:21.366908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd54a00aba8f438f829ac70fbac552ea', 'request_id': 'req-819aa161-8b35-425b-b4ed-5fe53bd754ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.394741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd54a00aba8f438f829ac70fbac552ea', 'request_id': 'req-819aa161-8b35-425b-b4ed-5fe53bd754ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.444064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] The token cache is being invalidate because project bd54a00aba8f438f829ac70fbac552ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:21.444980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.446574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-819aa161-8b35-425b-b4ed-5fe53bd754ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:21.449688 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1243/2517] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:20 2022] DELETE /identity/v3/projects/bd54a00aba8f438f829ac70fbac552ea => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:21.457026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b88d-01fb-4bb2-8e38-0b01115d0f91 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.457341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b88d-01fb-4bb2-8e38-0b01115d0f91 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.458785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b88d-01fb-4bb2-8e38-0b01115d0f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.492851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6073b88d-01fb-4bb2-8e38-0b01115d0f91 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:21.494659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6073b88d-01fb-4bb2-8e38-0b01115d0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:21.562852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae6fa-900a-4b4d-8032-52ea0899bc78 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:21.636344 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1244/2518] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:21.648117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:21.648946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.649994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.650723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.650988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.651138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.652676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.665264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:21.685371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:21.687058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:21.691788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:21.692275 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:21.694007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:21.700840 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1275/2519] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:21.722134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:21.722347 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1245/2520] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:21.746132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad08fb-2013-415b-b020-3509af435ea8 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:21.755835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:21.756610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.756901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.757185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.758022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:21.758341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:21.760891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:21.779422 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1276/2521] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:21.786459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:21.806972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f3ae8-07e2-4e87-bec0-766dab2b8bc6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:21.826230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:21.827801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:21.828856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:21.830059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:21.832680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:21.838692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:21.913738 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1246/2522] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:21 2022] POST /identity/v3/projects => generated 395 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:21.918082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:21.933561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dddb1a-2975-4036-83b3-04d2e06eda20 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.088053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.092622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.096078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.097268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.101030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.108695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.160967 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1277/2523] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:21 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:22.162796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.176229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb637b12-bc31-4170-8292-c7e9144ad295 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.183378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.186534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.186534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.186534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.186534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.190101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.210312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1247/2524] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:22.218546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.251691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3869-ebb0-4461-ae48-206c459667e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.257708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.258979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.260053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.260362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.260691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.261314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:22.261671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.264040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.280775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc9335-0145-49d6-be04-188dc845098c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.281637 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1278/2525] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:48:22.286170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.307122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.308768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b210-add1-49e4-b8a6-231361b45e75 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.309609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.309977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.310694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] PATH_INFO: `/v3/projects/68c501453ddc43fd94399c9ef56ede67` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.314800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c501453ddc43fd94399c9ef56ede67)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.316194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd7639-3f82-4445-affe-bc1b788beea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.317374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd7639-3f82-4445-affe-bc1b788beea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.317925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd7639-3f82-4445-affe-bc1b788beea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.318220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd7639-3f82-4445-affe-bc1b788beea6 admin admin] PATH_INFO: `/v3/projects/a08e192d9b554b73b7feedf563881a1e/users/a2750a20e81549b4a6839a205161dd5a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.320022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.335620 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:22.371642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd7639-3f82-4445-affe-bc1b788beea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08e192d9b554b73b7feedf563881a1e, user_id=a2750a20e81549b4a6839a205161dd5a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.379940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd7639-3f82-4445-affe-bc1b788beea6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.403096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1279/2526] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:22 2022] PUT /identity/v3/projects/a08e192d9b554b73b7feedf563881a1e/users/a2750a20e81549b4a6839a205161dd5a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:22.408907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c501453ddc43fd94399c9ef56ede67', 'request_id': 'req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.416381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.416767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.417437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.420442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c501453ddc43fd94399c9ef56ede67', 'request_id': 'req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.433616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c501453ddc43fd94399c9ef56ede67', 'request_id': 'req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.458990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] MFA Rules not processed for user `a2750a20e81549b4a6839a205161dd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:22.460469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:22.469938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] The token cache is being invalidate because project 68c501453ddc43fd94399c9ef56ede67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:22.470364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.471110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.475417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1248/2527] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:22 2022] DELETE /identity/v3/projects/68c501453ddc43fd94399c9ef56ede67 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:22.479821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.481715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:22.645476 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1280/2528] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:22.651558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.655159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:22.660834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5b9d4-cf48-4c96-a80a-9a3e64b4cdc2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.711183 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:22.783216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.784475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.784949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.785411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] PATH_INFO: `/v3/users/7c0422e697e34294829f1a547f36ae9c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.787222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0422e697e34294829f1a547f36ae9c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.790601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.813045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230351da-9e85-4f52-a281-4ecf4931fe8f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:22.822221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:22.823482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:22.824111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:22.824618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:22.826229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:22.832058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:22.890289 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:22.893889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0422e697e34294829f1a547f36ae9c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.905914 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1281/2529] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:22 2022] POST /identity/v3/projects => generated 393 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:22.910977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:22.936933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0422e697e34294829f1a547f36ae9c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.964518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0422e697e34294829f1a547f36ae9c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.976577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0422e697e34294829f1a547f36ae9c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.977645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7712746f-4fa3-434e-9fb8-2c18f576dbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0422e697e34294829f1a547f36ae9c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:22.987236 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1249/2530] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:22 2022] DELETE /identity/v3/users/7c0422e697e34294829f1a547f36ae9c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:23.097195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.097925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.097925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.102734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8433f-1ff2-4e9f-a92a-da4320fd675b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:23.119361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] MFA Rules not processed for user `8599707377e644b5a083586b2d46654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:23.121267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:23.225031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1250/2531] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:23.236299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:23.240008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.241766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.242574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.244937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:23.249203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:23.305120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1282/2532] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:22 2022] POST /identity/v3/users => generated 303 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:23.307333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:23.309874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:23.341639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5648a35-c4b6-4f1a-8d29-a9c35e35a6dc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:23.367366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:23.369186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.369913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.374593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.376562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:23.379905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:23.411354 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1251/2533] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:23.413528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:23.435703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15cab6-e5d0-4147-96bc-6e5bf0111934 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:23.446702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:23.451210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.452391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.453064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] PATH_INFO: `/v3/projects/5281519a410940dabc8da34139d5260b/users/9e2d52cf98e04fdca0d604e338ff62b4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.502701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5281519a410940dabc8da34139d5260b, user_id=9e2d52cf98e04fdca0d604e338ff62b4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:23.514952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:23.562673 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1283/2534] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:23 2022] PUT /identity/v3/projects/5281519a410940dabc8da34139d5260b/users/9e2d52cf98e04fdca0d604e338ff62b4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:23.564890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:23.583681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ef10-ceed-4064-80c5-075ca101c028 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:23.793488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ef2d-88e0-4857-994d-31217151143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:23.795104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ef2d-88e0-4857-994d-31217151143f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.795904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ef2d-88e0-4857-994d-31217151143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.796610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ef2d-88e0-4857-994d-31217151143f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.798201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ef2d-88e0-4857-994d-31217151143f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:23.801530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ef2d-88e0-4857-994d-31217151143f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:23.830149 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1252/2535] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:23.831501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:23.852668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d86b4-f58c-4844-b65b-e15dc5d9f6d3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:23.865187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:23.866123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.866410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.866719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] PATH_INFO: `/v3/projects/5281519a410940dabc8da34139d5260b/users/9e2d52cf98e04fdca0d604e338ff62b4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.874068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5281519a410940dabc8da34139d5260b, user_id=9e2d52cf98e04fdca0d604e338ff62b4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:23.878471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:23.904595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1284/2536] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:23 2022] PUT /identity/v3/projects/5281519a410940dabc8da34139d5260b/users/9e2d52cf98e04fdca0d604e338ff62b4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:23.922665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec8e0-f4ff-4791-aa1f-fc3b8d3a2efa None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:23.923171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec8e0-f4ff-4791-aa1f-fc3b8d3a2efa None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:23.923630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec8e0-f4ff-4791-aa1f-fc3b8d3a2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:23.983332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b06ec8e0-f4ff-4791-aa1f-fc3b8d3a2efa None None] MFA Rules not processed for user `9e2d52cf98e04fdca0d604e338ff62b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:23.989738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b06ec8e0-f4ff-4791-aa1f-fc3b8d3a2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:24.020975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:24.023378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:24.067929 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:24.121493 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:24.188829 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1253/2537] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:24.202230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a013-a6b0-4425-94bd-1b9d7bb23da3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:24.202783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a013-a6b0-4425-94bd-1b9d7bb23da3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:24.203837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a013-a6b0-4425-94bd-1b9d7bb23da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:24.234128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c50c-4cdb-445b-98d8-ca8912dd9856 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:24.237676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9b61a013-a6b0-4425-94bd-1b9d7bb23da3 None None] MFA Rules not processed for user `a2750a20e81549b4a6839a205161dd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:24.240117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b61a013-a6b0-4425-94bd-1b9d7bb23da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:24.264454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:24.267840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:24.269686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:24.270743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] PATH_INFO: `/v3/projects/4bc302cb274b41cca6b6e1aa4b6c8c1a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:24.274865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc302cb274b41cca6b6e1aa4b6c8c1a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:24.291306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:24.374550 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1254/2538] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:24.441209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc302cb274b41cca6b6e1aa4b6c8c1a', 'request_id': 'req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:24.470609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc302cb274b41cca6b6e1aa4b6c8c1a', 'request_id': 'req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:24.485617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc302cb274b41cca6b6e1aa4b6c8c1a', 'request_id': 'req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:24.528994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] The token cache is being invalidate because project 4bc302cb274b41cca6b6e1aa4b6c8c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:24.529243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:24.530144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0ea6c9b-937d-4a4a-9e42-d54f10e677ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:24.535662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1285/2539] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:24 2022] DELETE /identity/v3/projects/4bc302cb274b41cca6b6e1aa4b6c8c1a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:24.545940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:24.546831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:24.547331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:24.593151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:24.595593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:24.728292 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1255/2540] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:24.740676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:24.740833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:24.741216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:24.808553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:24.810753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:24.842013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:24.845571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:24.854870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1286/2541] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:24.861069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:24.878237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699842-087d-4f41-96ce-d18ca0b70789 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:24.902701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:24.903748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:24.905308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:24.906283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:24.913282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:24.915568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:24.919407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:24.968271 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1287/2542] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:24.972409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:24.999046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51d69-a1f7-4280-b8a4-92af1227a9bc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:25.006287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:25.007271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:25.007730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:25.008253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:25.009316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:25.011839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:25.067045 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1288/2543] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:24 2022] POST /identity/v3/projects => generated 395 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:25.068398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:25.140794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1ea53-d5a7-4f95-8c7e-056c8a0b178e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:25.184020 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:25.222172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b370b-52c2-4235-92cf-90a6a3722ca6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:25.252530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:25.254870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:25.255673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:25.270889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:25.272969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:25.276873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:25.330544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:25.331236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:25.331522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:25.331803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:25.333826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:25.341843 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:25.378609 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1289/2544] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:25 2022] POST /identity/v3/users => generated 298 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:25.392944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:25.461204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadd56-c9cf-431d-916d-6a032911a3e4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:25.481337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:25.482437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:25.482942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:25.483400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:25.500591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:25.503304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:25.567215 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1290/2545] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:25.574154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:25.594600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:25.600907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:25.634475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee52d6d-6026-4928-924e-442de857ab4d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:25.653822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470125d5-6aaf-4fcf-9eee-c446219c5ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:25.654700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470125d5-6aaf-4fcf-9eee-c446219c5ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:25.655715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470125d5-6aaf-4fcf-9eee-c446219c5ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:25.656181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470125d5-6aaf-4fcf-9eee-c446219c5ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:25.657201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470125d5-6aaf-4fcf-9eee-c446219c5ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:25.663120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470125d5-6aaf-4fcf-9eee-c446219c5ec3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:25.683293 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1256/2546] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:48:25.710552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1291/2547] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:25.717522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:25.795729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302be73-df9b-4ffb-ae4a-323317a15f3f service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:25.833424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:25.839443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:25.840232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:25.841461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a/users/4e49b2223b5140c59350be6f91f03dcb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:25.974880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9dee3eff62b4eeb9a7df9636b7a810a, user_id=4e49b2223b5140c59350be6f91f03dcb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:26.014659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:26.084800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1257/2548] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:25 2022] PUT /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a/users/4e49b2223b5140c59350be6f91f03dcb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:26.098554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:26.098838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:26.099170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:26.152244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] MFA Rules not processed for user `4e49b2223b5140c59350be6f91f03dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:26.153924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:26.285062 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1292/2549] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:26.292238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:26.454366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562632-86fb-4e80-83c9-edc9af3b5ecd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:26.466929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:26.467636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:26.467924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:26.468221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:26.468923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:26.471088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:26.536362 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1258/2550] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:26 2022] POST /identity/v3/projects => generated 395 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:26.542484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:26.560332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e23467-66e6-4159-96ee-546a979021c0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:26.820391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:26.825136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:26.828800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:26.834999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:26.838427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:26.852664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:26.915096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1293/2551] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:26 2022] POST /identity/v3/users => generated 304 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:26.920536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:27.007188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3216cf-cd59-481d-97e3-7582403ff164 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:27.046194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:27.047227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:27.047663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:27.048082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:27.055440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:27.057329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:27.093422 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1259/2552] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:27.098314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:27.127901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7658fd-bd84-4099-b1b2-ed001a1741fe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:27.152920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:27.155192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:27.155723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:27.156234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] PATH_INFO: `/v3/projects/e0f733aa4975435bba2668a1fba0908c/users/2328f165a0bc483998a7666aa2966958/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:27.195292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f733aa4975435bba2668a1fba0908c, user_id=2328f165a0bc483998a7666aa2966958, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:27.212328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:27.259060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:27.262107 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1294/2553] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:27 2022] PUT /identity/v3/projects/e0f733aa4975435bba2668a1fba0908c/users/2328f165a0bc483998a7666aa2966958/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:27.281540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052a9e3-b522-4c81-84d0-a5dedd12776c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:27.293116 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:27.416654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19bd34-9d43-40d6-a4e6-988f67e9db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:27.417685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19bd34-9d43-40d6-a4e6-988f67e9db66 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:27.418459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19bd34-9d43-40d6-a4e6-988f67e9db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:27.418980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19bd34-9d43-40d6-a4e6-988f67e9db66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:27.420126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19bd34-9d43-40d6-a4e6-988f67e9db66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:27.422019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19bd34-9d43-40d6-a4e6-988f67e9db66 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:27.437584 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1260/2554] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:27.454636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:27.472725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7b81-50fe-459b-bf72-66c5d91ca5e2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:27.478371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:27.479437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:27.479782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:27.480125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] PATH_INFO: `/v3/projects/e0f733aa4975435bba2668a1fba0908c/users/2328f165a0bc483998a7666aa2966958/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:27.482385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f733aa4975435bba2668a1fba0908c, user_id=2328f165a0bc483998a7666aa2966958, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:27.485551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:27.521940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:27.522904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:27.523720 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1295/2555] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:27 2022] PUT /identity/v3/projects/e0f733aa4975435bba2668a1fba0908c/users/2328f165a0bc483998a7666aa2966958/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:27.524262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:27.647575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] MFA Rules not processed for user `2328f165a0bc483998a7666aa2966958`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:27.648906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:27.980248 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1261/2556] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:27.982162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:28.028002 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:28.190214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adf511-06b9-43a7-be3a-972a250bb270 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:28.206415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27022-65f0-433d-a714-8e51b7ed8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:28.207296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27022-65f0-433d-a714-8e51b7ed8cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:28.207591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27022-65f0-433d-a714-8e51b7ed8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:28.210664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27022-65f0-433d-a714-8e51b7ed8cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:28.213276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b27022-65f0-433d-a714-8e51b7ed8cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:28.218147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b27022-65f0-433d-a714-8e51b7ed8cbf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:28.306204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:28.311316 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1296/2557] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:27 2022] POST /identity/v3/projects => generated 395 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:28.322716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c33ef4-9928-4e7f-8e58-499d2475b084 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:28.434784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:28.435705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:28.436247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:28.527758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:28.529034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:28.594788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:28.596887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:28.598286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:28.599640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:28.601506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:28.603643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:28.628504 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1297/2558] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:28.690881 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1262/2559] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:28 2022] POST /identity/v3/users => generated 298 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:28.693575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:28.719654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7175c-3457-4c81-a84d-253b8358c837 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:28.736262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:28.738707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:28.739935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:28.741190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:28.743404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:28.758999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:28.803259 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1298/2560] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:48:28.806562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:28.854172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7349ad0-b64b-4f58-8630-09de07fd4fdb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:28.889576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee9a8a-2cc4-4829-94c7-e2623e39c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:28.891106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee9a8a-2cc4-4829-94c7-e2623e39c125 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:28.891650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee9a8a-2cc4-4829-94c7-e2623e39c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:28.892135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee9a8a-2cc4-4829-94c7-e2623e39c125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:28.893664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee9a8a-2cc4-4829-94c7-e2623e39c125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:28.897369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee9a8a-2cc4-4829-94c7-e2623e39c125 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:28.942464 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1263/2561] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:48:28.944680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:28.972086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87260-ef27-492c-a20c-a8aa01daca40 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:28.998350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:28.999902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:29.000397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:29.001676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] PATH_INFO: `/v3/projects/1a97aef3ff7d4a15a9ec0f6702ddc2f7/users/10cf38e04e5f4d77bbfd9e1550efe34c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:29.081816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a97aef3ff7d4a15a9ec0f6702ddc2f7, user_id=10cf38e04e5f4d77bbfd9e1550efe34c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:29.091974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:29.176552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1299/2562] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:28 2022] PUT /identity/v3/projects/1a97aef3ff7d4a15a9ec0f6702ddc2f7/users/10cf38e04e5f4d77bbfd9e1550efe34c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:29.179502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d414e6-58d9-4507-8908-4c2392e2f171 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:29.180352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d414e6-58d9-4507-8908-4c2392e2f171 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:29.180914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d414e6-58d9-4507-8908-4c2392e2f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:29.271646 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:29.312069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-08d414e6-58d9-4507-8908-4c2392e2f171 None None] MFA Rules not processed for user `10cf38e04e5f4d77bbfd9e1550efe34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:29.314471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-08d414e6-58d9-4507-8908-4c2392e2f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:29.516817 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1264/2563] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:29.637895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:29.866428 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:29.883619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28cfc-267c-47f2-9d1d-daa6ba4aa7b1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:29.901840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:29.909627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:29.912389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:29.912389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:30.069969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:30.072926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:30.091922 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1300/2564] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:30.672271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735a17-b25f-4b24-b4ba-a1e52b1e2afd None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:30.672849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735a17-b25f-4b24-b4ba-a1e52b1e2afd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:30.672849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735a17-b25f-4b24-b4ba-a1e52b1e2afd None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:30.675274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1265/2565] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:30.681132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:30.683180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:30.729429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:30.751581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c7b6-28c2-4e9f-b0ee-1b61c5965cc2 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:30.765792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2328f165a0bc483998a7666aa2966958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0f733aa4975435bba2668a1fba0908c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:30.766842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:30.766977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:30.767415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:30.770424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9dee3eff62b4eeb9a7df9636b7a810a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:30.776310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:30.778639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1301/2566] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:30 2022] GET /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a => generated 395 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:31.148576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd28c-7b7a-4bcf-923a-da7d357ead7b None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:31.148870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd28c-7b7a-4bcf-923a-da7d357ead7b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:31.149180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd28c-7b7a-4bcf-923a-da7d357ead7b None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:31.153231 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1266/2567] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:31.162274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:31.186141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:31.218202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a1d6-d652-4cd0-b683-f1ebd4277c0e tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:31.238109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2328f165a0bc483998a7666aa2966958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0f733aa4975435bba2668a1fba0908c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:31.239513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:31.240006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:31.240454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:31.242722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9dee3eff62b4eeb9a7df9636b7a810a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:31.245270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:31.248177 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1302/2568] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:31 2022] GET /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a => generated 395 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:31.446310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94985a9c-133c-4e95-ad3d-d9617d58f141 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:31.446821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94985a9c-133c-4e95-ad3d-d9617d58f141 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:31.447109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94985a9c-133c-4e95-ad3d-d9617d58f141 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:31.449251 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1267/2569] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:31.469522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:31.546025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:31.551270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826079-59ba-4188-a98e-9db5cea7fdbd tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:31.557791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf7a0-d937-45fc-bb99-a3927dc6cec0 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2328f165a0bc483998a7666aa2966958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0f733aa4975435bba2668a1fba0908c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:31.559202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf7a0-d937-45fc-bb99-a3927dc6cec0 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:31.559735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf7a0-d937-45fc-bb99-a3927dc6cec0 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:31.560344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf7a0-d937-45fc-bb99-a3927dc6cec0 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:31.561877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf7a0-d937-45fc-bb99-a3927dc6cec0 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9dee3eff62b4eeb9a7df9636b7a810a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:31.565399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf7a0-d937-45fc-bb99-a3927dc6cec0 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:31.568130 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1303/2570] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:31 2022] GET /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a => generated 395 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:48:34.305988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94985a9c-133c-4e95-ad3d-d9617d58f141 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:34.342530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94985a9c-133c-4e95-ad3d-d9617d58f141 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:34.353050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:34.362596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:34.363686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:34.364623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:34.551405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:34.553332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:34.583314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1268/2571] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:34.962376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c69ec-6aaa-4a0f-8522-c5c75ab47ce1 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:34.963289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c69ec-6aaa-4a0f-8522-c5c75ab47ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:34.963447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c69ec-6aaa-4a0f-8522-c5c75ab47ce1 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:34.970310 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1304/2572] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:34.981141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:35.005638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:35.024544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89757c6-6e4f-4d76-b6da-a01db3cbe682 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:35.034861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2328f165a0bc483998a7666aa2966958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0f733aa4975435bba2668a1fba0908c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:35.042074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:35.042074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:35.042074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:35.042074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9dee3eff62b4eeb9a7df9636b7a810a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:35.042915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:35.046556 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1269/2573] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:34 2022] GET /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a => generated 395 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:48:35.263164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41884925-6071-41cc-9fd7-769ae441052b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:35.263448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41884925-6071-41cc-9fd7-769ae441052b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:35.263719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41884925-6071-41cc-9fd7-769ae441052b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:35.265132 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1305/2574] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:35.284966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:35.306080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:35.361882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dac90-34d8-43e0-a6e8-6b27cdabcb27 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:35.367760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2328f165a0bc483998a7666aa2966958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0f733aa4975435bba2668a1fba0908c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:35.368658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:35.368956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:35.369244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:35.379374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9dee3eff62b4eeb9a7df9636b7a810a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:35.381845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:35.385406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1270/2575] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:35 2022] GET /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a => generated 395 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:36.255242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0d83-26c5-4add-b391-9290df5d220b None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:36.256085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0d83-26c5-4add-b391-9290df5d220b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:36.256262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0d83-26c5-4add-b391-9290df5d220b None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:36.259856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1306/2576] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:48:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:36.269855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 14:48:36.295929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:36.315377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a95e8-3fce-47d4-b8d1-c160da4ce462 tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:36.326720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404990d-be77-4348-9fa5-f74ac014cb2f tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2328f165a0bc483998a7666aa2966958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0f733aa4975435bba2668a1fba0908c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:36.328389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404990d-be77-4348-9fa5-f74ac014cb2f tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:36.328992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404990d-be77-4348-9fa5-f74ac014cb2f tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:36.329525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404990d-be77-4348-9fa5-f74ac014cb2f tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] PATH_INFO: `/v3/projects/1a97aef3ff7d4a15a9ec0f6702ddc2f7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:36.332192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404990d-be77-4348-9fa5-f74ac014cb2f tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorizing `identity:get_project(project_id=1a97aef3ff7d4a15a9ec0f6702ddc2f7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:36.336477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404990d-be77-4348-9fa5-f74ac014cb2f tempest-FlavorsAccessNegativeTestJSON-1827494385 tempest-FlavorsAccessNegativeTestJSON-1827494385-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:36.348344 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1271/2577] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 14:48:36 2022] GET /identity/v3/projects/1a97aef3ff7d4a15a9ec0f6702ddc2f7 => generated 395 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:36.664809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c0d83-26c5-4add-b391-9290df5d220b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:36.819546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c0d83-26c5-4add-b391-9290df5d220b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:36.829654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:36.831318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:36.831934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:36.832476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] PATH_INFO: `/v3/users/4e49b2223b5140c59350be6f91f03dcb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:36.834106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e49b2223b5140c59350be6f91f03dcb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:36.837241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:36.939686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e49b2223b5140c59350be6f91f03dcb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:36.940606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e49b2223b5140c59350be6f91f03dcb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:36.960432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e49b2223b5140c59350be6f91f03dcb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:36.961566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e49b2223b5140c59350be6f91f03dcb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:36.975962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e49b2223b5140c59350be6f91f03dcb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:36.978823 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:37.020763 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1307/2578] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:36 2022] DELETE /identity/v3/users/4e49b2223b5140c59350be6f91f03dcb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:37.025411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:37.025838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:37.026264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:37.062456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:37.072446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:37.218830 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1272/2579] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:37.233566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:37.235192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:37.340435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9bcc6-cda6-449c-a9c9-bc767fd000eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:37.345246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:37.346160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:37.346727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:37.347251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:37.364344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:37.366575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:37.403790 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1308/2580] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:39.233544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:39.235284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:39.273305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194635d4-e374-41a3-9007-d7c4e79466be None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:39.287710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:39.290248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:39.290724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:39.291758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] PATH_INFO: `/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:39.295812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9dee3eff62b4eeb9a7df9636b7a810a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:39.298091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:39.313143 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:39.469084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dee3eff62b4eeb9a7df9636b7a810a', 'request_id': 'req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.488610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dee3eff62b4eeb9a7df9636b7a810a', 'request_id': 'req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.523304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dee3eff62b4eeb9a7df9636b7a810a', 'request_id': 'req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.542262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] The token cache is being invalidate because project b9dee3eff62b4eeb9a7df9636b7a810a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:39.542817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.543793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.550007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:39.559752 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1273/2581] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:39 2022] DELETE /identity/v3/projects/b9dee3eff62b4eeb9a7df9636b7a810a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:39.573891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12936-540c-42d9-ba86-ebdc03b0fb8b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:39.679142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:39.680688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:39.680988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:39.681268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] PATH_INFO: `/v3/users/2328f165a0bc483998a7666aa2966958` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:39.683134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2328f165a0bc483998a7666aa2966958)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:39.685641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:39.760689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2328f165a0bc483998a7666aa2966958'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.761389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2328f165a0bc483998a7666aa2966958'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.782002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2328f165a0bc483998a7666aa2966958'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.782969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2328f165a0bc483998a7666aa2966958'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.795368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2328f165a0bc483998a7666aa2966958'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:39.823068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1309/2582] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:39 2022] DELETE /identity/v3/users/2328f165a0bc483998a7666aa2966958 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:40.826340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:40.828442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:40.848480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2cbb-bc11-44bb-ac1c-0f5ffeee604a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:40.937020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:40.939939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:40.940489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:40.941298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] PATH_INFO: `/v3/projects/e0f733aa4975435bba2668a1fba0908c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:40.943925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f733aa4975435bba2668a1fba0908c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:40.947189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:41.012154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f733aa4975435bba2668a1fba0908c', 'request_id': 'req-f66da752-bd9b-40f9-9d65-531e8e34b8ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.017741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f733aa4975435bba2668a1fba0908c', 'request_id': 'req-f66da752-bd9b-40f9-9d65-531e8e34b8ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.025824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f733aa4975435bba2668a1fba0908c', 'request_id': 'req-f66da752-bd9b-40f9-9d65-531e8e34b8ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.037201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] The token cache is being invalidate because project e0f733aa4975435bba2668a1fba0908c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:41.037485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.038121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.040314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1274/2583] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:40 2022] DELETE /identity/v3/projects/e0f733aa4975435bba2668a1fba0908c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:41.044525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:41.046643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:41.064367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76454a31-e67d-4438-8fff-83d0cb3e47e1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:41.080047 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:41.148203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:41.149221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:41.149497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:41.149766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] PATH_INFO: `/v3/users/10cf38e04e5f4d77bbfd9e1550efe34c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:41.151384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10cf38e04e5f4d77bbfd9e1550efe34c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:41.153595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:41.215386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10cf38e04e5f4d77bbfd9e1550efe34c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.216493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10cf38e04e5f4d77bbfd9e1550efe34c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.233079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10cf38e04e5f4d77bbfd9e1550efe34c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.233914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10cf38e04e5f4d77bbfd9e1550efe34c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.243181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8852a6ce-1214-4619-913b-24c063316d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10cf38e04e5f4d77bbfd9e1550efe34c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:41.260534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1310/2584] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:41 2022] DELETE /identity/v3/users/10cf38e04e5f4d77bbfd9e1550efe34c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:42.230180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:42.232274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:42.251228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da752-bd9b-40f9-9d65-531e8e34b8ad admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:42.299285 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:42.387738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:42.388624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:42.388914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:42.389196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] PATH_INFO: `/v3/projects/1a97aef3ff7d4a15a9ec0f6702ddc2f7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:42.390439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a97aef3ff7d4a15a9ec0f6702ddc2f7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:42.392391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:42.497189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a97aef3ff7d4a15a9ec0f6702ddc2f7', 'request_id': 'req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.503511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a97aef3ff7d4a15a9ec0f6702ddc2f7', 'request_id': 'req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.534010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a97aef3ff7d4a15a9ec0f6702ddc2f7', 'request_id': 'req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.548477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] The token cache is being invalidate because project 1a97aef3ff7d4a15a9ec0f6702ddc2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:42.548697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.549555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-70dee1a5-7c9b-46de-b61f-1eceb04a2d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:42.552411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1275/2585] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:42 2022] DELETE /identity/v3/projects/1a97aef3ff7d4a15a9ec0f6702ddc2f7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:42.559215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:42.559659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:42.559659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:42.600395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:42.601925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:42.699333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1311/2586] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:42.710015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:42.711321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:42.711488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:42.746899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:42.748428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:42.759664 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1276/2587] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:42.764814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:42.780358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd76f3-a424-49bb-a62e-8cd00550c90d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:42.789922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:42.791593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:42.791964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:42.792736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:42.793670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:42.794646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:42.796505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:42.811799 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1312/2588] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:42.816393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:42.855815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a50372-fc21-463e-a32a-da8aaaeb8f00 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:42.870986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:42.872555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:42.873658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:42.874142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:42.875637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:42.882427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:42.927492 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1277/2589] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:42 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:42.931782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:42.952493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fd95c-ad0c-4168-9f13-53ee72a2e962 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:42.996701 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:43.103602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:43.104613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.105415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.105935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.107169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:43.109266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:43.153283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1313/2590] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:42 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:43.157966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:43.175200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490af248-9a0b-4c84-961b-9e7beeb9cf0b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:43.181432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:43.182630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.182993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.183411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.184196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:43.185966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:43.206279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1278/2591] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:43.211342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:43.228585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f371-5055-4e7c-954a-944a0fa7ba20 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:43.239334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413c7f-f95b-4eb9-8ca8-b23d89fb5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:43.240533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413c7f-f95b-4eb9-8ca8-b23d89fb5a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.240533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413c7f-f95b-4eb9-8ca8-b23d89fb5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.240899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413c7f-f95b-4eb9-8ca8-b23d89fb5a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.243335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413c7f-f95b-4eb9-8ca8-b23d89fb5a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:43.245138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413c7f-f95b-4eb9-8ca8-b23d89fb5a3b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:43.260533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1314/2592] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:43.261513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:43.272131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6744-c167-496c-9c33-af7a2d070873 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:43.277607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:43.278578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.278829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.279093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] PATH_INFO: `/v3/projects/1e3966d5c9ec438ca23fc1ce40a83099/users/e66959dbdbc94dd5ae80ef876b41c0d2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.296664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3966d5c9ec438ca23fc1ce40a83099, user_id=e66959dbdbc94dd5ae80ef876b41c0d2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:43.299625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:43.332892 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1279/2593] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:43 2022] PUT /identity/v3/projects/1e3966d5c9ec438ca23fc1ce40a83099/users/e66959dbdbc94dd5ae80ef876b41c0d2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:43.345550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.345889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.346181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.388523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] MFA Rules not processed for user `e66959dbdbc94dd5ae80ef876b41c0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:43.390419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:43.505205 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1315/2594] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:48:43.506594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:43.650798 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:43.686063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc198144-1c4d-495f-a436-c209ec7c498a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:43.700831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:43.701532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.701826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.702456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.702845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:43.707034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:43.760283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1280/2595] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:43 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:43.764512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:43.781287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88938b9e-8500-4ce8-9899-170158d73308 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:43.939953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:43.940659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:43.940952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:43.941236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:43.941946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:43.943922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:44.004555 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1316/2596] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:43 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:44.005859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:44.026061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87befd6c-01c4-4818-8ff8-e80608591f31 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:44.037339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:44.038108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:44.038424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:44.038747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:44.041162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:44.044363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:44.091227 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1281/2597] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:44.095396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:44.113158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24ebd-249b-44a6-bb90-bc700971195d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:44.120377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:44.122211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:44.122629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:44.122917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] PATH_INFO: `/v3/projects/fc461ae555fa4cc1a1659469506c6016/users/c091a9b527064435b374c5b045178516/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:44.147461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc461ae555fa4cc1a1659469506c6016, user_id=c091a9b527064435b374c5b045178516, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:44.151065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:44.154841 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:44.172874 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1317/2598] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:44 2022] PUT /identity/v3/projects/fc461ae555fa4cc1a1659469506c6016/users/c091a9b527064435b374c5b045178516/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:44.174096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:44.188970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b539cf-79cc-41ff-b17d-3cbc107e0735 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:44.330035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fb3e6-3686-45c2-b554-d00ff0a9acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:44.330899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fb3e6-3686-45c2-b554-d00ff0a9acd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:44.331031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fb3e6-3686-45c2-b554-d00ff0a9acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:44.331311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fb3e6-3686-45c2-b554-d00ff0a9acd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:44.332136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fb3e6-3686-45c2-b554-d00ff0a9acd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:44.333797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fb3e6-3686-45c2-b554-d00ff0a9acd9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:44.355697 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1282/2599] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:48:44.360297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:44.421390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbd73-4325-4e67-abe1-62c351815b31 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:44.438097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:44.439438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:44.439883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:44.440426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] PATH_INFO: `/v3/projects/fc461ae555fa4cc1a1659469506c6016/users/c091a9b527064435b374c5b045178516/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:44.443450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc461ae555fa4cc1a1659469506c6016, user_id=c091a9b527064435b374c5b045178516, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:44.447251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:44.478950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1318/2600] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:44 2022] PUT /identity/v3/projects/fc461ae555fa4cc1a1659469506c6016/users/c091a9b527064435b374c5b045178516/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:44.490025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:44.491510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:44.492491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:44.564206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] MFA Rules not processed for user `c091a9b527064435b374c5b045178516`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:44.566009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:44.809260 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1283/2601] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:45.091825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:45.093674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:45.243622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fd4f-3119-4bb2-acfb-b153b96ff740 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:45.256819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:45.259094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:45.259652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:45.260078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:45.273783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:45.275766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:45.290473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1319/2602] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:45.336481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:45.339256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:45.427643 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:45.466970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5d85-f71e-40a0-a511-bd23014f5da8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:45.473471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:45.474435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:45.474854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:45.475247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:45.477472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:45.492380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:45.494802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:45.508669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1284/2603] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:45.605215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:45.608988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:45.646462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b263c8c-36c1-45cd-8c59-6fbfae5a142b service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:45.674467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:45.676282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:45.677112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:45.677943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:45.899670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:45.909211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:45.991068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1320/2604] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:52.236164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:52.238717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:52.261273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185d81c-706a-4adc-82de-3b516ea677c0 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:52.275947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:52.276767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:52.277051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:52.277506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:52.280087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:52.299833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:52.306808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf47be8-2951-4bf7-9358-f4ed7d1dec20 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:52.342938 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1285/2605] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:53.964398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:54.120705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60183769-cdc5-4c5b-afea-15c86c352569 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:54.127391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:54.131198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:54.138914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:54.140141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] PATH_INFO: `/v3/users/e66959dbdbc94dd5ae80ef876b41c0d2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:54.141946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66959dbdbc94dd5ae80ef876b41c0d2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:54.146660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:54.153756 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:54.250874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66959dbdbc94dd5ae80ef876b41c0d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:54.252536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66959dbdbc94dd5ae80ef876b41c0d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:54.270889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66959dbdbc94dd5ae80ef876b41c0d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:54.272796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66959dbdbc94dd5ae80ef876b41c0d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:54.283124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66959dbdbc94dd5ae80ef876b41c0d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:54.308142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1321/2606] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:53 2022] DELETE /identity/v3/users/e66959dbdbc94dd5ae80ef876b41c0d2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:54.309614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:54.310096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:54.310372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:54.340514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:54.343031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:54.433336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1286/2607] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:54.496138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:54.502816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:54.679894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ade342-164b-4d71-bef5-17d4b6277bbb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:54.701348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:54.705711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:54.706685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:54.706977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:54.747408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:54.749064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:54.778001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1322/2608] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:56.401114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:56.403183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:56.417688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa53dd8-d1a4-45e2-b978-f2aea4cd8223 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:56.423403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:56.424582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:56.425066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:56.425742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] PATH_INFO: `/v3/users/98c5142aba9a49bc8138fa10974c4ceb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:56.427515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c5142aba9a49bc8138fa10974c4ceb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:56.435747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:56.543508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c5142aba9a49bc8138fa10974c4ceb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.561915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:56.563683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:56.577220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c5142aba9a49bc8138fa10974c4ceb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.595311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f2df6-0e85-4fec-bb11-e83c9616ddc2 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:56.608497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c5142aba9a49bc8138fa10974c4ceb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.612779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:56.613705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:56.613983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:56.614320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] PATH_INFO: `/v3/projects/1e3966d5c9ec438ca23fc1ce40a83099` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:56.615549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3966d5c9ec438ca23fc1ce40a83099)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:56.618733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:56.627173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c5142aba9a49bc8138fa10974c4ceb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.627874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c5142aba9a49bc8138fa10974c4ceb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.649416 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1287/2609] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:56 2022] DELETE /identity/v3/users/98c5142aba9a49bc8138fa10974c4ceb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:56.724610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3966d5c9ec438ca23fc1ce40a83099', 'request_id': 'req-4605a81b-608e-4f84-8629-8823947632d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.739800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3966d5c9ec438ca23fc1ce40a83099', 'request_id': 'req-4605a81b-608e-4f84-8629-8823947632d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.749858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3966d5c9ec438ca23fc1ce40a83099', 'request_id': 'req-4605a81b-608e-4f84-8629-8823947632d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.768695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] The token cache is being invalidate because project 1e3966d5c9ec438ca23fc1ce40a83099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:56.769096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.770098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:56.777077 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1323/2610] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:56 2022] DELETE /identity/v3/projects/1e3966d5c9ec438ca23fc1ce40a83099 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:56.778966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:56.781108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:56.910713 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:56.967905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf14fc7-5c6e-4fc7-bd30-a968df90da96 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:57.110146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:57.111155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:57.111442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:57.111720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] PATH_INFO: `/v3/users/c091a9b527064435b374c5b045178516` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:57.113505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c091a9b527064435b374c5b045178516)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:57.115257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:57.222631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:57.224193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:57.229071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c091a9b527064435b374c5b045178516'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.264433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a81b-608e-4f84-8629-8823947632d2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:57.281902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c091a9b527064435b374c5b045178516'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.284708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:57.287180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:57.287180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:57.287563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] PATH_INFO: `/v3/projects/1140c993d9a54885b62eb64c1a7ead0d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:57.294912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1140c993d9a54885b62eb64c1a7ead0d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:57.297829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:57.305245 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:57.320885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c091a9b527064435b374c5b045178516'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.354073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c091a9b527064435b374c5b045178516'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.355127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c091a9b527064435b374c5b045178516'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.372055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1288/2611] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:56 2022] DELETE /identity/v3/users/c091a9b527064435b374c5b045178516 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:57.467163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1140c993d9a54885b62eb64c1a7ead0d', 'request_id': 'req-e04e6e9c-5371-4df0-bc20-cabb3744c816'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.482659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1140c993d9a54885b62eb64c1a7ead0d', 'request_id': 'req-e04e6e9c-5371-4df0-bc20-cabb3744c816'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.497041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1140c993d9a54885b62eb64c1a7ead0d', 'request_id': 'req-e04e6e9c-5371-4df0-bc20-cabb3744c816'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.524359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] The token cache is being invalidate because project 1140c993d9a54885b62eb64c1a7ead0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:57.524960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.526910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:57.531958 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1324/2612] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:57 2022] DELETE /identity/v3/projects/1140c993d9a54885b62eb64c1a7ead0d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:57.537599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:57.539981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:57.770270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a93c8-5f7f-4d40-b0a0-0c626dfe22d9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:57.787418 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:57.909649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:57.911277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:57.911705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:57.912139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] PATH_INFO: `/v3/users/8589b1b6f413475e96a7905ad0b54118` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:57.914034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8589b1b6f413475e96a7905ad0b54118)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:57.917177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:58.024108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8589b1b6f413475e96a7905ad0b54118'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.041182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8589b1b6f413475e96a7905ad0b54118'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.053027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8589b1b6f413475e96a7905ad0b54118'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.065353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8589b1b6f413475e96a7905ad0b54118'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.067521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2644adae-6e07-44f9-b736-2fe0f29458e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8589b1b6f413475e96a7905ad0b54118'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.088090 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1289/2613] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:57 2022] DELETE /identity/v3/users/8589b1b6f413475e96a7905ad0b54118 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:58.638405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:58.639960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:58.660295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e6e9c-5371-4df0-bc20-cabb3744c816 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:58.812245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:58.813092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:58.813092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:58.814910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] PATH_INFO: `/v3/projects/fc461ae555fa4cc1a1659469506c6016` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:58.815137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc461ae555fa4cc1a1659469506c6016)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:58.818236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:58.916970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc461ae555fa4cc1a1659469506c6016', 'request_id': 'req-d5974dae-9b89-41f7-bd04-7b8bf05fc293'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.934305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc461ae555fa4cc1a1659469506c6016', 'request_id': 'req-d5974dae-9b89-41f7-bd04-7b8bf05fc293'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.953844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc461ae555fa4cc1a1659469506c6016', 'request_id': 'req-d5974dae-9b89-41f7-bd04-7b8bf05fc293'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.970970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] The token cache is being invalidate because project fc461ae555fa4cc1a1659469506c6016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:58.971638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.974223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5974dae-9b89-41f7-bd04-7b8bf05fc293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:58.977694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1325/2614] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:58 2022] DELETE /identity/v3/projects/fc461ae555fa4cc1a1659469506c6016 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:58.982753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:58.983237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:58.983354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.017365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:59.018722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:59.163525 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1290/2615] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:59.172588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.172908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.173248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.213673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:59.215582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:59.233652 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1326/2616] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:59.236228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.252445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32207082-fab1-4d19-b34f-8505ca713ce0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.263815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:59.264688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.264985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.266323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.267178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:59.268381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:59.270432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:59.305263 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1291/2617] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:59.310631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.327441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70511b7-c22f-4d66-9d11-3b8bf1d8925c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.342807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:59.343517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.343803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.344084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.344793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:59.377991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:59.468656 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:59.499717 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1327/2618] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:59 2022] POST /identity/v3/projects => generated 393 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:59.500827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.501644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.502860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:59.554195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae6d3-dacf-4b25-a423-75f648c572d6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.599605 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:59.660095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac38b6a-782c-411d-a650-8c30e5512894 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.669964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:59.671174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.671576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.671990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.674568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:59.677420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:59.737483 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1328/2619] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:59 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:59.742912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.749224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:59.750120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.750403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.750779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] PATH_INFO: `/v3/projects/dbaa7f1dfbd441c0a37b8c899ed00a0b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.762240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbaa7f1dfbd441c0a37b8c899ed00a0b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:59.764407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:59.769306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49efc-b832-4e2b-9b9f-fcd0ccb5a591 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.785123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:59.786123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.789220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.789879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.790876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:59.792760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:59.825496 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1329/2620] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:59.829494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.851421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc61e4-d223-416d-b9c0-a225f8945692 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.857237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:59.858113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:59.858406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:59.858781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:59.859737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:59.861681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:59.883552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1330/2621] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:59.883552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:59.886133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:59.908110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbaa7f1dfbd441c0a37b8c899ed00a0b', 'request_id': 'req-554a29a1-c074-494c-aaf2-22d68ce1b495'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:59.926127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37454975-7137-4c64-a973-262a34b4d89c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:59.938867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbaa7f1dfbd441c0a37b8c899ed00a0b', 'request_id': 'req-554a29a1-c074-494c-aaf2-22d68ce1b495'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:59.955945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbaa7f1dfbd441c0a37b8c899ed00a0b', 'request_id': 'req-554a29a1-c074-494c-aaf2-22d68ce1b495'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:59.988867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] The token cache is being invalidate because project dbaa7f1dfbd441c0a37b8c899ed00a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:59.992593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:59.997064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:00.001758 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1292/2622] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:59 2022] DELETE /identity/v3/projects/dbaa7f1dfbd441c0a37b8c899ed00a0b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:00.004452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:00.011646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.056295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.059306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.059689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.060147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] PATH_INFO: `/v3/users/a2750a20e81549b4a6839a205161dd5a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.066967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2750a20e81549b4a6839a205161dd5a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:00.070653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:00.191833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a29a1-c074-494c-aaf2-22d68ce1b495 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:00.205935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81547b1-d816-4df4-9f9c-b9022d9e1cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.210835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81547b1-d816-4df4-9f9c-b9022d9e1cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.213502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81547b1-d816-4df4-9f9c-b9022d9e1cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.214081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81547b1-d816-4df4-9f9c-b9022d9e1cf5 admin admin] PATH_INFO: `/v3/projects/16afce854fb74415b42f7e484ef3bc3c/users/1a09caae73ca47428b94e7a2f797d337/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.220242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2750a20e81549b4a6839a205161dd5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:00.224328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2750a20e81549b4a6839a205161dd5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:00.273210 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:00.280368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81547b1-d816-4df4-9f9c-b9022d9e1cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16afce854fb74415b42f7e484ef3bc3c, user_id=1a09caae73ca47428b94e7a2f797d337, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:00.285539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2750a20e81549b4a6839a205161dd5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:00.289936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2750a20e81549b4a6839a205161dd5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:00.293298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81547b1-d816-4df4-9f9c-b9022d9e1cf5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:00.314427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d6f3d3b-6c80-432c-95e3-aaf5736bb20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2750a20e81549b4a6839a205161dd5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:00.330417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1293/2623] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:00 2022] PUT /identity/v3/projects/16afce854fb74415b42f7e484ef3bc3c/users/1a09caae73ca47428b94e7a2f797d337/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:00.331625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef72e3-5815-4630-80cd-d2be5214df7f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.332564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef72e3-5815-4630-80cd-d2be5214df7f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.332564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef72e3-5815-4630-80cd-d2be5214df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.368085 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1331/2624] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:59 2022] DELETE /identity/v3/users/a2750a20e81549b4a6839a205161dd5a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:00.370137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582406-aba8-42a3-a774-39572c577f2d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.370437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582406-aba8-42a3-a774-39572c577f2d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.372116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582406-aba8-42a3-a774-39572c577f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.397753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-22ef72e3-5815-4630-80cd-d2be5214df7f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:00.407673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-22ef72e3-5815-4630-80cd-d2be5214df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.418300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c4582406-aba8-42a3-a774-39572c577f2d None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:00.430507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c4582406-aba8-42a3-a774-39572c577f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.469587 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:00.553178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1332/2625] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:00.555364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.555731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.556059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.573055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1294/2626] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:00.577876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df592d5-6a40-4e27-928a-fc239628d74e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.578388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df592d5-6a40-4e27-928a-fc239628d74e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.579534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df592d5-6a40-4e27-928a-fc239628d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.629243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] MFA Rules not processed for user `1a09caae73ca47428b94e7a2f797d337`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:00.630727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.638179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8df592d5-6a40-4e27-928a-fc239628d74e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:00.643273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8df592d5-6a40-4e27-928a-fc239628d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.669045 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1295/2627] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:00.671178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.674092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.674574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.723041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:00.727046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.749583 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1296/2628] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:00.750758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:00.753075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.803979 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1333/2629] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:00.807127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:00.828659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd2dc5-2767-440f-9d9b-90309b445419 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:00.848879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.852901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.853762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.857199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.862662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:00.863436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:00.872833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:00.904591 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1334/2630] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:00.908544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:00.914539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.951085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119286-d188-43d3-8023-e37d92a8c235 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:00.951304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111af28-7359-497f-9077-a47389c75607 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:00.958153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.958858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.959136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.959411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.964462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.965166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.965459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.965737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.966568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:00.972196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.014689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.018885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.047706 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1297/2631] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:01.048600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.086159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1335/2632] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:00 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:01.087809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.110139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b7be5-992f-4418-9a56-bf96939a3fc9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.207003 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:01.261746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d07a2-88ee-4723-9bc0-f90bb42f3c42 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.274336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.275158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.275455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.275737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.276470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.283279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.323976 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1336/2633] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:01 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:01.331684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.337482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.338419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.338856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.339249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.342997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.345473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.356385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b54b-8063-4b5d-8d8f-581cb38b7297 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.369275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.370159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.371351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.371750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.373772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.379940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.403052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1298/2634] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:01 2022] POST /identity/v3/projects => generated 375 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:01.405244 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1337/2635] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:01.407702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.409123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.432351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b1420-df56-4bb0-b7a5-b52f9e80d8a8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.524485 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:01.565373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ebdd-64e5-4b62-8ca7-c0f9b90da7eb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.581762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.582481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.583268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.583268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.583893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.585972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.589641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.590734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.591034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.591318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] PATH_INFO: `/v3/projects/c0aaa4e62313477188be4ae9c0cfc88f/users/45a88f0893274646b90673d72761d9cd/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.612095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aaa4e62313477188be4ae9c0cfc88f, user_id=45a88f0893274646b90673d72761d9cd, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.615042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.645711 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1338/2636] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:01 2022] PUT /identity/v3/projects/c0aaa4e62313477188be4ae9c0cfc88f/users/45a88f0893274646b90673d72761d9cd/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:01.646821 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1299/2637] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:01 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:49:01.650868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.652995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.684166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2acc-a8f4-4714-8114-e575c9f3182f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.805626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d589667-1add-4716-9fa6-003b8ab2df96 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:01.843612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.847968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.849293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.849826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.851446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.879583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.943736 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1339/2638] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:49:01.946690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:01.952806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:01.956202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:01.957418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:01.957921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:01.958429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:01.960410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:01.976166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:01.998721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f7f63-0cc1-483a-ae87-e0d66dabdb41 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:02.029544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1300/2639] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:02.030477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:02.057631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:02.059222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.059687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.060151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] PATH_INFO: `/v3/projects/a08e192d9b554b73b7feedf563881a1e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.072121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a52c6-dfd1-451a-9230-bdaa32a52419 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:02.077692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08e192d9b554b73b7feedf563881a1e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:02.081347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:02.094107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:02.096990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.098358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.098776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] PATH_INFO: `/v3/projects/c0aaa4e62313477188be4ae9c0cfc88f/users/45a88f0893274646b90673d72761d9cd/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.104298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aaa4e62313477188be4ae9c0cfc88f, user_id=45a88f0893274646b90673d72761d9cd, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:02.115314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:02.150528 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1301/2640] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:02 2022] PUT /identity/v3/projects/c0aaa4e62313477188be4ae9c0cfc88f/users/45a88f0893274646b90673d72761d9cd/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:02.150528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:02.273030 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:02.336763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08e192d9b554b73b7feedf563881a1e', 'request_id': 'req-d19661ef-8750-49bb-ac67-b029fd027971'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.368411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08e192d9b554b73b7feedf563881a1e', 'request_id': 'req-d19661ef-8750-49bb-ac67-b029fd027971'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.375332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafaa7-6509-4ab0-b738-0bacedc5690b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:02.385244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08e192d9b554b73b7feedf563881a1e', 'request_id': 'req-d19661ef-8750-49bb-ac67-b029fd027971'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.426543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] The token cache is being invalidate because project a08e192d9b554b73b7feedf563881a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:02.427144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.432002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d19661ef-8750-49bb-ac67-b029fd027971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.445545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1340/2641] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:01 2022] DELETE /identity/v3/projects/a08e192d9b554b73b7feedf563881a1e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:02.445545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.445545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.445545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.513714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] MFA Rules not processed for user `45a88f0893274646b90673d72761d9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:02.515282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:02.558466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:02.559206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.559535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.559976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.560732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:02.562828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:02.570074 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:02.601548 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1302/2642] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:02.601548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:02.606435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:02.654638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3898c-ecc2-4e3c-8983-04dcfa524864 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:02.671130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:02.672083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.672083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.672083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] PATH_INFO: `/v3/users/9e2d52cf98e04fdca0d604e338ff62b4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.679090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2d52cf98e04fdca0d604e338ff62b4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:02.684564 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1341/2643] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:02.685245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:02.686080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:02.691146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:02.728687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2791ce-6832-4f84-bb62-29b54edeed46 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:02.748223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de71e-5cde-44e3-b21b-b93117c541c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:02.749238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de71e-5cde-44e3-b21b-b93117c541c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.749527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de71e-5cde-44e3-b21b-b93117c541c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.749807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de71e-5cde-44e3-b21b-b93117c541c5 admin admin] PATH_INFO: `/v3/projects/72b3a5fb90ca4d7e8250dd9c29d998fe/users/a197bb8850294b8a8659895eb4a13306/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.789782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de71e-5cde-44e3-b21b-b93117c541c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b3a5fb90ca4d7e8250dd9c29d998fe, user_id=a197bb8850294b8a8659895eb4a13306, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:02.793942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de71e-5cde-44e3-b21b-b93117c541c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:02.803135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2d52cf98e04fdca0d604e338ff62b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.845179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1342/2644] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:02 2022] PUT /identity/v3/projects/72b3a5fb90ca4d7e8250dd9c29d998fe/users/a197bb8850294b8a8659895eb4a13306/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:02.845748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2d52cf98e04fdca0d604e338ff62b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.848215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:02.848553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:02.849248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:02.873122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2d52cf98e04fdca0d604e338ff62b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.909936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2d52cf98e04fdca0d604e338ff62b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.911244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2d52cf98e04fdca0d604e338ff62b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:02.941837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1303/2645] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:02 2022] DELETE /identity/v3/users/9e2d52cf98e04fdca0d604e338ff62b4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:02.964419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] MFA Rules not processed for user `a197bb8850294b8a8659895eb4a13306`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:02.969176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:03.050168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:03.054334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:03.208061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1343/2646] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:03.213218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:03.214959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:03.242443 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:03.332672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4b347-90a7-48c4-a4d4-f8bc9cbd6f07 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:03.338788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:03.339484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.339777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.340102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:03.340826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:03.342636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448889-8322-4300-a600-fcfb68d41829 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:03.342863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:03.362773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:03.364328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.365116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.365468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] PATH_INFO: `/v3/users/1a09caae73ca47428b94e7a2f797d337` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:03.367974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a09caae73ca47428b94e7a2f797d337)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:03.374267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:03.388719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1344/2647] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:03 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:03.394130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:03.492081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a09caae73ca47428b94e7a2f797d337'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:03.535314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a09caae73ca47428b94e7a2f797d337'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:03.552800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a09caae73ca47428b94e7a2f797d337'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:03.555336 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:03.575918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a09caae73ca47428b94e7a2f797d337'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:03.576605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-32b27fd6-62f6-4e14-ac2c-1aed99551605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a09caae73ca47428b94e7a2f797d337'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:03.592841 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1304/2648] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:03 2022] DELETE /identity/v3/users/1a09caae73ca47428b94e7a2f797d337 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:03.598609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.599845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.600711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:03.603487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb2f8-2612-4e9f-8f7c-a67ad56f2dda admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:03.643846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:03.645658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:03.763677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:03.764313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.765435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.765435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:03.765738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:03.772800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:03.829842 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1345/2649] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:03 2022] POST /identity/v3/users => generated 293 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:03.833748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:03.836442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:03.849395 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1305/2650] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:03.849742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0acd-75d6-42df-ad1a-93d0db3b8753 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:03.853331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:03.855084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:03.855789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.856077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.856353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:03.857108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:03.858785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:03.864279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:03.873841 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1346/2651] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:03.875121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:03.892610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7189-7d6b-4676-86f5-4229d0190b2f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:03.895654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8c8a-04cf-4332-b443-c2964442772e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:03.902452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:03.904485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.904485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.904883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] PATH_INFO: `/v3/projects/5281519a410940dabc8da34139d5260b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:03.907155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5281519a410940dabc8da34139d5260b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:03.918239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:03.919496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:03.920419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:03.921997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:03.923016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] PATH_INFO: `/v3/projects/2d1e80faff6247b0a7544d76ca5ac005/users/1ac54ddd65cb44a2bac5b9bf5f8f3f80/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.007777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1e80faff6247b0a7544d76ca5ac005, user_id=1ac54ddd65cb44a2bac5b9bf5f8f3f80, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.012063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.026343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5281519a410940dabc8da34139d5260b', 'request_id': 'req-829231cf-270a-49dc-a40c-b5047604cf3b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:04.028141 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:04.034320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5281519a410940dabc8da34139d5260b', 'request_id': 'req-829231cf-270a-49dc-a40c-b5047604cf3b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:04.059887 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1347/2652] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:03 2022] PUT /identity/v3/projects/2d1e80faff6247b0a7544d76ca5ac005/users/1ac54ddd65cb44a2bac5b9bf5f8f3f80/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:04.062266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.062708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5281519a410940dabc8da34139d5260b', 'request_id': 'req-829231cf-270a-49dc-a40c-b5047604cf3b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:04.066259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.080716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] The token cache is being invalidate because project 5281519a410940dabc8da34139d5260b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:04.081236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:04.082064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:04.090398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1306/2653] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:03 2022] DELETE /identity/v3/projects/5281519a410940dabc8da34139d5260b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:04.090398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.092222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.186057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829231cf-270a-49dc-a40c-b5047604cf3b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.217753 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:04.270782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7801-73ee-41a6-9df3-d1abc15f54b4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.284450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.285656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.286107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.286658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.290240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.301345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c5ebd-48c2-4159-9451-a2e69893cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.302147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5ebd-48c2-4159-9451-a2e69893cb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.302697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5ebd-48c2-4159-9451-a2e69893cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.303618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5ebd-48c2-4159-9451-a2e69893cb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.304409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c5ebd-48c2-4159-9451-a2e69893cb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.306283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c5ebd-48c2-4159-9451-a2e69893cb93 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.317835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.321113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.324299 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1307/2654] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:04.327800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ffc89-b895-48b7-b7fb-7583343ae6cb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.329727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ffc89-b895-48b7-b7fb-7583343ae6cb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.330087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ffc89-b895-48b7-b7fb-7583343ae6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.341705 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1348/2655] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:04.347600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.369085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2a67-a9f4-4b2b-b54a-9abab99844ba service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.371609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-168ffc89-b895-48b7-b7fb-7583343ae6cb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:04.375173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-168ffc89-b895-48b7-b7fb-7583343ae6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.376518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bbc5e-85d8-4831-a0e4-2e2569a933f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.377522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bbc5e-85d8-4831-a0e4-2e2569a933f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.377903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bbc5e-85d8-4831-a0e4-2e2569a933f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.378299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bbc5e-85d8-4831-a0e4-2e2569a933f1 admin admin] PATH_INFO: `/v3/projects/2d1e80faff6247b0a7544d76ca5ac005/users/1ac54ddd65cb44a2bac5b9bf5f8f3f80/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.380637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bbc5e-85d8-4831-a0e4-2e2569a933f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1e80faff6247b0a7544d76ca5ac005, user_id=1ac54ddd65cb44a2bac5b9bf5f8f3f80, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.385434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bbc5e-85d8-4831-a0e4-2e2569a933f1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.391184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1308/2656] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:04.394336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.394943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.396539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.404157 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1349/2657] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:04 2022] PUT /identity/v3/projects/2d1e80faff6247b0a7544d76ca5ac005/users/1ac54ddd65cb44a2bac5b9bf5f8f3f80/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:04.422150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.422358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.422665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.442756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:04.448660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.487070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] MFA Rules not processed for user `1ac54ddd65cb44a2bac5b9bf5f8f3f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:04.488320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.599590 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1309/2658] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:04.604389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.620294 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1350/2659] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:04.623418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e060-88dc-4cdf-b7fd-090e07bead50 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.629124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.630834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:04.634015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.634854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.635238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.635585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.636927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:04.637239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.639149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.659195 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1310/2660] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:49:04.665428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.682517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd36789-74a3-4d77-9c2f-5116230c70ba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.689893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.691576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.691812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.692119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.694016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.695901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.738534 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1311/2661] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:04 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:04.743624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.780021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a82cb-19f2-451e-ac68-8e0783257790 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.804304 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:04.882093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee88af-7232-4b56-8335-7dd51b1474e0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.896506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.899160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.899747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.900661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.902698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.903583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.904701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.904839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.905169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.906792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.956447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1312/2662] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:04 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:04.958187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:04.974790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9da78-2e09-46ed-8a40-9d3819af5070 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:04.990305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:04.992173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:04.992640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:04.992997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:04.993826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:04.995578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:04.997543 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:05.023296 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1313/2663] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:05.025065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.039327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e155b-6407-4883-8205-e6d20470aef0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.046425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:05.047222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.047512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.047790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.048733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.050273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.050796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.053276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.068357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1314/2664] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:05.071314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.076727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:05.089845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1351/2665] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:49:05.091636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.109471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432cc01-60da-450d-9f25-fb7db8a40a9d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.118756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:05.120005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.120697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.128365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022d8c3-3deb-4fdd-b627-583f18c2afbf service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.131796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] PATH_INFO: `/v3/projects/16afce854fb74415b42f7e484ef3bc3c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.133810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16afce854fb74415b42f7e484ef3bc3c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.136732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.140217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f59580-f015-481e-baa5-c0d282450564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:05.141684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59580-f015-481e-baa5-c0d282450564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.141998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59580-f015-481e-baa5-c0d282450564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.142287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59580-f015-481e-baa5-c0d282450564 admin admin] PATH_INFO: `/v3/projects/382365fd0ac441e49e02369f41e9f547/users/9570506719b242b0b347b4ba8d81fb6c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.174317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f59580-f015-481e-baa5-c0d282450564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382365fd0ac441e49e02369f41e9f547, user_id=9570506719b242b0b347b4ba8d81fb6c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.177143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f59580-f015-481e-baa5-c0d282450564 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.199122 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1352/2666] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:05 2022] PUT /identity/v3/projects/382365fd0ac441e49e02369f41e9f547/users/9570506719b242b0b347b4ba8d81fb6c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:05.211286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.211750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.212176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.218679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16afce854fb74415b42f7e484ef3bc3c', 'request_id': 'req-98aa5893-c480-48cc-ac13-adbea9106b31'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.238995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16afce854fb74415b42f7e484ef3bc3c', 'request_id': 'req-98aa5893-c480-48cc-ac13-adbea9106b31'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.248965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] MFA Rules not processed for user `9570506719b242b0b347b4ba8d81fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:05.250308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:05.257214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16afce854fb74415b42f7e484ef3bc3c', 'request_id': 'req-98aa5893-c480-48cc-ac13-adbea9106b31'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.288927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] The token cache is being invalidate because project 16afce854fb74415b42f7e484ef3bc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:05.289228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.289951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.292797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1315/2667] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:05 2022] DELETE /identity/v3/projects/16afce854fb74415b42f7e484ef3bc3c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:05.297796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.300411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:05.389628 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1353/2668] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:05.399507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.401616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:05.427039 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:05.497794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa5893-c480-48cc-ac13-adbea9106b31 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.523696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:05.524763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.525168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.525568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] PATH_INFO: `/v3/users/45a88f0893274646b90673d72761d9cd` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.530095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a88f0893274646b90673d72761d9cd)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.534411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.608346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d710-9c61-4f72-aae1-ecbab020e0d0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.634365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:05.636950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.637750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.638623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.639574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.642342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.652625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a88f0893274646b90673d72761d9cd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.699051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a88f0893274646b90673d72761d9cd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.716256 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:05.720264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1354/2669] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:05 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:05.722453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.727215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a88f0893274646b90673d72761d9cd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.728118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:05.744520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a88f0893274646b90673d72761d9cd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.745270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a88f0893274646b90673d72761d9cd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:05.756561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1316/2670] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:05 2022] DELETE /identity/v3/users/45a88f0893274646b90673d72761d9cd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:05.757495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.759112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:05.898388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f36964-f4ed-44d8-824e-d59dfa781d2e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.904779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5267bb-7bd5-4093-b60e-e1d73f6bb43f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:05.919369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:05.920085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:05.920377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:05.920667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:05.921400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:05.923516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:05.971924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1317/2671] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:05 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:05.975986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:05.992961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f539b-7b1a-4459-850e-0a101fc4ed47 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:06.005340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:06.006031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.006883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.007169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.011996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:06.014868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:06.028808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:06.029485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.029774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.030052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.035562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:06.042574 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1318/2672] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:06.049662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:06.077775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32fed-233a-4f19-9bf7-f9080345c060 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:06.093695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:06.094643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.094931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.095212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] PATH_INFO: `/v3/projects/a0dbdf444f4f430fb43614a1adca6730/users/7b992bae4edb4134bb504b2a8ab55847/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.127334 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:06.138888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dbdf444f4f430fb43614a1adca6730, user_id=7b992bae4edb4134bb504b2a8ab55847, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:06.145148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:06.161472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:06.163432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:06.173525 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1355/2673] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:06.181127 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1319/2674] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:06 2022] PUT /identity/v3/projects/a0dbdf444f4f430fb43614a1adca6730/users/7b992bae4edb4134bb504b2a8ab55847/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:06.185602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:06.210572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365739d-3adf-42bc-aec1-581e2acc8cf2 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:06.345324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9c02e-87aa-4220-a68b-161ed4bf3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:06.346656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c02e-87aa-4220-a68b-161ed4bf3954 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.347108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c02e-87aa-4220-a68b-161ed4bf3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.347576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c02e-87aa-4220-a68b-161ed4bf3954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.349281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9c02e-87aa-4220-a68b-161ed4bf3954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:06.351240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9c02e-87aa-4220-a68b-161ed4bf3954 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:06.365366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1356/2675] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:06.370456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:06.388384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b3c6a-486a-4467-998e-348f30234251 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:06.395830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bdbb-0d63-4e9e-bbb6-997bf4bf0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:06.397759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bdbb-0d63-4e9e-bbb6-997bf4bf0a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.398711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bdbb-0d63-4e9e-bbb6-997bf4bf0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.399253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bdbb-0d63-4e9e-bbb6-997bf4bf0a97 admin admin] PATH_INFO: `/v3/projects/a0dbdf444f4f430fb43614a1adca6730/users/7b992bae4edb4134bb504b2a8ab55847/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.409014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bdbb-0d63-4e9e-bbb6-997bf4bf0a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dbdf444f4f430fb43614a1adca6730, user_id=7b992bae4edb4134bb504b2a8ab55847, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:06.412889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bdbb-0d63-4e9e-bbb6-997bf4bf0a97 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:06.456017 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1320/2676] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:06 2022] PUT /identity/v3/projects/a0dbdf444f4f430fb43614a1adca6730/users/7b992bae4edb4134bb504b2a8ab55847/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:06.458956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.459315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.459610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.491914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] MFA Rules not processed for user `7b992bae4edb4134bb504b2a8ab55847`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:06.493376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:06.692954 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1357/2677] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:06.706914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6702f-d380-4c4b-a512-66bf2e37ed03 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:06.707470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6702f-d380-4c4b-a512-66bf2e37ed03 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:06.708068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6702f-d380-4c4b-a512-66bf2e37ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:06.734428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b7e6702f-d380-4c4b-a512-66bf2e37ed03 None None] MFA Rules not processed for user `9570506719b242b0b347b4ba8d81fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:06.736177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7e6702f-d380-4c4b-a512-66bf2e37ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:06.849717 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1321/2678] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:07.202336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:07.205359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:07.329907 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:07.347992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf602-7fcf-46aa-bfe8-53976a6ecfe4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:07.353908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:07.354955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:07.355310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:07.355659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] PATH_INFO: `/v3/projects/c0aaa4e62313477188be4ae9c0cfc88f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:07.357052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0aaa4e62313477188be4ae9c0cfc88f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:07.359273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:07.432663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0aaa4e62313477188be4ae9c0cfc88f', 'request_id': 'req-d6805869-da7b-4835-a63a-09f9f210f4c0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:07.444830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0aaa4e62313477188be4ae9c0cfc88f', 'request_id': 'req-d6805869-da7b-4835-a63a-09f9f210f4c0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:07.452957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0aaa4e62313477188be4ae9c0cfc88f', 'request_id': 'req-d6805869-da7b-4835-a63a-09f9f210f4c0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:07.469487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] The token cache is being invalidate because project c0aaa4e62313477188be4ae9c0cfc88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:07.470095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:07.471144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:07.474378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1358/2679] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:07 2022] DELETE /identity/v3/projects/c0aaa4e62313477188be4ae9c0cfc88f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:07.484177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a19dd-c5a7-41a4-9e5f-8de70e259564 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:07.484757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a19dd-c5a7-41a4-9e5f-8de70e259564 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:07.485215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a19dd-c5a7-41a4-9e5f-8de70e259564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:07.538891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ee0a19dd-c5a7-41a4-9e5f-8de70e259564 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:07.544513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ee0a19dd-c5a7-41a4-9e5f-8de70e259564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:07.582451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:07.584072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:07.635273 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:07.739593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6805869-da7b-4835-a63a-09f9f210f4c0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:07.746857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1322/2680] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:07.748398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505846-1600-4575-9735-2073b368402c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:07.748502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505846-1600-4575-9735-2073b368402c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:07.748796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505846-1600-4575-9735-2073b368402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:07.752097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:07.752774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:07.753069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:07.753350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:07.766128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:07.781998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d8505846-1600-4575-9735-2073b368402c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:07.785469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8505846-1600-4575-9735-2073b368402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:07.807813 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1323/2681] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:07.811822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505846-1600-4575-9735-2073b368402c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:07.837863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505846-1600-4575-9735-2073b368402c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:07.843527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:07.844210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:07.844501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:07.844781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:07.845579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:07.845897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:07.847609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:07.878876 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1324/2682] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:07.884731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:07.902010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d52077-3032-435a-9c20-e63e42083561 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:07.907684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:07.908563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:07.909338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:07.909746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:07.910274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:07.910804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:07.911732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:07.914296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:07.948872 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1359/2683] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:07.988059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1325/2684] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:07 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:07.988761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.016536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0904-0f87-41b5-9636-26bf6868cd35 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.055857 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:08.153567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.153567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.153567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.153567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.154064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.155823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.189559 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1360/2685] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:07 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:49:08.192654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.203977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308c7d-38ac-4f3a-aa45-9a39e275080a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.215798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.216406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.220742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.220742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.220742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.220742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.252927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1326/2686] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:08.256129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.268239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad32751-b066-4d16-b9e8-f8947594e92a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.276461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253e48-6529-48dd-a7a8-430d640907ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.277211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253e48-6529-48dd-a7a8-430d640907ec admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.277386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253e48-6529-48dd-a7a8-430d640907ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.277660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253e48-6529-48dd-a7a8-430d640907ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.278394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253e48-6529-48dd-a7a8-430d640907ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.280132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253e48-6529-48dd-a7a8-430d640907ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.294034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1361/2687] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:49:08.297975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.311611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad733-2862-4915-b83e-42005518adff admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.317183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.317605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.317997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.318378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] PATH_INFO: `/v3/projects/3f4eb77d9404438996454f2837c9af93/users/88b9f89a5a54456fb4fb6773844b95a2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.341731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4eb77d9404438996454f2837c9af93, user_id=88b9f89a5a54456fb4fb6773844b95a2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.344738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.368834 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1327/2688] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:08 2022] PUT /identity/v3/projects/3f4eb77d9404438996454f2837c9af93/users/88b9f89a5a54456fb4fb6773844b95a2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:08.379772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.380374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.380881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.430957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] MFA Rules not processed for user `88b9f89a5a54456fb4fb6773844b95a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:08.432449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:08.515495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.520370 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1362/2689] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:08.608947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c319-576e-4076-b12d-3c538afb37c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.615922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.616670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.617016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.617516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.618393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.620653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.660359 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1328/2690] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:08 2022] POST /identity/v3/projects => generated 397 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:08.666826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.681740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12d31-415d-4ffa-9bcb-deefac451105 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.754662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.755734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.755734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.755944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.757048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.759054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.791463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.793309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:08.817712 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1363/2691] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:08 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:08.819209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.820298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8480c-ff89-45fb-9585-c381d14c2354 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.831418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300dced-87a4-4432-84d3-eb773bc3c84f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.833715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.835181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.835467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.835742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] PATH_INFO: `/v3/users/a197bb8850294b8a8659895eb4a13306` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.838628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.839306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.839592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.839870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.840651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.842260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.845584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a197bb8850294b8a8659895eb4a13306)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.847335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.858880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1364/2692] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:08.863785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.874113 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:08.879886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511941-9539-4144-99c0-59e14150e6e4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:08.889649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:08.890667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:08.891096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:08.891591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] PATH_INFO: `/v3/projects/5e0d6ce513194c299ff53737406f0a23/users/31f5a547647b4229ab02bf95835ba51e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:08.916882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0d6ce513194c299ff53737406f0a23, user_id=31f5a547647b4229ab02bf95835ba51e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:08.921245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:08.924394 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:08.936746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a197bb8850294b8a8659895eb4a13306'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:08.962945 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1365/2693] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:08 2022] PUT /identity/v3/projects/5e0d6ce513194c299ff53737406f0a23/users/31f5a547647b4229ab02bf95835ba51e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:08.963629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:08.964223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a197bb8850294b8a8659895eb4a13306'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:08.981154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a197bb8850294b8a8659895eb4a13306'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:08.996069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a197bb8850294b8a8659895eb4a13306'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:08.997189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67528c3f-2772-4785-a6d6-d3c07df8c434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a197bb8850294b8a8659895eb4a13306'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:09.006000 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1329/2694] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:08 2022] DELETE /identity/v3/users/a197bb8850294b8a8659895eb4a13306 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:09.011699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.012256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.012743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.048340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:09.053632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.085756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f0d5-b2f0-4446-93ff-e6aba9e4f4d6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:09.145256 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1330/2695] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:09.157262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:09.161802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.187481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:09.188310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.188645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.189412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.191548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:09.195125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:09.210895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1366/2696] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:09.214846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:09.217198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.231926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866ed9-13c3-44c1-99c7-e71d1a037c97 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:09.233601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaacf1-a47f-4b63-83eb-c5edd3b9c69d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:09.237182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508d552-29b4-4412-a555-dd8222c6ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:09.238038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d552-29b4-4412-a555-dd8222c6ecf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.238159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:09.238359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d552-29b4-4412-a555-dd8222c6ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.238609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d552-29b4-4412-a555-dd8222c6ecf7 admin admin] PATH_INFO: `/v3/projects/5e0d6ce513194c299ff53737406f0a23/users/31f5a547647b4229ab02bf95835ba51e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.239008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.239400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.239702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.241256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508d552-29b4-4412-a555-dd8222c6ecf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0d6ce513194c299ff53737406f0a23, user_id=31f5a547647b4229ab02bf95835ba51e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:09.243918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508d552-29b4-4412-a555-dd8222c6ecf7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:09.252074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:09.253429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:09.260909 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1367/2697] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:09 2022] PUT /identity/v3/projects/5e0d6ce513194c299ff53737406f0a23/users/31f5a547647b4229ab02bf95835ba51e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:09.267912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.268816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.269101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.270624 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1331/2698] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:09.301685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] MFA Rules not processed for user `31f5a547647b4229ab02bf95835ba51e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:09.303492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.384345 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:09.403388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1368/2699] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:09.709619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:09.711240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.764195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:09.765970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.792395 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:09.815255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a744a-c31a-4513-8414-f6d6b79a6026 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:09.866228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c83e6-a47d-4817-bd44-1af6d0d432d3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:09.871608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:09.872636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.872925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.873276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] PATH_INFO: `/v3/projects/72b3a5fb90ca4d7e8250dd9c29d998fe` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.874640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b3a5fb90ca4d7e8250dd9c29d998fe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:09.878360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:09.963848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:09.964682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:09.965239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:09.965804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:09.968139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b3a5fb90ca4d7e8250dd9c29d998fe', 'request_id': 'req-bb566fd6-86fc-400b-abb0-785cbdeb24c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:09.968319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:09.978330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b3a5fb90ca4d7e8250dd9c29d998fe', 'request_id': 'req-bb566fd6-86fc-400b-abb0-785cbdeb24c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:09.986325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b3a5fb90ca4d7e8250dd9c29d998fe', 'request_id': 'req-bb566fd6-86fc-400b-abb0-785cbdeb24c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.000467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] The token cache is being invalidate because project 72b3a5fb90ca4d7e8250dd9c29d998fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:10.001062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.002202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.007794 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1369/2700] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:09 2022] DELETE /identity/v3/projects/72b3a5fb90ca4d7e8250dd9c29d998fe => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:10.009761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:10.011966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:10.092044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:10.093806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:10.106813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566fd6-86fc-400b-abb0-785cbdeb24c5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:10.112366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:10.113258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:10.113544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:10.113826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] PATH_INFO: `/v3/users/1ac54ddd65cb44a2bac5b9bf5f8f3f80` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:10.115262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac54ddd65cb44a2bac5b9bf5f8f3f80)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:10.121125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:10.121784 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1332/2701] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:10.159167 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:10.235353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac54ddd65cb44a2bac5b9bf5f8f3f80'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.236170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac54ddd65cb44a2bac5b9bf5f8f3f80'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.254650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac54ddd65cb44a2bac5b9bf5f8f3f80'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.255491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac54ddd65cb44a2bac5b9bf5f8f3f80'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.264071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac54ddd65cb44a2bac5b9bf5f8f3f80'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:10.288670 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1370/2702] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:10 2022] DELETE /identity/v3/users/1ac54ddd65cb44a2bac5b9bf5f8f3f80 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:11.121904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.148693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452584d-646f-4a75-b470-ab9f48dcaff6 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:11.295123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:11.297781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.298071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.298348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] PATH_INFO: `/v3/projects/2d1e80faff6247b0a7544d76ca5ac005` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.302578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1e80faff6247b0a7544d76ca5ac005)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:11.308301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:11.395026 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:11.407246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1e80faff6247b0a7544d76ca5ac005', 'request_id': 'req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:11.414827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1e80faff6247b0a7544d76ca5ac005', 'request_id': 'req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:11.428892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1e80faff6247b0a7544d76ca5ac005', 'request_id': 'req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:11.453293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.455578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:11.458613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] The token cache is being invalidate because project 2d1e80faff6247b0a7544d76ca5ac005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:11.458613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:11.463102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55b149ef-6b3b-4ce9-b4f3-b3953f5a3563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:11.471162 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1333/2703] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:11 2022] DELETE /identity/v3/projects/2d1e80faff6247b0a7544d76ca5ac005 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:11.474024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099918-c0cd-4dd7-b56c-62a2c7614128 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.477466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099918-c0cd-4dd7-b56c-62a2c7614128 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.477912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099918-c0cd-4dd7-b56c-62a2c7614128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.533782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-19099918-c0cd-4dd7-b56c-62a2c7614128 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:11.535386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-19099918-c0cd-4dd7-b56c-62a2c7614128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:11.680685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387568-4ac9-4128-9894-53c27703e010 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:11.719787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1334/2704] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:11.728794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.729342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.729627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.770293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:11.774038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:11.792637 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1335/2705] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:11.798458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.818369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af566a-030f-47b8-8aca-ceb0e2baeea7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:11.827911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:11.828792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.829084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.829651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.832380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:11.834241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:11.835144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.835546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.835835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.836614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:11.837015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:11.840143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:11.866703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1336/2706] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:49:11.872148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.896726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81831d-e155-4e7b-b4c6-f287233f6920 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:11.908249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:11.909075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.909368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.909651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.910487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:11.913027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:11.931744 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:11.973197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:11.975952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:11.980238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1337/2707] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:11.984474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.997719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1371/2708] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:49:12.179039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ecd9b-d0ac-46d5-b0fb-9c3d68cfd745 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.194283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.195181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.195473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.196533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.196533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.199551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:12.266280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1338/2709] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:11 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:12.267906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:12.288792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63dea8-5f97-4c1e-b5d2-c84e7d64cffb service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.314059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.314815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.315103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.315380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.316129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.318112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:12.345342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1372/2710] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:12.346819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:12.365084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3a44-d1e6-490a-aedf-91ce86bc0cb1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.380185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.381367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.381764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.382171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.383819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.386960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:12.409730 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:12.433565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:12.444776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1339/2711] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:12.447263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d12f09-8070-4ff8-a71a-c02a337d88f6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.464479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23fe6-840f-4447-acbc-c8a49ee6556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.469977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23fe6-840f-4447-acbc-c8a49ee6556f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.472193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23fe6-840f-4447-acbc-c8a49ee6556f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.472854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23fe6-840f-4447-acbc-c8a49ee6556f admin admin] PATH_INFO: `/v3/projects/772c96aaff754bb9a5570f0b6d17c945/users/f5aac81d4e814d8badfad2bafebf9565/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.531633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:12.531633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:12.548327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23fe6-840f-4447-acbc-c8a49ee6556f admin admin] RBAC: Authorizing `identity:create_grant(project_id=772c96aaff754bb9a5570f0b6d17c945, user_id=f5aac81d4e814d8badfad2bafebf9565, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.558014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23fe6-840f-4447-acbc-c8a49ee6556f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:12.597076 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1373/2712] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:12 2022] PUT /identity/v3/projects/772c96aaff754bb9a5570f0b6d17c945/users/f5aac81d4e814d8badfad2bafebf9565/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:12.615074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.615967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.616236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.674149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] MFA Rules not processed for user `f5aac81d4e814d8badfad2bafebf9565`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:12.675505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:12.732244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5233a-3080-4ebf-84fd-13e8ca007ceb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.808539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1374/2713] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:12.813837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:12.848299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.848966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.849262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.849556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.852873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:12.951862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.954355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:12.960824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985805-b08c-4872-8e45-b290bd64e3cd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.968626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1340/2714] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:49:12.985311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.986833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.987360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.987847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.988817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.992926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.039545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1375/2715] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:12 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:13.043910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:13.102096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862df5-c020-41bb-b20b-905944137b36 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:13.228036 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:13.303951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:13.304679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.304970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.305255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.305988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:13.308061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.357490 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1341/2716] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:13 2022] POST /identity/v3/users => generated 298 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:13.361735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:13.382290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2506e5-6ee0-4eec-86ae-0800b83b54bf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:13.400210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:13.400923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.401725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.407559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.409214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:13.411645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.449673 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1376/2717] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:13.460974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:13.502471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49671bba-032c-4236-8f43-f6a455f484c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:13.519520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:13.521419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.522798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.523618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] PATH_INFO: `/v3/projects/a4957687cd8d4f92909374cb11224b53/users/991e542da64b496792365bcc205a7897/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.585804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4957687cd8d4f92909374cb11224b53, user_id=991e542da64b496792365bcc205a7897, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:13.588231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.613779 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1342/2718] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:13 2022] PUT /identity/v3/projects/a4957687cd8d4f92909374cb11224b53/users/991e542da64b496792365bcc205a7897/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:13.619703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:13.640110 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:13.652482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709dd3-236c-4520-9412-24e5ae33f68a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:13.768642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773c1a-7277-4d37-9b62-f1b44a095347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:13.770386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773c1a-7277-4d37-9b62-f1b44a095347 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.771547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773c1a-7277-4d37-9b62-f1b44a095347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.772794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773c1a-7277-4d37-9b62-f1b44a095347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.774812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773c1a-7277-4d37-9b62-f1b44a095347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:13.778633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773c1a-7277-4d37-9b62-f1b44a095347 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.801057 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1377/2719] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:13.807555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:13.832714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2665-3d85-4460-b012-dde6bf743bba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:13.841172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:13.842839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.844639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.844639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] PATH_INFO: `/v3/projects/a4957687cd8d4f92909374cb11224b53/users/991e542da64b496792365bcc205a7897/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.848383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4957687cd8d4f92909374cb11224b53, user_id=991e542da64b496792365bcc205a7897, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:13.868515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.898567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1343/2720] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:13 2022] PUT /identity/v3/projects/a4957687cd8d4f92909374cb11224b53/users/991e542da64b496792365bcc205a7897/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:13.915855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.916306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.918005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.971689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] MFA Rules not processed for user `991e542da64b496792365bcc205a7897`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:13.973146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:14.114793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1378/2721] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:14.354799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:14.540866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f1b1-84ec-4d7f-ba5a-c2981b0a8f9b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:14.572569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7632e-04f1-44db-89bc-80a196f24e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:14.573751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7632e-04f1-44db-89bc-80a196f24e5d service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:14.574274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7632e-04f1-44db-89bc-80a196f24e5d service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:14.574831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7632e-04f1-44db-89bc-80a196f24e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:14.596360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7632e-04f1-44db-89bc-80a196f24e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:14.600033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7632e-04f1-44db-89bc-80a196f24e5d service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:14.617161 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1344/2722] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:15.702042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:15.828741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbb10-58dc-4bc4-aff6-e35135a83789 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:15.837101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:15.838117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:15.838651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:15.839169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] PATH_INFO: `/v3/users/f5aac81d4e814d8badfad2bafebf9565` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:15.841664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aac81d4e814d8badfad2bafebf9565)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:15.845575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:15.911857 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:15.948276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aac81d4e814d8badfad2bafebf9565'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:15.949277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aac81d4e814d8badfad2bafebf9565'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:15.968548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aac81d4e814d8badfad2bafebf9565'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:15.969431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aac81d4e814d8badfad2bafebf9565'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:15.979392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aac81d4e814d8badfad2bafebf9565'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:16.018642 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1379/2723] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:15 2022] DELETE /identity/v3/users/f5aac81d4e814d8badfad2bafebf9565 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:16.024745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:16.025346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:16.025550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:16.091517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:16.093678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:16.211530 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1345/2724] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:16.240992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:16.242546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:16.346050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:16.346245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:16.365431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205fba2-3b40-4186-863a-1897f05f9914 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:16.368897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e845d-46bc-416b-ae1d-e5f17666e2d4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:16.371582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b323-4640-4ae1-82be-ccbfbab06866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:16.372406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b323-4640-4ae1-82be-ccbfbab06866 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:16.372709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b323-4640-4ae1-82be-ccbfbab06866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:16.372987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b323-4640-4ae1-82be-ccbfbab06866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:16.377651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:16.378796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:16.379209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:16.390952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] PATH_INFO: `/v3/users/88b9f89a5a54456fb4fb6773844b95a2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:16.392588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b9f89a5a54456fb4fb6773844b95a2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:16.394175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b323-4640-4ae1-82be-ccbfbab06866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:16.394939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:16.397499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b323-4640-4ae1-82be-ccbfbab06866 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:16.398638 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:16.440543 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1380/2725] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:16.530852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b9f89a5a54456fb4fb6773844b95a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:16.560823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b9f89a5a54456fb4fb6773844b95a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:16.571569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b9f89a5a54456fb4fb6773844b95a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:16.582562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b9f89a5a54456fb4fb6773844b95a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:16.583126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b9f89a5a54456fb4fb6773844b95a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:16.595792 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1346/2726] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:16 2022] DELETE /identity/v3/users/88b9f89a5a54456fb4fb6773844b95a2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:16.602063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:16.602399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:16.602724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:16.635734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:16.637822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:16.745217 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1381/2727] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:16.790395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:16.793739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:16.947039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3280a0-2fa9-445c-8529-e043eeef69b8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:16.952817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:16.953900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:16.954380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:16.954923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:16.972085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:16.973941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:16.994175 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1347/2728] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:17.204315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:17.206113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:17.231397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dadb74-c88e-434a-8fa2-84e3dc735186 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:17.248098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:17.249072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:17.249355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:17.251639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] PATH_INFO: `/v3/projects/772c96aaff754bb9a5570f0b6d17c945` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:17.259769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772c96aaff754bb9a5570f0b6d17c945)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:17.262469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:17.414080 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:17.429531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772c96aaff754bb9a5570f0b6d17c945', 'request_id': 'req-67c94510-673b-4f76-a949-b2d4e34f8933'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.453804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772c96aaff754bb9a5570f0b6d17c945', 'request_id': 'req-67c94510-673b-4f76-a949-b2d4e34f8933'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.472240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772c96aaff754bb9a5570f0b6d17c945', 'request_id': 'req-67c94510-673b-4f76-a949-b2d4e34f8933'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.496371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] The token cache is being invalidate because project 772c96aaff754bb9a5570f0b6d17c945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:17.496932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.497990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.503383 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1382/2729] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:17 2022] DELETE /identity/v3/projects/772c96aaff754bb9a5570f0b6d17c945 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:17.504144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:17.532067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49210c3-9d9f-427b-b3df-3d9f97d228fa service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:17.687880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:17.688929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:17.689283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:17.689587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] PATH_INFO: `/v3/users/991e542da64b496792365bcc205a7897` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:17.695114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991e542da64b496792365bcc205a7897)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:17.703574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:17.747163 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:17.797990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991e542da64b496792365bcc205a7897'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.820962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991e542da64b496792365bcc205a7897'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.837713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991e542da64b496792365bcc205a7897'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.850849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991e542da64b496792365bcc205a7897'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.852259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991e542da64b496792365bcc205a7897'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:17.867640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:17.871369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:17.873388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1348/2730] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:17 2022] DELETE /identity/v3/users/991e542da64b496792365bcc205a7897 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:17.917830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94510-673b-4f76-a949-b2d4e34f8933 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:18.067348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:18.068995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:18.069852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:18.070415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] PATH_INFO: `/v3/projects/3f4eb77d9404438996454f2837c9af93` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:18.073069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4eb77d9404438996454f2837c9af93)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:18.076162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:18.169897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4eb77d9404438996454f2837c9af93', 'request_id': 'req-e428250e-ae3a-4593-80fa-3a004dc9d438'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.182030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4eb77d9404438996454f2837c9af93', 'request_id': 'req-e428250e-ae3a-4593-80fa-3a004dc9d438'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.192152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4eb77d9404438996454f2837c9af93', 'request_id': 'req-e428250e-ae3a-4593-80fa-3a004dc9d438'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.225759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] The token cache is being invalidate because project 3f4eb77d9404438996454f2837c9af93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:18.226689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.229174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.235889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1383/2731] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:17 2022] DELETE /identity/v3/projects/3f4eb77d9404438996454f2837c9af93 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:18.238018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:18.239573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:18.258716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0afa3a-dc86-4812-be4b-c7d08fe2cce4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:18.419527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:18.420918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:18.421455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:18.421774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] PATH_INFO: `/v3/users/31f5a547647b4229ab02bf95835ba51e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:18.428774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f5a547647b4229ab02bf95835ba51e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:18.431385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:18.529141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f5a547647b4229ab02bf95835ba51e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.558046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f5a547647b4229ab02bf95835ba51e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.576354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f5a547647b4229ab02bf95835ba51e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.590570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f5a547647b4229ab02bf95835ba51e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.591443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f5a547647b4229ab02bf95835ba51e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:18.604824 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1349/2732] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:18 2022] DELETE /identity/v3/users/31f5a547647b4229ab02bf95835ba51e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:18.898743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:18.900762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:18.934168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428250e-ae3a-4593-80fa-3a004dc9d438 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:19.203588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:19.204919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:19.207921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:19.207921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] PATH_INFO: `/v3/projects/a4957687cd8d4f92909374cb11224b53` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:19.217858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4957687cd8d4f92909374cb11224b53)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:19.220721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:19.233612 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:19.369573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4957687cd8d4f92909374cb11224b53', 'request_id': 'req-d5155086-859a-40a7-b1ad-793031ad3c5c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.386357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4957687cd8d4f92909374cb11224b53', 'request_id': 'req-d5155086-859a-40a7-b1ad-793031ad3c5c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.405375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4957687cd8d4f92909374cb11224b53', 'request_id': 'req-d5155086-859a-40a7-b1ad-793031ad3c5c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.429851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:19.430450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] The token cache is being invalidate because project a4957687cd8d4f92909374cb11224b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:19.430856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.432054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5155086-859a-40a7-b1ad-793031ad3c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.432483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:19.435133 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1384/2733] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:18 2022] DELETE /identity/v3/projects/a4957687cd8d4f92909374cb11224b53 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:19.440422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cda694-c7fa-4308-9301-00f1e17f68ca None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:19.440811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cda694-c7fa-4308-9301-00f1e17f68ca None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:19.441121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cda694-c7fa-4308-9301-00f1e17f68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:19.471044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148540-fe5d-4ea4-97b4-8d1221caf240 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:19.480325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a6cda694-c7fa-4308-9301-00f1e17f68ca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:19.481713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6cda694-c7fa-4308-9301-00f1e17f68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:19.522806 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:19.629723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1385/2734] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:19.632711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:19.633893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:19.634182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:19.634459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] PATH_INFO: `/v3/projects/5e0d6ce513194c299ff53737406f0a23` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:19.639554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:19.639831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0d6ce513194c299ff53737406f0a23)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:19.640382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:19.641080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:19.647233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:19.693679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:19.695765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:19.726814 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1386/2735] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:19.728018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:19.758957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a712ec-f7f1-4a66-9c8c-223237791065 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:19.779198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0d6ce513194c299ff53737406f0a23', 'request_id': 'req-15d423ff-0fe3-41b4-ba87-6be41a7666ca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.798044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0d6ce513194c299ff53737406f0a23', 'request_id': 'req-15d423ff-0fe3-41b4-ba87-6be41a7666ca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.816508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0d6ce513194c299ff53737406f0a23', 'request_id': 'req-15d423ff-0fe3-41b4-ba87-6be41a7666ca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.864102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] The token cache is being invalidate because project 5e0d6ce513194c299ff53737406f0a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:19.864623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.867021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15d423ff-0fe3-41b4-ba87-6be41a7666ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:19.874125 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1350/2736] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:19 2022] DELETE /identity/v3/projects/5e0d6ce513194c299ff53737406f0a23 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:19.880404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21dc54-bc43-405f-a195-1c1bac3a3533 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:19.880936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21dc54-bc43-405f-a195-1c1bac3a3533 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:19.881460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21dc54-bc43-405f-a195-1c1bac3a3533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:19.953312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fb21dc54-bc43-405f-a195-1c1bac3a3533 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:19.957575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fb21dc54-bc43-405f-a195-1c1bac3a3533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:20.002233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.006998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.007468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.007957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.014863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:20.016401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.033193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.101792 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1387/2737] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:20.108695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.116202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:20.158805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d8cb2-050b-4675-970b-543e709924c0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.180880 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1351/2738] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:20.182044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.183106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.183553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.184022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.185034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.185308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.185810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.186288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.188374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.227171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:20.230903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:20.233326 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:20.252441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1352/2739] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:20.254585 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1388/2740] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:20 2022] POST /identity/v3/projects => generated 405 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:49:20.255207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.256976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.292287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9bdbc-3e3c-411b-9b0c-c7948e7ebcd4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.369167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe9ad-a884-480f-a198-01c69cac8484 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.374865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffdf0f-ad26-4ed1-bc45-d9a78063c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.375568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffdf0f-ad26-4ed1-bc45-d9a78063c3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.376011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffdf0f-ad26-4ed1-bc45-d9a78063c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.376291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffdf0f-ad26-4ed1-bc45-d9a78063c3aa admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.377009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffdf0f-ad26-4ed1-bc45-d9a78063c3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.379556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffdf0f-ad26-4ed1-bc45-d9a78063c3aa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.446637 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1389/2741] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:20 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:49:20.449502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.451413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.452177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.461461 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:20.508950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:20.511522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:20.539105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.539914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.540240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.540561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.541566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:20.541917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.550841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.613474 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1353/2742] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:20.614548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.626902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980b3f-1fb8-4bb1-8264-1edb07194d08 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.632748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.633500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.633723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.635061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.635852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.637492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.656683 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1354/2743] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:20.658314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.689627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc943b63-8bfe-437f-a13f-0cf37b7004a3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.707609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.709580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.709721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.710075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.711318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.714826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.726766 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1390/2744] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:20.737419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.775860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43b7b-25ba-4b1d-9905-22a7871af76b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.808002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.809788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.810440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.810965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.811938 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1355/2745] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:20 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:20.812379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.815596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.817223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.844469 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1391/2746] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:20.852577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.881044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1c15-c4a0-45a0-9e49-37ff35432d1d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.926671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188e15-7e8a-4ad5-974e-7966bfbe32ad admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.934881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.936341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.936741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:20.937127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:20.937967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:20.940124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:20.969986 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1356/2747] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:20 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:20.975874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:20.989208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f29a-0bbf-4e1d-928a-3164819321fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:20.997756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:20.999387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:20.999780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.000172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.001225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:21.003060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:21.019324 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1357/2748] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:21.027969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:21.081712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4077d2-38de-4b8e-ab98-e8d49b2dfa50 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:21.097191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:21.098206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.098692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.099137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.100211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c23b-3908-40cf-98cf-0fd7871e7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:21.101212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:21.101765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c23b-3908-40cf-98cf-0fd7871e7fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.102222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c23b-3908-40cf-98cf-0fd7871e7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.102672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c23b-3908-40cf-98cf-0fd7871e7fac admin admin] PATH_INFO: `/v3/projects/40f2ad87ad354e35951db4de35107fdb/users/49c191c9a184416f834013d598a3d982/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.108111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:21.135199 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1358/2749] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:21.139968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:21.159864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c23b-3908-40cf-98cf-0fd7871e7fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f2ad87ad354e35951db4de35107fdb, user_id=49c191c9a184416f834013d598a3d982, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:21.165271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c23b-3908-40cf-98cf-0fd7871e7fac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:21.172567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc36dc-8a99-4e23-8065-914079193fd0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:21.193035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec47e8-b23e-4987-8afe-cc222c524f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:21.193956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec47e8-b23e-4987-8afe-cc222c524f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.196259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec47e8-b23e-4987-8afe-cc222c524f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.196259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec47e8-b23e-4987-8afe-cc222c524f90 admin admin] PATH_INFO: `/v3/projects/efe013099b8a416ba5edb8829a9a17d4/users/bf59a9e902304a60939b4d5309b90714/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.214043 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1392/2750] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:20 2022] PUT /identity/v3/projects/40f2ad87ad354e35951db4de35107fdb/users/49c191c9a184416f834013d598a3d982/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:21.216164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.216762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.217334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.226568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec47e8-b23e-4987-8afe-cc222c524f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe013099b8a416ba5edb8829a9a17d4, user_id=bf59a9e902304a60939b4d5309b90714, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:21.229467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec47e8-b23e-4987-8afe-cc222c524f90 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:21.229885 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:21.247813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:21.248875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1359/2751] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:21 2022] PUT /identity/v3/projects/efe013099b8a416ba5edb8829a9a17d4/users/bf59a9e902304a60939b4d5309b90714/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:21.250830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:21.255853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.256365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.256775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.289860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:21.292053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:21.417985 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:21.437973 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1393/2752] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:21.485261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:21.487096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:21.520694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1360/2753] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:21.553704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:21.558079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:21.624242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dfc1c-aa3d-4965-a233-9cccda2829ee None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:21.635497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5288b7-be62-4c5f-bab8-6c1cb1821c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:21.636194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5288b7-be62-4c5f-bab8-6c1cb1821c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.636481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5288b7-be62-4c5f-bab8-6c1cb1821c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.636762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5288b7-be62-4c5f-bab8-6c1cb1821c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.664221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5288b7-be62-4c5f-bab8-6c1cb1821c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:21.667537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5288b7-be62-4c5f-bab8-6c1cb1821c17 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:21.685009 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1394/2754] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:21.750926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578acd4-c5da-44c7-a003-88d20ad72cca None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:21.757754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:21.758427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:21.758789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:21.759131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:21.772210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:21.773800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:21.786279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1361/2755] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:49:24.357667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:24.358440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:24.360187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:24.461146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] MFA Rules not processed for user `f4fb9a3eacf448578b8ba8a8cb7f33c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:24.462740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:24.618070 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1395/2756] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:27.992792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:27.994391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:28.209816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c9b4f-4d0e-4dc6-b0f7-affa5cf0e8db service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:28.224865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:28.227704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:28.228212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:28.230816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:28.234468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:28.379654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:28.381886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7a339-7ed6-4868-a655-5a2a563ef2c3 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:28.395284 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1362/2757] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:34.601058 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=76 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:37.461815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:37.461815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:37.504368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6681c-dd0c-409c-afd8-7abcc0cf0533 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:37.531374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:37.535431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:37.539014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:37.539871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] PATH_INFO: `/v3/users/9570506719b242b0b347b4ba8d81fb6c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:37.555455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9570506719b242b0b347b4ba8d81fb6c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:37.562554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:37.733996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9570506719b242b0b347b4ba8d81fb6c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:37.734926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9570506719b242b0b347b4ba8d81fb6c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:37.803606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9570506719b242b0b347b4ba8d81fb6c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:37.804442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9570506719b242b0b347b4ba8d81fb6c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:37.827177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9570506719b242b0b347b4ba8d81fb6c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:37.859999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1396/2758] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:37 2022] DELETE /identity/v3/users/9570506719b242b0b347b4ba8d81fb6c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:37.866661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:37.867524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:37.867524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:37.891101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:37.893118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:37.928685 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:38.020109 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1363/2759] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:38.225601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:38.227491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:38.385907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d050a-a87c-4560-b75e-7490e0d1aadf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:38.396384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:38.398326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:38.398799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:38.399085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:38.425786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:38.429292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:38.448664 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1397/2760] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:49:39.412753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:39.415115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:39.436598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba956ba-7abf-4b4c-973b-e73d568be8de None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:39.455529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:39.457646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:39.459967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:39.460897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] PATH_INFO: `/v3/projects/382365fd0ac441e49e02369f41e9f547` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:39.462714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382365fd0ac441e49e02369f41e9f547)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:39.472806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:39.656791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382365fd0ac441e49e02369f41e9f547', 'request_id': 'req-744662c6-7dc7-4536-a373-f64afd4fbf69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:39.672912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382365fd0ac441e49e02369f41e9f547', 'request_id': 'req-744662c6-7dc7-4536-a373-f64afd4fbf69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:39.710225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382365fd0ac441e49e02369f41e9f547', 'request_id': 'req-744662c6-7dc7-4536-a373-f64afd4fbf69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:39.738972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] The token cache is being invalidate because project 382365fd0ac441e49e02369f41e9f547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:39.739541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:39.742195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:39.752950 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1364/2761] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:39 2022] DELETE /identity/v3/projects/382365fd0ac441e49e02369f41e9f547 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:39.753481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:39.771098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dda9f-06af-40ba-8ae7-ebef3d6c39e5 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:39.912692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:39.915214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:39.918996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:39.919624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] PATH_INFO: `/v3/users/7b992bae4edb4134bb504b2a8ab55847` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:39.922582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b992bae4edb4134bb504b2a8ab55847)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:39.925800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:40.002772 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:40.094390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b992bae4edb4134bb504b2a8ab55847'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:40.107319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b992bae4edb4134bb504b2a8ab55847'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:40.167727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b992bae4edb4134bb504b2a8ab55847'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:40.179827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b992bae4edb4134bb504b2a8ab55847'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:40.202020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ab618ff-b90e-4968-9fec-f4a9c94f778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b992bae4edb4134bb504b2a8ab55847'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:40.253813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1398/2762] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:39 2022] DELETE /identity/v3/users/7b992bae4edb4134bb504b2a8ab55847 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:41.264865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:41.266800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:41.296145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744662c6-7dc7-4536-a373-f64afd4fbf69 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:41.433483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:41.435012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:41.435415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:41.435856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] PATH_INFO: `/v3/projects/a0dbdf444f4f430fb43614a1adca6730` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:41.437600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dbdf444f4f430fb43614a1adca6730)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:41.441929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:41.515095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dbdf444f4f430fb43614a1adca6730', 'request_id': 'req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:41.518385 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:41.532079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dbdf444f4f430fb43614a1adca6730', 'request_id': 'req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:41.569510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dbdf444f4f430fb43614a1adca6730', 'request_id': 'req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:41.595738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] The token cache is being invalidate because project a0dbdf444f4f430fb43614a1adca6730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:41.596260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:41.597356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03bcfba4-837c-4f4d-a2c2-2ddceb26ae48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:41.601640 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1365/2763] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:41 2022] DELETE /identity/v3/projects/a0dbdf444f4f430fb43614a1adca6730 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:41.607673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:41.608768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:41.609212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:41.641655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:41.643265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:41.838916 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1399/2764] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:41.847185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:41.847551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:41.847909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:41.885551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:41.898060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:41.935107 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1366/2765] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:41.936502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:41.954778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29486-8c94-4c16-b99f-d31a16671385 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:41.985101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:41.986380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:41.986982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:41.988407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:41.990202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:41.991123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:41.996501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.024781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1400/2766] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:42.028728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.042005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e16f5e-ed15-4109-88f0-e07e4a056029 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:42.060500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:42.061476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.062135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.062640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.063599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:42.065835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.128727 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1367/2767] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:42.132850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.149045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7aafe-50e3-45d9-bc9a-dd56c320b489 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:42.247702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:42.248766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.249212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.250338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.251758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:42.254209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.289425 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1401/2768] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:42.294092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.308177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a964a-1e0c-4071-9d79-b86e5e3cd217 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:42.321323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:42.322028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.323815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.325139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.326756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:42.328753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.342353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1368/2769] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:42.351808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.362780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731ac07-a494-460b-821b-426cead5992e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:42.374117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445de0-71af-4e5d-b311-7f4dd3c7ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:42.374867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445de0-71af-4e5d-b311-7f4dd3c7ec00 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.375157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445de0-71af-4e5d-b311-7f4dd3c7ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.375438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445de0-71af-4e5d-b311-7f4dd3c7ec00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.376930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445de0-71af-4e5d-b311-7f4dd3c7ec00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:42.379225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445de0-71af-4e5d-b311-7f4dd3c7ec00 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.390462 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:42.403255 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1402/2770] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:42.404710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.421060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b7f87-9a07-443b-974d-3da5ab4e3d18 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:42.427800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bcea5-531a-4137-bb55-ec6186de5677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:42.428792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bcea5-531a-4137-bb55-ec6186de5677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.429304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bcea5-531a-4137-bb55-ec6186de5677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.429655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bcea5-531a-4137-bb55-ec6186de5677 admin admin] PATH_INFO: `/v3/projects/3e2e40eb91bf4f15b85a76d5c94fd555/users/e6a1dcddc5564723997a64a94bd595ce/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.449621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bcea5-531a-4137-bb55-ec6186de5677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2e40eb91bf4f15b85a76d5c94fd555, user_id=e6a1dcddc5564723997a64a94bd595ce, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:42.452591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bcea5-531a-4137-bb55-ec6186de5677 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.473595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1369/2771] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:42 2022] PUT /identity/v3/projects/3e2e40eb91bf4f15b85a76d5c94fd555/users/e6a1dcddc5564723997a64a94bd595ce/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:42.484960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.485479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.486003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.528681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] MFA Rules not processed for user `e6a1dcddc5564723997a64a94bd595ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:42.530229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:42.620372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.620675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.620962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.655192 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1403/2772] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:42.659206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.743202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] MFA Rules not processed for user `bf59a9e902304a60939b4d5309b90714`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:42.746558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:42.827542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444be93f-3c1b-4dcb-887d-34e83bb70b4c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:42.842306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455177f-b5fb-445f-986d-8cda8f8c72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:42.843018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455177f-b5fb-445f-986d-8cda8f8c72cc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.843308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455177f-b5fb-445f-986d-8cda8f8c72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.843588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455177f-b5fb-445f-986d-8cda8f8c72cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.844339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455177f-b5fb-445f-986d-8cda8f8c72cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:42.846287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455177f-b5fb-445f-986d-8cda8f8c72cc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:42.906275 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1404/2773] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/projects => generated 393 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:42.907720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:42.908087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:42.908320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:42.972005 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1370/2774] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:42.972005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:42.992247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] MFA Rules not processed for user `49c191c9a184416f834013d598a3d982`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:42.994693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:43.012960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4be1d-818a-45af-9deb-2b41bc4b81f6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.119488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.120868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.121226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.121723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.122410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.125064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.150600 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:43.152356 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1405/2775] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:43.153613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.156564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:43.176942 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1371/2776] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:42 2022] POST /identity/v3/users => generated 303 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:43.179929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.182220 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:43.188205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:43.195332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7809c-4f3a-4215-a48a-183b85654630 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.208605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.209216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.209501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.209778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.210477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.212504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.221441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02fb8d-279a-437f-980c-3a76a3be9e64 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.243199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.244135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.245302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.246266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.248349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.257654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.271236 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1406/2777] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:43 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:43.273974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.343423 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1372/2778] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:43 2022] POST /identity/v3/projects => generated 405 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:43.344415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.534534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db64b-d076-4838-9b99-ab456b2fb833 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.553688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.554652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.554786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3271-08b4-4652-aa37-cbd40b4bfb27 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.555021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.555297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.556007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.559758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.580518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.581286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.581685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.582105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.584112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.587123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.634917 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1407/2779] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:43.635932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.651238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1373/2780] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:43 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:43.653238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.660020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be12c-4068-4098-a846-501481c2e837 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.675884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.677160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.677447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.677725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.679135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.681156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.701622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba4d04-579c-4f5f-a56f-4eaeadd9504e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.719085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.720075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.721281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.721484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] PATH_INFO: `/v3/projects/6fda744bea4f43cebc74c03dc061ebf6/users/37424de6bb554c26b5b5915ef5fb6ccc/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.758462 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1408/2781] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:43 2022] POST /identity/v3/users => generated 309 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:43.758462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.765148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fda744bea4f43cebc74c03dc061ebf6, user_id=37424de6bb554c26b5b5915ef5fb6ccc, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.776321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.789956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e784a-2db8-4e2c-8a8c-95168b282e7b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.813359 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1374/2782] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:43 2022] PUT /identity/v3/projects/6fda744bea4f43cebc74c03dc061ebf6/users/37424de6bb554c26b5b5915ef5fb6ccc/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:43.813359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.814058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.814795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.815083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.815361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.816107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.817788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.862482 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1409/2783] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:43.875316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.924331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfafb8-9b84-42cd-8231-48638babefa6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.935983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc649d-1f66-45a4-a89c-062f2113d419 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.942558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.942803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.943250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.943475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.943598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.943764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.943883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.944041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:43.944529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.944986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:43.946131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.946894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:43.964300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1375/2784] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:43.964300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.982727 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1410/2785] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:43.982727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:43.983043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb98e8-6e16-47f6-8a8d-fc3f15d7f4d5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:43.990743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:43.991905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:43.992290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:43.992725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] PATH_INFO: `/v3/projects/922e39a6de404676b3e335d262ae6169/users/839be0adb459435da71015e49cc81728/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.002617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352f098-82f3-4fea-9bda-60325c36f400 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:44.028452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922e39a6de404676b3e335d262ae6169, user_id=839be0adb459435da71015e49cc81728, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.031991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:44.032903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.033188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.033466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] PATH_INFO: `/v3/projects/0a5b1fce00fa4a4bb69412794a59ba09/users/4c7520db76344dfabd39ba11b8c7e9af/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.037673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.066209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5b1fce00fa4a4bb69412794a59ba09, user_id=4c7520db76344dfabd39ba11b8c7e9af, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.069733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.092163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1376/2786] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:43 2022] PUT /identity/v3/projects/922e39a6de404676b3e335d262ae6169/users/839be0adb459435da71015e49cc81728/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:44.104823 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1411/2787] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:43 2022] PUT /identity/v3/projects/0a5b1fce00fa4a4bb69412794a59ba09/users/4c7520db76344dfabd39ba11b8c7e9af/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:44.104823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:44.105053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:44.154736 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:44.284156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268f3ad-3032-486f-87be-78e6b8858ee1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:44.321663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2775-6a82-4100-9524-8997104c508f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:44.343726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:44.346069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.347220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.348675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.351874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.356956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.406958 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1412/2788] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:44.411843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:44.439289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a825c5d-c178-46a8-8416-1592126f92c0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:44.445789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:44.449039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.449335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.451577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] PATH_INFO: `/v3/projects/6fda744bea4f43cebc74c03dc061ebf6/users/37424de6bb554c26b5b5915ef5fb6ccc/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.456014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:44.456323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fda744bea4f43cebc74c03dc061ebf6, user_id=37424de6bb554c26b5b5915ef5fb6ccc, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.457023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.457609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.457994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.459032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.460973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.463880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.473084 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:44.487900 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1377/2789] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:44 2022] PUT /identity/v3/projects/6fda744bea4f43cebc74c03dc061ebf6/users/37424de6bb554c26b5b5915ef5fb6ccc/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:44.493050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:44.498449 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1413/2790] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:44.501437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:44.525646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa6b9e-6f5f-4a62-b4bc-6c7d4273d814 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:44.633654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab6499-d296-46e1-b885-e87c2dd9cad8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:44.656396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16055cb-783e-4c2e-8c79-d917bbab7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:44.658936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16055cb-783e-4c2e-8c79-d917bbab7ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.662418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16055cb-783e-4c2e-8c79-d917bbab7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.662817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16055cb-783e-4c2e-8c79-d917bbab7ea5 admin admin] PATH_INFO: `/v3/projects/922e39a6de404676b3e335d262ae6169/users/839be0adb459435da71015e49cc81728/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.669690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16055cb-783e-4c2e-8c79-d917bbab7ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922e39a6de404676b3e335d262ae6169, user_id=839be0adb459435da71015e49cc81728, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.675886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16055cb-783e-4c2e-8c79-d917bbab7ea5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.689721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:44.690654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.690943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.691224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] PATH_INFO: `/v3/projects/0a5b1fce00fa4a4bb69412794a59ba09/users/4c7520db76344dfabd39ba11b8c7e9af/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.697205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5b1fce00fa4a4bb69412794a59ba09, user_id=4c7520db76344dfabd39ba11b8c7e9af, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:44.700201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:44.711477 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1378/2791] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:44 2022] PUT /identity/v3/projects/922e39a6de404676b3e335d262ae6169/users/839be0adb459435da71015e49cc81728/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:44.712808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:44.713100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:44.713383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:44.733226 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1414/2792] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:44 2022] PUT /identity/v3/projects/0a5b1fce00fa4a4bb69412794a59ba09/users/4c7520db76344dfabd39ba11b8c7e9af/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:44.772350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] MFA Rules not processed for user `37424de6bb554c26b5b5915ef5fb6ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:44.774365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:44.923568 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:45.062259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1379/2793] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:45.076208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:45.078144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:45.282260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f10e-79ff-487f-ae4f-bc08bec41f0c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:45.300237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:45.300850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:45.301134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:45.301445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:45.334739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:45.336865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:45.392694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1415/2794] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:45.454154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:45.481709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0700d7-2f15-4460-be46-a6ef18037d2d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:45.500570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246c65e-f0a5-4745-bd1b-8a756df6f7cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:45.504042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c65e-f0a5-4745-bd1b-8a756df6f7cf service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:45.506418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c65e-f0a5-4745-bd1b-8a756df6f7cf service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:45.510240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c65e-f0a5-4745-bd1b-8a756df6f7cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:45.691181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246c65e-f0a5-4745-bd1b-8a756df6f7cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:45.696547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246c65e-f0a5-4745-bd1b-8a756df6f7cf service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:45.721406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1380/2795] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:45.835753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:45.987539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf892fc-1a9c-45bc-bb8f-5c7b2e50d16d service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:45.999049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:46.001873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:46.002299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:46.002736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] PATH_INFO: `/v3/users/e6a1dcddc5564723997a64a94bd595ce` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:46.004391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a1dcddc5564723997a64a94bd595ce)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:46.007353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:46.061996 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:46.122681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a1dcddc5564723997a64a94bd595ce'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.124562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a1dcddc5564723997a64a94bd595ce'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.156971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a1dcddc5564723997a64a94bd595ce'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.160416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a1dcddc5564723997a64a94bd595ce'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.183835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a1dcddc5564723997a64a94bd595ce'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.213783 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1416/2796] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:45 2022] DELETE /identity/v3/users/e6a1dcddc5564723997a64a94bd595ce => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:46.219859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:46.220367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:46.221387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:46.319882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:46.321277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:46.522135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1381/2797] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:46.540700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:46.542854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:46.668061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932cb0-130f-4d04-812f-d3a590184283 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:46.673282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:46.674424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:46.674917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:46.675425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:46.697191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:46.699179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:46.724966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1417/2798] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:46.757569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:46.759053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:46.786984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22322fc-125e-4a1d-8f8d-b19191383378 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:46.805971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:46.807526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:46.808044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:46.808540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] PATH_INFO: `/v3/users/8599707377e644b5a083586b2d46654f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:46.811064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8599707377e644b5a083586b2d46654f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:46.813635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:46.914461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8599707377e644b5a083586b2d46654f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.937541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8599707377e644b5a083586b2d46654f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.940246 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:46.955551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8599707377e644b5a083586b2d46654f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.968033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8599707377e644b5a083586b2d46654f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.975255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8599707377e644b5a083586b2d46654f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:46.984949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1382/2799] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:46 2022] DELETE /identity/v3/users/8599707377e644b5a083586b2d46654f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:47.289543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:47.291137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:47.314040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda31a-1c1f-4da9-9f5c-e9bcd0a84aad service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:47.505323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:47.511015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:47.511479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:47.511846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] PATH_INFO: `/v3/projects/3e2e40eb91bf4f15b85a76d5c94fd555` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:47.517494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2e40eb91bf4f15b85a76d5c94fd555)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:47.519588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:47.631730 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:47.636722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2e40eb91bf4f15b85a76d5c94fd555', 'request_id': 'req-e0338bd7-5103-4292-9a5d-f202a5639eaf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:47.648948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2e40eb91bf4f15b85a76d5c94fd555', 'request_id': 'req-e0338bd7-5103-4292-9a5d-f202a5639eaf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:47.668019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2e40eb91bf4f15b85a76d5c94fd555', 'request_id': 'req-e0338bd7-5103-4292-9a5d-f202a5639eaf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:47.686325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] The token cache is being invalidate because project 3e2e40eb91bf4f15b85a76d5c94fd555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:47.686694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:47.687414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:47.692566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1418/2800] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:47 2022] DELETE /identity/v3/projects/3e2e40eb91bf4f15b85a76d5c94fd555 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:47.695604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:47.699152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:47.729941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b929-805c-4ac5-a867-3da3043d0b7e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:47.891618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:47.892283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:47.893245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:47.893245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] PATH_INFO: `/v3/users/37424de6bb554c26b5b5915ef5fb6ccc` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:47.901150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37424de6bb554c26b5b5915ef5fb6ccc)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:47.901305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:47.902851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:47.904421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:47.924952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0338bd7-5103-4292-9a5d-f202a5639eaf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:47.938176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:47.939152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:47.939432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:47.939704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] PATH_INFO: `/v3/projects/118e0a3efbd14eb7b5e18477a25bfe82` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:47.941289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118e0a3efbd14eb7b5e18477a25bfe82)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:47.943330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:47.994236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37424de6bb554c26b5b5915ef5fb6ccc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.036221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37424de6bb554c26b5b5915ef5fb6ccc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.037824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118e0a3efbd14eb7b5e18477a25bfe82', 'request_id': 'req-559acabd-afa4-4e08-b7fd-5549c75e6be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.045332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37424de6bb554c26b5b5915ef5fb6ccc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.064310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118e0a3efbd14eb7b5e18477a25bfe82', 'request_id': 'req-559acabd-afa4-4e08-b7fd-5549c75e6be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.067368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37424de6bb554c26b5b5915ef5fb6ccc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.068164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2233af-7d19-45b5-8595-c01b450c71c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37424de6bb554c26b5b5915ef5fb6ccc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.073627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118e0a3efbd14eb7b5e18477a25bfe82', 'request_id': 'req-559acabd-afa4-4e08-b7fd-5549c75e6be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.076052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1383/2801] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:47 2022] DELETE /identity/v3/users/37424de6bb554c26b5b5915ef5fb6ccc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:48.097833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] The token cache is being invalidate because project 118e0a3efbd14eb7b5e18477a25bfe82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:48.098991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.100013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-559acabd-afa4-4e08-b7fd-5549c75e6be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:48.102985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1419/2802] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:47 2022] DELETE /identity/v3/projects/118e0a3efbd14eb7b5e18477a25bfe82 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:48.107917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.108633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.109195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.156089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:48.157365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:48.247542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1384/2803] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:48.255366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.255655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.256376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.291065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:48.292590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:48.315962 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1420/2804] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:48.318385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.331392 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:48.345050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f9fec-bd79-472f-a1ee-140a9a99db6d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.361751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.363582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.365624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.366476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.369007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:48.370882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.375686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:48.412424 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1385/2805] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:48.413995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.426672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78924-dd85-4083-8ac8-e91dd847f714 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.435611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.435611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.436023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.436480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.438189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.440588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:48.515892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1421/2806] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:48 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:48.517523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.538424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4345d5d-7e5f-4b0e-89d3-f3838829c7eb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.682190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.683132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.683428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.683768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.684980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.687732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:48.721395 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1386/2807] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:48 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:48.722349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.740400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98503ff-97a6-48e0-90f9-8c1e228299e5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.746733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.748234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.748539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.749553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.750410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.752713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:48.768111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1422/2808] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:49:48.773207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.786690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473aa8-3106-4a7b-be42-27dd83ffeeea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.794638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5889b-a162-48a6-9c41-a7a28135801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.796743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5889b-a162-48a6-9c41-a7a28135801d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.797236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5889b-a162-48a6-9c41-a7a28135801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.797852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5889b-a162-48a6-9c41-a7a28135801d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.799422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5889b-a162-48a6-9c41-a7a28135801d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.803467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5889b-a162-48a6-9c41-a7a28135801d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:48.824962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.837864 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1387/2809] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:48.847574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cc9a-a87c-4f56-b243-bd6a63bdc394 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.860568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.861920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.862460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.862998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] PATH_INFO: `/v3/projects/83020f2fea8347f19fb8216a7576b7ba/users/dd8d6bbf2e204d42b1881c594210722a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.920976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83020f2fea8347f19fb8216a7576b7ba, user_id=dd8d6bbf2e204d42b1881c594210722a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.955865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:49.010271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.010598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.010940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.012398 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1423/2810] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:48 2022] PUT /identity/v3/projects/83020f2fea8347f19fb8216a7576b7ba/users/dd8d6bbf2e204d42b1881c594210722a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:49.078968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] MFA Rules not processed for user `dd8d6bbf2e204d42b1881c594210722a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:49.081691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:49.210669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:49.213268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:49.327176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1388/2811] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:49.338989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:49.341663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:49.359477 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:49.400709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c725b8-2970-4d16-a5f7-1db5dc55ef0a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:49.417263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:49.420447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.420447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.420731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] PATH_INFO: `/v3/projects/6fda744bea4f43cebc74c03dc061ebf6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.427014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fda744bea4f43cebc74c03dc061ebf6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:49.430939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:49.437635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d83b-253e-4495-9af7-72eea1df4915 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:49.449277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94442-1530-4f03-af1b-6a23ed87fdce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:49.450330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94442-1530-4f03-af1b-6a23ed87fdce service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.450720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94442-1530-4f03-af1b-6a23ed87fdce service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.451107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94442-1530-4f03-af1b-6a23ed87fdce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.483266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f94442-1530-4f03-af1b-6a23ed87fdce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:49.489725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f94442-1530-4f03-af1b-6a23ed87fdce service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:49.498080 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:49.510579 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1389/2812] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:49.540977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fda744bea4f43cebc74c03dc061ebf6', 'request_id': 'req-0eb62823-5f17-4942-a0b1-2cc240a32192'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:49.558959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fda744bea4f43cebc74c03dc061ebf6', 'request_id': 'req-0eb62823-5f17-4942-a0b1-2cc240a32192'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:49.569268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fda744bea4f43cebc74c03dc061ebf6', 'request_id': 'req-0eb62823-5f17-4942-a0b1-2cc240a32192'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:49.604580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] The token cache is being invalidate because project 6fda744bea4f43cebc74c03dc061ebf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:49.605097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:49.606534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0eb62823-5f17-4942-a0b1-2cc240a32192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:49.615102 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1424/2813] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:49 2022] DELETE /identity/v3/projects/6fda744bea4f43cebc74c03dc061ebf6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:49.618273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.619612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.620411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.670286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:49.671755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:49.774784 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1390/2814] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:49.781842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.782143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.782480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.809153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:49.811795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:49.846922 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1425/2815] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:49.852106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:49.867273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ca3f-7986-4a7a-a4fe-627a308798c2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:49.874891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:49.875969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.876732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.877166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.878115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:49.878607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:49.880660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:49.898730 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1391/2816] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:49.905418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:49.916329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549309b-0c94-48b3-b886-f03da6110ded None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:49.924390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:49.925083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:49.925371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:49.925657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:49.926418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:49.928673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.001847 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1426/2817] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:49 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:50.006067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:50.018474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4996941-c550-4fd5-8c20-67e1f5f7200e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:50.154458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:50.155635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.156101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.156734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.157905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:50.160629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.192439 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1392/2818] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:50 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:50.197152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:50.215714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fb8e4-2702-4456-ba9c-abef05309b85 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:50.230171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:50.230891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.231292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.231581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.232326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:50.233978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.281274 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1427/2819] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:50.286275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:50.304679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dccb6d-50e3-426a-a9a4-926c6bbaadcb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:50.319594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0845325-ae55-4194-809b-53b4f55b297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:50.320519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0845325-ae55-4194-809b-53b4f55b297d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.321016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0845325-ae55-4194-809b-53b4f55b297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.321406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0845325-ae55-4194-809b-53b4f55b297d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.323290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0845325-ae55-4194-809b-53b4f55b297d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:50.325900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0845325-ae55-4194-809b-53b4f55b297d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.342242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1393/2820] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:50.346417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:50.360017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a092a1-7b5c-48c0-9e94-a260751e9dbe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:50.366884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:50.368125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.368637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.369154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] PATH_INFO: `/v3/projects/3554eae7cfd54be0ba7682235e5f6699/users/b27bfc0e95874f57866174f390c7bc63/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.401906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3554eae7cfd54be0ba7682235e5f6699, user_id=b27bfc0e95874f57866174f390c7bc63, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:50.406562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.432914 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1428/2821] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:50 2022] PUT /identity/v3/projects/3554eae7cfd54be0ba7682235e5f6699/users/b27bfc0e95874f57866174f390c7bc63/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:50.438892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.438892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.439383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.464966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:50.466392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:50.565513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:50.570551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:50.690675 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1394/2822] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:50.702243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:50.704788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:50.725054 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:50.807986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67281-db25-4d89-a160-ea596fbc6e61 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:50.818889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:50.819796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.820379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.820821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] PATH_INFO: `/v3/users/0f1db17e1fcd448f95650bfd6e0fc45f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.827960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1db17e1fcd448f95650bfd6e0fc45f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:50.829965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.830313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b2ce0-ddbd-4697-9190-98c9ca1c7777 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:50.836332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9a48-6d8f-4d23-a6c8-9f4b77f6cae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:50.837201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9a48-6d8f-4d23-a6c8-9f4b77f6cae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.837708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9a48-6d8f-4d23-a6c8-9f4b77f6cae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.838173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9a48-6d8f-4d23-a6c8-9f4b77f6cae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.853245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb9a48-6d8f-4d23-a6c8-9f4b77f6cae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:50.855895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb9a48-6d8f-4d23-a6c8-9f4b77f6cae6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:50.881062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1395/2823] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:50.884330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92aed-0ce1-472f-ae62-0cf909daa339 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:50.884815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92aed-0ce1-472f-ae62-0cf909daa339 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:50.885282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92aed-0ce1-472f-ae62-0cf909daa339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:50.887241 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:50.927675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-47c92aed-0ce1-472f-ae62-0cf909daa339 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:50.929530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-47c92aed-0ce1-472f-ae62-0cf909daa339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:50.945911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1db17e1fcd448f95650bfd6e0fc45f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:50.947195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1db17e1fcd448f95650bfd6e0fc45f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:50.989787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1db17e1fcd448f95650bfd6e0fc45f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:50.990925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1db17e1fcd448f95650bfd6e0fc45f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:51.009286 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1396/2824] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:51.010429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1db17e1fcd448f95650bfd6e0fc45f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:51.053286 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1429/2825] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:50 2022] DELETE /identity/v3/users/0f1db17e1fcd448f95650bfd6e0fc45f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:51.065563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:51.069483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:51.070321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:51.141484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:51.143090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:51.149703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:51.151834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:51.323136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1397/2826] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:51.367157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e77ad-8739-4df4-8183-37c83210672f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:51.371105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:51.373735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:51.380201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:51.381151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:51.381343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:51.381790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:51.550645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:51.552993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:51.571081 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1430/2827] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:49:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:49:51.699144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494be2d-c17d-4581-b9cc-34af9f6cc12c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:51.722672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:51.722672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:51.722672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:51.722672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:51.760378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:51.763366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:51.770603 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:51.795776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1398/2828] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:52.891015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:52.892722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:52.929904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578be4-75ce-47bf-b7e6-0291dbd253ff service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:52.964139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:52.965706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:52.966401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:52.966994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] PATH_INFO: `/v3/projects/81c9be33346b431db8dd827fd33f1e43` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:52.976630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c9be33346b431db8dd827fd33f1e43)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:52.979905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:53.056237 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:53.100961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c9be33346b431db8dd827fd33f1e43', 'request_id': 'req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.115538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c9be33346b431db8dd827fd33f1e43', 'request_id': 'req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.128789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c9be33346b431db8dd827fd33f1e43', 'request_id': 'req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.164281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] The token cache is being invalidate because project 81c9be33346b431db8dd827fd33f1e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:53.164992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.166149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2447917c-9b41-47ee-b8b8-94c8ea8d65e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.172591 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1431/2829] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:52 2022] DELETE /identity/v3/projects/81c9be33346b431db8dd827fd33f1e43 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:53.177944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:53.190940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655671e-22e6-4d83-9f97-59cde9a62fdf service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:53.266656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:53.267707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:53.268057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:53.268253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] PATH_INFO: `/v3/users/2bb2273335b44f23be97fd40477056ec` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:53.269734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb2273335b44f23be97fd40477056ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:53.272019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:53.388771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb2273335b44f23be97fd40477056ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.436359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb2273335b44f23be97fd40477056ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.452394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb2273335b44f23be97fd40477056ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.464090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:53.464517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:53.465047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:53.476890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb2273335b44f23be97fd40477056ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.477755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb2273335b44f23be97fd40477056ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:53.493694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1399/2830] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:53 2022] DELETE /identity/v3/users/2bb2273335b44f23be97fd40477056ec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:53.512080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:53.515659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:53.634661 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1432/2831] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:53.650580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:53.652173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:53.899404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6b4b-6e36-47ab-8fa8-2987796b946a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:53.918211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de008df-f91b-4011-a327-a5f3b2a213bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:53.918908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de008df-f91b-4011-a327-a5f3b2a213bc service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:53.919196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de008df-f91b-4011-a327-a5f3b2a213bc service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:53.919475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de008df-f91b-4011-a327-a5f3b2a213bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:53.938839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de008df-f91b-4011-a327-a5f3b2a213bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:53.940907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de008df-f91b-4011-a327-a5f3b2a213bc service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:53.965771 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1400/2832] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:49:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:49:55.380861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:55.382578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:55.581232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214a63-fb74-4b2c-baac-cd3c2935d0b0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:55.589940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:55.590873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:55.591160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:55.591894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] PATH_INFO: `/v3/projects/8380e90ad3f94bb3bfb689af280c5623` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:55.599200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8380e90ad3f94bb3bfb689af280c5623)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:55.601189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:55.714438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8380e90ad3f94bb3bfb689af280c5623', 'request_id': 'req-9d8cd739-27cb-49f9-b56d-f8156723cbed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.725892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8380e90ad3f94bb3bfb689af280c5623', 'request_id': 'req-9d8cd739-27cb-49f9-b56d-f8156723cbed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.739570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8380e90ad3f94bb3bfb689af280c5623', 'request_id': 'req-9d8cd739-27cb-49f9-b56d-f8156723cbed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.744357 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:55.768342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] The token cache is being invalidate because project 8380e90ad3f94bb3bfb689af280c5623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:55.768749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.769590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9d8cd739-27cb-49f9-b56d-f8156723cbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.778732 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1433/2833] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:55 2022] DELETE /identity/v3/projects/8380e90ad3f94bb3bfb689af280c5623 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:55.781271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a51f6-1e8d-463c-bb0d-2c896affec75 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:55.781776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a51f6-1e8d-463c-bb0d-2c896affec75 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:55.782052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a51f6-1e8d-463c-bb0d-2c896affec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:55.808874 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:55.836972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-465a51f6-1e8d-463c-bb0d-2c896affec75 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:55.843378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-465a51f6-1e8d-463c-bb0d-2c896affec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:55.882347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:55.882875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:55.883166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:55.935405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:55.936689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:56.065950 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1401/2834] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:56.079650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.079939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.083131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.129931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:56.131392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:56.142294 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1402/2835] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:56.147047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.155998 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1434/2836] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:56.163910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba490-32e9-4cbe-9c1b-a112cb5c3402 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.168897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.170893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:56.178887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.179576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.179862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.180140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.181068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:56.181537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.185900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.217417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1403/2837] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:56.221744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.248643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deca76d-f02b-43c2-be78-346cbbe80239 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.278849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.279846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.280312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.280748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.282194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.288244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.353007 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1404/2838] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:56.357506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.430213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523222eb-5006-4828-816c-9a63a2bc472b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.528991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe054197-ec7c-4a22-9d26-1add3c968c73 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.544612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.545310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.545599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.546071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.546882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.549489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.597254 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1405/2839] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:49:56.605691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.629279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c298c0-39a0-4bb4-8345-02f3a2805e28 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.648725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.655064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.656018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.656312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.657719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.689197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67089-07a8-4aac-a3e6-2905cc868d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.690155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67089-07a8-4aac-a3e6-2905cc868d8d service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.690818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67089-07a8-4aac-a3e6-2905cc868d8d service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.691306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67089-07a8-4aac-a3e6-2905cc868d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.704820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.749431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1406/2840] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:49:56.750772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.767591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2624b-4120-454a-b398-3594b0ec6bce admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.787766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.787766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.788703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.788703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.789331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.791320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.827691 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1407/2841] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:49:56.829439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.836698 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:56.849828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352cb54-8b16-47e8-b5b3-d2abdaedfb0a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.855118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f21a5-a5b1-4abb-add4-010af105ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.856192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f21a5-a5b1-4abb-add4-010af105ea65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.856598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f21a5-a5b1-4abb-add4-010af105ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.857530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f21a5-a5b1-4abb-add4-010af105ea65 admin admin] PATH_INFO: `/v3/projects/338c6586392b4c80a3c751ae0e838843/users/a01ecc148cb346b2bca7a04ee46bba5d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.874331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67089-07a8-4aac-a3e6-2905cc868d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.877229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f21a5-a5b1-4abb-add4-010af105ea65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=338c6586392b4c80a3c751ae0e838843, user_id=a01ecc148cb346b2bca7a04ee46bba5d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.877560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67089-07a8-4aac-a3e6-2905cc868d8d service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.880912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f21a5-a5b1-4abb-add4-010af105ea65 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.892986 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1435/2842] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:49:56.906372 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1408/2843] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:56 2022] PUT /identity/v3/projects/338c6586392b4c80a3c751ae0e838843/users/a01ecc148cb346b2bca7a04ee46bba5d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:56.923904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.924366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.926767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.032889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] MFA Rules not processed for user `a01ecc148cb346b2bca7a04ee46bba5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:57.034405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:57.382962 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1436/2844] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:57.443269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.445198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd059d-2881-44f6-8348-6b52019aebe7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.449558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd059d-2881-44f6-8348-6b52019aebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.449558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd059d-2881-44f6-8348-6b52019aebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.450135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:57.528852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d0fd059d-2881-44f6-8348-6b52019aebe7 None None] MFA Rules not processed for user `dd8d6bbf2e204d42b1881c594210722a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:57.535992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0fd059d-2881-44f6-8348-6b52019aebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:57.555421 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:57.901014 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1409/2845] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:57.906016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0502b6c-8a5c-4534-aa5e-afd4738e7d13 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.931582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.932287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.932575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.932854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.962920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.965070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.996306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1437/2846] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:58.275311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5229bf9-9f88-4181-9978-275e48196da3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:58.275578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5229bf9-9f88-4181-9978-275e48196da3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:58.275736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5229bf9-9f88-4181-9978-275e48196da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:58.316666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b5229bf9-9f88-4181-9978-275e48196da3 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:58.317107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5229bf9-9f88-4181-9978-275e48196da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:58.515781 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1410/2847] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:58.533117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:58.683462 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:58.695608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399e107-e758-495c-94c5-ed50d669bb56 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:58.714968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63b2a-f76d-4b53-b1bf-429e07d58b90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:58.715678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63b2a-f76d-4b53-b1bf-429e07d58b90 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:58.716029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63b2a-f76d-4b53-b1bf-429e07d58b90 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:58.716248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63b2a-f76d-4b53-b1bf-429e07d58b90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:58.745081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc63b2a-f76d-4b53-b1bf-429e07d58b90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:58.748294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc63b2a-f76d-4b53-b1bf-429e07d58b90 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:58.791043 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1438/2848] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:49:59.007966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66accfdc-62d1-423c-9a9c-5e502dc421db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:59.008876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66accfdc-62d1-423c-9a9c-5e502dc421db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:59.009509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66accfdc-62d1-423c-9a9c-5e502dc421db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:59.046376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-66accfdc-62d1-423c-9a9c-5e502dc421db None None] MFA Rules not processed for user `a01ecc148cb346b2bca7a04ee46bba5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:59.048010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-66accfdc-62d1-423c-9a9c-5e502dc421db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:59.076420 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1411/2849] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:59.527814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26713899-0e32-4c7a-9a4b-b23b2b33a48a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:59.528996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26713899-0e32-4c7a-9a4b-b23b2b33a48a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:59.529722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26713899-0e32-4c7a-9a4b-b23b2b33a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:59.625244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-26713899-0e32-4c7a-9a4b-b23b2b33a48a None None] MFA Rules not processed for user `dd8d6bbf2e204d42b1881c594210722a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:59.628475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-26713899-0e32-4c7a-9a4b-b23b2b33a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:59.647287 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1439/2850] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:59.755466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:59.756317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:59.757069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:59.816562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] MFA Rules not processed for user `8c9e190ac4fd457fac81ff0b04bf87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:59.821042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:59.996764 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1412/2851] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:01.656516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:01.657225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:01.657225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:01.727351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:01.730863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:01.777092 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1440/2852] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:01.778749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:01.817361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baaa99-e46f-448a-b83a-15074c017a74 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:01.843563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03edb3e-a85a-4beb-86a9-d32ceb7eff13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:01.844374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03edb3e-a85a-4beb-86a9-d32ceb7eff13 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:01.844494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03edb3e-a85a-4beb-86a9-d32ceb7eff13 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:01.844783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03edb3e-a85a-4beb-86a9-d32ceb7eff13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:01.881369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03edb3e-a85a-4beb-86a9-d32ceb7eff13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:01.886707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03edb3e-a85a-4beb-86a9-d32ceb7eff13 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:01.931837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1413/2853] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:50:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:50:02.334655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:02.514291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea19fbb-d2ed-466d-8d8f-d09ef8e81e18 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:02.527355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:02.528943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:02.529738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:02.530349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] PATH_INFO: `/v3/users/a01ecc148cb346b2bca7a04ee46bba5d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:02.532976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01ecc148cb346b2bca7a04ee46bba5d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:02.536093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:02.657197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01ecc148cb346b2bca7a04ee46bba5d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:02.658525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01ecc148cb346b2bca7a04ee46bba5d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:02.696522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01ecc148cb346b2bca7a04ee46bba5d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:02.697594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01ecc148cb346b2bca7a04ee46bba5d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:02.722000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01ecc148cb346b2bca7a04ee46bba5d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:02.814453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1441/2854] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:02 2022] DELETE /identity/v3/users/a01ecc148cb346b2bca7a04ee46bba5d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:02.819140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602310-d808-4e57-8c64-3af13529f086 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:02.820405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602310-d808-4e57-8c64-3af13529f086 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:02.820995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602310-d808-4e57-8c64-3af13529f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:02.869213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2a602310-d808-4e57-8c64-3af13529f086 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:02.871071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a602310-d808-4e57-8c64-3af13529f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:03.032455 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:03.084387 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1414/2855] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:03.145681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:03.147248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:03.275802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d0ab-c923-4a8c-b373-f63a14d7a22d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:03.282868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:03.284044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:03.284743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:03.285288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:03.335744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:03.338681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:03.353263 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:03.403455 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1442/2856] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:05.517020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1d20-84af-472b-b5fc-fe70783f42ba None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.517575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1d20-84af-472b-b5fc-fe70783f42ba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.517774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1d20-84af-472b-b5fc-fe70783f42ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.652471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ed1a1d20-84af-472b-b5fc-fe70783f42ba None None] MFA Rules not processed for user `4c7520db76344dfabd39ba11b8c7e9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:05.656535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed1a1d20-84af-472b-b5fc-fe70783f42ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.803010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.805173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.846406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492010c-b87f-4976-91d3-15ef0cb1286f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.867778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.868768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.868976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.869259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] PATH_INFO: `/v3/projects/338c6586392b4c80a3c751ae0e838843` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.878214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=338c6586392b4c80a3c751ae0e838843)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.880918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.895864 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1415/2857] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:06.045451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338c6586392b4c80a3c751ae0e838843', 'request_id': 'req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.062244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338c6586392b4c80a3c751ae0e838843', 'request_id': 'req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.072339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338c6586392b4c80a3c751ae0e838843', 'request_id': 'req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.120842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] The token cache is being invalidate because project 338c6586392b4c80a3c751ae0e838843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:06.121374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.123007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b77c786f-5b86-42ba-9d63-4838f6b1d5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.128476 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1443/2858] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:05 2022] DELETE /identity/v3/projects/338c6586392b4c80a3c751ae0e838843 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:06.132018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba460db-9158-4510-b14c-99367656c540 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.132359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba460db-9158-4510-b14c-99367656c540 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.132833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba460db-9158-4510-b14c-99367656c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.184467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0ba460db-9158-4510-b14c-99367656c540 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:06.189076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ba460db-9158-4510-b14c-99367656c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.522773 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1416/2859] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:06.584258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.584527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.584815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.622464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:06.623879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.648971 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1444/2860] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:06.655872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba460db-9158-4510-b14c-99367656c540 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.667216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba460db-9158-4510-b14c-99367656c540 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.674053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.677433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.678517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.679284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.680943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:06.681532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.687173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf19f-bc37-4866-9ac6-d5510fdb87b2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.759001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.759226 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1417/2861] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:06.781331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3bde-f523-4ccc-b688-0411ae1949ae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.791976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.792234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3c75-6fee-4b6b-973a-f9cd534cfa0a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.792478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3c75-6fee-4b6b-973a-f9cd534cfa0a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.792607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.792755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3c75-6fee-4b6b-973a-f9cd534cfa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.792874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.793178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.793962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.798396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.866210 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1445/2862] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:06.870848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.871537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-acec3c75-6fee-4b6b-973a-f9cd534cfa0a None None] MFA Rules not processed for user `839be0adb459435da71015e49cc81728`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:06.887306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-acec3c75-6fee-4b6b-973a-f9cd534cfa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.014221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b26054-f72c-41d4-9cca-9eafe7dc1f13 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.027864 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:07.033180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.034349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.035441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.035949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.036936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.039308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.093595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1446/2863] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:07.095288 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1418/2864] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:07.112071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.128246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c360a-f56b-479d-8c76-c56f0f9806be None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.128682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c360a-f56b-479d-8c76-c56f0f9806be None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.129042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c360a-f56b-479d-8c76-c56f0f9806be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.131917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a4c2-1d28-4e31-839a-060b8b71fa74 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.147680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.148788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.149323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.149773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.150947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.159565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.183837 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1447/2865] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:07.185043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cd8c360a-f56b-479d-8c76-c56f0f9806be None None] MFA Rules not processed for user `bf59a9e902304a60939b4d5309b90714`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:07.186691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cd8c360a-f56b-479d-8c76-c56f0f9806be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.189325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.229685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90816-84ad-4eec-b8b3-d5d509250fe6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.252705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.253996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.254391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.254773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.255817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.257517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.335207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1448/2866] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:07.336844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.363183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1419/2867] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:07.387135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1cbb-805a-4b07-ac2c-d310da87bb48 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.412900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.419958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.420707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.421229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] PATH_INFO: `/v3/projects/a03a05a45d874be187848d8bcdc27e70/users/c86c5087a0284ccb9b95580c378b1de5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.518895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03a05a45d874be187848d8bcdc27e70, user_id=c86c5087a0284ccb9b95580c378b1de5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.556633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.584852 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:07.604036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1449/2868] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:07 2022] PUT /identity/v3/projects/a03a05a45d874be187848d8bcdc27e70/users/c86c5087a0284ccb9b95580c378b1de5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:07.611896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.613675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.614192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.646599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:07.648873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.700119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.703836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.819207 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1420/2869] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:07.857274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.860122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.879573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e33f5e-5651-4109-b382-934af21209de admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.891557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.892900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.894278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.895402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.898126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:08.038543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.040792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e002-f9bf-44da-9aff-f4e2ff29063e service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.058794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44725f2-b51a-42bb-a117-a039370f26a3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:08.070620 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1450/2870] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:08.081444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:08.083070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.084243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.084740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.141037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.143673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.167861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1421/2871] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:09.273858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.274772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.274772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.337825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] MFA Rules not processed for user `b27bfc0e95874f57866174f390c7bc63`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:09.339961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:09.515604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1451/2872] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:09.520409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.522828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:09.559306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1398e-bec2-4304-bb61-07a7eaa348b5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.575078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.576273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.576954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.578424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.585129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.599734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.683895 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1422/2873] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:09.688638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.709208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4053346-8795-4541-bfa1-10c74adfa401 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.761310 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:09.872970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.876465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.877578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.878914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.880673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.885592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.977054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1452/2874] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:09.981064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:10.002211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467f03-46ad-4f9a-8167-01611ed16357 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:10.013021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:10.014365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:10.015906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:10.022233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:10.022233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:10.026046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:10.032063 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:10.068034 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1423/2875] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:50:10.072905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:10.108235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49933e1e-bb0e-421a-9d6d-8669492c1374 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:10.124705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:10.126327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:10.126825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:10.127466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] PATH_INFO: `/v3/projects/6ee9af6437c645828bb72a5a163d352d/users/e59bfc5a83c34869892c1b5491907c7c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:10.188748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee9af6437c645828bb72a5a163d352d, user_id=e59bfc5a83c34869892c1b5491907c7c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:10.196140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:10.231585 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1453/2876] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:10 2022] PUT /identity/v3/projects/6ee9af6437c645828bb72a5a163d352d/users/e59bfc5a83c34869892c1b5491907c7c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:10.240064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:10.284052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59e93-8067-4d14-ace0-70d47f189cb4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:10.759134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:10.759995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:10.760387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:10.760768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:10.761816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:10.763954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:10.790904 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1424/2877] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:10.792370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:10.834362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79cba-a983-47d7-961b-d22e851750e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:10.867519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:10.868593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:10.868875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:10.869155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] PATH_INFO: `/v3/projects/6ee9af6437c645828bb72a5a163d352d/users/e59bfc5a83c34869892c1b5491907c7c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:10.872323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee9af6437c645828bb72a5a163d352d, user_id=e59bfc5a83c34869892c1b5491907c7c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:10.875148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:10.900714 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1454/2878] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:10 2022] PUT /identity/v3/projects/6ee9af6437c645828bb72a5a163d352d/users/e59bfc5a83c34869892c1b5491907c7c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:20.781247 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=30 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:20.894271 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=34,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:35.114983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:35.121752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:35.163407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef13277-5ea0-4643-87eb-d310c0c99ade admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:35.305863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:35.306987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:35.307531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:35.308115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] PATH_INFO: `/v3/users/49c191c9a184416f834013d598a3d982` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:35.309803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c191c9a184416f834013d598a3d982)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:35.312783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:35.412756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c191c9a184416f834013d598a3d982'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:35.448560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c191c9a184416f834013d598a3d982'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:35.459573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c191c9a184416f834013d598a3d982'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:35.477046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c191c9a184416f834013d598a3d982'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:35.478092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c191c9a184416f834013d598a3d982'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:35.493882 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1425/2879] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:35 2022] DELETE /identity/v3/users/49c191c9a184416f834013d598a3d982 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:37.003730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:37.014821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:37.066412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6f2e-6fd6-46bc-bc86-9bc0fcadf335 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:37.255526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:37.258343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:37.259435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:37.271606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] PATH_INFO: `/v3/projects/40f2ad87ad354e35951db4de35107fdb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:37.273822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f2ad87ad354e35951db4de35107fdb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:37.278916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:37.398536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f2ad87ad354e35951db4de35107fdb', 'request_id': 'req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.421919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f2ad87ad354e35951db4de35107fdb', 'request_id': 'req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.437110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f2ad87ad354e35951db4de35107fdb', 'request_id': 'req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.470462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] The token cache is being invalidate because project 40f2ad87ad354e35951db4de35107fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:37.470833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.471538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.473142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1455/2880] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:37 2022] DELETE /identity/v3/projects/40f2ad87ad354e35951db4de35107fdb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:37.477178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:37.493195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486cfe7-dcff-40a7-adf3-bca2dc4bff73 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:37.614842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:37.615856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:37.616014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:37.616300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] PATH_INFO: `/v3/users/4c7520db76344dfabd39ba11b8c7e9af` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:37.619513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7520db76344dfabd39ba11b8c7e9af)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:37.621580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:37.672150 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:37.728479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7520db76344dfabd39ba11b8c7e9af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.749733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7520db76344dfabd39ba11b8c7e9af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.761587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7520db76344dfabd39ba11b8c7e9af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.795536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7520db76344dfabd39ba11b8c7e9af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.804863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c9e3ed63-8e7c-4cbc-b7d6-6a76602c707a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7520db76344dfabd39ba11b8c7e9af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:37.832079 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1426/2881] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:37 2022] DELETE /identity/v3/users/4c7520db76344dfabd39ba11b8c7e9af => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:38.539553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:38.541688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:38.564371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d345fd-b1b7-49e7-aa3a-6f471ddf5520 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:38.690769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:38.692053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:38.692499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:38.692947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] PATH_INFO: `/v3/projects/0a5b1fce00fa4a4bb69412794a59ba09` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:38.695089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5b1fce00fa4a4bb69412794a59ba09)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:38.697561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:38.763653 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:38.792533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5b1fce00fa4a4bb69412794a59ba09', 'request_id': 'req-192deae2-e73c-41e8-8497-c6dd65996a34'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:38.817458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5b1fce00fa4a4bb69412794a59ba09', 'request_id': 'req-192deae2-e73c-41e8-8497-c6dd65996a34'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:38.831049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5b1fce00fa4a4bb69412794a59ba09', 'request_id': 'req-192deae2-e73c-41e8-8497-c6dd65996a34'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:38.852931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] The token cache is being invalidate because project 0a5b1fce00fa4a4bb69412794a59ba09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:38.853901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:38.854858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-192deae2-e73c-41e8-8497-c6dd65996a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:38.862763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:38.863304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:38.863426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:38.864140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1456/2882] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:38 2022] DELETE /identity/v3/projects/0a5b1fce00fa4a4bb69412794a59ba09 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:38.887531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:38.888935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:39.020184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1427/2883] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:39.027681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.028869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.029352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.060236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:39.063298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:39.075511 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1457/2884] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:39.080751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.092496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39fc8-91f8-43e1-9a2e-ffb745bd5f95 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.098247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.099238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.099717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.100149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.101054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:39.101525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.103532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:39.117376 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1428/2885] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:39.123213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.144919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bcd18-b38c-4794-bce0-e47aeddf3e86 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.151848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.152843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.153291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.153764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.154764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.156973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:39.201381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1458/2886] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:39 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:39.204991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.246761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e4a49-067d-427c-8e8c-aaff8aa99d3b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.361940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.362690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.362985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.363434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.365276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.368426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:39.404875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1429/2887] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:39 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:39.411521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.428891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf0c2-b227-4496-a392-53ce359489dc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.436826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.437811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.438241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.441792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.443003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.445667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:39.460772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1459/2888] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:39.464869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.480296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36bed2-a237-497a-97ba-adac269c4cb6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.489798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82b6be-a026-4060-b1df-37c8194189c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.491320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b6be-a026-4060-b1df-37c8194189c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.491837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b6be-a026-4060-b1df-37c8194189c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.492255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b6be-a026-4060-b1df-37c8194189c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.494550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82b6be-a026-4060-b1df-37c8194189c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.496981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82b6be-a026-4060-b1df-37c8194189c3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:39.520148 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1430/2889] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:39.524152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.538732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdb23a-b006-4a4c-90fa-0e87e0330751 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.544905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.547530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.547908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.548313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] PATH_INFO: `/v3/projects/57e75af784304a4b84a72531faa44111/users/55e38f4c2a814efab3873507d136dda8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.589731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e75af784304a4b84a72531faa44111, user_id=55e38f4c2a814efab3873507d136dda8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.594482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:39.618665 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1460/2890] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:39 2022] PUT /identity/v3/projects/57e75af784304a4b84a72531faa44111/users/55e38f4c2a814efab3873507d136dda8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:39.629397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.629877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.630698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.640179 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:39.694663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] MFA Rules not processed for user `55e38f4c2a814efab3873507d136dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:39.696305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:39.823105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1431/2891] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:39.827464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:39.936385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e90db-2f3b-463f-aff4-182d57aa7516 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:39.970583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:39.978204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:39.978525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:39.978822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:39.979569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:39.987623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:40.055089 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1461/2892] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:39 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:40.055571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:40.082602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97969e51-f9f8-4470-b6e3-b5af1731d382 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:40.328632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:40.330520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:40.331201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:40.331653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:40.333170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:40.335380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:40.382849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:40.395722 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1432/2893] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:40 2022] POST /identity/v3/users => generated 294 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:40.416093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3abbe-004d-484d-bfab-aa1e84065541 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:40.421748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:40.422449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:40.422857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:40.423139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:40.424155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:40.426200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:40.456789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:40.470463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1462/2894] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:40.475827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae0bd-73bb-4031-8512-4a5451e8fdf4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:40.489018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602de17-7a16-423d-91e4-ef6fc41e0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:40.492024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602de17-7a16-423d-91e4-ef6fc41e0b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:40.492323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602de17-7a16-423d-91e4-ef6fc41e0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:40.492611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602de17-7a16-423d-91e4-ef6fc41e0b67 admin admin] PATH_INFO: `/v3/projects/dab99adf73684625af3e04b7604e80ca/users/57e9c1ef0cdd47348b85fd6be6b6f484/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:40.537124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602de17-7a16-423d-91e4-ef6fc41e0b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab99adf73684625af3e04b7604e80ca, user_id=57e9c1ef0cdd47348b85fd6be6b6f484, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:40.539867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602de17-7a16-423d-91e4-ef6fc41e0b67 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:40.571323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:40.572511 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1433/2895] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:40 2022] PUT /identity/v3/projects/dab99adf73684625af3e04b7604e80ca/users/57e9c1ef0cdd47348b85fd6be6b6f484/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:40.590029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ce7d-f402-4ea7-b15f-43a21c3ad1cc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:40.652718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:40.653114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:40.653536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:40.692035 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:40.718279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] MFA Rules not processed for user `e59bfc5a83c34869892c1b5491907c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:40.719741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:40.781288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:40.782368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:40.782843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:40.784386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:40.795991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:40.797907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:40.832463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1463/2896] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:50:40.839917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:40.868247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d520-9761-487c-92dc-7df1fa4d3d7b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:40.869962 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:40.906472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ac5e2-f83e-4a7b-baa7-c1bc514dc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:40.907451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ac5e2-f83e-4a7b-baa7-c1bc514dc38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:40.907744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ac5e2-f83e-4a7b-baa7-c1bc514dc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:40.915333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ac5e2-f83e-4a7b-baa7-c1bc514dc38c admin admin] PATH_INFO: `/v3/projects/dab99adf73684625af3e04b7604e80ca/users/57e9c1ef0cdd47348b85fd6be6b6f484/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:40.927687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ac5e2-f83e-4a7b-baa7-c1bc514dc38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab99adf73684625af3e04b7604e80ca, user_id=57e9c1ef0cdd47348b85fd6be6b6f484, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:40.930885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ac5e2-f83e-4a7b-baa7-c1bc514dc38c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:40.931562 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1434/2897] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:40.947693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:40.958016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:40.982485 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1464/2898] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:40 2022] PUT /identity/v3/projects/dab99adf73684625af3e04b7604e80ca/users/57e9c1ef0cdd47348b85fd6be6b6f484/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:41.000157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef941-bc0b-4265-8eab-7fc0f4247131 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:41.000820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef941-bc0b-4265-8eab-7fc0f4247131 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:41.001365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef941-bc0b-4265-8eab-7fc0f4247131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:41.080399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bbdef941-bc0b-4265-8eab-7fc0f4247131 None None] MFA Rules not processed for user `57e9c1ef0cdd47348b85fd6be6b6f484`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:41.080399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbdef941-bc0b-4265-8eab-7fc0f4247131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:41.089419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4510cc-d183-44d6-bad1-694f00d3c891 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:41.198714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:41.199597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:41.199892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:41.200224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:41.253595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1465/2899] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:41.256635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60e3b-1faf-4749-9a64-539f47435e02 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:41.256635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60e3b-1faf-4749-9a64-539f47435e02 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:41.257048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60e3b-1faf-4749-9a64-539f47435e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:41.326973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-55b60e3b-1faf-4749-9a64-539f47435e02 None None] MFA Rules not processed for user `55e38f4c2a814efab3873507d136dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:41.328447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55b60e3b-1faf-4749-9a64-539f47435e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:41.385573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:41.393486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:41.413582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1435/2900] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:41.454462 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1466/2901] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:41.522215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:41.524385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:41.645282 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:41.729254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c3fa-8e6c-4b1a-8338-872dde7703fd service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:41.741242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:41.742420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:41.743072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:41.743624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:41.777216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:41.779889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:41.807151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1436/2902] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:41.849464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:41.850102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:41.850102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:41.924557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] MFA Rules not processed for user `c86c5087a0284ccb9b95580c378b1de5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:41.925824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:42.052692 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:42.151366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1467/2903] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:42.524748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:42.541152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:42.656799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29ed73-0a87-4ccd-84ba-134278ab605c service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:42.691074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:42.692658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:42.695191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:42.695980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:42.790024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:42.829570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:42.884013 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1437/2904] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:48.635851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:48.635851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:48.871383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eff91-23e6-4b93-a933-2407243f5265 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:48.884430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:48.885891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:48.886794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:48.887084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] PATH_INFO: `/v3/users/58ce5615a9284a548acea20f6f6e6390` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:48.889623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ce5615a9284a548acea20f6f6e6390)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:48.894729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:49.039023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ce5615a9284a548acea20f6f6e6390'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:49.043628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ce5615a9284a548acea20f6f6e6390'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:49.078427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ce5615a9284a548acea20f6f6e6390'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:49.082417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ce5615a9284a548acea20f6f6e6390'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:49.104511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ce5615a9284a548acea20f6f6e6390'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:49.138578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1468/2905] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:48 2022] DELETE /identity/v3/users/58ce5615a9284a548acea20f6f6e6390 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:49.252348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:49.276276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bc2e7-f0db-42b2-94dd-3e2d4ae75219 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:49.541666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:49.543105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:49.543699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:49.546750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:49.553561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:49.860137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:49.861701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:49.878673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:49.884529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294b103-8166-4781-b934-c8b5e25417d1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:49.911031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1438/2906] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:50.068984 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:50.103676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bec425-215a-429c-8a4b-9be68ee023a7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.138348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.140163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.140311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.140549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] PATH_INFO: `/v3/projects/440c741054a64fd791cd96cc124d3d22` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.144394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440c741054a64fd791cd96cc124d3d22)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.151399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.346071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440c741054a64fd791cd96cc124d3d22', 'request_id': 'req-231a3583-4545-4a24-ac86-462a2e95b2f4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.375774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440c741054a64fd791cd96cc124d3d22', 'request_id': 'req-231a3583-4545-4a24-ac86-462a2e95b2f4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.395525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440c741054a64fd791cd96cc124d3d22', 'request_id': 'req-231a3583-4545-4a24-ac86-462a2e95b2f4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.446155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] The token cache is being invalidate because project 440c741054a64fd791cd96cc124d3d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:50.446365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.450077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.459981 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1469/2907] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:49 2022] DELETE /identity/v3/projects/440c741054a64fd791cd96cc124d3d22 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:50.462057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2a2e9-9161-4ebf-ad7b-30864f91a73f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.462592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2a2e9-9161-4ebf-ad7b-30864f91a73f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.462690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2a2e9-9161-4ebf-ad7b-30864f91a73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.542335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-01e2a2e9-9161-4ebf-ad7b-30864f91a73f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:50.543970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-01e2a2e9-9161-4ebf-ad7b-30864f91a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.623104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.631880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.743501 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:50.796795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1439/2908] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:50.799443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.802702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.803128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.860991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a3583-4545-4a24-ac86-462a2e95b2f4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.886319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:50.889264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.906453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.907490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.909311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.910151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.917327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.955083 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1440/2909] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:50.962423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.001930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0782-4171-4996-8d03-d4451f2f74f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.020444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.021042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.025066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.025066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.025724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:51.026045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.036843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.109967 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1441/2910] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:51.112572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.136282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069df90-7544-470a-96aa-a7e23a853ec4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.154618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.155304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.155594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.155884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.156597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.160164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.208120 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1442/2911] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:51 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:51.212722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.212904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.214346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.238863 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1470/2912] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:51.336824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4dd74-ed30-4e49-92e1-f8dbd73ddfb3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.350542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.351822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.352173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.352458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.353178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.355230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.426873 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1443/2913] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:51 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:51.428147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.446392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c4d0-7d7e-4759-8a0f-c4e8a5071e0f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.460913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.461534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.461821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.462101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.462931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.464693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.514560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1471/2914] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:51.515558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.535525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dad1b2-9569-48f6-8261-aabeffbdc1f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.558043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061ac5a-4749-409a-bd0d-c09fd5508166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.558791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ac5a-4749-409a-bd0d-c09fd5508166 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.559075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ac5a-4749-409a-bd0d-c09fd5508166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.559355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ac5a-4749-409a-bd0d-c09fd5508166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.560100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061ac5a-4749-409a-bd0d-c09fd5508166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.564022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061ac5a-4749-409a-bd0d-c09fd5508166 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.600246 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1444/2915] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:51.604262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.616633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd770b5-9919-40cc-934a-69329e88ba70 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.634785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.635712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.635997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.636279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] PATH_INFO: `/v3/projects/3ee1c1d62a8946a18faa6e146a6d23b3/users/b53f091f93b74298890f2a18a006d7b2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.665389 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:51.673752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee1c1d62a8946a18faa6e146a6d23b3, user_id=b53f091f93b74298890f2a18a006d7b2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.677382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.709246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e628e-d2b9-4832-826a-ae2707778269 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.709546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e628e-d2b9-4832-826a-ae2707778269 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.709830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e628e-d2b9-4832-826a-ae2707778269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.711311 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1472/2916] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:51 2022] PUT /identity/v3/projects/3ee1c1d62a8946a18faa6e146a6d23b3/users/b53f091f93b74298890f2a18a006d7b2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:51.769680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-407e628e-d2b9-4832-826a-ae2707778269 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:51.777121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-407e628e-d2b9-4832-826a-ae2707778269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:51.924828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1445/2917] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:52.189494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:52.611252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b56258-a184-49c6-9fbb-a46aff23ecc9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:52.627271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:52.628268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:52.630060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:52.630776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:52.661950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:52.666981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:52.760552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1473/2918] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:52.967416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77052497-e710-4b61-9678-5c7f32f496ee None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:52.968560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77052497-e710-4b61-9678-5c7f32f496ee None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:52.969230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77052497-e710-4b61-9678-5c7f32f496ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:53.016506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-77052497-e710-4b61-9678-5c7f32f496ee None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:53.021730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-77052497-e710-4b61-9678-5c7f32f496ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:53.137557 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:53.295409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1446/2919] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:53.349175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:53.351640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:53.504010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3efdd5-7088-4126-a009-064b76806fac None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:53.504471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3efdd5-7088-4126-a009-064b76806fac None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:53.504849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3efdd5-7088-4126-a009-064b76806fac None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:53.508576 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1447/2920] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:50:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:53.531779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:53.555209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:53.555624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:53.661295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:53.661295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:53.804375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cddc1-4e48-4292-888c-a66b96ab6d9c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:53.814772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:53.815841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:53.816364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:53.816893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:53.829326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:53.832333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:53.872693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1474/2921] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:50:54.017826 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1448/2922] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:50:54.048200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:54.049687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:54.087695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeebcf0-678b-4a6a-8b9f-645673accedf service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:54.107509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720903b-c259-4732-9002-a03403f0becb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:54.108252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720903b-c259-4732-9002-a03403f0becb service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:54.108603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720903b-c259-4732-9002-a03403f0becb service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:54.109447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720903b-c259-4732-9002-a03403f0becb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:54.137228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720903b-c259-4732-9002-a03403f0becb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:54.143005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720903b-c259-4732-9002-a03403f0becb service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:54.193144 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1475/2923] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:54.496035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:54.507728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570e742-2474-4e38-9ec0-45614b466298 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:54.522864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:54.523545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:54.523835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:54.524117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:54.539080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:54.570682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:54.572335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617e0bf-7ec8-4db9-a8f8-0d58a76ef9d6 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:54.611890 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1449/2924] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:55.188498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67023e7d-c3c5-4675-9ea1-7438c9ade2f7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.189776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67023e7d-c3c5-4675-9ea1-7438c9ade2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.189776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67023e7d-c3c5-4675-9ea1-7438c9ade2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.287035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-67023e7d-c3c5-4675-9ea1-7438c9ade2f7 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:55.302438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67023e7d-c3c5-4675-9ea1-7438c9ade2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:55.348949 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1476/2925] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:55.385626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b134a-9b36-4c69-9c52-3599b0129da0 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.386330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b134a-9b36-4c69-9c52-3599b0129da0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.386330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b134a-9b36-4c69-9c52-3599b0129da0 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.387811 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1450/2926] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:50:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:55.395649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc59c57-b5a8-4384-a9ed-8c9514031ad6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.395939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc59c57-b5a8-4384-a9ed-8c9514031ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.396328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc59c57-b5a8-4384-a9ed-8c9514031ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.468997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6bc59c57-b5a8-4384-a9ed-8c9514031ad6 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:55.471964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6bc59c57-b5a8-4384-a9ed-8c9514031ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:55.499046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b134a-9b36-4c69-9c52-3599b0129da0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:55.530793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b134a-9b36-4c69-9c52-3599b0129da0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:55.541975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:55.542701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.543207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.544323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.560703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:55.562666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:55.574362 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1451/2927] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:50:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:50:55.690357 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:55.715503 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1477/2928] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:55.857882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:55.877309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe59d-12db-42c8-9e17-8ed6de6c32b1 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:55.895568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:55.897543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.899177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.899650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.951355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:55.952833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:56.024738 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1452/2929] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:56.061839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:56.062404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:56.062929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:56.119431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:56.124565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:56.148637 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1478/2930] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:56.178032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:56.189870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6596b-b60e-488d-add4-013b7373983f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:56.209228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:56.210988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:56.211926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:56.212215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:56.248459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:56.257765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:56.300264 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1453/2931] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:57.739818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:57.741403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:57.759282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1749a96-5757-4342-b0a1-ab1c9d6e1b49 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:57.778378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:57.779098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:57.779377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:57.779661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:57.789957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:57.840564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:57.843540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:57.880955 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1479/2932] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:01.269826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:01.281418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f80cc8-796f-4394-84ed-12ada5ccb981 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:01.299328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:01.299895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:01.302220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:01.302521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:01.311549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:01.355477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:01.367707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:01.409771 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1454/2933] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:04.789917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:04.792033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:04.816395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6aec4-fbfc-4bc1-a84d-040df9090ffd service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:04.834482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:04.835917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:04.836375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:04.836815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:04.839285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:04.872741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:04.874711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:04.912592 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1480/2934] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:11.392286 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=69 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:14.887685 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=18 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:15.128267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:15.150885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a64743-cdef-49f3-bd6c-5090c85e1306 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:15.163398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:15.164362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:15.164872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:15.165707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:15.170860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:15.261527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:15.263595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:15.275907 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1455/2935] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:15.305666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:15.307792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:15.324195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:15.326286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:15.334203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259885ba-5ecc-4a41-a54c-db338769de81 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:15.341288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:15.343494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:15.343677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:15.344867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:15.345195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2a4cd-617b-4949-a63d-01f264641a70 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:15.348459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:15.350557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:15.351457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:15.351746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:15.352037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] PATH_INFO: `/v3/users/f4fb9a3eacf448578b8ba8a8cb7f33c0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:15.353570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fb9a3eacf448578b8ba8a8cb7f33c0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:15.370712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:15.455900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fb9a3eacf448578b8ba8a8cb7f33c0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:15.476785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fb9a3eacf448578b8ba8a8cb7f33c0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:15.489034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fb9a3eacf448578b8ba8a8cb7f33c0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:15.504107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fb9a3eacf448578b8ba8a8cb7f33c0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:15.508295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:15.509142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b6e34a2-ea67-4bb9-b974-de768846b4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fb9a3eacf448578b8ba8a8cb7f33c0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:15.510844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5f57c-eeca-4af1-8e31-85b04d44f4a6 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:15.522541 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1456/2936] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:15 2022] DELETE /identity/v3/users/f4fb9a3eacf448578b8ba8a8cb7f33c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:15.526956 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1481/2937] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:15.950732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1950976-7f39-4972-b249-284fa8e327f3 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:15.951280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1950976-7f39-4972-b249-284fa8e327f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:15.951662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1950976-7f39-4972-b249-284fa8e327f3 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:15.954517 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1457/2938] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:51:15.960601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e0ca-0ff0-4377-bc81-00f05087168c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:15.961160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e0ca-0ff0-4377-bc81-00f05087168c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:15.961160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e0ca-0ff0-4377-bc81-00f05087168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:15.991165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fe73e0ca-0ff0-4377-bc81-00f05087168c None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:15.992468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe73e0ca-0ff0-4377-bc81-00f05087168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:16.103986 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1482/2939] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:16.142838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1950976-7f39-4972-b249-284fa8e327f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:16.144820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a1950976-7f39-4972-b249-284fa8e327f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:16.183414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1950976-7f39-4972-b249-284fa8e327f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:16.195125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b69c6f-318f-42cb-94bd-dbadf289c408 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:16.196827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b69c6f-318f-42cb-94bd-dbadf289c408 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:16.197556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b69c6f-318f-42cb-94bd-dbadf289c408 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:16.198363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b69c6f-318f-42cb-94bd-dbadf289c408 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:16.223866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b69c6f-318f-42cb-94bd-dbadf289c408 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:16.230368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b69c6f-318f-42cb-94bd-dbadf289c408 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:16.267070 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1458/2940] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:16.609487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a425d2-f802-49e2-acfa-9a86e6c3f008 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:16.610832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a425d2-f802-49e2-acfa-9a86e6c3f008 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:16.611343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a425d2-f802-49e2-acfa-9a86e6c3f008 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:16.613185 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1483/2941] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:51:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:51:16.621568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301b7a-25db-43bf-91f5-893e6e93b88a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:16.622137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301b7a-25db-43bf-91f5-893e6e93b88a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:16.622652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301b7a-25db-43bf-91f5-893e6e93b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:16.651242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fd301b7a-25db-43bf-91f5-893e6e93b88a None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:16.653377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fd301b7a-25db-43bf-91f5-893e6e93b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:16.750973 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1459/2942] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:16.766246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a425d2-f802-49e2-acfa-9a86e6c3f008 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:16.768356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-05a425d2-f802-49e2-acfa-9a86e6c3f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:16.805250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a425d2-f802-49e2-acfa-9a86e6c3f008 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:16.813737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bd988-2047-4a18-9973-f1f641ee8996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:16.815303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd988-2047-4a18-9973-f1f641ee8996 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:16.815847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd988-2047-4a18-9973-f1f641ee8996 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:16.816337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd988-2047-4a18-9973-f1f641ee8996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:16.849876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bd988-2047-4a18-9973-f1f641ee8996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:16.860947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bd988-2047-4a18-9973-f1f641ee8996 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:16.910588 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1484/2943] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:17.057326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e20d0c-a40d-4eb2-a6a8-f44a9e8959dc None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.057641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e20d0c-a40d-4eb2-a6a8-f44a9e8959dc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.058347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e20d0c-a40d-4eb2-a6a8-f44a9e8959dc None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.060739 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1460/2944] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:51:17.068418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.069466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.069959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.103938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:17.105852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:17.117265 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1485/2945] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:17.142911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e20d0c-a40d-4eb2-a6a8-f44a9e8959dc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:17.152937 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:17.178258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:17.179827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:17.180259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e20d0c-a40d-4eb2-a6a8-f44a9e8959dc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:17.199220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:17.200568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.201346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.203386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.237505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:17.239234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:17.266691 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1461/2946] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:17.317039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137227d-2599-4dc1-876a-e4a83d058b3a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:17.323365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:17.324686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.324966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.325559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] PATH_INFO: `/v3/projects/02fef5a066a54d209555356044ab0d81` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.327143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fef5a066a54d209555356044ab0d81)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:17.330423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:17.418131 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:17.506525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fef5a066a54d209555356044ab0d81', 'request_id': 'req-3683fd76-66c3-43c4-91e8-f8cff3edef82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.529501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fef5a066a54d209555356044ab0d81', 'request_id': 'req-3683fd76-66c3-43c4-91e8-f8cff3edef82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.558663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fef5a066a54d209555356044ab0d81', 'request_id': 'req-3683fd76-66c3-43c4-91e8-f8cff3edef82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.597726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] The token cache is being invalidate because project 02fef5a066a54d209555356044ab0d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:17.598125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.623036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3683fd76-66c3-43c4-91e8-f8cff3edef82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.625963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1486/2947] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:17 2022] DELETE /identity/v3/projects/02fef5a066a54d209555356044ab0d81 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:17.630590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:17.650444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bada77c-f15d-4d55-b14c-8d8b91d84a40 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:17.655471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29890961-0e6e-4cc5-ae4b-93751783e3d0 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.657106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29890961-0e6e-4cc5-ae4b-93751783e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.657780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29890961-0e6e-4cc5-ae4b-93751783e3d0 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.659450 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1487/2948] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:51:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:51:17.683950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa47c5-22a2-4124-9ca8-f7aa92a927a7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.684484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa47c5-22a2-4124-9ca8-f7aa92a927a7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.684960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa47c5-22a2-4124-9ca8-f7aa92a927a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.722674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e1aa47c5-22a2-4124-9ca8-f7aa92a927a7 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:17.724197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e1aa47c5-22a2-4124-9ca8-f7aa92a927a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:17.787047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:17.787951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.788240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.788521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] PATH_INFO: `/v3/users/ab1cc3df201a44528353bea5e1c15714` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.793216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1cc3df201a44528353bea5e1c15714)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:17.800859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:17.889972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1488/2949] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:17.892527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:17.892822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:17.893104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:17.902085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1cc3df201a44528353bea5e1c15714'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.936212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1cc3df201a44528353bea5e1c15714'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.946922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] MFA Rules not processed for user `b53f091f93b74298890f2a18a006d7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:17.958636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:17.958749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1cc3df201a44528353bea5e1c15714'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.972874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1cc3df201a44528353bea5e1c15714'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.974872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1cc3df201a44528353bea5e1c15714'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:17.988258 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1462/2950] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:17 2022] DELETE /identity/v3/users/ab1cc3df201a44528353bea5e1c15714 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:17.989974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:17.994448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.097744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1489/2951] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:18.134692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28074282-e11c-4a08-b591-798d48294b1f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:18.145534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:18.146853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:18.147316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:18.147749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:18.149843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.169749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:18.171211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.200252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bded7-66c0-40e5-911d-2b5aa0ae3903 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:18.209124 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:18.247408 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:18.318233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:18.340959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:18.346480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:18.347310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:18.349828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:18.350139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:18.368256 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1463/2952] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:18.466866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:18.468976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:18.477687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:18.479490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.485450 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1490/2953] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:51:18.620338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:18.622109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.646746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1e37-802b-4645-a4d3-a1dbc4826839 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:18.658621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:18.659514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:18.659799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:18.660131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] PATH_INFO: `/v3/projects/026cf9c830294a99bde1468fbd1acec9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:18.664696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026cf9c830294a99bde1468fbd1acec9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:18.666940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:18.759553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0145d-f7f2-4864-a2ff-34e397983c5b service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:18.766415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026cf9c830294a99bde1468fbd1acec9', 'request_id': 'req-27fce6c0-bb55-4238-bbd8-ffa302032cf7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:18.780108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026cf9c830294a99bde1468fbd1acec9', 'request_id': 'req-27fce6c0-bb55-4238-bbd8-ffa302032cf7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:18.793766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026cf9c830294a99bde1468fbd1acec9', 'request_id': 'req-27fce6c0-bb55-4238-bbd8-ffa302032cf7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:18.815745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] The token cache is being invalidate because project 026cf9c830294a99bde1468fbd1acec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:18.817458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:18.820462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27fce6c0-bb55-4238-bbd8-ffa302032cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:18.824562 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1464/2954] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:18 2022] DELETE /identity/v3/projects/026cf9c830294a99bde1468fbd1acec9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:18.829811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:18.830147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:18.830362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:18.870716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:18.871985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.932042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:18.934453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:18.935951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:18.936553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:18.941165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:18.952162 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:18.973244 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:18.979521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:18.981709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd3194-a750-4ca4-9748-8b641cc1f1a0 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.012933 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1465/2955] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:19.013418 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1491/2956] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:51:19.019701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.020537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.020930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.021464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.027401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:19.068115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:19.074315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:19.095106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1492/2957] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:51:19.099974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.123055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6470b-0960-47a4-b09f-eb3c2cbeed08 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.138134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.139012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.139732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.139909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.141668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:19.142158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.146805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.185743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f82250-c053-419e-8db7-2447d98aeec2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.200805 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1493/2958] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:19.207657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.207884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.208886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.209362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.209824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.215250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:19.239097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f75a-0053-4a3d-8d02-9188293a773c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.242290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.247328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.253614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.256621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.258140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.259202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.260435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.265889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.279380 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1466/2959] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:19.353562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1494/2960] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:19 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:19.357765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.373699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a9567-d6ad-4d37-9852-1e43b738b9dc service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.559471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.560793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.561253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.562885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.563774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.569916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.623622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1467/2961] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:19 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:19.627709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.639403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36f71-16cd-46e6-9fcf-c542b2ab5333 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.656217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.657039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.657824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.657968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.661625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.666440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.685488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.697183 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1495/2962] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:19.698040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035936ff-8142-4bad-85e6-921ff080354f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.704706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f1cc-eee5-4831-b796-d75c43ba9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.705407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f1cc-eee5-4831-b796-d75c43ba9c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.705696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f1cc-eee5-4831-b796-d75c43ba9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.705983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f1cc-eee5-4831-b796-d75c43ba9c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.706781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f1cc-eee5-4831-b796-d75c43ba9c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.708496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f1cc-eee5-4831-b796-d75c43ba9c63 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.726865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:19.727308 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1468/2963] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:19.737735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9fb5d-16c1-432d-bdc0-f700b9a4057e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:19.744103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178491dc-9143-4b7a-bfe7-590c255237af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:19.746524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178491dc-9143-4b7a-bfe7-590c255237af admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.746524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178491dc-9143-4b7a-bfe7-590c255237af admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.746524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178491dc-9143-4b7a-bfe7-590c255237af admin admin] PATH_INFO: `/v3/projects/b794e83822054db4b5594576c0a40284/users/c9f8ffcf8701456eaf14be281ea02b78/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.772431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178491dc-9143-4b7a-bfe7-590c255237af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b794e83822054db4b5594576c0a40284, user_id=c9f8ffcf8701456eaf14be281ea02b78, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:19.776026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178491dc-9143-4b7a-bfe7-590c255237af admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:19.803898 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1496/2964] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:19 2022] PUT /identity/v3/projects/b794e83822054db4b5594576c0a40284/users/c9f8ffcf8701456eaf14be281ea02b78/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:51:19.815929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:19.816326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:19.816572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:19.877703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] MFA Rules not processed for user `c9f8ffcf8701456eaf14be281ea02b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:19.879345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:19.976491 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:20.053249 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1469/2965] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:20.067875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bac203-a07b-40a3-a7c7-3f23d0c27482 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:20.068167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bac203-a07b-40a3-a7c7-3f23d0c27482 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:20.068451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bac203-a07b-40a3-a7c7-3f23d0c27482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:20.129324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-42bac203-a07b-40a3-a7c7-3f23d0c27482 None None] MFA Rules not processed for user `c9f8ffcf8701456eaf14be281ea02b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:20.130402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-42bac203-a07b-40a3-a7c7-3f23d0c27482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:20.156382 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1497/2966] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:20.323279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:20.325053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:20.445863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25902edc-0ed2-48be-9b23-7ba6d1e488f9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:20.446161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25902edc-0ed2-48be-9b23-7ba6d1e488f9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:20.446448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25902edc-0ed2-48be-9b23-7ba6d1e488f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:20.504202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-25902edc-0ed2-48be-9b23-7ba6d1e488f9 None None] MFA Rules not processed for user `b27bfc0e95874f57866174f390c7bc63`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:20.509784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-25902edc-0ed2-48be-9b23-7ba6d1e488f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:20.529991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fafce-2662-4c06-b69f-fa263b9d7445 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:20.535211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:20.536452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:20.537017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:20.537323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:20.539569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:20.554122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:20.555954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:20.569338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1470/2967] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:20.728838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1498/2968] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:20.794680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:20.796331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:20.979862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646405f2-d314-4f2f-8339-3869f79b2449 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:20.996176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:20.996934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:20.997378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:20.997880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:21.018799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:21.020680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:21.035610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1471/2969] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:21.348124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:21.348595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:21.348802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:21.388697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:21.390140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:21.513783 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1499/2970] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:21.528827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:21.530353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:21.775861 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:21.783239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550203-3935-45fd-aa47-5a9480a629db service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:21.796262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106de3-c5cb-4848-984d-ef21fbdfa3eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:21.797083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106de3-c5cb-4848-984d-ef21fbdfa3eb service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:21.797717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106de3-c5cb-4848-984d-ef21fbdfa3eb service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:21.798143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106de3-c5cb-4848-984d-ef21fbdfa3eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:21.820416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab106de3-c5cb-4848-984d-ef21fbdfa3eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:21.822225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab106de3-c5cb-4848-984d-ef21fbdfa3eb service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:21.839688 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1472/2971] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:23.832926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:23.862065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01206627-6671-4cc0-a521-4d2584da22ca None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:23.891170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:23.894830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:23.895470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:23.895985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:23.901109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:23.923495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:23.930179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:23.967970 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1500/2972] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:26.226300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:26.226889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:26.226889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:26.265376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] MFA Rules not processed for user `b53f091f93b74298890f2a18a006d7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:26.266604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:26.383467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1473/2973] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:27.230631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:27.236024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:27.257587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985069c-1667-472d-8d7c-fc3ed7d81427 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:27.266538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:27.268155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:27.269326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:27.273311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:27.278169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:27.292009 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:27.300169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:27.301681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a73a2-c687-439b-91d8-2c42b2dfb01b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:27.342115 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1501/2974] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:27.492468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:27.494716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:27.635586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec92ce-b7dd-4515-b484-b9dbe3d822e0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:27.641494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:27.643813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:27.644398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:27.644982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] PATH_INFO: `/v3/users/c86c5087a0284ccb9b95580c378b1de5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:27.646706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86c5087a0284ccb9b95580c378b1de5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:27.649135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:27.777820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86c5087a0284ccb9b95580c378b1de5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:27.819920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86c5087a0284ccb9b95580c378b1de5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:27.842786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86c5087a0284ccb9b95580c378b1de5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:27.855759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86c5087a0284ccb9b95580c378b1de5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:27.856780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86c5087a0284ccb9b95580c378b1de5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:27.868251 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1474/2975] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:27 2022] DELETE /identity/v3/users/c86c5087a0284ccb9b95580c378b1de5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:28.235967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:28.236492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:28.237725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:28.278473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:28.279817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:28.464381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1502/2976] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:28.465098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:28.467257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:28.529282 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:28.680386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417e752-7feb-413f-89a3-8583cb544522 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:28.688436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7721cc1-4e49-469e-9cd8-4a8295a06b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:28.689257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721cc1-4e49-469e-9cd8-4a8295a06b13 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:28.689973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721cc1-4e49-469e-9cd8-4a8295a06b13 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:28.690471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721cc1-4e49-469e-9cd8-4a8295a06b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:28.707182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7721cc1-4e49-469e-9cd8-4a8295a06b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:28.709368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:28.709767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7721cc1-4e49-469e-9cd8-4a8295a06b13 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:28.711415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:28.726970 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1475/2977] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:51:28.907367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9ec62-fead-4bb1-bc7b-84f2e4846366 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:28.929714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:28.931807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:28.932099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:28.942807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] PATH_INFO: `/v3/projects/a03a05a45d874be187848d8bcdc27e70` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:28.944925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03a05a45d874be187848d8bcdc27e70)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:28.946941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:29.089403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03a05a45d874be187848d8bcdc27e70', 'request_id': 'req-333b4fb0-e385-41b0-a6df-203c9b61818d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:29.107044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03a05a45d874be187848d8bcdc27e70', 'request_id': 'req-333b4fb0-e385-41b0-a6df-203c9b61818d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:29.126534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03a05a45d874be187848d8bcdc27e70', 'request_id': 'req-333b4fb0-e385-41b0-a6df-203c9b61818d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:29.172136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] The token cache is being invalidate because project a03a05a45d874be187848d8bcdc27e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:29.172437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:29.173439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-333b4fb0-e385-41b0-a6df-203c9b61818d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:29.181460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1503/2978] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:28 2022] DELETE /identity/v3/projects/a03a05a45d874be187848d8bcdc27e70 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:51:29.188763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:29.189378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:29.189829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:29.230648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:29.233164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:29.400876 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1476/2979] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:29.409070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:29.409624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:29.410709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:29.465298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:29.466719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:29.486288 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1504/2980] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:29.490627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:29.511837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8885a-46a6-4541-8273-8825aff6c7f9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:29.526528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:29.527610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:29.528463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:29.530352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:29.533598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:29.535499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:29.537630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:29.595851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:29.606097 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1477/2981] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:29.617518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108348d1-b628-45c9-a5f5-a744e23ac6dd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:29.632992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:29.636208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:29.636850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:29.637369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:29.638263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:29.641706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:29.699241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1505/2982] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:29 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:51:29.700542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:29.721850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404a12-1f32-44a9-b814-561fb506a050 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:29.996911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:30.001516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.004540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.005157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:30.007977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:30.014161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:30.068581 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1478/2983] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:29 2022] POST /identity/v3/users => generated 296 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:30.071806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:30.082089 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:30.094526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424fc7d-9470-4fd7-8583-caff6e62c8d4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:30.108582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:30.110156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.110582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.111152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:30.112689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:30.116213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:30.147506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1506/2984] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:30.151579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:30.167220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13621e5-e456-4ef5-a792-fa62e3313e4b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:30.186178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dabad-061d-4721-9cf2-5099eddbc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:30.188083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dabad-061d-4721-9cf2-5099eddbc247 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.188507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dabad-061d-4721-9cf2-5099eddbc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.188928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dabad-061d-4721-9cf2-5099eddbc247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:30.190155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dabad-061d-4721-9cf2-5099eddbc247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:30.197763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dabad-061d-4721-9cf2-5099eddbc247 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:30.231418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1479/2985] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:51:30.236108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:30.251198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651b28-f023-4306-a86e-9a3a1f3c7610 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:30.278845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:30.281333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.283296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.283696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] PATH_INFO: `/v3/projects/cd455eee73304abdb7c80a302d8461eb/users/5ec39a3df4664f67bcce46b0083ba63a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:30.341585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd455eee73304abdb7c80a302d8461eb, user_id=5ec39a3df4664f67bcce46b0083ba63a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:30.349910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:30.380197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1507/2986] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:30 2022] PUT /identity/v3/projects/cd455eee73304abdb7c80a302d8461eb/users/5ec39a3df4664f67bcce46b0083ba63a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:30.385547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dab37-2592-45c2-b453-af56c760251b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.386096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dab37-2592-45c2-b453-af56c760251b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.386650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dab37-2592-45c2-b453-af56c760251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:30.423665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-434dab37-2592-45c2-b453-af56c760251b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:30.425692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-434dab37-2592-45c2-b453-af56c760251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:30.442437 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:30.558829 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1480/2987] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:30.571212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:30.573052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:30.809838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda0b9-7512-43bd-afad-04e6c252de69 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:30.816407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:30.817335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.817627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.817913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:30.848087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:30.852931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:30.904036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1508/2988] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:30.924305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444fd3-1f53-4bdb-8455-fcac10532783 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:30.924633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444fd3-1f53-4bdb-8455-fcac10532783 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:30.926706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444fd3-1f53-4bdb-8455-fcac10532783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:31.023953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c9444fd3-1f53-4bdb-8455-fcac10532783 None None] MFA Rules not processed for user `bf59a9e902304a60939b4d5309b90714`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:31.026956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c9444fd3-1f53-4bdb-8455-fcac10532783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:31.192107 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1481/2989] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:32.610638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:32.619038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:32.666331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07763-1c5a-4cff-a3df-d3c16cc44292 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:32.689605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:32.691116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:32.691459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:32.691748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] PATH_INFO: `/v3/users/8c9e190ac4fd457fac81ff0b04bf87c4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:32.697591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9e190ac4fd457fac81ff0b04bf87c4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:32.701680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:32.844400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9e190ac4fd457fac81ff0b04bf87c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:32.846208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9e190ac4fd457fac81ff0b04bf87c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:32.911746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9e190ac4fd457fac81ff0b04bf87c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:32.912993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9e190ac4fd457fac81ff0b04bf87c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:32.925192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9e190ac4fd457fac81ff0b04bf87c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:32.967948 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1509/2990] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:32 2022] DELETE /identity/v3/users/8c9e190ac4fd457fac81ff0b04bf87c4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:32.969138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:32.969626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:32.969738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:33.021167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:33.022428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:33.148173 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1482/2991] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:33.208481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:33.212303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:33.355580 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:33.404443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0f20-c53a-486b-b8e1-b16d07b8f3a9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:33.420859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:33.421791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:33.422435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:33.422729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:33.445973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:33.451760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:33.475305 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1510/2992] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:34.845495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:34.847125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:34.867118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f555b0-5181-4736-8328-8f4e3e2beb15 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:34.895220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:34.896059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:34.896459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:34.896663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] PATH_INFO: `/v3/projects/e4733e3e78a5499dbdecfe80680719f6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:34.903468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4733e3e78a5499dbdecfe80680719f6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:34.905427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:35.111713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4733e3e78a5499dbdecfe80680719f6', 'request_id': 'req-39fb810f-e333-4542-b9a0-45208999403e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.121273 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:35.127940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4733e3e78a5499dbdecfe80680719f6', 'request_id': 'req-39fb810f-e333-4542-b9a0-45208999403e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.145833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4733e3e78a5499dbdecfe80680719f6', 'request_id': 'req-39fb810f-e333-4542-b9a0-45208999403e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.172078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] The token cache is being invalidate because project e4733e3e78a5499dbdecfe80680719f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:35.172955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.175207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.177221 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1483/2993] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:34 2022] DELETE /identity/v3/projects/e4733e3e78a5499dbdecfe80680719f6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:35.181254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:35.192424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318771bf-d9ff-49f4-b8aa-24817ea96d79 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:35.373888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:35.376346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:35.377266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:35.377753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] PATH_INFO: `/v3/users/5dafac00d5374f049f55ace60265dd95` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:35.396592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dafac00d5374f049f55ace60265dd95)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:35.398770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:35.555996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dafac00d5374f049f55ace60265dd95'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.559249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dafac00d5374f049f55ace60265dd95'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.606230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dafac00d5374f049f55ace60265dd95'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.610394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dafac00d5374f049f55ace60265dd95'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.634993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b8f003dd-47dd-4baf-a21e-83579b7583d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dafac00d5374f049f55ace60265dd95'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:35.675419 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1511/2994] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:35 2022] DELETE /identity/v3/users/5dafac00d5374f049f55ace60265dd95 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:36.144082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:36.146243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:36.180573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb810f-e333-4542-b9a0-45208999403e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:36.360588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:36.361492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:36.361780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:36.362058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] PATH_INFO: `/v3/projects/a98fd0e0234146938deb8788aa25e7a5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:36.367885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98fd0e0234146938deb8788aa25e7a5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:36.379278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:36.542303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98fd0e0234146938deb8788aa25e7a5', 'request_id': 'req-8dae9b84-df39-4836-b2ef-d7d1a1429827'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:36.556238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98fd0e0234146938deb8788aa25e7a5', 'request_id': 'req-8dae9b84-df39-4836-b2ef-d7d1a1429827'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:36.576518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98fd0e0234146938deb8788aa25e7a5', 'request_id': 'req-8dae9b84-df39-4836-b2ef-d7d1a1429827'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:36.598375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] The token cache is being invalidate because project a98fd0e0234146938deb8788aa25e7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:36.598914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:36.599743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8dae9b84-df39-4836-b2ef-d7d1a1429827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:36.601715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1484/2995] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:36 2022] DELETE /identity/v3/projects/a98fd0e0234146938deb8788aa25e7a5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:36.607022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:36.607488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:36.607715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:36.649126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:36.650736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:36.817247 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1512/2996] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:36.825446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:36.825839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:36.826202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:36.863508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:36.864826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:36.880329 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1485/2997] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:36.884449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:36.893967 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:36.901863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408562e-76b3-47eb-8bf4-e78630b4a637 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:36.917311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:36.918424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:36.918967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:36.919481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:36.920455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:36.920990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:36.924889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:36.955506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1513/2998] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:36.960263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:36.974675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f6ce7-02b5-4192-9ccf-8e5aee7214a3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:36.987010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:36.987694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:36.988001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:36.988298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:36.989058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:36.991208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:37.054353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1486/2999] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:36 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:37.055553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:37.067776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e734f56-3bbf-4216-a233-0284865910ec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:37.209354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:37.210202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:37.211046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:37.213294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:37.214212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:37.216296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:37.264940 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1514/3000] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:37 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:37.269213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:37.287303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5da5e-a7a2-4492-b457-049ca084c79a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:37.295639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:37.297425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:37.297916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:37.298981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:37.300829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:37.303135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:37.333668 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1487/3001] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:37.337335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:37.356956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ffd3-006b-430b-8976-97145a445d6c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:37.371911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f8c7-4fd3-4ac7-be9d-7cf58638edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:37.372880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f8c7-4fd3-4ac7-be9d-7cf58638edd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:37.373399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f8c7-4fd3-4ac7-be9d-7cf58638edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:37.373896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f8c7-4fd3-4ac7-be9d-7cf58638edd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:37.378660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f8c7-4fd3-4ac7-be9d-7cf58638edd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:37.383039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f8c7-4fd3-4ac7-be9d-7cf58638edd0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:37.402802 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1515/3002] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:37.404478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:37.424780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b585e-788a-41a9-84b1-efffdc244969 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:37.431796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:37.433632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:37.434071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:37.434619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] PATH_INFO: `/v3/projects/ea2f73da903e4f2a9dc90ddf56cdad4b/users/4b500ea57d394cce88119429c528bfc8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:37.462375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2f73da903e4f2a9dc90ddf56cdad4b, user_id=4b500ea57d394cce88119429c528bfc8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:37.466298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:37.497177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1488/3003] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:37 2022] PUT /identity/v3/projects/ea2f73da903e4f2a9dc90ddf56cdad4b/users/4b500ea57d394cce88119429c528bfc8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:51:37.504649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7bb3-eedc-46d0-a82c-41e2846ee084 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:37.505258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7bb3-eedc-46d0-a82c-41e2846ee084 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:37.505834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7bb3-eedc-46d0-a82c-41e2846ee084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:37.558223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d20d7bb3-eedc-46d0-a82c-41e2846ee084 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:37.559605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d20d7bb3-eedc-46d0-a82c-41e2846ee084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:37.692854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1516/3004] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:37.705319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:37.707505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:37.722918 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:37.832467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289f959-54b2-43d0-9385-4a47641982a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:37.843002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01d4ca-96b0-44f6-b20b-9f9da26ed4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:37.844017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d4ca-96b0-44f6-b20b-9f9da26ed4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:37.844557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d4ca-96b0-44f6-b20b-9f9da26ed4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:37.845086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d4ca-96b0-44f6-b20b-9f9da26ed4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:37.863822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01d4ca-96b0-44f6-b20b-9f9da26ed4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:37.866391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01d4ca-96b0-44f6-b20b-9f9da26ed4e0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:37.880787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1489/3005] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:46.467733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.468829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.469373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.534852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] MFA Rules not processed for user `5ec39a3df4664f67bcce46b0083ba63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:46.536611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:46.676926 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:46.696796 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1517/3006] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:46.699185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5269-a718-44a3-b9a6-127fd4ec0039 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:46.700105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5269-a718-44a3-b9a6-127fd4ec0039 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:46.700403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5269-a718-44a3-b9a6-127fd4ec0039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:46.757103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a1ef5269-a718-44a3-b9a6-127fd4ec0039 None None] MFA Rules not processed for user `5ec39a3df4664f67bcce46b0083ba63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:46.758387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a1ef5269-a718-44a3-b9a6-127fd4ec0039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:46.796779 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1490/3007] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:47.290089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:47.292071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:47.507939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45650974-bbd1-42b7-a7c6-012aaa1afbae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:47.521146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:47.521975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:47.523261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:47.523898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:47.552748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:47.556194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:47.586084 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1518/3008] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:51.946274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b22219-382b-4429-97eb-8469429b7ea3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:51.946847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b22219-382b-4429-97eb-8469429b7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:51.946847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b22219-382b-4429-97eb-8469429b7ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:52.013006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e4b22219-382b-4429-97eb-8469429b7ea3 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:52.015633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4b22219-382b-4429-97eb-8469429b7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:52.218645 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1491/3009] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:52.236801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:52.238998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:52.334247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672a32-5300-40e3-8de6-6673290a17f3 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:52.345112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eda0d-00f2-4768-8e06-fb776bfe8755 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:52.346821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eda0d-00f2-4768-8e06-fb776bfe8755 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:52.347402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eda0d-00f2-4768-8e06-fb776bfe8755 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:52.349584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eda0d-00f2-4768-8e06-fb776bfe8755 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:52.362283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eda0d-00f2-4768-8e06-fb776bfe8755 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:52.364930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eda0d-00f2-4768-8e06-fb776bfe8755 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:52.384105 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1519/3010] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:55.505272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:55.505909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:55.506020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:55.563704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:55.563704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:55.565740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2c9c-6b16-4de1-98fd-0495dacb1e9f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:55.566247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2c9c-6b16-4de1-98fd-0495dacb1e9f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:55.566341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2c9c-6b16-4de1-98fd-0495dacb1e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:55.571883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1492/3011] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:55.618255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:55.626298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-adbb2c9c-6b16-4de1-98fd-0495dacb1e9f None None] MFA Rules not processed for user `4b500ea57d394cce88119429c528bfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:55.627586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-adbb2c9c-6b16-4de1-98fd-0495dacb1e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:55.640987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23155aa0-0567-4e66-b8cf-deb4ca4f4cf7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:55.648175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:55.649254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:55.650594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:55.651323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:55.684782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:55.688037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:55.701128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1493/3012] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:55.892950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1520/3013] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:56.991053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:56.993590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:57.034364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa84bc-5271-4318-8583-34f028e1c865 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:57.063656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:57.064330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:57.064618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:57.064893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:57.077706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:57.085803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:57.130921 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1494/3014] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:05.886737 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:07.097439 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=66 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:12.436515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141c49-a07b-4137-ae78-2c39ab0345c5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:12.437644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141c49-a07b-4137-ae78-2c39ab0345c5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:12.438197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141c49-a07b-4137-ae78-2c39ab0345c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:12.459758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4a141c49-a07b-4137-ae78-2c39ab0345c5 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:12.460991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4a141c49-a07b-4137-ae78-2c39ab0345c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:12.471474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1521/3015] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:12.484651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:12.498029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af34a1a-c0d8-4515-bb6c-83326bba42a3 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:12.505501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136341d-fa74-4557-b1de-b6ea53608d2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:12.506664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136341d-fa74-4557-b1de-b6ea53608d2e service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:12.507103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136341d-fa74-4557-b1de-b6ea53608d2e service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:12.507536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136341d-fa74-4557-b1de-b6ea53608d2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:12.522127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136341d-fa74-4557-b1de-b6ea53608d2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:12.524056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136341d-fa74-4557-b1de-b6ea53608d2e service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:12.537157 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1495/3016] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:13.141334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:13.141733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:13.142108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:13.160786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] MFA Rules not processed for user `55e38f4c2a814efab3873507d136dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:13.162032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:13.230956 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1522/3017] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:15.264366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ed72d-a038-448e-8b5d-cae866ac7478 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.264899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ed72d-a038-448e-8b5d-cae866ac7478 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.265036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ed72d-a038-448e-8b5d-cae866ac7478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.283896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2b1ed72d-a038-448e-8b5d-cae866ac7478 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:15.285125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2b1ed72d-a038-448e-8b5d-cae866ac7478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:15.293890 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1496/3018] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:15.309187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:15.325622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97350cee-cf03-4d40-9f93-c04940804c09 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:15.337942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:15.338656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.338957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.339727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.351014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:15.354820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:15.366761 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1523/3019] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:52:15.834267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d683f4-cb2a-42cf-a426-fcd41259dfad None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.834596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d683f4-cb2a-42cf-a426-fcd41259dfad None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.834883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d683f4-cb2a-42cf-a426-fcd41259dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.854360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-02d683f4-cb2a-42cf-a426-fcd41259dfad None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:15.855556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-02d683f4-cb2a-42cf-a426-fcd41259dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:15.864107 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1497/3020] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:15.877426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:15.891212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f307-cc0b-4f75-b953-9113473cc5a1 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:15.896882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:15.897858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:15.898342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:15.898817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:15.908546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:15.910289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:15.919331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1524/3021] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:16.379229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da365fe-5c1a-450d-a2fe-e6a94d210444 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:16.379820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da365fe-5c1a-450d-a2fe-e6a94d210444 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:16.380186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da365fe-5c1a-450d-a2fe-e6a94d210444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:16.401656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8da365fe-5c1a-450d-a2fe-e6a94d210444 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:16.403087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8da365fe-5c1a-450d-a2fe-e6a94d210444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:16.423674 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1498/3022] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:16.434669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:16.449282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a00920-605f-4e4c-b977-ae25dfe1e80a service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:16.474002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053985f0-ba4e-480d-83c4-0cd06bd9b21f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:16.477072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053985f0-ba4e-480d-83c4-0cd06bd9b21f service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:16.477560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053985f0-ba4e-480d-83c4-0cd06bd9b21f service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:16.479232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053985f0-ba4e-480d-83c4-0cd06bd9b21f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:16.500247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053985f0-ba4e-480d-83c4-0cd06bd9b21f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:16.503351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053985f0-ba4e-480d-83c4-0cd06bd9b21f service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:16.536665 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1525/3023] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:17.297057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a3764-fc64-4897-a80b-98bdc13e6b0c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:17.297482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a3764-fc64-4897-a80b-98bdc13e6b0c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:17.298393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a3764-fc64-4897-a80b-98bdc13e6b0c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:17.300510 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1499/3024] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:17.308671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:17.308961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:17.309247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:17.353187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:17.354484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:17.504411 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1526/3025] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:17.538016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a3764-fc64-4897-a80b-98bdc13e6b0c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:17.539917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-204a3764-fc64-4897-a80b-98bdc13e6b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:17.591810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a3764-fc64-4897-a80b-98bdc13e6b0c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:17.610319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa43d64-333d-4bcc-8450-6517ce25b86c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:17.611023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa43d64-333d-4bcc-8450-6517ce25b86c service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:17.611306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa43d64-333d-4bcc-8450-6517ce25b86c service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:17.611585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa43d64-333d-4bcc-8450-6517ce25b86c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:17.633722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa43d64-333d-4bcc-8450-6517ce25b86c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:17.635733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa43d64-333d-4bcc-8450-6517ce25b86c service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:17.668536 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1500/3026] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:20.557513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:20.585405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5cc7-e8a0-41b3-951b-602b446f3e50 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:20.592383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:20.593452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:20.593952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:20.594447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] PATH_INFO: `/v3/users/4b500ea57d394cce88119429c528bfc8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:20.596462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b500ea57d394cce88119429c528bfc8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:20.598696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:20.697914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b500ea57d394cce88119429c528bfc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:20.699578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b500ea57d394cce88119429c528bfc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:20.723362 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:20.752252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:20.753570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:20.754270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:20.770399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b500ea57d394cce88119429c528bfc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:20.772073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b500ea57d394cce88119429c528bfc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:20.777571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:20.780065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:20.796012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1501/3027] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:20.803072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b500ea57d394cce88119429c528bfc8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:20.822625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:20.831906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:20.838363 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1527/3028] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:20 2022] DELETE /identity/v3/users/4b500ea57d394cce88119429c528bfc8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:20.864626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb03e0-3101-4bbd-a5c7-bbeedf259495 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:21.039961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6a0d-9726-4780-90a8-a5c4fde5de1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:21.040697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6a0d-9726-4780-90a8-a5c4fde5de1b service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:21.040990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6a0d-9726-4780-90a8-a5c4fde5de1b service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:21.041272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6a0d-9726-4780-90a8-a5c4fde5de1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:21.188139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c6a0d-9726-4780-90a8-a5c4fde5de1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:21.190157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c6a0d-9726-4780-90a8-a5c4fde5de1b service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:21.200925 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1502/3029] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:21.418228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:21.420632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:21.581439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352810f-9a1f-4000-a389-f80cff958eda admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:21.594684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:21.595575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:21.595869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:21.596152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] PATH_INFO: `/v3/projects/ea2f73da903e4f2a9dc90ddf56cdad4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:21.598985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2f73da903e4f2a9dc90ddf56cdad4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:21.601152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:21.741472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2f73da903e4f2a9dc90ddf56cdad4b', 'request_id': 'req-ecc3b453-b251-4319-acd6-7fc01971e389'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.758869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2f73da903e4f2a9dc90ddf56cdad4b', 'request_id': 'req-ecc3b453-b251-4319-acd6-7fc01971e389'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.766577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2f73da903e4f2a9dc90ddf56cdad4b', 'request_id': 'req-ecc3b453-b251-4319-acd6-7fc01971e389'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.801349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] The token cache is being invalidate because project ea2f73da903e4f2a9dc90ddf56cdad4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:21.801874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.802816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ecc3b453-b251-4319-acd6-7fc01971e389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:21.806352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1528/3030] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:21 2022] DELETE /identity/v3/projects/ea2f73da903e4f2a9dc90ddf56cdad4b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:21.811758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:21.813285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:21.814313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:21.839945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:21.845523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:21.969515 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:22.018970 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1503/3031] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:22.019883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.020356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.020717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.072510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:22.077103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:22.104452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1529/3032] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:22.108790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.123263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225911e-37c3-4086-9f49-7ebccd2761d1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.138341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.138848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.139149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.139429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.140346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:22.141497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.143388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.203855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1504/3033] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:22.208298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.219546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6d48-9e5c-4fba-863b-029bf722cbfe None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.231753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.232615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.233318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.233810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.235603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.237883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.291461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.298031 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1530/3034] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:22 2022] POST /identity/v3/projects => generated 411 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:22.306415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f929c99-81f8-4613-966b-f59255f2a067 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.458644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.460482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.460776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.462290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.463624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.470074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.521820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.528357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1505/3035] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:22 2022] POST /identity/v3/users => generated 306 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:22.535603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717de03-d765-42f2-97ad-2ddc634b36cf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.550378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.552196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.552652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.554070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.555030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.561995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.596046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1531/3036] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:22.598158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.616824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4d490-398e-4538-aa42-35a76365dd1a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.623620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977dc4a-ff9a-4c9c-a58f-30ea14315eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.624821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977dc4a-ff9a-4c9c-a58f-30ea14315eef admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.625300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977dc4a-ff9a-4c9c-a58f-30ea14315eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.625854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977dc4a-ff9a-4c9c-a58f-30ea14315eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.626815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977dc4a-ff9a-4c9c-a58f-30ea14315eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.629516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977dc4a-ff9a-4c9c-a58f-30ea14315eef admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.666849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1506/3037] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:22.671930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:22.687395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a2a3-2ad7-469c-b1e6-ac7358dcee3d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:22.697290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:22.698778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.701841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.702359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] PATH_INFO: `/v3/projects/c68dc16261fc47d5b6237cf3a4f5ef84/users/1708ee3c62304377a553a136d3f93fa1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.741864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68dc16261fc47d5b6237cf3a4f5ef84, user_id=1708ee3c62304377a553a136d3f93fa1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:22.745264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:22.753479 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:22.786430 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1532/3038] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:22 2022] PUT /identity/v3/projects/c68dc16261fc47d5b6237cf3a4f5ef84/users/1708ee3c62304377a553a136d3f93fa1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:22.788259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:22.788568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:22.788857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:22.830913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:22.836340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:22.998109 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1507/3039] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:23.040217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:23.042161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:23.140405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d1fca-a4e7-41ea-959c-ac2bcdd188dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:23.145265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:23.145990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:23.146277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:23.146582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:23.159316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:23.160782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:23.200825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1533/3040] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:26.687233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:26.689368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:26.719314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059730df-4cd1-45d0-a573-a32bf5f93c7c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:26.735042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:26.737815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:26.738401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:26.739419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] PATH_INFO: `/v3/users/5ec39a3df4664f67bcce46b0083ba63a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:26.742840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec39a3df4664f67bcce46b0083ba63a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:26.748620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:26.931180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec39a3df4664f67bcce46b0083ba63a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.935233 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:26.968614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec39a3df4664f67bcce46b0083ba63a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:26.995268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec39a3df4664f67bcce46b0083ba63a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.015056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec39a3df4664f67bcce46b0083ba63a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.016828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdab62cd-6d80-4dc2-991e-45b63ea631dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec39a3df4664f67bcce46b0083ba63a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.031869 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1508/3041] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:26 2022] DELETE /identity/v3/users/5ec39a3df4664f67bcce46b0083ba63a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:27.410736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:27.423733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963d285-e66b-4883-8dcd-b4d70e4cdef4 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:27.611004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:27.612269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:27.612875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:27.613381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] PATH_INFO: `/v3/projects/cd455eee73304abdb7c80a302d8461eb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:27.614940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd455eee73304abdb7c80a302d8461eb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:27.617312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:27.686946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd455eee73304abdb7c80a302d8461eb', 'request_id': 'req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.700661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd455eee73304abdb7c80a302d8461eb', 'request_id': 'req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.709928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd455eee73304abdb7c80a302d8461eb', 'request_id': 'req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.725497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] The token cache is being invalidate because project cd455eee73304abdb7c80a302d8461eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:27.725860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.726684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ba736e4a-5ec0-44b2-8e48-14213dbc8f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:27.728808 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1534/3042] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:27 2022] DELETE /identity/v3/projects/cd455eee73304abdb7c80a302d8461eb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:27.738542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:27.739130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:27.739494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:27.772872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:27.774707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:27.878172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1509/3043] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:27.879443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:27.879736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:27.880018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:27.916554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:27.918106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:27.942381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1535/3044] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:27.943798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:27.968301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15bcec-581d-4de4-a369-d8c03fac462a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:27.999922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.000994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.001578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.002198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.003340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:28.003924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.006206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.073010 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1510/3045] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:28.078389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.095586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c08fb-8468-4d56-a173-d53a10d3d35c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:28.124740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.125503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.133282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.136307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.137150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.139239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.221276 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:28.240204 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1536/3046] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:28 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:28.244125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.262637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64a39-500a-44e4-b417-07e6e0c974c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:28.423328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.424200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.424573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.424968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.426602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.428955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.472542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1511/3047] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:28 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:28.476387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.493697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df19301-5481-4789-ac90-0701339cd0d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:28.508602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.510351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.510855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.511453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.512916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.515301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.532520 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1537/3048] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:28.536796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.561746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e2051-00a9-4ee0-bbb6-dd390c601343 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:28.568383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30307-72db-4854-a319-3a11e8e50ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.569317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30307-72db-4854-a319-3a11e8e50ece admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.569787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30307-72db-4854-a319-3a11e8e50ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.570232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30307-72db-4854-a319-3a11e8e50ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.571341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30307-72db-4854-a319-3a11e8e50ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.574573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30307-72db-4854-a319-3a11e8e50ece admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.592628 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1512/3049] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:28.597710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.611508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befec91a-c452-4d65-bffe-8544e32c60e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:28.617601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:28.622396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.622958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.623400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] PATH_INFO: `/v3/projects/66df1b6b667d481c8df867b34e8a5cfb/users/9eeeb36672a2487db7c86faf03c82d48/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.649984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66df1b6b667d481c8df867b34e8a5cfb, user_id=9eeeb36672a2487db7c86faf03c82d48, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:28.653668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:28.671062 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1538/3050] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:28 2022] PUT /identity/v3/projects/66df1b6b667d481c8df867b34e8a5cfb/users/9eeeb36672a2487db7c86faf03c82d48/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:28.686297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584ea68-2a1e-4aa2-acd3-12557a77b88e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:28.686657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584ea68-2a1e-4aa2-acd3-12557a77b88e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:28.687035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584ea68-2a1e-4aa2-acd3-12557a77b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:28.720458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6584ea68-2a1e-4aa2-acd3-12557a77b88e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:28.721848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6584ea68-2a1e-4aa2-acd3-12557a77b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:28.782907 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:28.853460 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1513/3051] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:28.863509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:28.866274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:28.996833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8b1e-43f8-4af2-a8a1-dd6ffb363a04 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:29.003303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:29.003988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:29.004274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:29.004554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:29.033114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:29.034602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:29.065147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1539/3052] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:29.425971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c303-d7ff-4fd5-af4f-7dc8279c6d77 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:29.426270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c303-d7ff-4fd5-af4f-7dc8279c6d77 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:29.426570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c303-d7ff-4fd5-af4f-7dc8279c6d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:29.491565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f966c303-d7ff-4fd5-af4f-7dc8279c6d77 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:29.497904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f966c303-d7ff-4fd5-af4f-7dc8279c6d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:29.609261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1514/3053] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:29.642129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:29.643655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:29.829934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc20a5-7317-4a0d-9807-6590fd0b5146 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:29.836511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:29.837738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:29.838384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:29.838861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:29.853209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:29.855300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:29.867993 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1540/3054] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:30.877958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b5e5-781a-4f26-a1e0-71b532da8f7f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:30.878576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b5e5-781a-4f26-a1e0-71b532da8f7f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:30.878576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b5e5-781a-4f26-a1e0-71b532da8f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:30.900884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6188b5e5-781a-4f26-a1e0-71b532da8f7f None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:30.908035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6188b5e5-781a-4f26-a1e0-71b532da8f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:30.925298 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1515/3055] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:31.125509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.141016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ed84-4b9a-4d15-84cf-ac603cec3144 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:31.147280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.148671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.149189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.149894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.161408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.164121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.179544 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1541/3056] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:31.534672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.535007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.535325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.591480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:31.599456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:31.646898 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1516/3057] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:31.776213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:31.821573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ac50b-4a9f-4f42-a378-d1e631aa0f11 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:31.870928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6252a-5cf3-4cc6-9dda-5198eefe4f73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:31.872255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6252a-5cf3-4cc6-9dda-5198eefe4f73 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:31.878617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6252a-5cf3-4cc6-9dda-5198eefe4f73 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:31.879272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6252a-5cf3-4cc6-9dda-5198eefe4f73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:31.913572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6252a-5cf3-4cc6-9dda-5198eefe4f73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:31.936086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6252a-5cf3-4cc6-9dda-5198eefe4f73 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:31.962487 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1542/3058] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:32.349607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:32.351134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.398812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d78d-94f1-4ca7-986a-122b55a951c8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:32.419891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:32.421065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.421356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.421633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] PATH_INFO: `/v3/users/dd8d6bbf2e204d42b1881c594210722a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.437251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8d6bbf2e204d42b1881c594210722a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:32.443815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:32.568695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8d6bbf2e204d42b1881c594210722a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.600077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8d6bbf2e204d42b1881c594210722a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.619049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8d6bbf2e204d42b1881c594210722a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.642217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8d6bbf2e204d42b1881c594210722a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.643053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6df44c9-8373-4f51-9187-b09bfb200bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8d6bbf2e204d42b1881c594210722a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:32.647489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540753-1754-4e1a-8a0c-90178b6be56d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.648048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540753-1754-4e1a-8a0c-90178b6be56d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.648048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540753-1754-4e1a-8a0c-90178b6be56d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.650169 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1543/3059] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:52:32.663032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.663635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.663965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.678638 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1517/3060] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:32 2022] DELETE /identity/v3/users/dd8d6bbf2e204d42b1881c594210722a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:32.682838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:32.683150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:32.683792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:32.704085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:32.705318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.732484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:32.733738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.796324 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:32.880316 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:32.932534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1544/3061] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:32.956012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1518/3062] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:32.977999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:32.983418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:32.997610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:33.000033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:33.026630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064de8-14c3-4d37-9e97-809557976e97 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:33.045055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a60dc-0986-477e-9438-d23fb42f2a43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:33.045745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a60dc-0986-477e-9438-d23fb42f2a43 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.046013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a60dc-0986-477e-9438-d23fb42f2a43 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.046288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a60dc-0986-477e-9438-d23fb42f2a43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.080710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a60dc-0986-477e-9438-d23fb42f2a43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:33.086093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a60dc-0986-477e-9438-d23fb42f2a43 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:33.129032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1545/3063] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:33.180750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ad1aa-cd24-4b96-b2f2-8e881c4faca7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:33.193089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd765a6-653d-413f-b1eb-800d2192c231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:33.193593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd765a6-653d-413f-b1eb-800d2192c231 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.193881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd765a6-653d-413f-b1eb-800d2192c231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.194160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd765a6-653d-413f-b1eb-800d2192c231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.233616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd765a6-653d-413f-b1eb-800d2192c231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:33.235274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd765a6-653d-413f-b1eb-800d2192c231 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:33.272100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1519/3064] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:33.384262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb263-e77d-4def-ab62-29ab7e8a3608 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.387645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb263-e77d-4def-ab62-29ab7e8a3608 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.388319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb263-e77d-4def-ab62-29ab7e8a3608 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.390035 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1546/3065] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:52:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:52:33.401415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:33.401976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:33.402092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:33.443367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:33.444747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:33.683355 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1520/3066] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:33.956663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb263-e77d-4def-ab62-29ab7e8a3608 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:34.021533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb263-e77d-4def-ab62-29ab7e8a3608 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:34.039558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d151d9c-39c6-4164-9646-5a78b7e0788f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:34.041112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d151d9c-39c6-4164-9646-5a78b7e0788f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:34.073107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d151d9c-39c6-4164-9646-5a78b7e0788f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:34.082111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d151d9c-39c6-4164-9646-5a78b7e0788f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:34.146238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d151d9c-39c6-4164-9646-5a78b7e0788f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:34.147903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d151d9c-39c6-4164-9646-5a78b7e0788f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:34.195187 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1547/3067] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:35.432433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:35.434703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:35.452361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd620d0a-44f7-4b13-be28-3e2a9d6a5c08 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:35.469966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:35.471132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.471696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.472260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] PATH_INFO: `/v3/projects/83020f2fea8347f19fb8216a7576b7ba` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.474529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83020f2fea8347f19fb8216a7576b7ba)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:35.476557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:35.585422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83020f2fea8347f19fb8216a7576b7ba', 'request_id': 'req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:35.593708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83020f2fea8347f19fb8216a7576b7ba', 'request_id': 'req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:35.614310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83020f2fea8347f19fb8216a7576b7ba', 'request_id': 'req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:35.633889 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:35.690217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] The token cache is being invalidate because project 83020f2fea8347f19fb8216a7576b7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:35.691088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:35.692879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3ec66a8-79c1-40e4-b719-97c0c7147b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:35.696933 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1521/3068] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:35 2022] DELETE /identity/v3/projects/83020f2fea8347f19fb8216a7576b7ba => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:35.702050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.702679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.702679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:35.780655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:35.784288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:35.948603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1548/3069] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:35.960247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:35.960564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:35.961180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.032206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:36.032772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:36.106009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1522/3070] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:36.110181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.129229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2049cc6-d7b5-4892-a143-041c62eeb3a2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.147424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.150451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.151340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.152550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.156490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:36.157470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.161990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.211297 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1549/3071] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:36.215081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.230264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a39a-8e28-49ec-b731-b2f00c52c2e7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.247529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.248243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.248535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.248817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.261543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.268366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.365994 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1523/3072] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:36 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:36.366277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.386324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e7cf-fd9e-426e-a404-6b6bd2c81881 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.574382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.575825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.576135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.576691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.578692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.582816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.648089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.650238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1550/3073] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:36 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:36.673175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73160575-6d76-49fc-8941-cbdbfd6c153b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.687368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.688355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.688815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.689261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.690454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.692553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.712656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.721172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1524/3074] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:36.740190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90551e8a-58fc-4b2c-9760-702b8bc6f68e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.754374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c47300-a902-4115-8bd9-c6fe5f158cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.755175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c47300-a902-4115-8bd9-c6fe5f158cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.755541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c47300-a902-4115-8bd9-c6fe5f158cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.755952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c47300-a902-4115-8bd9-c6fe5f158cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.757318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c47300-a902-4115-8bd9-c6fe5f158cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.759077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c47300-a902-4115-8bd9-c6fe5f158cd3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.773581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1551/3075] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:36.778881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:36.792154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46515f0-8eac-4175-8d66-ffecf9e0409a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:36.799244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:36.800462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.801046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.816551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] PATH_INFO: `/v3/projects/d61957d87a6943eb8dad424fabce425e/users/d8943eb23fc940c4a1da0e26f4e7f267/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.857365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61957d87a6943eb8dad424fabce425e, user_id=d8943eb23fc940c4a1da0e26f4e7f267, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:36.861863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:36.900072 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1525/3076] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:36 2022] PUT /identity/v3/projects/d61957d87a6943eb8dad424fabce425e/users/d8943eb23fc940c4a1da0e26f4e7f267/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:36.968224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:36.969315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:36.969747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:36.980554 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:37.030230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] MFA Rules not processed for user `d8943eb23fc940c4a1da0e26f4e7f267`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:37.032938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:37.158974 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1552/3077] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:37.165796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:37.174987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:37.370469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874d460-bd16-4a17-bc05-53f4b0a026b2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:37.381704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd204-ac9f-405a-bf1c-480d6c84bb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:37.383915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd204-ac9f-405a-bf1c-480d6c84bb34 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:37.384382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd204-ac9f-405a-bf1c-480d6c84bb34 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:37.384997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd204-ac9f-405a-bf1c-480d6c84bb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:37.399504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd204-ac9f-405a-bf1c-480d6c84bb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:37.401800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd204-ac9f-405a-bf1c-480d6c84bb34 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:37.416085 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1526/3078] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:38.437269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:38.614812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15cc45-54e6-4177-943c-30fc3237af18 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:38.620687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:38.622264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:38.622813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:38.623326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] PATH_INFO: `/v3/users/d8943eb23fc940c4a1da0e26f4e7f267` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:38.624820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8943eb23fc940c4a1da0e26f4e7f267)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:38.627048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:38.785093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8943eb23fc940c4a1da0e26f4e7f267'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:38.786818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8943eb23fc940c4a1da0e26f4e7f267'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:38.829843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8943eb23fc940c4a1da0e26f4e7f267'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:38.830638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8943eb23fc940c4a1da0e26f4e7f267'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:38.849673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8943eb23fc940c4a1da0e26f4e7f267'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:38.882733 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1553/3079] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:38 2022] DELETE /identity/v3/users/d8943eb23fc940c4a1da0e26f4e7f267 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:38.887849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c49c4-cc33-4301-8cf9-b77458f793c3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:38.888895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c49c4-cc33-4301-8cf9-b77458f793c3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:38.889395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c49c4-cc33-4301-8cf9-b77458f793c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:38.927418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ba4c49c4-cc33-4301-8cf9-b77458f793c3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:38.932807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba4c49c4-cc33-4301-8cf9-b77458f793c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:39.090755 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1527/3080] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:39.109815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:39.111774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:39.153418 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:39.268731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10598d1a-6713-4c55-95e4-09319a182b7c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:39.278947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b040e-9e6a-4801-a34f-2c46289b2eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:39.280590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b040e-9e6a-4801-a34f-2c46289b2eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:39.281738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b040e-9e6a-4801-a34f-2c46289b2eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:39.282938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b040e-9e6a-4801-a34f-2c46289b2eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:39.313576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b040e-9e6a-4801-a34f-2c46289b2eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:39.315306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b040e-9e6a-4801-a34f-2c46289b2eb0 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:39.345541 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1554/3081] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:39.817125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:39.817422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:39.817713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:39.894672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] MFA Rules not processed for user `1708ee3c62304377a553a136d3f93fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:39.896118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:39.911851 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:40.104212 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1528/3082] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:40.106577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:40.107010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:40.107139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:40.142593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] MFA Rules not processed for user `1708ee3c62304377a553a136d3f93fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:40.144486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:40.161134 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1555/3083] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:40.172226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:40.174224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:40.415416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bb1c-4282-4a57-8db3-cee9ffdf58d3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:40.436213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff543ad1-5418-4f8d-b75f-2647411a94bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:40.439374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff543ad1-5418-4f8d-b75f-2647411a94bf service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:40.439891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff543ad1-5418-4f8d-b75f-2647411a94bf service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:40.442957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff543ad1-5418-4f8d-b75f-2647411a94bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:40.468688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff543ad1-5418-4f8d-b75f-2647411a94bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:40.470566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff543ad1-5418-4f8d-b75f-2647411a94bf service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:40.511011 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1529/3084] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:40.657731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:40.659478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:40.691177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32ecc-5fe4-4826-b3aa-febead225f37 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:40.714194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:40.716028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:40.716511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:40.716982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] PATH_INFO: `/v3/projects/d61957d87a6943eb8dad424fabce425e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:40.719454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61957d87a6943eb8dad424fabce425e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:40.738567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:40.890734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61957d87a6943eb8dad424fabce425e', 'request_id': 'req-63284888-863a-43ac-b327-cef05af82eee'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:40.908745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61957d87a6943eb8dad424fabce425e', 'request_id': 'req-63284888-863a-43ac-b327-cef05af82eee'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:40.919463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61957d87a6943eb8dad424fabce425e', 'request_id': 'req-63284888-863a-43ac-b327-cef05af82eee'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:40.946781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] The token cache is being invalidate because project d61957d87a6943eb8dad424fabce425e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:40.947205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:40.948000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-63284888-863a-43ac-b327-cef05af82eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:40.950003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1556/3085] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:40 2022] DELETE /identity/v3/projects/d61957d87a6943eb8dad424fabce425e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:40.955118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce6bca-b1cc-41b3-8e3e-6d108b94eeab None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:40.956085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce6bca-b1cc-41b3-8e3e-6d108b94eeab None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:40.956633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce6bca-b1cc-41b3-8e3e-6d108b94eeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:41.010033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-92ce6bca-b1cc-41b3-8e3e-6d108b94eeab None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:41.017895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92ce6bca-b1cc-41b3-8e3e-6d108b94eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:41.406167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:41.406813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:41.406813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:41.438234 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1530/3086] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:41.440676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:41.440973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:41.441211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:41.490072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] MFA Rules not processed for user `bf59a9e902304a60939b4d5309b90714`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:41.497382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:41.568514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:41.577826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:41.626614 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1531/3087] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:41.638724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:41.705707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58774b-2582-4dfd-8344-bc722e600b47 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:41.729941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1557/3088] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:41.775590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:41.779359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:41.780904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:41.781295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:41.782074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:41.782394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:41.784807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:41.821593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1532/3089] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:41.828377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:41.845165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c28a2-e8de-4680-8e97-3bc8aefab268 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:41.863295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:41.864097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:41.864447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:41.864789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:41.865561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:41.867770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:41.933145 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1558/3090] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:41 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:41.935011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:41.950839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:41.952451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c5b1-08dc-48ca-9472-c789a8672d72 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:41.954561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:42.000704 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:42.029393 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:42.174213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0656ff-2286-4f9b-98bf-1e1a1d4945e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:42.184464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:42.185424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:42.185905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:42.187336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:42.188290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:42.192082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:42.193277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:42.193277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:42.193277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:42.195287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:42.196112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:42.246292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:42.248754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:42.252605 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1533/3091] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:41 2022] POST /identity/v3/users => generated 291 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:42.253869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:42.279402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd806ac-62f1-493d-bd1a-f871a8540470 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:42.290253 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1559/3092] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:42.297482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:42.298515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:42.299812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:42.300339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:42.302836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:42.304505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:42.351940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1534/3093] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:42.356623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:42.376153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea9c6-bab4-462f-a6e6-a52dfb89d904 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:42.389907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f84a-927f-477a-b91f-430fb1f47132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:42.390836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f84a-927f-477a-b91f-430fb1f47132 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:42.391303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f84a-927f-477a-b91f-430fb1f47132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:42.391759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f84a-927f-477a-b91f-430fb1f47132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:42.392939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f84a-927f-477a-b91f-430fb1f47132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:42.396274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f84a-927f-477a-b91f-430fb1f47132 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:42.428758 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1560/3094] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:42.433098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:42.448795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751d455-5cd6-42b6-aad7-d79db7951c0f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:42.463148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:42.464367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:42.464660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:42.465507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] PATH_INFO: `/v3/projects/5ddafef349aa4d279496d89064c79d5b/users/7c7161c7bbbe4349b7a2a4e3abe6a3a8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:42.507380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddafef349aa4d279496d89064c79d5b, user_id=7c7161c7bbbe4349b7a2a4e3abe6a3a8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:42.515062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:42.550194 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1535/3095] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:42 2022] PUT /identity/v3/projects/5ddafef349aa4d279496d89064c79d5b/users/7c7161c7bbbe4349b7a2a4e3abe6a3a8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:42.558127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:42.558292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:42.558969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:42.628774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] MFA Rules not processed for user `7c7161c7bbbe4349b7a2a4e3abe6a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:42.630071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:42.870919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1561/3096] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:44.319319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:44.322122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:44.882425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1899b-12a6-40c4-b9d1-d11f250dbb81 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:44.913617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d92210-ee68-4902-b443-f4a326522821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:44.922820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92210-ee68-4902-b443-f4a326522821 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:44.924362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92210-ee68-4902-b443-f4a326522821 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:44.924882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92210-ee68-4902-b443-f4a326522821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:44.945188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d92210-ee68-4902-b443-f4a326522821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:44.947775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d92210-ee68-4902-b443-f4a326522821 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:44.968919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1536/3097] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:45.128708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:45.303575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3398a-baa6-45a6-bf64-817152972a75 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:45.309766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:45.310985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:45.311447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:45.311896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] PATH_INFO: `/v3/users/7c7161c7bbbe4349b7a2a4e3abe6a3a8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:45.313376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7161c7bbbe4349b7a2a4e3abe6a3a8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:45.328721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:45.392972 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:45.419497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7161c7bbbe4349b7a2a4e3abe6a3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:45.420419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7161c7bbbe4349b7a2a4e3abe6a3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:45.463946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7161c7bbbe4349b7a2a4e3abe6a3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:45.466324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7161c7bbbe4349b7a2a4e3abe6a3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:45.493505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7161c7bbbe4349b7a2a4e3abe6a3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:45.531329 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1562/3098] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:45 2022] DELETE /identity/v3/users/7c7161c7bbbe4349b7a2a4e3abe6a3a8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:45.535731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:45.536251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:45.536367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:45.581107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:45.582409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:45.778311 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:45.830930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1537/3099] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:45.842117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:45.843669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:46.006322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d258-00b5-4ed3-9278-1448e52fb57a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:46.012693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db66e-79dd-4202-aa70-97b28bbf867c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:46.013645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db66e-79dd-4202-aa70-97b28bbf867c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:46.014116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db66e-79dd-4202-aa70-97b28bbf867c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:46.014661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db66e-79dd-4202-aa70-97b28bbf867c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:46.027469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1db66e-79dd-4202-aa70-97b28bbf867c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:46.029281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1db66e-79dd-4202-aa70-97b28bbf867c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:46.042987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1563/3100] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:46.660342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:46.661892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:46.702197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b78550-42d3-46a9-83da-de1302aad5c2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:46.739365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:46.740518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:46.741042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:46.742888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] PATH_INFO: `/v3/projects/5ddafef349aa4d279496d89064c79d5b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:46.745743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddafef349aa4d279496d89064c79d5b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:46.750011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:46.859447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddafef349aa4d279496d89064c79d5b', 'request_id': 'req-c2cc7750-4db5-4f41-b987-bc7aff0cc837'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:46.877875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddafef349aa4d279496d89064c79d5b', 'request_id': 'req-c2cc7750-4db5-4f41-b987-bc7aff0cc837'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:46.888003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddafef349aa4d279496d89064c79d5b', 'request_id': 'req-c2cc7750-4db5-4f41-b987-bc7aff0cc837'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:46.903865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] The token cache is being invalidate because project 5ddafef349aa4d279496d89064c79d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:46.904348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:46.905233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2cc7750-4db5-4f41-b987-bc7aff0cc837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:46.907523 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1538/3101] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:46 2022] DELETE /identity/v3/projects/5ddafef349aa4d279496d89064c79d5b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:46.913149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189867ff-a420-4576-8d09-e7d8d4fb56c0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:46.913657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189867ff-a420-4576-8d09-e7d8d4fb56c0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:46.913786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189867ff-a420-4576-8d09-e7d8d4fb56c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:46.929468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada314-e8f2-46f6-8aa3-416a294657e5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:46.930113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada314-e8f2-46f6-8aa3-416a294657e5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:46.930593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada314-e8f2-46f6-8aa3-416a294657e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:46.951692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-189867ff-a420-4576-8d09-e7d8d4fb56c0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:46.952955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-189867ff-a420-4576-8d09-e7d8d4fb56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:46.994549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f3ada314-e8f2-46f6-8aa3-416a294657e5 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:46.996124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f3ada314-e8f2-46f6-8aa3-416a294657e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:47.099872 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1564/3102] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:47.107742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.108292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.108754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.158221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:47.159510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:47.170379 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1539/3103] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:47.184771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.185375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.185822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.200591 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1565/3104] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:47.204717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.228673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706ab4e-b30b-40b4-bcb3-a9a89dec9200 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.229059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:47.232831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:47.246251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.247003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.247295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.247576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.248320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:47.251696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.256720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.256910 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1540/3105] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:52:47.266531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.268035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:47.284268 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1566/3106] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:52:47.289347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.303347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6e06c-7dc4-4d11-9138-623e4964da09 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.310189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.311614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.312106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.312564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.313451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.316509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.359029 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1567/3107] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:47 2022] POST /identity/v3/projects => generated 357 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:52:47.364019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.415217 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:47.416869 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:47.460226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af710b-59d1-4185-874e-4faadd91ceca None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.535964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86388-5051-4e30-9bbe-24104d96a914 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.571350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.572059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.572348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.572635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.573615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.586273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.641141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83fa07-95e3-417f-8ab0-b4e17004a66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.641926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83fa07-95e3-417f-8ab0-b4e17004a66e service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.642360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83fa07-95e3-417f-8ab0-b4e17004a66e service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.642798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83fa07-95e3-417f-8ab0-b4e17004a66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.643345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1568/3108] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:47 2022] POST /identity/v3/users => generated 279 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:47.647717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.669409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae3ced-eea9-48f1-a3c7-282a05af1002 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.675235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.677695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.677995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.678283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.679072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.680731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.703727 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1569/3109] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:47.710182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.744423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaab30-55c9-4bc5-b213-7ecf983d588f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.756047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.757070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.757365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.757650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.758402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.760288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.788764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83fa07-95e3-417f-8ab0-b4e17004a66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.790552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83fa07-95e3-417f-8ab0-b4e17004a66e service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.798690 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1570/3110] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:52:47.804108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:47.818209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1541/3111] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:47.835720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724655-1985-4114-9260-e23fb3702cf3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:47.849271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6539c-5b69-44e7-9f2d-f0faeb1965de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:47.850407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6539c-5b69-44e7-9f2d-f0faeb1965de admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.850660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6539c-5b69-44e7-9f2d-f0faeb1965de admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.850764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6539c-5b69-44e7-9f2d-f0faeb1965de admin admin] PATH_INFO: `/v3/projects/b9c0574c94da4c97b25d2046b620abd3/users/64bedd25388e49739ebf1de1f881fcd5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.893831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6539c-5b69-44e7-9f2d-f0faeb1965de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c0574c94da4c97b25d2046b620abd3, user_id=64bedd25388e49739ebf1de1f881fcd5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:47.896673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6539c-5b69-44e7-9f2d-f0faeb1965de admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:47.938606 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1571/3112] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:47 2022] PUT /identity/v3/projects/b9c0574c94da4c97b25d2046b620abd3/users/64bedd25388e49739ebf1de1f881fcd5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:47.945031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:47.945432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:47.945821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:47.999127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] MFA Rules not processed for user `64bedd25388e49739ebf1de1f881fcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:48.000851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:48.189609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1542/3113] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:48.949548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a017fe-df33-4848-85af-a164a931af43 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:48.950511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a017fe-df33-4848-85af-a164a931af43 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:48.950970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a017fe-df33-4848-85af-a164a931af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:48.991925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-22a017fe-df33-4848-85af-a164a931af43 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:48.994638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-22a017fe-df33-4848-85af-a164a931af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:49.108402 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1572/3114] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:49.124231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:49.126285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:49.185680 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:49.312507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823d960-5aa5-46c6-99e7-9a2b649adea7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:49.349383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:49.366919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:49.374032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:49.377353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:49.425644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:49.427868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:49.463472 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1543/3115] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:52:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:52:50.061724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a017fe-df33-4848-85af-a164a931af43 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:50.063957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-22a017fe-df33-4848-85af-a164a931af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:50.214717 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:50.220949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a017fe-df33-4848-85af-a164a931af43 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:50.229015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349f64b-5777-42f0-8079-7da2424324ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:50.229984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349f64b-5777-42f0-8079-7da2424324ce service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:50.230533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349f64b-5777-42f0-8079-7da2424324ce service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:50.231114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349f64b-5777-42f0-8079-7da2424324ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:50.241620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349f64b-5777-42f0-8079-7da2424324ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:50.255616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349f64b-5777-42f0-8079-7da2424324ce service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:50.292771 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1573/3116] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:50.332851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:50.543126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c303f-69e9-4b24-91e2-422fb9ced7b1 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:50.562856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:50.563763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:50.571447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:50.572767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] PATH_INFO: `/v3/users/64bedd25388e49739ebf1de1f881fcd5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:50.579019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bedd25388e49739ebf1de1f881fcd5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:50.585730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:50.754128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bedd25388e49739ebf1de1f881fcd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:50.827607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bedd25388e49739ebf1de1f881fcd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:50.849668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bedd25388e49739ebf1de1f881fcd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:50.876175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bedd25388e49739ebf1de1f881fcd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:50.878589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bedd25388e49739ebf1de1f881fcd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:50.901019 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1544/3117] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:50 2022] DELETE /identity/v3/users/64bedd25388e49739ebf1de1f881fcd5 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:50.906406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:50.906713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:50.906996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:50.948466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:50.951022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:51.156134 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1574/3118] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:51.175544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:51.177102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:51.269270 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:51.327079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6ab33-a8bf-43ca-b9b0-866c234a2c62 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:51.336727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8ec28-2331-48af-b2eb-f01f980317df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:51.337974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ec28-2331-48af-b2eb-f01f980317df service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:51.339421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ec28-2331-48af-b2eb-f01f980317df service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:51.340280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ec28-2331-48af-b2eb-f01f980317df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:51.370169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ec28-2331-48af-b2eb-f01f980317df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:51.372034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ec28-2331-48af-b2eb-f01f980317df service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:51.393980 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1545/3119] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:52.619768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:52.621987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:52.654467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44804e-401e-47d5-b5bd-96685253b22d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:52.692051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:52.693089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:52.694662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:52.695184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] PATH_INFO: `/v3/projects/b9c0574c94da4c97b25d2046b620abd3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:52.697530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c0574c94da4c97b25d2046b620abd3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:52.705278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:52.847713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c0574c94da4c97b25d2046b620abd3', 'request_id': 'req-107c6934-a5b7-4fdc-b8fd-2f999735decd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:52.889237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c0574c94da4c97b25d2046b620abd3', 'request_id': 'req-107c6934-a5b7-4fdc-b8fd-2f999735decd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:52.897893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c0574c94da4c97b25d2046b620abd3', 'request_id': 'req-107c6934-a5b7-4fdc-b8fd-2f999735decd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:52.917696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] The token cache is being invalidate because project b9c0574c94da4c97b25d2046b620abd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:52.918835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:52.919753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107c6934-a5b7-4fdc-b8fd-2f999735decd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:52.922193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1575/3120] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:52 2022] DELETE /identity/v3/projects/b9c0574c94da4c97b25d2046b620abd3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:52.927482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:52.928803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:52.929455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:52.995887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:52.998682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:53.108374 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1546/3121] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:53.116823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.117114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.117399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.140586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:53.141828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:53.171175 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1576/3122] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:53.175647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.186904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8a857-d22f-4107-87ea-7d63fdfbc4ae None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.206651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.207403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.208149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.208149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.208715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:53.209031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:53.210854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:53.247458 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1547/3123] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:53.251906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.264217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935cb7d-ca44-4a1f-83ce-2fbb9d46228b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.278099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.279093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.279820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.280298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.281008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:53.283186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:53.322183 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1577/3124] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:53 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:53.326990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.340184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994e3c-3f04-418c-b6c1-05891d888500 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.411502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.412201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.412490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.412771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.413478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:53.415706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:53.446283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.450787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1548/3125] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:53 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:53.459705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe9941-1c76-4aba-a71f-734f0fb5302f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.467478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.468461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.468966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.469458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.471718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:53.474060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:53.492417 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1578/3126] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:52:53.492598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.513637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c62f-f665-4b1d-aa6d-d6797927852a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.520550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a8144-d5ec-4c60-b833-18b309c50a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.521309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a8144-d5ec-4c60-b833-18b309c50a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.521705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a8144-d5ec-4c60-b833-18b309c50a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.522087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a8144-d5ec-4c60-b833-18b309c50a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.523742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a8144-d5ec-4c60-b833-18b309c50a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:53.525618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a8144-d5ec-4c60-b833-18b309c50a4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:53.543809 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1549/3127] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:52:53.546810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.560368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59c351-3756-4b2c-9d14-9ab7e7f9819c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.567417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.568176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.568604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.569022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] PATH_INFO: `/v3/projects/d459d15165854acf89c7c4ce3bd24de7/users/77beaaf4fc4349f4ab29452be3d307a6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.588949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d459d15165854acf89c7c4ce3bd24de7, user_id=77beaaf4fc4349f4ab29452be3d307a6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:53.592101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:53.618765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.619163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.619542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:53.622013 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1579/3128] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:52:53 2022] PUT /identity/v3/projects/d459d15165854acf89c7c4ce3bd24de7/users/77beaaf4fc4349f4ab29452be3d307a6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:53.643410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:53.645045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:53.688398 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:53.715074 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1550/3129] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:53.788415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:53.790463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:53.844523 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:53.940319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009b88-62dd-4a9c-b874-73707e0fb215 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:53.987989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7ca7b-c511-42c4-a0ad-6d3048d60bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:53.989571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7ca7b-c511-42c4-a0ad-6d3048d60bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:53.990097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7ca7b-c511-42c4-a0ad-6d3048d60bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:53.991208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7ca7b-c511-42c4-a0ad-6d3048d60bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:54.019523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7ca7b-c511-42c4-a0ad-6d3048d60bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:54.023792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7ca7b-c511-42c4-a0ad-6d3048d60bd1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:54.045495 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1580/3130] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:57.407560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:57.409353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:57.431582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fea77-9c78-4340-96f0-4727ef406062 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:57.453399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:57.454936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:57.455420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:57.455892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] PATH_INFO: `/v3/users/c9f8ffcf8701456eaf14be281ea02b78` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:57.458392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f8ffcf8701456eaf14be281ea02b78)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:57.461105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:57.566682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f8ffcf8701456eaf14be281ea02b78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:57.594681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f8ffcf8701456eaf14be281ea02b78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:57.603801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f8ffcf8701456eaf14be281ea02b78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:57.613628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f8ffcf8701456eaf14be281ea02b78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:57.614818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f8ffcf8701456eaf14be281ea02b78'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:57.623261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1551/3131] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:52:57 2022] DELETE /identity/v3/users/c9f8ffcf8701456eaf14be281ea02b78 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:57.628624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:57.629496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:57.629929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:57.664699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:57.667124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:57.762035 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1581/3132] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:57.782110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:57.784070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:57.878891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df85f-d516-4af2-8ed5-1fd73d906fb0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:57.889493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f301bf-b323-48a9-b9d0-9dead75232d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:57.890192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f301bf-b323-48a9-b9d0-9dead75232d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:57.890482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f301bf-b323-48a9-b9d0-9dead75232d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:57.890868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f301bf-b323-48a9-b9d0-9dead75232d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:57.903838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f301bf-b323-48a9-b9d0-9dead75232d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:57.906156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f301bf-b323-48a9-b9d0-9dead75232d2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:57.920858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1552/3133] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:59.242589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:59.244677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:59.257873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ec6a-6d66-4927-94a4-681df97dd753 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:59.278383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:59.279531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:59.280729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:59.282368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] PATH_INFO: `/v3/projects/b794e83822054db4b5594576c0a40284` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:59.284927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b794e83822054db4b5594576c0a40284)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:59.289094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:59.395915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b794e83822054db4b5594576c0a40284', 'request_id': 'req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:59.424130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b794e83822054db4b5594576c0a40284', 'request_id': 'req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:59.443748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b794e83822054db4b5594576c0a40284', 'request_id': 'req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:59.470281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] The token cache is being invalidate because project b794e83822054db4b5594576c0a40284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:52:59.471052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:59.472166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f19a785-3e6e-4ad0-b751-0f3aa9162ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:52:59.474860 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1582/3134] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:52:59 2022] DELETE /identity/v3/projects/b794e83822054db4b5594576c0a40284 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:59.479832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:59.480370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:59.480478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:59.516141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:59.518308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:59.618924 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:59.643292 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1553/3135] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:59.651178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:59.652552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:59.653186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:59.686547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:52:59.687606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:59.700585 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1583/3136] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:52:59.704643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:59.720053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a98212-26ef-4661-86c9-a40bffbe1d1d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:59.732642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:59.734552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:59.734927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:59.735686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:59.738894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:52:59.739431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:59.746427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:59.772609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1554/3137] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:52:59.778556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:59.791218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43080f-dd67-46ff-b538-a798d25a90b9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:59.810210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:59.811078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:59.811436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:59.811801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:59.812580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:59.814744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:59.854461 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1584/3138] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:52:59 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:52:59.857030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:59.877190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dd82-094a-4ede-8f5f-0b83c6517998 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:59.963500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:59.964603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:59.965056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:59.966122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:59.967276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:59.970659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:00.004417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1555/3139] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:52:59 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:00.008901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:00.037306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13eef4-a8a5-4c37-92fb-20b804961c0f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:00.068135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:00.069501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:00.069817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:00.070106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:00.072919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:00.075562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:00.079407 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:00.099482 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1585/3140] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:00.105825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:00.118474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c81d36-dafc-4713-886c-360ad9be4926 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:00.130951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488beff7-bcb5-40c9-84b8-60b39bfbfaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:00.131734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488beff7-bcb5-40c9-84b8-60b39bfbfaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:00.132795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488beff7-bcb5-40c9-84b8-60b39bfbfaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:00.133170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488beff7-bcb5-40c9-84b8-60b39bfbfaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:00.134607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488beff7-bcb5-40c9-84b8-60b39bfbfaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:00.137122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488beff7-bcb5-40c9-84b8-60b39bfbfaa4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:00.156406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1556/3141] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:00.160230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:00.184761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50625e-4dfb-4ec5-bb6f-f2298950aea1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:00.192019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:00.193609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:00.194178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:00.194689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] PATH_INFO: `/v3/projects/49da1d74845940d094de4d568e4970bc/users/9c106ee9c2334f199e8ce5b1d7b9f7ad/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:00.222798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=49da1d74845940d094de4d568e4970bc, user_id=9c106ee9c2334f199e8ce5b1d7b9f7ad, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:00.225243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:00.250710 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1586/3142] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:00 2022] PUT /identity/v3/projects/49da1d74845940d094de4d568e4970bc/users/9c106ee9c2334f199e8ce5b1d7b9f7ad/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:53:00.263314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:00.263690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:00.264236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:00.331064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] MFA Rules not processed for user `9c106ee9c2334f199e8ce5b1d7b9f7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:00.332660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:00.487146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1557/3143] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:53:00.798302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:00.800864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:01.000286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0230f-8f97-4206-b6fc-9007c81308ec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:01.019320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced60dc-ab9b-4ff7-a7df-5a120edc307f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:01.020353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced60dc-ab9b-4ff7-a7df-5a120edc307f service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:01.022191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced60dc-ab9b-4ff7-a7df-5a120edc307f service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:01.022480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced60dc-ab9b-4ff7-a7df-5a120edc307f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:01.037022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced60dc-ab9b-4ff7-a7df-5a120edc307f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:01.038743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced60dc-ab9b-4ff7-a7df-5a120edc307f service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:01.070196 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1587/3144] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:01.623432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:01.709524 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:01.732878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da575c-9ab0-4760-9ccc-872a3ea5beb8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:01.756580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:01.757701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:01.757993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:01.758261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] PATH_INFO: `/v3/users/9c106ee9c2334f199e8ce5b1d7b9f7ad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:01.759537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c106ee9c2334f199e8ce5b1d7b9f7ad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:01.762556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:01.848924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c106ee9c2334f199e8ce5b1d7b9f7ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:01.873398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c106ee9c2334f199e8ce5b1d7b9f7ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:01.881869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c106ee9c2334f199e8ce5b1d7b9f7ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:01.893523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c106ee9c2334f199e8ce5b1d7b9f7ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:01.894409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c106ee9c2334f199e8ce5b1d7b9f7ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:01.929758 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1558/3145] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:01 2022] DELETE /identity/v3/users/9c106ee9c2334f199e8ce5b1d7b9f7ad => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:01.935933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:01.936962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:01.937455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:01.979821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:01.986115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:02.151820 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1588/3146] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:02.226830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:02.228882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:02.319897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bca38b-b2ff-4d1d-8d63-b870f5e8c0e7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:02.329057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c753166-9cce-43df-915e-bbded93e50f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:02.329882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c753166-9cce-43df-915e-bbded93e50f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:02.330008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c753166-9cce-43df-915e-bbded93e50f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:02.330303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c753166-9cce-43df-915e-bbded93e50f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:02.343791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c753166-9cce-43df-915e-bbded93e50f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:02.345237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c753166-9cce-43df-915e-bbded93e50f2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:02.365184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1559/3147] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:03.365743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:03.367214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:03.385324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa1a3d-3473-4f7d-875d-77ff324ec4fb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:03.393591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:03.394849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:03.395497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:03.397260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] PATH_INFO: `/v3/projects/49da1d74845940d094de4d568e4970bc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:03.399077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49da1d74845940d094de4d568e4970bc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:03.403558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:03.486681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49da1d74845940d094de4d568e4970bc', 'request_id': 'req-352e20d9-4257-46e2-871d-64fb82d3f919'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:03.493242 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:03.504940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49da1d74845940d094de4d568e4970bc', 'request_id': 'req-352e20d9-4257-46e2-871d-64fb82d3f919'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:03.512934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49da1d74845940d094de4d568e4970bc', 'request_id': 'req-352e20d9-4257-46e2-871d-64fb82d3f919'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:03.529202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] The token cache is being invalidate because project 49da1d74845940d094de4d568e4970bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:03.529892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:03.531600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-352e20d9-4257-46e2-871d-64fb82d3f919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:03.534651 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1589/3148] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:03 2022] DELETE /identity/v3/projects/49da1d74845940d094de4d568e4970bc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:03.540722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:03.541572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:03.541873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:03.571185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:03.572422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:03.688455 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1560/3149] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:03.696224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:03.696768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:03.697407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:03.732250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:03.734710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:03.746387 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1590/3150] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:53:03.750467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:03.765920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8654143-e37d-47ee-9386-b7600f453763 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:03.772130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:03.772913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:03.773340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:03.773632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:03.774739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:03.776298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:03.777507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:03.822535 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1561/3151] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:53:03.827922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:03.863096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cddd95-f148-432a-9fa3-fa253c76051b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:03.871497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:03.873370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:03.873866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:03.874421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:03.876366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:03.880211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:03.929042 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1591/3152] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:03 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:03.931174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:03.938102 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:03.945417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63f57-9a10-47da-8c74-673662665e12 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.029280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.030138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.030632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.031016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.031809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.033893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.057387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:04.059252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:04.087593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1562/3153] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:03 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:04.088793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:04.112340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fb86d-953c-4090-8a69-0dc8d915ba77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.124703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.127019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.129931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.130343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.131557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.134979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.163997 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1563/3154] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:04.165086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:04.188455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b128-7214-476c-804a-3ebe56d82702 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.204667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.206108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.206961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.209955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.234879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.237471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.270980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9106-1278-4855-8da0-078b9949df1c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.273233 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1564/3155] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:04.278336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:04.283814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:04.289311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.290736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.293326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.293812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.303686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:04.313051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0d8f-bdeb-4f26-9967-05b53fbce141 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.330256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.333131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.334029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.334315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.334603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.334748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] PATH_INFO: `/v3/users/b53f091f93b74298890f2a18a006d7b2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.342526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53f091f93b74298890f2a18a006d7b2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.344468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.401187 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1592/3156] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:53:04.405437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:04.444330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da203b5e-feae-43cb-b988-8cb5cdd72fe8 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.446728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53f091f93b74298890f2a18a006d7b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:04.479378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724779e-720e-498b-8960-b0b6fb00a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.479378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724779e-720e-498b-8960-b0b6fb00a538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.479378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724779e-720e-498b-8960-b0b6fb00a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.479378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724779e-720e-498b-8960-b0b6fb00a538 admin admin] PATH_INFO: `/v3/projects/a1488f69a86d439cbd588b114edb64a3/users/a90c48bbb93649cfa201f70f1a4499a0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.496249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53f091f93b74298890f2a18a006d7b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:04.503701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724779e-720e-498b-8960-b0b6fb00a538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1488f69a86d439cbd588b114edb64a3, user_id=a90c48bbb93649cfa201f70f1a4499a0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.508130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724779e-720e-498b-8960-b0b6fb00a538 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.508440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53f091f93b74298890f2a18a006d7b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:04.526545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53f091f93b74298890f2a18a006d7b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:04.528072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53f091f93b74298890f2a18a006d7b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:04.532701 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1593/3157] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:04 2022] PUT /identity/v3/projects/a1488f69a86d439cbd588b114edb64a3/users/a90c48bbb93649cfa201f70f1a4499a0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:04.540319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.540680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.541192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.541497 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1565/3158] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:04 2022] DELETE /identity/v3/users/b53f091f93b74298890f2a18a006d7b2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:04.567479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:04.570210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:04.654892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1594/3159] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:04.676498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:04.678061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:04.784533 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:04.805587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ff4c-e622-40a0-9223-be404bd0bc9d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:04.810918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f986-b180-427d-a3d0-be390d3206fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:04.811749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f986-b180-427d-a3d0-be390d3206fa service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:04.812049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f986-b180-427d-a3d0-be390d3206fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:04.812406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f986-b180-427d-a3d0-be390d3206fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:04.843924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7f986-b180-427d-a3d0-be390d3206fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:04.847429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7f986-b180-427d-a3d0-be390d3206fa service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:04.872482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1566/3160] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:05.015693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:05.019473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:05.034147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0c86-ce5c-4409-8ff3-b006e58dc2d7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:05.041993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:05.043887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:05.044537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:05.045057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] PATH_INFO: `/v3/projects/3ee1c1d62a8946a18faa6e146a6d23b3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:05.053164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee1c1d62a8946a18faa6e146a6d23b3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:05.063240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:05.092089 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:05.177182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee1c1d62a8946a18faa6e146a6d23b3', 'request_id': 'req-d272de7d-f345-4dab-9d07-d505297b417c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:05.205161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee1c1d62a8946a18faa6e146a6d23b3', 'request_id': 'req-d272de7d-f345-4dab-9d07-d505297b417c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:05.218980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee1c1d62a8946a18faa6e146a6d23b3', 'request_id': 'req-d272de7d-f345-4dab-9d07-d505297b417c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:05.262488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] The token cache is being invalidate because project 3ee1c1d62a8946a18faa6e146a6d23b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:05.263121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:05.264242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d272de7d-f345-4dab-9d07-d505297b417c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:05.269739 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1595/3161] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:05 2022] DELETE /identity/v3/projects/3ee1c1d62a8946a18faa6e146a6d23b3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:05.277469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:05.278248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:05.278812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:05.353749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:05.355664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:05.544611 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1567/3162] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:05.552504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:05.552978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:05.553475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:05.595639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:05.602901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:05.642107 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1596/3163] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:05.643826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:05.667091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837d444-ada2-45f1-a2e3-e17724f43485 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:05.686770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:05.689527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:05.690847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:05.691333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:05.694516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:05.696095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:05.701838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:05.728912 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1568/3164] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:53:05.733357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:05.800542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9866-687e-4936-b790-f88d79bea0f7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:05.811238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:05.811956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:05.812239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:05.812514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:05.816575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:05.820072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:05.885864 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1597/3165] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:05 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:05.889155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:05.904481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3077e7-35ba-488e-8344-c9b97b34f3fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:06.096105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:06.098722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.099992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.101212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:06.102145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:06.112120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:06.174320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1569/3166] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:05 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:53:06.178340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:06.197078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d024539-a9c1-4714-a1ed-9d17247d8658 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:06.203087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:06.203846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.204242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.204556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:06.205372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:06.207204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:06.223977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1598/3167] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:06.228000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:06.253386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dea5-dbcf-423e-ac75-eb66342382c6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:06.281135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcbad-3239-4a85-83e8-b6f0e536aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:06.282106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcbad-3239-4a85-83e8-b6f0e536aae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.282397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcbad-3239-4a85-83e8-b6f0e536aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.283088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcbad-3239-4a85-83e8-b6f0e536aae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:06.283874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefcbad-3239-4a85-83e8-b6f0e536aae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:06.285638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefcbad-3239-4a85-83e8-b6f0e536aae0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:06.299832 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1570/3168] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:06.304064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:06.318752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3daeb8-5479-4226-b713-bcd061ba957e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:06.324458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:06.325756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.326154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.327486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] PATH_INFO: `/v3/projects/9edafb7132564b15a2a49eabf7a42019/users/8b25774c24e3411b91794b8fb73c9da8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:06.355615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edafb7132564b15a2a49eabf7a42019, user_id=8b25774c24e3411b91794b8fb73c9da8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:06.362788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:06.388238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1599/3169] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:06 2022] PUT /identity/v3/projects/9edafb7132564b15a2a49eabf7a42019/users/8b25774c24e3411b91794b8fb73c9da8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:06.393313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797225-ef5c-46ee-b274-dc8f6762fce6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.393779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797225-ef5c-46ee-b274-dc8f6762fce6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.394626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797225-ef5c-46ee-b274-dc8f6762fce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:06.426099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-82797225-ef5c-46ee-b274-dc8f6762fce6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:06.428045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-82797225-ef5c-46ee-b274-dc8f6762fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:06.507126 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:06.540091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1571/3170] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:06.552249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:06.555399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:06.638291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06747597-ab69-4e9e-b3dd-07d7b4683caf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:06.660568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8815c-f452-4802-9caa-c20d2bb2a305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:06.661611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8815c-f452-4802-9caa-c20d2bb2a305 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:06.661893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8815c-f452-4802-9caa-c20d2bb2a305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:06.662181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8815c-f452-4802-9caa-c20d2bb2a305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:06.688077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8815c-f452-4802-9caa-c20d2bb2a305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:06.689552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8815c-f452-4802-9caa-c20d2bb2a305 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:06.701740 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1600/3171] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:07.263137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:07.263666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:07.263901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:07.330628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] MFA Rules not processed for user `77beaaf4fc4349f4ab29452be3d307a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:07.332152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:07.492324 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1572/3172] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:07.503934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c96d5e-862c-431a-8eb4-a1345c4e2115 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:07.504350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c96d5e-862c-431a-8eb4-a1345c4e2115 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:07.505101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c96d5e-862c-431a-8eb4-a1345c4e2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:07.548644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-86c96d5e-862c-431a-8eb4-a1345c4e2115 None None] MFA Rules not processed for user `77beaaf4fc4349f4ab29452be3d307a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:07.553808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-86c96d5e-862c-431a-8eb4-a1345c4e2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:07.572409 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1601/3173] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:07.589584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:07.591662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:07.748654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db23986-e6cd-4b72-8d2b-c3e08ce45245 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:07.761706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60cbc9-2fb0-4634-8db8-0ef80b2dff4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:07.762721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60cbc9-2fb0-4634-8db8-0ef80b2dff4e service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:07.763251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60cbc9-2fb0-4634-8db8-0ef80b2dff4e service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:07.763713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60cbc9-2fb0-4634-8db8-0ef80b2dff4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:07.778928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60cbc9-2fb0-4634-8db8-0ef80b2dff4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:07.780850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60cbc9-2fb0-4634-8db8-0ef80b2dff4e service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:07.797796 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1573/3174] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:12.618062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c411e5-03e8-478a-9c9f-8b7c1e693585 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:12.618617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c411e5-03e8-478a-9c9f-8b7c1e693585 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:12.618882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c411e5-03e8-478a-9c9f-8b7c1e693585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:12.664134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d9c411e5-03e8-478a-9c9f-8b7c1e693585 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:12.672914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d9c411e5-03e8-478a-9c9f-8b7c1e693585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:12.777449 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:12.855443 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1602/3175] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:17.790316 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=70 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:22.728502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:22.729172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:22.729172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:22.795046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] MFA Rules not processed for user `a90c48bbb93649cfa201f70f1a4499a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:22.796652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:22.826219 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:22.952854 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1574/3176] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:23.800273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:23.800715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:23.801094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:23.885772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] MFA Rules not processed for user `8b25774c24e3411b91794b8fb73c9da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:23.892269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:24.091008 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1603/3177] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:24.110823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:24.112846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:24.119377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:24.182163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911221f-c797-47ae-9ece-6ecde2c06f87 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:24.190840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec4d48-6569-45e8-b6f6-37d1f7d61264 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:24.199456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27dd58-dc4b-45c6-bcc1-c4b707b203fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:24.201954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27dd58-dc4b-45c6-bcc1-c4b707b203fc service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:24.202269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27dd58-dc4b-45c6-bcc1-c4b707b203fc service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:24.202562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27dd58-dc4b-45c6-bcc1-c4b707b203fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:24.207842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346e659-09d4-45a7-9309-95e232a7e946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:24.208552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e659-09d4-45a7-9309-95e232a7e946 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:24.208843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e659-09d4-45a7-9309-95e232a7e946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:24.209124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e659-09d4-45a7-9309-95e232a7e946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:24.230630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27dd58-dc4b-45c6-bcc1-c4b707b203fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:24.232848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27dd58-dc4b-45c6-bcc1-c4b707b203fc service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:24.239091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346e659-09d4-45a7-9309-95e232a7e946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:24.244763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346e659-09d4-45a7-9309-95e232a7e946 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:24.259935 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1604/3178] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:53:24.300409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1575/3179] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:26.296490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480287-1ae8-4769-89f0-2bf634067fa2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:26.297045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480287-1ae8-4769-89f0-2bf634067fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:26.297179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480287-1ae8-4769-89f0-2bf634067fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:26.340810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1f480287-1ae8-4769-89f0-2bf634067fa2 None None] MFA Rules not processed for user `a90c48bbb93649cfa201f70f1a4499a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:26.344383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1f480287-1ae8-4769-89f0-2bf634067fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:26.369528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1605/3180] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:28.532639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:28.533101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:28.533299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:28.573853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] MFA Rules not processed for user `8b25774c24e3411b91794b8fb73c9da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:28.575089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:28.594971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1576/3181] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:29.358879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc633d-fd88-49a2-b7f8-27c026170544 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:29.360066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc633d-fd88-49a2-b7f8-27c026170544 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:29.360623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc633d-fd88-49a2-b7f8-27c026170544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:29.436125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9dbc633d-fd88-49a2-b7f8-27c026170544 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:29.437842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9dbc633d-fd88-49a2-b7f8-27c026170544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:29.646481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1606/3182] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:29.688970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:29.690609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:29.812026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd983-0919-4622-b852-d52cb2310ddb None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:29.828117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:29.828791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:29.829086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:29.829357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:29.848522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:29.850148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:29.864246 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1577/3183] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:53:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:53:39.458834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451dae-ae29-4ff4-ab90-91f529617206 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:39.459397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451dae-ae29-4ff4-ab90-91f529617206 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:39.459397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451dae-ae29-4ff4-ab90-91f529617206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:39.508988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-42451dae-ae29-4ff4-ab90-91f529617206 None None] MFA Rules not processed for user `55e38f4c2a814efab3873507d136dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:39.512235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-42451dae-ae29-4ff4-ab90-91f529617206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:39.539364 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:39.592132 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1607/3184] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:39.860421 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:44.855515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:44.858032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:45.102227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f0aeb-de09-4916-9e7b-6efd137ad576 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:45.121242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:45.122577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:45.123044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:45.123487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:45.128071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:45.164277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:45.166694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16659b8-e38a-493b-935b-c362367cc570 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:45.187332 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1578/3185] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:47.947380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570c96a-d780-4942-9350-26416def8c4f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:47.947983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570c96a-d780-4942-9350-26416def8c4f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:47.947983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570c96a-d780-4942-9350-26416def8c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:47.978311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8570c96a-d780-4942-9350-26416def8c4f None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:47.980668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8570c96a-d780-4942-9350-26416def8c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:48.000108 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1608/3186] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:52.991338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:52.992359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:52.992884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:53.048258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:53.049825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:53.057991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1579/3187] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:57.422665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570c96a-d780-4942-9350-26416def8c4f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:57.451786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570c96a-d780-4942-9350-26416def8c4f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:57.457446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:57.458112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:57.458403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:57.458733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:57.460578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:57.473996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:57.475866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e6c47-00a7-42d0-b71b-21c136c1b2ca service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:57.493211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1609/3188] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:57.540170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:57.543124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:57.601511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9023d3-c4ea-4edb-97a6-e79daa3e7d2a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:57.606931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:57.607882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:57.608338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:57.608686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] PATH_INFO: `/v3/users/1708ee3c62304377a553a136d3f93fa1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:57.610074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1708ee3c62304377a553a136d3f93fa1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:57.612510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:57.716337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1708ee3c62304377a553a136d3f93fa1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.751048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1708ee3c62304377a553a136d3f93fa1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.776074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1708ee3c62304377a553a136d3f93fa1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.793646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1708ee3c62304377a553a136d3f93fa1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.793646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1708ee3c62304377a553a136d3f93fa1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:57.797469 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1580/3189] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:57 2022] DELETE /identity/v3/users/1708ee3c62304377a553a136d3f93fa1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:57.967389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:57.967688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:57.967972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:57.992805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:57.994966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:58.038424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:58.041371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:58.065341 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:58.103994 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1610/3190] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:58.184731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42770567-5e49-4358-a0ca-77b2c37a1042 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:58.191820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:58.192800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:58.193092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:58.193371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] PATH_INFO: `/v3/users/77beaaf4fc4349f4ab29452be3d307a6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:58.210118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77beaaf4fc4349f4ab29452be3d307a6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:58.214445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:58.293183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77beaaf4fc4349f4ab29452be3d307a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.325702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77beaaf4fc4349f4ab29452be3d307a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.341514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77beaaf4fc4349f4ab29452be3d307a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.363379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:58.365021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:58.374938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77beaaf4fc4349f4ab29452be3d307a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.377888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-048bb17b-5093-4a0a-9af0-ec4dae0c1882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77beaaf4fc4349f4ab29452be3d307a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.412607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145633dc-1a71-4608-a50b-be871ff7b2f6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:58.416288 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1581/3191] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:53:58 2022] DELETE /identity/v3/users/77beaaf4fc4349f4ab29452be3d307a6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:53:58.541722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:58.543586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:58.544153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:58.544717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] PATH_INFO: `/v3/projects/c68dc16261fc47d5b6237cf3a4f5ef84` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:58.546099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68dc16261fc47d5b6237cf3a4f5ef84)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:58.548188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:58.615076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68dc16261fc47d5b6237cf3a4f5ef84', 'request_id': 'req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.624526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68dc16261fc47d5b6237cf3a4f5ef84', 'request_id': 'req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.627732 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:58.635384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68dc16261fc47d5b6237cf3a4f5ef84', 'request_id': 'req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.657247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] The token cache is being invalidate because project c68dc16261fc47d5b6237cf3a4f5ef84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:58.657910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.658803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:58.661688 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1611/3192] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:58 2022] DELETE /identity/v3/projects/c68dc16261fc47d5b6237cf3a4f5ef84 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:53:58.667190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bcfa-bd63-4f8a-af86-0efbbedc5355 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:58.668148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bcfa-bd63-4f8a-af86-0efbbedc5355 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:58.668798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bcfa-bd63-4f8a-af86-0efbbedc5355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:58.754958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0115bcfa-bd63-4f8a-af86-0efbbedc5355 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:58.756479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0115bcfa-bd63-4f8a-af86-0efbbedc5355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:58.814580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:58.816910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:58.929516 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:58.976355 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1582/3193] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:58.976577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd926ffc-2872-4dfd-b5a3-0cbdc16de932 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:58.977088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:58.977717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:58.978004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:58.978345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] PATH_INFO: `/v3/projects/d459d15165854acf89c7c4ce3bd24de7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:58.980246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d459d15165854acf89c7c4ce3bd24de7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:58.980375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76306-032c-47e8-aef8-32f070498525 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:58.980717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76306-032c-47e8-aef8-32f070498525 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:58.982348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:58.982593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76306-032c-47e8-aef8-32f070498525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.011770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-40a76306-032c-47e8-aef8-32f070498525 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.012932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40a76306-032c-47e8-aef8-32f070498525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.022399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1583/3194] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:59.027151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a76306-032c-47e8-aef8-32f070498525 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.038197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a76306-032c-47e8-aef8-32f070498525 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.079652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd459d15165854acf89c7c4ce3bd24de7', 'request_id': 'req-5d929bc3-3bf3-4c71-839e-dcad19abc08d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.095659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd459d15165854acf89c7c4ce3bd24de7', 'request_id': 'req-5d929bc3-3bf3-4c71-839e-dcad19abc08d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.103439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd459d15165854acf89c7c4ce3bd24de7', 'request_id': 'req-5d929bc3-3bf3-4c71-839e-dcad19abc08d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.139860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.141266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.141564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.141846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.142166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] The token cache is being invalidate because project d459d15165854acf89c7c4ce3bd24de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:53:59.142464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.142661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:59.142914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.143196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d929bc3-3bf3-4c71-839e-dcad19abc08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:53:59.144774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1612/3195] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:53:58 2022] DELETE /identity/v3/projects/d459d15165854acf89c7c4ce3bd24de7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:53:59.147148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc698fa-3843-4152-b0c1-6ea978d97425 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.148000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc698fa-3843-4152-b0c1-6ea978d97425 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.148453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f675f-0a6d-494e-9f86-54dd1bffb2eb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.148606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc698fa-3843-4152-b0c1-6ea978d97425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.169248 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1584/3196] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:53:59.170924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.171293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.171648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.173236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fdc698fa-3843-4152-b0c1-6ea978d97425 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.174882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fdc698fa-3843-4152-b0c1-6ea978d97425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.201359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.203230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.212317 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1585/3197] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:59.213413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.220819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.234869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c0f43-d260-4343-a99e-25945ab20cfe None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.240146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.247386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.247908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.248442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.249286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.251514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.257097 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1613/3198] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:59.258459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.258785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.259070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.282812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.284067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:59.294397 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1586/3199] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/projects => generated 401 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:59.294397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.304868 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:59.387064 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1614/3200] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:53:59.405394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.420743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd985e5-7cb1-4508-a96b-1fb280cbb812 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.427735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.429050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.429441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.429860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.431061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:53:59.432016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.435952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.464510 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1615/3201] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:53:59.467318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.469501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5d0f-4db5-48a3-b8a0-a75dd49d03bb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.486103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.487243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.487531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.487809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.488615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.490766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.490929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22c102-0ad2-4f73-b402-5aec1a82631d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.497960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.498717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.499000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.499315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.500332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.513302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.545146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1587/3202] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:59.551813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.576140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac744e95-f23e-4ba2-a42c-95cf1f8eae0d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.611485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.613316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.622051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.622051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.623867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.629821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.637295 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1616/3203] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:59.641414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.660683 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1588/3204] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:59.662209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.685882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc777ac-b108-4b1f-a7e2-8e1c675eddf1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.733584 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:59.776698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.777802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.778319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.778895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.780034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.782224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.800800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9223-dec6-4e84-9d25-849ea4e5f1b9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.804059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1589/3205] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:59.809178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.815086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.815790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.816076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.816515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.817217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.819766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.827332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51870f2-f08b-4f82-b22b-1e18757bb4ed admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.835375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044feca3-7db3-4d56-a024-3d9c1fbd9ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.836890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044feca3-7db3-4d56-a024-3d9c1fbd9ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.837438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044feca3-7db3-4d56-a024-3d9c1fbd9ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.840607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044feca3-7db3-4d56-a024-3d9c1fbd9ac0 admin admin] PATH_INFO: `/v3/projects/a73f2a2b13e24712a31c1f993babea62/users/35050c64ac24497ca416df808581423a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.862789 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1617/3206] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:53:59.871740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.878279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044feca3-7db3-4d56-a024-3d9c1fbd9ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73f2a2b13e24712a31c1f993babea62, user_id=35050c64ac24497ca416df808581423a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.881078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044feca3-7db3-4d56-a024-3d9c1fbd9ac0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.883724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7c62-ac12-4159-a1be-9ba63e49d487 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.889333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:59.890305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.891026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.891477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.893320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:59.895135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:59.908808 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1590/3207] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:53:59 2022] PUT /identity/v3/projects/a73f2a2b13e24712a31c1f993babea62/users/35050c64ac24497ca416df808581423a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:53:59.915415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:59.916265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:59.916854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1618/3208] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:53:59.920204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:59.921726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:59.941374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b11eb-0619-468a-8cbb-a7f42b8e4b1f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:59.954582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:53:59.956098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.054116 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1591/3209] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:00.055075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.055981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.057015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.059707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.060515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.063037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.075439 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1619/3210] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:00.079275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.088376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.090335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.092695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f965f0-6c7d-4d9a-9b55-0e90c19d363c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.100567 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:00.107163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f620f32-81f6-4b5b-8569-de55278c98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.108077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620f32-81f6-4b5b-8569-de55278c98b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.108436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620f32-81f6-4b5b-8569-de55278c98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.108723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620f32-81f6-4b5b-8569-de55278c98b9 admin admin] PATH_INFO: `/v3/projects/777b69fbf63541678476e7e00d2bc4a8/users/87a2664617054e1ba5d6059513911164/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.141070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620f32-81f6-4b5b-8569-de55278c98b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777b69fbf63541678476e7e00d2bc4a8, user_id=87a2664617054e1ba5d6059513911164, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.143802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620f32-81f6-4b5b-8569-de55278c98b9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.170866 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1592/3211] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:00 2022] PUT /identity/v3/projects/777b69fbf63541678476e7e00d2bc4a8/users/87a2664617054e1ba5d6059513911164/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:00.176195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.176417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.176646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.191666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e2693-6244-45bc-aeb2-9ffdaacbf2d4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.216798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:00.218050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.256589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.257842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.258294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.258692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.343718 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1593/3212] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:00.371115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.372755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.374793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.387381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09867-2609-40c9-8846-6f2e81779704 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.389315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1620/3213] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:00.391733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198456-a1c0-43a2-a882-249a5cff07f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.392390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198456-a1c0-43a2-a882-249a5cff07f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.392677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198456-a1c0-43a2-a882-249a5cff07f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.392958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198456-a1c0-43a2-a882-249a5cff07f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.404301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198456-a1c0-43a2-a882-249a5cff07f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.406797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198456-a1c0-43a2-a882-249a5cff07f9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.422468 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1594/3214] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:00.449974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.465788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.483423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad364-b859-427a-8f69-bbc7659d0aae service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:00.490334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:00.491600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.492206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.492652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] PATH_INFO: `/v3/users/b27bfc0e95874f57866174f390c7bc63` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.497697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27bfc0e95874f57866174f390c7bc63)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:00.501486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:00.575452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27bfc0e95874f57866174f390c7bc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.576148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27bfc0e95874f57866174f390c7bc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.598638 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:00.600945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27bfc0e95874f57866174f390c7bc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.614611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27bfc0e95874f57866174f390c7bc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.642808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27bfc0e95874f57866174f390c7bc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:00.667553 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1621/3215] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:00 2022] DELETE /identity/v3/users/b27bfc0e95874f57866174f390c7bc63 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:00.754204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:00.754825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:00.754825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:00.789675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:00.791012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:00.799213 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:00.914635 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1595/3216] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:00.957374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:00.959214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:01.090027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78008-5c4d-42fb-a423-6225f43437f7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.096802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.098033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.098529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.099000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] PATH_INFO: `/v3/projects/3554eae7cfd54be0ba7682235e5f6699` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.100428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3554eae7cfd54be0ba7682235e5f6699)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.103269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.205240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3554eae7cfd54be0ba7682235e5f6699', 'request_id': 'req-bc561f78-88f0-4994-9781-f0d0106b11ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.216055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3554eae7cfd54be0ba7682235e5f6699', 'request_id': 'req-bc561f78-88f0-4994-9781-f0d0106b11ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.251468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3554eae7cfd54be0ba7682235e5f6699', 'request_id': 'req-bc561f78-88f0-4994-9781-f0d0106b11ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.297130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] The token cache is being invalidate because project 3554eae7cfd54be0ba7682235e5f6699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:01.297483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.298123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc561f78-88f0-4994-9781-f0d0106b11ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.303835 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1622/3217] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:00 2022] DELETE /identity/v3/projects/3554eae7cfd54be0ba7682235e5f6699 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:01.304685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.323585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37815840-fc50-41ec-be59-a83dd3dd0896 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.350375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1545c-b784-44d5-be94-c90b1002d680 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.350919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1545c-b784-44d5-be94-c90b1002d680 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.351310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1545c-b784-44d5-be94-c90b1002d680 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.353873 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1623/3218] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:54:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:54:01.363608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.363608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.363608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.427960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:01.429593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:01.470887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.472092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.472547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.473007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] PATH_INFO: `/v3/users/e59bfc5a83c34869892c1b5491907c7c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.477781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59bfc5a83c34869892c1b5491907c7c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.480711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.566200 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:01.593461 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1624/3219] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:01.602274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59bfc5a83c34869892c1b5491907c7c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.619947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:01.623514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:01.643141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacf173-79b0-45f4-83f7-48c95faf234c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:01.651037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59bfc5a83c34869892c1b5491907c7c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.677715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59bfc5a83c34869892c1b5491907c7c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.690528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59bfc5a83c34869892c1b5491907c7c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.691277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59bfc5a83c34869892c1b5491907c7c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:01.693012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:01.695981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:01.696408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:01.706685 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1596/3220] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:01 2022] DELETE /identity/v3/users/e59bfc5a83c34869892c1b5491907c7c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:01.712504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:01.718610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:01.759373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:01.762272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7503e-10bd-4a6d-b02c-591e89031ff7 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:01.807133 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1625/3221] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:02.247579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:02.249431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:02.350285 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:02.430976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbb657-4956-47f4-b74e-e4fabdd2ef31 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:02.442845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:02.444838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.446650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.447862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] PATH_INFO: `/v3/projects/6ee9af6437c645828bb72a5a163d352d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.451195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee9af6437c645828bb72a5a163d352d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:02.457225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:02.553500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee9af6437c645828bb72a5a163d352d', 'request_id': 'req-f56002d1-75f2-4bef-8695-bba06c382c54'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:02.560651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee9af6437c645828bb72a5a163d352d', 'request_id': 'req-f56002d1-75f2-4bef-8695-bba06c382c54'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:02.572010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee9af6437c645828bb72a5a163d352d', 'request_id': 'req-f56002d1-75f2-4bef-8695-bba06c382c54'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:02.586539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] The token cache is being invalidate because project 6ee9af6437c645828bb72a5a163d352d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:02.587242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:02.588660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f56002d1-75f2-4bef-8695-bba06c382c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:02.590742 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1597/3222] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:02 2022] DELETE /identity/v3/projects/6ee9af6437c645828bb72a5a163d352d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:02.595983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d91cd-817e-41c0-9b67-434b5d612003 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.596274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d91cd-817e-41c0-9b67-434b5d612003 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.597393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d91cd-817e-41c0-9b67-434b5d612003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.715603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-374d91cd-817e-41c0-9b67-434b5d612003 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:02.731832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-374d91cd-817e-41c0-9b67-434b5d612003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:02.886366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c4b9-7425-4faf-9b06-f67aeb530a90 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.886703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c4b9-7425-4faf-9b06-f67aeb530a90 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.887109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c4b9-7425-4faf-9b06-f67aeb530a90 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.889429 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1598/3223] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:54:02.898600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.898885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.899167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.929634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1626/3224] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:02.938054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330ef2b-7756-40d7-b88a-cb007d0d1afa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:02.938374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330ef2b-7756-40d7-b88a-cb007d0d1afa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:02.941482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330ef2b-7756-40d7-b88a-cb007d0d1afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:02.951258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:02.959592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.007543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3330ef2b-7756-40d7-b88a-cb007d0d1afa None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:03.009073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3330ef2b-7756-40d7-b88a-cb007d0d1afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.038097 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1627/3225] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:03.039903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0962c-9f68-4fa7-bb03-fa45c6e24891 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.041333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0962c-9f68-4fa7-bb03-fa45c6e24891 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.042827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0962c-9f68-4fa7-bb03-fa45c6e24891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.077416 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1599/3226] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:03.078564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.085657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b1d0962c-9f68-4fa7-bb03-fa45c6e24891 None None] MFA Rules not processed for user `87a2664617054e1ba5d6059513911164`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:03.089582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81642e9-31cb-4bb9-a8b2-867797d1065a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.095611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.097332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.097894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.098578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.098899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b1d0962c-9f68-4fa7-bb03-fa45c6e24891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.099839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:03.100407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.104684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.123925 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1600/3227] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:03.125026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.129040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.145166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b440-a7f1-4ab6-a105-a1c730952800 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.160030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.161017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.162536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.162988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.174139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.175964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.214160 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1601/3228] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:03.214510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.223855 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1628/3229] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:03.235137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc4cc-deb9-4cca-901c-0c4c3dfeb455 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.236169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc4cc-deb9-4cca-901c-0c4c3dfeb455 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.236586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc4cc-deb9-4cca-901c-0c4c3dfeb455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.257420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5f0b6-02a4-4adb-b366-c82b0120e366 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.279235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20b28-d92d-4259-b497-4ddd7eb753b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.281584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20b28-d92d-4259-b497-4ddd7eb753b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.282077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20b28-d92d-4259-b497-4ddd7eb753b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.283064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20b28-d92d-4259-b497-4ddd7eb753b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.284465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20b28-d92d-4259-b497-4ddd7eb753b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.286644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20b28-d92d-4259-b497-4ddd7eb753b9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.327117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6dbfc4cc-deb9-4cca-901c-0c4c3dfeb455 None None] MFA Rules not processed for user `87a2664617054e1ba5d6059513911164`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:03.332250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dbfc4cc-deb9-4cca-901c-0c4c3dfeb455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.362562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1629/3230] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:03.365237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.366225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.368112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.409860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1602/3231] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/projects => generated 397 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:03.409860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.409860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.409860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.418294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:03.419664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.484046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] MFA Rules not processed for user `87a2664617054e1ba5d6059513911164`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:03.485323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:03.507359 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:03.595852 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1630/3232] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:03.597087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.607271 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:03.636923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1603/3233] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:03.714283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3723-b32c-4d14-b87f-67e548b7fca2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.719401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.721135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.721668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.722408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.723376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.726841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.765646 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1631/3234] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:03.769834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.784822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02a002-4496-4ba4-be99-5dec489fc247 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.791720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.792641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.792938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.793326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.794364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.797097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.817069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1604/3235] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:03.821438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.848197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957cec-042c-4532-9167-75f33aeaa46c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.858287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.860167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.860683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.861053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.862582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.864503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.881314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1632/3236] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:03.886255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.899382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9b2ad-1117-40c7-9596-5cef318a1ca5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:03.906629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5381-bea5-4edd-b75f-49bcf13c66a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:03.908179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5381-bea5-4edd-b75f-49bcf13c66a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.908663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5381-bea5-4edd-b75f-49bcf13c66a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.909197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5381-bea5-4edd-b75f-49bcf13c66a5 admin admin] PATH_INFO: `/v3/projects/28517f9547d14841b886f07514d26de1/users/0279cdac62b64736a52d236af050e284/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:03.926756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:03.943182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d5381-bea5-4edd-b75f-49bcf13c66a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28517f9547d14841b886f07514d26de1, user_id=0279cdac62b64736a52d236af050e284, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:03.951051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d5381-bea5-4edd-b75f-49bcf13c66a5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:03.985677 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1605/3237] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:03 2022] PUT /identity/v3/projects/28517f9547d14841b886f07514d26de1/users/0279cdac62b64736a52d236af050e284/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:03.996188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de2398-f095-4a62-af19-357b4b38002a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:03.996570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de2398-f095-4a62-af19-357b4b38002a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:03.996813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de2398-f095-4a62-af19-357b4b38002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:04.059344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-42de2398-f095-4a62-af19-357b4b38002a None None] MFA Rules not processed for user `0279cdac62b64736a52d236af050e284`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:04.060591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-42de2398-f095-4a62-af19-357b4b38002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:04.102889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291637c-f0d0-451f-b184-0586188f9dac admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:04.202278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1606/3238] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:04.203368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de2398-f095-4a62-af19-357b4b38002a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:04.204741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-42de2398-f095-4a62-af19-357b4b38002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:04.224100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:04.225197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:04.226012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:04.226526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:04.229696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:04.247137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:04.253133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa75459-d076-47db-a8fe-3d423e6cd457 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:04.279453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1633/3239] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:04.304987 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:04.370179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de2398-f095-4a62-af19-357b4b38002a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:04.378700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:04.380134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:04.380428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:04.380706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:04.458014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90942f-3101-40e0-b02e-81523e2baff1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:04.458593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90942f-3101-40e0-b02e-81523e2baff1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:04.459036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90942f-3101-40e0-b02e-81523e2baff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:04.468349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:04.470259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:04.497441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1607/3240] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:04.498720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9c90942f-3101-40e0-b02e-81523e2baff1 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:04.500352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9c90942f-3101-40e0-b02e-81523e2baff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:04.523346 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1634/3241] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:04.543211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:04.547299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:04.698550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c0d46-74cf-4211-beba-95dec29d0ee4 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:04.703997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:04.705346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:04.706162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:04.706162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:04.728003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:04.730662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:04.748925 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1608/3242] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:05.367254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b256-1684-4765-ae16-5a50a1e542b9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:05.367743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b256-1684-4765-ae16-5a50a1e542b9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:05.367743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b256-1684-4765-ae16-5a50a1e542b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:05.384264 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:05.413800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1712b256-1684-4765-ae16-5a50a1e542b9 None None] MFA Rules not processed for user `87a2664617054e1ba5d6059513911164`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:05.415073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1712b256-1684-4765-ae16-5a50a1e542b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:05.456207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1635/3243] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:05.790300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:05.833408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292751-a0f5-415f-aa8f-000e56a19f9b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:05.880686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3bf7a-e7ea-44f7-9a48-d5b13d8ecb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:05.881670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bf7a-e7ea-44f7-9a48-d5b13d8ecb8b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:05.882171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bf7a-e7ea-44f7-9a48-d5b13d8ecb8b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:05.882702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bf7a-e7ea-44f7-9a48-d5b13d8ecb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:05.902771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3bf7a-e7ea-44f7-9a48-d5b13d8ecb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:05.908448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3bf7a-e7ea-44f7-9a48-d5b13d8ecb8b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:05.935861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1609/3244] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:06.932207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26b0af-f161-40f1-8afd-728b9251b155 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:06.932837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26b0af-f161-40f1-8afd-728b9251b155 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:06.932837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26b0af-f161-40f1-8afd-728b9251b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:06.979319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ea26b0af-f161-40f1-8afd-728b9251b155 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:06.980593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ea26b0af-f161-40f1-8afd-728b9251b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:07.192856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1636/3245] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:07.476414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22fc0-46b3-445f-aad7-63181b899571 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:07.476999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22fc0-46b3-445f-aad7-63181b899571 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:07.476999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22fc0-46b3-445f-aad7-63181b899571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:07.523818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6cb22fc0-46b3-445f-aad7-63181b899571 None None] MFA Rules not processed for user `87a2664617054e1ba5d6059513911164`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:07.525605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6cb22fc0-46b3-445f-aad7-63181b899571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:07.550041 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1610/3246] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:08.299689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:08.300223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:08.300331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:08.343564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] MFA Rules not processed for user `a90c48bbb93649cfa201f70f1a4499a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:08.343564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:08.471142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1637/3247] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:10.496709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32840-5a54-4cae-83c7-66710994a8ee None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:10.497201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32840-5a54-4cae-83c7-66710994a8ee None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:10.497295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32840-5a54-4cae-83c7-66710994a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:10.558633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:10.572797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-35c32840-5a54-4cae-83c7-66710994a8ee None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:10.580167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-35c32840-5a54-4cae-83c7-66710994a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:10.607712 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1611/3248] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:10.729547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780406b7-3fbe-4970-9ca0-981f07daafde None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:10.743177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:10.745330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:10.745941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:10.746453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] PATH_INFO: `/v3/users/0279cdac62b64736a52d236af050e284` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:10.750923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0279cdac62b64736a52d236af050e284)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:10.753216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:10.883041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0279cdac62b64736a52d236af050e284'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:10.885227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0279cdac62b64736a52d236af050e284'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:10.896076 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:10.914843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0279cdac62b64736a52d236af050e284'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:10.917399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0279cdac62b64736a52d236af050e284'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:10.935695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0279cdac62b64736a52d236af050e284'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:10.967334 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1638/3249] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:10 2022] DELETE /identity/v3/users/0279cdac62b64736a52d236af050e284 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:54:10.971474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d828a-d7cf-4512-8f84-870157af52b0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:10.971775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d828a-d7cf-4512-8f84-870157af52b0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:10.972060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d828a-d7cf-4512-8f84-870157af52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:11.066160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-902d828a-d7cf-4512-8f84-870157af52b0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:11.074711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-902d828a-d7cf-4512-8f84-870157af52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:11.200545 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:11.291263 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1612/3250] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:11.389388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:11.391803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:11.546792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb578a2-212d-4b83-9fd1-78ca32338e32 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:11.563187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:11.564156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:11.564439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:11.564909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:11.592084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:11.598438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:11.622610 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1639/3251] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:14.158652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840323c-2d89-4ff2-9054-6a01436c711b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:14.159209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840323c-2d89-4ff2-9054-6a01436c711b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:14.159209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840323c-2d89-4ff2-9054-6a01436c711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:14.192094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a840323c-2d89-4ff2-9054-6a01436c711b None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:14.193407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a840323c-2d89-4ff2-9054-6a01436c711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:14.332883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1613/3252] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:14.997697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:14.999734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:15.038037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ffde-9d97-408f-9a4a-40017f34f5ab service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:15.046523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:15.048435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.048901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.049391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] PATH_INFO: `/v3/projects/28517f9547d14841b886f07514d26de1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.051082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28517f9547d14841b886f07514d26de1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:15.053735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:15.145410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28517f9547d14841b886f07514d26de1', 'request_id': 'req-9b39082c-1113-4231-86b1-eec8557f919e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.162425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28517f9547d14841b886f07514d26de1', 'request_id': 'req-9b39082c-1113-4231-86b1-eec8557f919e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.173418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28517f9547d14841b886f07514d26de1', 'request_id': 'req-9b39082c-1113-4231-86b1-eec8557f919e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.213499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] The token cache is being invalidate because project 28517f9547d14841b886f07514d26de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:15.214837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.216455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b39082c-1113-4231-86b1-eec8557f919e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:15.223955 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1640/3253] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:14 2022] DELETE /identity/v3/projects/28517f9547d14841b886f07514d26de1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:15.230305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.230890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.231032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.268426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:15.270783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:15.455507 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1614/3254] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:15.464600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.465307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.465773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.508957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:15.533471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:15.564361 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1641/3255] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:15.568615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:15.583437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc41e11-0f40-4b8e-b758-ae4d9d439567 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:15.592711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:15.595184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.595592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.595981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.596845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:15.599123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:15.602710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:15.631394 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1615/3256] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:15.636173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:15.648326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde3354-f0cf-430a-826b-a3aaa86964f6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:15.664496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:15.665524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.666771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.667707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.668417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:15.673765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:15.732785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1642/3257] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:15 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:15.737311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:15.752455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f52b58-fe88-4af7-b312-2c12e3426478 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:15.932706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:15.933583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:15.933877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:15.934157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:15.934908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:15.937210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:15.982102 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:16.012819 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1616/3258] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:15 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:16.016180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:16.031749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c16a-2238-4b9d-a309-4de7269d6573 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:16.063071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:16.063855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.064281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.064622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.065440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:16.068363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:16.120536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1643/3259] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:16.124363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:16.151465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a4d6e-874d-4b6a-96cc-977876a88a1e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:16.158444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c91529-526d-4cc7-bd88-b0f8b8ee8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:16.159532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91529-526d-4cc7-bd88-b0f8b8ee8d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.160129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91529-526d-4cc7-bd88-b0f8b8ee8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.160544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91529-526d-4cc7-bd88-b0f8b8ee8d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.161549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91529-526d-4cc7-bd88-b0f8b8ee8d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:16.163498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91529-526d-4cc7-bd88-b0f8b8ee8d85 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:16.176837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1617/3260] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:16.180864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:16.199933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41197faa-208b-44d5-ab16-b517d7973a13 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:16.206383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:16.207704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.208170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.208676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] PATH_INFO: `/v3/projects/97860234361a4dc6abf8eca723b47aa7/users/f4a8263eb84a4c1095d0e62a29335262/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.250886 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:16.266699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] RBAC: Authorizing `identity:create_grant(project_id=97860234361a4dc6abf8eca723b47aa7, user_id=f4a8263eb84a4c1095d0e62a29335262, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:16.269840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:16.312010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24dca-ad4e-4361-bfb7-d26fc93de3fa None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.312938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24dca-ad4e-4361-bfb7-d26fc93de3fa None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.313436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24dca-ad4e-4361-bfb7-d26fc93de3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.315215 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1644/3261] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:16 2022] PUT /identity/v3/projects/97860234361a4dc6abf8eca723b47aa7/users/f4a8263eb84a4c1095d0e62a29335262/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:16.336265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3dc24dca-ad4e-4361-bfb7-d26fc93de3fa None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:16.338769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3dc24dca-ad4e-4361-bfb7-d26fc93de3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:16.466743 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1618/3262] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:16.501537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:16.503767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:16.614482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0507-bc9a-4feb-8a0a-75b6b925990c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:16.633741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff2bf4-c445-4b97-bc0f-57da9d98b46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:16.635351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff2bf4-c445-4b97-bc0f-57da9d98b46c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.635811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff2bf4-c445-4b97-bc0f-57da9d98b46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.636258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff2bf4-c445-4b97-bc0f-57da9d98b46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.658774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff2bf4-c445-4b97-bc0f-57da9d98b46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:16.664032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff2bf4-c445-4b97-bc0f-57da9d98b46c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:16.688391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1645/3263] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:16.779924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:16.780611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:16.781074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:16.855390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] MFA Rules not processed for user `35050c64ac24497ca416df808581423a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:16.857252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:17.037036 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1619/3264] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:17.561002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.561647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.561647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.572686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:17.574542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:17.601263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:17.606291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:17.699919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3710b-3797-4fd4-bb91-824488bb2f28 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:17.707270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:17.707940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:17.708229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:17.708511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:17.720030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:17.722015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:17.735833 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1620/3265] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:17.788322 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1646/3266] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:27.729581 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:27.773261 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=54,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:27.874178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:27.875807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:27.910855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132a5d-f973-4a1b-90cf-71adbdb179f2 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:27.925459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:27.929090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:27.930206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:27.934434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] PATH_INFO: `/v3/users/35050c64ac24497ca416df808581423a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:27.938220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35050c64ac24497ca416df808581423a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:27.945658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:28.095520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35050c64ac24497ca416df808581423a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.121838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35050c64ac24497ca416df808581423a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.140089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35050c64ac24497ca416df808581423a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.153754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35050c64ac24497ca416df808581423a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.154532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa191ec9-2d09-48f3-adb7-73abc5ccd123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35050c64ac24497ca416df808581423a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:28.169259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1621/3267] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:27 2022] DELETE /identity/v3/users/35050c64ac24497ca416df808581423a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:29.048386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.065934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6745d04-64c0-4f6f-abd1-15704afc42bf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.233447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.234535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.234784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.235063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] PATH_INFO: `/v3/projects/a73f2a2b13e24712a31c1f993babea62` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.236365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73f2a2b13e24712a31c1f993babea62)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.238322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.364568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73f2a2b13e24712a31c1f993babea62', 'request_id': 'req-90c72053-a595-4b24-af1e-2dab42efda15'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.388305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73f2a2b13e24712a31c1f993babea62', 'request_id': 'req-90c72053-a595-4b24-af1e-2dab42efda15'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.407852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73f2a2b13e24712a31c1f993babea62', 'request_id': 'req-90c72053-a595-4b24-af1e-2dab42efda15'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.433933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] The token cache is being invalidate because project a73f2a2b13e24712a31c1f993babea62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:29.434611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.435610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-90c72053-a595-4b24-af1e-2dab42efda15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:29.437835 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1647/3268] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:29 2022] DELETE /identity/v3/projects/a73f2a2b13e24712a31c1f993babea62 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:29.443254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.443809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.443809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.507481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:29.510990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:29.620633 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1622/3269] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:29.627035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.627570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.628014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.670078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:29.673033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:29.688655 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1648/3270] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:29.689228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.700263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e38546-1d33-4a40-9fdc-9ef0328f9fa8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.705239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.705984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.706367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.706795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.707487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:29.707814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.715428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.734127 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1623/3271] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:29.738006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.761485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6028f1-6ae2-46de-a6e3-41269b7b8a2b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:29.772813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:29.775344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:29.775599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:29.775891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:29.776627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:29.778583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:29.859267 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1649/3272] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:29.862979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:29.885119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7494df-c0df-4ae0-8b65-854f9a4c5ef3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.048820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.051353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.058401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.058749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.059530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.061503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.091971 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:30.117869 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1624/3273] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:29 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:30.119666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.134339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59440-9f31-497b-9688-433e829cefe4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.154962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.155756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.156434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.157536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.161295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.176578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.208881 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1650/3274] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:30.213150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.226817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971187f1-5a02-4b5a-b5eb-028a2a35857a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.234378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265e741-3900-4f12-a1fe-4a729133cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.236127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e741-3900-4f12-a1fe-4a729133cb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.236127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e741-3900-4f12-a1fe-4a729133cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.236738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e741-3900-4f12-a1fe-4a729133cb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.238231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265e741-3900-4f12-a1fe-4a729133cb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.240421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265e741-3900-4f12-a1fe-4a729133cb91 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.255628 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1625/3275] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:30.260949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.273702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cdc99-1e77-424b-b83f-e6d8e726470a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.285289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.287119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.288616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.289165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] PATH_INFO: `/v3/projects/d4b5fdbc15124c14a6de955799e60038/users/3bafee57dd9f4cd2b92aa55712b5f317/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.317499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5fdbc15124c14a6de955799e60038, user_id=3bafee57dd9f4cd2b92aa55712b5f317, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.321478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.354735 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1651/3276] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:30 2022] PUT /identity/v3/projects/d4b5fdbc15124c14a6de955799e60038/users/3bafee57dd9f4cd2b92aa55712b5f317/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:30.367174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081504-e4fc-4b28-abd8-8e1735ea068e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.367539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081504-e4fc-4b28-abd8-8e1735ea068e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.369041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081504-e4fc-4b28-abd8-8e1735ea068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.411418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5f081504-e4fc-4b28-abd8-8e1735ea068e None None] MFA Rules not processed for user `3bafee57dd9f4cd2b92aa55712b5f317`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:30.413181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5f081504-e4fc-4b28-abd8-8e1735ea068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:30.572800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:30.575128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:30.580543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1626/3277] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:30.676351 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:30.752438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b775e-50de-4132-be43-e529656e943c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:30.758341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:30.758341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:30.758775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:30.759040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:30.776069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:30.777544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:30.801978 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1652/3278] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:54:31.008202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b49ea-f4ed-4bf9-90fc-7c59d3c104c9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.010131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b49ea-f4ed-4bf9-90fc-7c59d3c104c9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.010789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b49ea-f4ed-4bf9-90fc-7c59d3c104c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.066604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-071b49ea-f4ed-4bf9-90fc-7c59d3c104c9 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:31.068018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-071b49ea-f4ed-4bf9-90fc-7c59d3c104c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:31.217573 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1627/3279] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:31.328642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:31.330474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:31.522312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4daf4a-a9d8-4fc2-9f84-1ee270d8d4ca service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:31.537931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:31.538805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:31.539085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:31.539571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:31.572251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:31.575428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:31.589636 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1653/3280] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:54:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:54:34.504456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deeb0d-7617-44f3-8ffb-d8ddcdb1b635 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:34.504906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deeb0d-7617-44f3-8ffb-d8ddcdb1b635 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:34.505202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deeb0d-7617-44f3-8ffb-d8ddcdb1b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:34.569569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-03deeb0d-7617-44f3-8ffb-d8ddcdb1b635 None None] MFA Rules not processed for user `f4a8263eb84a4c1095d0e62a29335262`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:34.582183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-03deeb0d-7617-44f3-8ffb-d8ddcdb1b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:34.770224 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1628/3281] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:35.293514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:35.299122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:35.468797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5507-245b-4ddc-831d-46bcc9233496 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:35.492849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b9b0e-02db-403b-8e85-f0bef6000113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:35.494599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9b0e-02db-403b-8e85-f0bef6000113 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.496248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9b0e-02db-403b-8e85-f0bef6000113 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.496878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9b0e-02db-403b-8e85-f0bef6000113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.511589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b9b0e-02db-403b-8e85-f0bef6000113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:35.516013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b9b0e-02db-403b-8e85-f0bef6000113 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:35.555778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1654/3282] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:35.685674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e580c-8e98-4b44-9ea4-66d9fa8337c2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:35.687285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e580c-8e98-4b44-9ea4-66d9fa8337c2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:35.687930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e580c-8e98-4b44-9ea4-66d9fa8337c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:35.705101 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:35.727613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a83e580c-8e98-4b44-9ea4-66d9fa8337c2 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:35.730743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a83e580c-8e98-4b44-9ea4-66d9fa8337c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:35.829631 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1629/3283] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:37.989679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f1440-ca3a-4635-8c5f-86a77eb4e3cc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:37.991290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f1440-ca3a-4635-8c5f-86a77eb4e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:37.993810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f1440-ca3a-4635-8c5f-86a77eb4e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:38.033213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9e9f1440-ca3a-4635-8c5f-86a77eb4e3cc None None] MFA Rules not processed for user `8b25774c24e3411b91794b8fb73c9da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:38.036411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e9f1440-ca3a-4635-8c5f-86a77eb4e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:38.214728 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:38.258333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1655/3284] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:38.445591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e08c-91a0-44b6-97a1-8bf95f0c79ad None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:38.447081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e08c-91a0-44b6-97a1-8bf95f0c79ad None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:38.447582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e08c-91a0-44b6-97a1-8bf95f0c79ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:38.494154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c831e08c-91a0-44b6-97a1-8bf95f0c79ad None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:38.497672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c831e08c-91a0-44b6-97a1-8bf95f0c79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:38.521450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1630/3285] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:47.349413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:47.350396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:47.350913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:47.381002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] MFA Rules not processed for user `55e38f4c2a814efab3873507d136dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:47.385014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:47.458059 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1656/3286] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:48.472423 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=27 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:49.473539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:49.474419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:49.474926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:49.496626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:49.497979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:49.506884 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1631/3287] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:49.526301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:49.544593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eba42-55ea-429c-b521-7a61bc180ab6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:49.552958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9870b4-b601-4670-8f72-b9db6177a524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:49.554403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9870b4-b601-4670-8f72-b9db6177a524 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:49.555143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9870b4-b601-4670-8f72-b9db6177a524 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:49.555786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9870b4-b601-4670-8f72-b9db6177a524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:49.566573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9870b4-b601-4670-8f72-b9db6177a524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:49.568980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9870b4-b601-4670-8f72-b9db6177a524 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:49.584262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1657/3288] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:54:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:54:49.800604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:49.953976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74759b-7b14-4601-b22a-dc952d5d9b78 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:49.958867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:49.961016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:49.961016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:49.961016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] PATH_INFO: `/v3/users/3bafee57dd9f4cd2b92aa55712b5f317` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:49.961726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bafee57dd9f4cd2b92aa55712b5f317)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:49.964066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:50.032636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bafee57dd9f4cd2b92aa55712b5f317'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.064770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bafee57dd9f4cd2b92aa55712b5f317'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.085929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bafee57dd9f4cd2b92aa55712b5f317'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.096533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bafee57dd9f4cd2b92aa55712b5f317'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.097550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bafee57dd9f4cd2b92aa55712b5f317'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:50.108132 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1632/3289] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:49 2022] DELETE /identity/v3/users/3bafee57dd9f4cd2b92aa55712b5f317 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:50.112602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:50.113453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:50.114138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:50.157930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:50.159482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:50.270578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1658/3290] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:50.279084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:50.280613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:50.355970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8975a5-df82-4bf5-a173-dec31f7a11a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:50.363410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3169758-adc6-4017-af2e-cbfc0e3f162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:50.364087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3169758-adc6-4017-af2e-cbfc0e3f162f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:50.364362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3169758-adc6-4017-af2e-cbfc0e3f162f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:50.364636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3169758-adc6-4017-af2e-cbfc0e3f162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:50.383513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3169758-adc6-4017-af2e-cbfc0e3f162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:50.385190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3169758-adc6-4017-af2e-cbfc0e3f162f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:50.399398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1633/3291] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:51.220470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.221964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:51.255321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbb9f7-b7c9-41f8-a181-02a97e3a5381 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.265083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.266843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.267903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.268455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] PATH_INFO: `/v3/projects/d4b5fdbc15124c14a6de955799e60038` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.270028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b5fdbc15124c14a6de955799e60038)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.272650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.340452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b5fdbc15124c14a6de955799e60038', 'request_id': 'req-55cb7d5b-a474-4bc5-be9a-59a145a073d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:51.350654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b5fdbc15124c14a6de955799e60038', 'request_id': 'req-55cb7d5b-a474-4bc5-be9a-59a145a073d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:51.360786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b5fdbc15124c14a6de955799e60038', 'request_id': 'req-55cb7d5b-a474-4bc5-be9a-59a145a073d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:51.397739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] The token cache is being invalidate because project d4b5fdbc15124c14a6de955799e60038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:51.399655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:51.402931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55cb7d5b-a474-4bc5-be9a-59a145a073d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:51.407672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1659/3292] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:51 2022] DELETE /identity/v3/projects/d4b5fdbc15124c14a6de955799e60038 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:51.416664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58274917-3a78-4db2-821b-252950291004 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.417692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58274917-3a78-4db2-821b-252950291004 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.418589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58274917-3a78-4db2-821b-252950291004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.465945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-58274917-3a78-4db2-821b-252950291004 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:51.469361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58274917-3a78-4db2-821b-252950291004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:51.487479 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:51.609231 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1634/3293] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:51.611310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.611792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.612079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.621355 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:51.636018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:51.637620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:51.649099 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1660/3294] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:51.653013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58274917-3a78-4db2-821b-252950291004 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.666209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58274917-3a78-4db2-821b-252950291004 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.674616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.675710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.676255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.676758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.677756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:51.678264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.681699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.703255 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1635/3295] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:51.704572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.716168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc92655-7903-453a-a8c9-69973fb30a1a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.721747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.722415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.722737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.723749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.724755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.727853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.764528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1661/3296] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/projects => generated 401 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:54:51.768565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.780118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42c31-353b-4539-90c4-cf1e3f91ab73 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.854753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.855556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.856202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.856202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.856956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.859100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.885417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1636/3297] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:51 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:51.889679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.900703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71bb6-4888-40c1-8331-287cc2792943 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.906288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.907028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.907314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.907592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.908396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.910067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.922553 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1662/3298] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:51.926927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.938601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71255e-9225-4158-84e1-c86a7c40a931 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.943612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c74f57-14b4-42ac-9772-da79d46ade76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.944377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c74f57-14b4-42ac-9772-da79d46ade76 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.944729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c74f57-14b4-42ac-9772-da79d46ade76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.945076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c74f57-14b4-42ac-9772-da79d46ade76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:51.945934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c74f57-14b4-42ac-9772-da79d46ade76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:51.947682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c74f57-14b4-42ac-9772-da79d46ade76 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:51.959572 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1637/3299] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:51.963796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:51.974802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c9ed-d227-4ef9-a98b-4ccfa707d46e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:51.980668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:51.981583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:51.981869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:51.982151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] PATH_INFO: `/v3/projects/a021289d3d2b44a5b8990375e62292b8/users/daee04787eaa49178037bb77ec194638/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.002032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a021289d3d2b44a5b8990375e62292b8, user_id=daee04787eaa49178037bb77ec194638, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:52.004772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:52.020197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1663/3300] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:51 2022] PUT /identity/v3/projects/a021289d3d2b44a5b8990375e62292b8/users/daee04787eaa49178037bb77ec194638/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:52.031414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:52.031766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:52.032099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.069479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] MFA Rules not processed for user `daee04787eaa49178037bb77ec194638`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:52.071199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:52.144940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1638/3301] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:52.490695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:52.495586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:52.634766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7dc56-0810-46e9-ae96-ec68b7c139e0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:52.641506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82cd02-e95d-4153-a6ae-ad03ede97a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:52.642266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82cd02-e95d-4153-a6ae-ad03ede97a8f service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:52.642682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82cd02-e95d-4153-a6ae-ad03ede97a8f service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:52.643082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82cd02-e95d-4153-a6ae-ad03ede97a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.659422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82cd02-e95d-4153-a6ae-ad03ede97a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:52.664897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82cd02-e95d-4153-a6ae-ad03ede97a8f service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:52.678018 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1664/3302] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:52.729323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:52.761769 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:52.916699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6d8e6-452b-4a03-8d40-1b598b6e3bfd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:52.928675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:52.929565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:52.929892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:52.930171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] PATH_INFO: `/v3/users/daee04787eaa49178037bb77ec194638` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:52.941456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daee04787eaa49178037bb77ec194638)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:52.943986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:53.038151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daee04787eaa49178037bb77ec194638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.072594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daee04787eaa49178037bb77ec194638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.087441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daee04787eaa49178037bb77ec194638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.108243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daee04787eaa49178037bb77ec194638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.109084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daee04787eaa49178037bb77ec194638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:53.117006 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1639/3303] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:54:52 2022] DELETE /identity/v3/users/daee04787eaa49178037bb77ec194638 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:53.122488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:53.124957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:53.125625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:53.169132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:53.170599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:53.301244 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1665/3304] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:53.346518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:53.348233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:53.453179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27ed20-48d5-45c3-9d80-319ab2933055 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:53.457155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91205e49-35f1-4283-ac92-7c5efdcf8bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:53.458175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205e49-35f1-4283-ac92-7c5efdcf8bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:53.458606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205e49-35f1-4283-ac92-7c5efdcf8bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:53.458987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205e49-35f1-4283-ac92-7c5efdcf8bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:53.470279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91205e49-35f1-4283-ac92-7c5efdcf8bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:53.471933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91205e49-35f1-4283-ac92-7c5efdcf8bd1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:53.483976 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1640/3305] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:54.988098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:54.990606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:55.022696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc49cab-a49f-4cc5-985a-31fe45dc6f50 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:55.028411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:55.029288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.029578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.029855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] PATH_INFO: `/v3/projects/a021289d3d2b44a5b8990375e62292b8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.031565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a021289d3d2b44a5b8990375e62292b8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:55.033489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:55.096998 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:55.129988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a021289d3d2b44a5b8990375e62292b8', 'request_id': 'req-affc5013-7c4e-4f52-80d5-fe52eeb3488f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:55.140774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a021289d3d2b44a5b8990375e62292b8', 'request_id': 'req-affc5013-7c4e-4f52-80d5-fe52eeb3488f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:55.149465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a021289d3d2b44a5b8990375e62292b8', 'request_id': 'req-affc5013-7c4e-4f52-80d5-fe52eeb3488f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:55.165379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] The token cache is being invalidate because project a021289d3d2b44a5b8990375e62292b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:54:55.166374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:55.168047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-affc5013-7c4e-4f52-80d5-fe52eeb3488f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:54:55.171034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1666/3306] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:54:54 2022] DELETE /identity/v3/projects/a021289d3d2b44a5b8990375e62292b8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:55.175717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.176384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.176384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.213789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:55.215243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:55.281561 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:55.352744 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1641/3307] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:55.362005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.362325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.362583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.400501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:55.401770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:55.417050 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1667/3308] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:54:55.418670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:55.430821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13713432-09e8-4d06-97cb-c60b970a7160 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:55.437474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:55.438033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.438331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.438687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.441473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:54:55.441473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:55.442487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:55.465764 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1642/3309] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:54:55.467092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:55.486180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de8208-aecd-4cc9-88ce-1506645741b6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:55.495005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:55.495997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.496179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.496431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.497413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:55.500195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:55.564977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1668/3310] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:54:55 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:55.566179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:55.582583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ccb5a-cf7e-491d-93ba-a9a30a83fe13 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:55.740829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:55.742986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.743280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.745033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.746527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:55.752592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:55.803983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:55.824474 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1643/3311] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:54:55 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:54:55.827938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00698d68-6645-4e7b-b1fd-301e38ce4ac4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:55.833395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:55.834127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.835041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.835041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.835744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:55.838791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:55.861409 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1669/3312] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:55.866874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:55.902320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353675-5969-45f6-9b91-790c2b05e110 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:55.954479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a8d3f-f9d5-4f9b-94b9-69bab0655ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:55.955199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a8d3f-f9d5-4f9b-94b9-69bab0655ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:55.955488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a8d3f-f9d5-4f9b-94b9-69bab0655ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:55.955769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a8d3f-f9d5-4f9b-94b9-69bab0655ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:55.956523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a8d3f-f9d5-4f9b-94b9-69bab0655ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:55.960547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a8d3f-f9d5-4f9b-94b9-69bab0655ed7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:55.991434 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1644/3313] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:54:55.999219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.020826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34d71-d588-4d22-9484-839303f17ce9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.027345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.028837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.029268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.029672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] PATH_INFO: `/v3/projects/26a1b7e9b12045f49a90510bc57ff5ca/users/812aa819ccb64ebd96cce7a991010268/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.089645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a1b7e9b12045f49a90510bc57ff5ca, user_id=812aa819ccb64ebd96cce7a991010268, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.092548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:56.112661 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1670/3314] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:54:55 2022] PUT /identity/v3/projects/26a1b7e9b12045f49a90510bc57ff5ca/users/812aa819ccb64ebd96cce7a991010268/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:54:56.118381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72e46-199f-4aab-b438-121b6d18b007 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.118718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72e46-199f-4aab-b438-121b6d18b007 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.118967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72e46-199f-4aab-b438-121b6d18b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.154128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e2e72e46-199f-4aab-b438-121b6d18b007 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:56.155411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e2e72e46-199f-4aab-b438-121b6d18b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.240473 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1645/3315] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:54:56.253197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:56.255189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:56.342096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252061a4-a36d-4407-9344-f074e7711dfd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:56.342096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86b80d-a4e7-43c5-9b7e-d63a53bacc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:56.342282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86b80d-a4e7-43c5-9b7e-d63a53bacc4f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:56.342684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86b80d-a4e7-43c5-9b7e-d63a53bacc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:56.342973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86b80d-a4e7-43c5-9b7e-d63a53bacc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:56.357818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86b80d-a4e7-43c5-9b7e-d63a53bacc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:56.359471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86b80d-a4e7-43c5-9b7e-d63a53bacc4f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:56.380597 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1671/3316] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:58.911551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:58.912043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:58.912258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:58.961061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] MFA Rules not processed for user `bf59a9e902304a60939b4d5309b90714`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:54:58.962482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:59.027277 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:59.081073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1646/3317] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:06.366539 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:07.385083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:07.385653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:07.385653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:07.446129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] MFA Rules not processed for user `812aa819ccb64ebd96cce7a991010268`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:07.447829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:07.453594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:07.456823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:07.628563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1672/3318] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:07.665529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dd232-8087-4b6f-aaa1-6b5c6b93aaf7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:07.676455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:07.677243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:07.677513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:07.677792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:07.682187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:07.695924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:07.697533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaec17-8620-4675-864f-21ee577fd8ba service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:07.713589 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1647/3319] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:55:08.437052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:08.438831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:08.542979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3f6c0-390e-43ad-8147-94787911d042 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:08.549913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a32a1-504a-4975-b319-3ff0fc6ec9b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:08.550624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a32a1-504a-4975-b319-3ff0fc6ec9b6 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:08.550908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a32a1-504a-4975-b319-3ff0fc6ec9b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:08.551193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a32a1-504a-4975-b319-3ff0fc6ec9b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:08.565310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a32a1-504a-4975-b319-3ff0fc6ec9b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:08.567318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a32a1-504a-4975-b319-3ff0fc6ec9b6 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:08.580774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1673/3320] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:08.721991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81574380-2629-4901-9d8e-53aa9276eeaf None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:08.722584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81574380-2629-4901-9d8e-53aa9276eeaf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:08.722584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81574380-2629-4901-9d8e-53aa9276eeaf None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:08.723999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1648/3321] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:55:08.741687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c70a-f1f6-4826-b7c4-01426388dba5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:08.741927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c70a-f1f6-4826-b7c4-01426388dba5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:08.742199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c70a-f1f6-4826-b7c4-01426388dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:08.771243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c405c70a-f1f6-4826-b7c4-01426388dba5 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:08.772519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c405c70a-f1f6-4826-b7c4-01426388dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:08.941066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1674/3322] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:08.970550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81574380-2629-4901-9d8e-53aa9276eeaf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:08.972628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-81574380-2629-4901-9d8e-53aa9276eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:09.023791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81574380-2629-4901-9d8e-53aa9276eeaf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:09.044060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:09.045936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:09.046392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:09.046787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:09.091831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:09.093464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:09.116801 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1649/3323] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:09.215081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:09.215373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:09.215690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:09.282618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] MFA Rules not processed for user `9eeeb36672a2487db7c86faf03c82d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:09.286250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:09.314980 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:09.469322 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1675/3324] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:10.995782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:10.998101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:11.030066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638898e-5c03-4dbb-98d5-fae6493cab29 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:11.037492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:11.039417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:11.039872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:11.040406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] PATH_INFO: `/v3/users/f4a8263eb84a4c1095d0e62a29335262` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:11.042176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a8263eb84a4c1095d0e62a29335262)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:11.044525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:11.223338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a8263eb84a4c1095d0e62a29335262'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:11.246145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a8263eb84a4c1095d0e62a29335262'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:11.264312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a8263eb84a4c1095d0e62a29335262'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:11.280448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a8263eb84a4c1095d0e62a29335262'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:11.282066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-30f6a456-bf24-4694-a4d1-bd500e86e34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a8263eb84a4c1095d0e62a29335262'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:11.313024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1650/3325] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:10 2022] DELETE /identity/v3/users/f4a8263eb84a4c1095d0e62a29335262 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:11.997833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:12.016275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2359-bcab-436e-80a3-7e079d2140b0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:12.196316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:12.197848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:12.198276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:12.198662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] PATH_INFO: `/v3/projects/97860234361a4dc6abf8eca723b47aa7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:12.202449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97860234361a4dc6abf8eca723b47aa7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:12.206601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:12.341758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97860234361a4dc6abf8eca723b47aa7', 'request_id': 'req-aa5d69c9-6ced-434c-9389-78044ede3869'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:12.355815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97860234361a4dc6abf8eca723b47aa7', 'request_id': 'req-aa5d69c9-6ced-434c-9389-78044ede3869'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:12.373381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97860234361a4dc6abf8eca723b47aa7', 'request_id': 'req-aa5d69c9-6ced-434c-9389-78044ede3869'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:12.390158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] The token cache is being invalidate because project 97860234361a4dc6abf8eca723b47aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:12.390646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:12.391518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa5d69c9-6ced-434c-9389-78044ede3869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:12.402556 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1676/3326] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:11 2022] DELETE /identity/v3/projects/97860234361a4dc6abf8eca723b47aa7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:12.402791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:12.402791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:12.402791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:12.445704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:12.448493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:12.509200 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:12.625622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1651/3327] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:12.636023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:12.636219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:12.636506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:12.673859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:12.675167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:12.704464 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1677/3328] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:12.708351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:12.723260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a70e10-3e9c-41f1-ab74-f556a319b60a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:12.737771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:12.738466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:12.738789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:12.739074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:12.739826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:12.740139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:12.742336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:12.775012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1652/3329] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:12.779050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:12.789623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab8e2a-008e-4ff0-9f04-5acb9e04857b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:12.795703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:12.801250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:12.801698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:12.802146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:12.803129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:12.806019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:12.851735 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1678/3330] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:12 2022] POST /identity/v3/projects => generated 395 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:55:12.856845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:12.879905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf51998-dd71-48b6-82b4-cde90a48fb9d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:13.019307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:13.022655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.023197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.023642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.027668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:13.033695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:13.073284 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1653/3331] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:12 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:13.077304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:13.096826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc0c3-8865-4ebd-9409-08d623213c68 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:13.111161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:13.111889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.112499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.112793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.117478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:13.119439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:13.153519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1679/3332] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:13.157589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:13.177304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e422ca3-dff2-4485-8a00-7067dfdca950 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:13.183516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccccae-f3e7-47ca-8b23-c8114bf229ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:13.184429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccccae-f3e7-47ca-8b23-c8114bf229ee admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.185122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccccae-f3e7-47ca-8b23-c8114bf229ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.185552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccccae-f3e7-47ca-8b23-c8114bf229ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.186455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccccae-f3e7-47ca-8b23-c8114bf229ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:13.189225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccccae-f3e7-47ca-8b23-c8114bf229ee admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:13.204065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1654/3333] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:13.208016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:13.221086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bda17-ed83-4c31-8e9e-68a5791d25e3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:13.232225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:13.235565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.246835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.247581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] PATH_INFO: `/v3/projects/37ffec2403734313a6e8f170d31984df/users/dd39c50fe510415a834e941f6d433aef/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.253142 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:13.282529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ffec2403734313a6e8f170d31984df, user_id=dd39c50fe510415a834e941f6d433aef, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:13.286648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:13.305162 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1680/3334] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:13 2022] PUT /identity/v3/projects/37ffec2403734313a6e8f170d31984df/users/dd39c50fe510415a834e941f6d433aef/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:13.310093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9cba-64e3-45b2-bc8c-96d52ffafbe9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.310398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9cba-64e3-45b2-bc8c-96d52ffafbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.310711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9cba-64e3-45b2-bc8c-96d52ffafbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.343108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fe7f9cba-64e3-45b2-bc8c-96d52ffafbe9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:13.344561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe7f9cba-64e3-45b2-bc8c-96d52ffafbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:13.430321 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1655/3335] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:13.482739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:13.485166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:13.629541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0849bc-7471-41c7-9058-533b14c04c19 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:13.637973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:13.639149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.639477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.639848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.655750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:13.657325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:13.674182 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1681/3336] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:13.856449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:13.856737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:13.857182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:13.885822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] MFA Rules not processed for user `812aa819ccb64ebd96cce7a991010268`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:13.889905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:13.985988 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:14.040002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1656/3337] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:21.896825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:21.899695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:21.923534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df785a5-7ade-401b-99a8-e1a585e882a0 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:21.931234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:21.932493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:21.933181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:21.934015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] PATH_INFO: `/v3/users/a90c48bbb93649cfa201f70f1a4499a0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:21.935553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90c48bbb93649cfa201f70f1a4499a0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:21.939066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:22.000482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90c48bbb93649cfa201f70f1a4499a0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.001153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90c48bbb93649cfa201f70f1a4499a0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.015217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90c48bbb93649cfa201f70f1a4499a0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.015937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90c48bbb93649cfa201f70f1a4499a0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.024073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4c7889f-8066-4670-ae39-2b31d36f544c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90c48bbb93649cfa201f70f1a4499a0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.041190 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1682/3338] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:21 2022] DELETE /identity/v3/users/a90c48bbb93649cfa201f70f1a4499a0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:22.269315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:22.283816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd45fa-f410-470f-8dda-11f2d118ee51 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:22.369965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:22.370896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:22.371182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:22.371461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] PATH_INFO: `/v3/projects/a1488f69a86d439cbd588b114edb64a3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:22.373320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1488f69a86d439cbd588b114edb64a3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:22.375601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:22.434907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1488f69a86d439cbd588b114edb64a3', 'request_id': 'req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.442065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1488f69a86d439cbd588b114edb64a3', 'request_id': 'req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.451741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1488f69a86d439cbd588b114edb64a3', 'request_id': 'req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.464316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] The token cache is being invalidate because project a1488f69a86d439cbd588b114edb64a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:22.464654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.465240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6986e0ed-4f7d-4e8a-ba95-91e9f640f8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:22.467044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1657/3339] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:22 2022] DELETE /identity/v3/projects/a1488f69a86d439cbd588b114edb64a3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:22.477943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:22.478235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:22.478527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:22.512410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:22.513657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:22.670731 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:22.698737 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1683/3340] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:22.699876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:22.700173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:22.700457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:22.739146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:22.740392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:22.764438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1658/3341] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:22.768357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:22.782834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24466-d242-43f9-afb3-1c09b0534741 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:22.799060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:22.799829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:22.800121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:22.800399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:22.801372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:22.801700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:22.804797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:22.852895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:22.862723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1684/3342] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:22.871260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76762e-8a5f-455c-a547-aa49ef00602a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:22.876486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:22.877161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:22.877444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:22.879176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:22.879892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:22.882144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:22.959422 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1659/3343] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:22 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:22.959650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:22.974301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04668e54-00f9-4b68-b6d4-27ac2db388e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:23.111296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:23.112543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.113009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.113444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.116068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:23.121372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.167696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1685/3344] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:22 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:23.168568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:23.187701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301d8d-36c6-4bf2-b81c-150169194a1e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:23.212158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:23.214295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.214749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.215610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.215999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:23.221733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.256684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:23.262660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1660/3345] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:23.279074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a8b1a-7b27-47f1-bec1-e19dbfff03ce admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:23.285437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b6d4-8ea3-4f9b-8a9a-895e0238c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:23.286132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b6d4-8ea3-4f9b-8a9a-895e0238c47b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.286421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b6d4-8ea3-4f9b-8a9a-895e0238c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.286734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b6d4-8ea3-4f9b-8a9a-895e0238c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.287494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b6d4-8ea3-4f9b-8a9a-895e0238c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:23.289232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b6d4-8ea3-4f9b-8a9a-895e0238c47b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.312325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:23.313178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1686/3346] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:23.334036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1ef5e-a352-4c3c-b25a-a5c5060eff26 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:23.344118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:23.345035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.345776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.346066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] PATH_INFO: `/v3/projects/1c45a1519cee4defa2cf2c971b29b456/users/e211fbf1e8644f95a0c40f705c42531d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.383826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c45a1519cee4defa2cf2c971b29b456, user_id=e211fbf1e8644f95a0c40f705c42531d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:23.386538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.441873 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1661/3347] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:23 2022] PUT /identity/v3/projects/1c45a1519cee4defa2cf2c971b29b456/users/e211fbf1e8644f95a0c40f705c42531d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:23.447265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971677-abd8-43a2-b4d1-987dd4fa8c11 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.447559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971677-abd8-43a2-b4d1-987dd4fa8c11 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.447836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971677-abd8-43a2-b4d1-987dd4fa8c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.478476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c4971677-abd8-43a2-b4d1-987dd4fa8c11 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:23.479789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c4971677-abd8-43a2-b4d1-987dd4fa8c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:23.603737 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1687/3348] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:23.623863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:23.626271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:23.641979 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:23.728622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6496-2919-4efc-a6d8-8fba8ff2362e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:23.733948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dea77-b117-4f01-9218-81eea1a85081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:23.734954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dea77-b117-4f01-9218-81eea1a85081 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:23.735103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dea77-b117-4f01-9218-81eea1a85081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:23.735507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dea77-b117-4f01-9218-81eea1a85081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:23.766968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dea77-b117-4f01-9218-81eea1a85081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:23.769993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dea77-b117-4f01-9218-81eea1a85081 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:23.785577 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1662/3349] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:29.278649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.279525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.279979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.306406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:29.308964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.365870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.375268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.376647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.427037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] MFA Rules not processed for user `dd39c50fe510415a834e941f6d433aef`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:29.428361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.498839 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1688/3350] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:29.527826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:29.529262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.537651 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1663/3351] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:29.557601 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:29.560759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:29.564666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:29.728787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c95714-1fc4-44ea-9a85-d5f6bcf54a38 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:29.737494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3337a1-aa38-4f8b-bcff-abeec1c524ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:29.738993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3337a1-aa38-4f8b-bcff-abeec1c524ad service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.739606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3337a1-aa38-4f8b-bcff-abeec1c524ad service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.740323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3337a1-aa38-4f8b-bcff-abeec1c524ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.759256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3337a1-aa38-4f8b-bcff-abeec1c524ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:29.762185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3337a1-aa38-4f8b-bcff-abeec1c524ad service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:29.775737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938ecd-7873-49ae-96e4-97b970f8fe81 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:29.776665 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1689/3352] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:55:29.783675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:29.784577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:29.784977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:29.785324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:29.857433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:29.861868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:29.937609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1664/3353] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:39.772405 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=28 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:39.923202 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:41.279369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:41.280253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:41.280684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:41.339631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] MFA Rules not processed for user `e211fbf1e8644f95a0c40f705c42531d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:41.341489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:41.509905 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1690/3354] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:41.899091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:41.944739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d4bea-1e9c-4e6e-890b-4cd6d3a8ad42 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:41.976658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:41.977703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:41.979527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:41.982938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:42.072431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:42.086839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:42.209438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1665/3355] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:42.408741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:42.431531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1998a60-a19b-42db-8cad-af294a0be315 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:42.459269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:42.459995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:42.460276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:42.460549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:42.479510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:42.657164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:42.658751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:42.674189 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1691/3356] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:45.421090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:45.423136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:45.468297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec57c94-b9c6-4040-9f30-169632ae5e99 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:45.479354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:45.480558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:45.481177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:45.481605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] PATH_INFO: `/v3/users/8b25774c24e3411b91794b8fb73c9da8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:45.493318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b25774c24e3411b91794b8fb73c9da8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:45.495668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:45.650354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b25774c24e3411b91794b8fb73c9da8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:45.692031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b25774c24e3411b91794b8fb73c9da8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:45.734367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b25774c24e3411b91794b8fb73c9da8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:45.774237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b25774c24e3411b91794b8fb73c9da8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:45.778698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b25774c24e3411b91794b8fb73c9da8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:45.800409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1666/3357] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:45 2022] DELETE /identity/v3/users/8b25774c24e3411b91794b8fb73c9da8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:55:49.128712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:49.130730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:49.169360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:49.171475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:49.183465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb9c7-2fc1-4553-aaa3-db12fc57e5af service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:49.323429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:49.325827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:49.326263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:49.326594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] PATH_INFO: `/v3/users/87a2664617054e1ba5d6059513911164` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:49.328095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a2664617054e1ba5d6059513911164)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:49.330194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:49.429747 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:49.462811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a2664617054e1ba5d6059513911164'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.463504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a2664617054e1ba5d6059513911164'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.477711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2a13-c938-499c-9085-f586e636e491 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:49.492812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:49.494620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:49.496785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:49.499495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] PATH_INFO: `/v3/projects/9edafb7132564b15a2a49eabf7a42019` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:49.501120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a2664617054e1ba5d6059513911164'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.503674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a2664617054e1ba5d6059513911164'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.504737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edafb7132564b15a2a49eabf7a42019)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:49.514680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:49.523697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-86fc2a82-68c0-42f7-9282-d83198c4cf9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a2664617054e1ba5d6059513911164'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.548576 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1692/3358] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:49 2022] DELETE /identity/v3/users/87a2664617054e1ba5d6059513911164 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:49.657969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edafb7132564b15a2a49eabf7a42019', 'request_id': 'req-91cf4b77-9b24-4466-8c40-bf46f75f8280'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.687092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edafb7132564b15a2a49eabf7a42019', 'request_id': 'req-91cf4b77-9b24-4466-8c40-bf46f75f8280'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.690447 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:49.710309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edafb7132564b15a2a49eabf7a42019', 'request_id': 'req-91cf4b77-9b24-4466-8c40-bf46f75f8280'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.743352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] The token cache is being invalidate because project 9edafb7132564b15a2a49eabf7a42019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:49.743644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.746339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-91cf4b77-9b24-4466-8c40-bf46f75f8280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:49.753784 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1667/3359] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:49 2022] DELETE /identity/v3/projects/9edafb7132564b15a2a49eabf7a42019 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:49.754665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:49.754927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:49.755238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:49.811984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:49.813244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:50.053106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1693/3360] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:50.054188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.054639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.054910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.104803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:50.110161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:50.147436 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1668/3361] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:50.152363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.171271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c69227-923d-40f8-8907-1701b047b136 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.185849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65188173-e067-4074-95ff-d37380527263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.188413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65188173-e067-4074-95ff-d37380527263 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.189462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65188173-e067-4074-95ff-d37380527263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.190624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65188173-e067-4074-95ff-d37380527263 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.193267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65188173-e067-4074-95ff-d37380527263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:50.194381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65188173-e067-4074-95ff-d37380527263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.199779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65188173-e067-4074-95ff-d37380527263 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.251100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.269804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1694/3362] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:50.271746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab321e-d750-406f-b6f4-b25f68845943 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.287849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.288820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.289317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.289836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.291381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.297236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.371439 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1669/3363] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:50 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:55:50.373229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65188173-e067-4074-95ff-d37380527263 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.389359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65188173-e067-4074-95ff-d37380527263 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.500808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.501613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.502416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.502416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.503454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.507569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.551139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.561623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1695/3364] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:50 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:50.562835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.567643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:50.568677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5d54-1bdd-47f7-a36d-11b4d73c24a3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.581123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.582098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.582741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.583182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.585785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.588069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.598223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69875-0913-4844-a29b-8a598a69d3eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.622963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.623793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.624078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.624365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] PATH_INFO: `/v3/projects/777b69fbf63541678476e7e00d2bc4a8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.625860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1670/3365] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:50.630999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777b69fbf63541678476e7e00d2bc4a8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.653831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.659822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.688304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a1806-e3a8-41f1-b2b5-5dfca3278635 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.710064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.710756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.711049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.711324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.712083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.714127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.724269 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:50.736792 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1671/3366] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:50.741966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:50.768916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a6764-d1c8-4675-839a-e86fa6e9e952 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:50.795524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777b69fbf63541678476e7e00d2bc4a8', 'request_id': 'req-f99f3ef1-2b39-4887-be6a-694d29aa7096'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:50.831018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777b69fbf63541678476e7e00d2bc4a8', 'request_id': 'req-f99f3ef1-2b39-4887-be6a-694d29aa7096'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:50.856321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777b69fbf63541678476e7e00d2bc4a8', 'request_id': 'req-f99f3ef1-2b39-4887-be6a-694d29aa7096'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:50.895033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812c3cb-ddc3-435c-a174-5779c2885979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:50.897319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c3cb-ddc3-435c-a174-5779c2885979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.897612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c3cb-ddc3-435c-a174-5779c2885979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.897888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c3cb-ddc3-435c-a174-5779c2885979 admin admin] PATH_INFO: `/v3/projects/4168be2884ab40388299ef1fea92e901/users/e160ed8d8d6e485b9cf0f7df067f9bb1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.901829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] The token cache is being invalidate because project 777b69fbf63541678476e7e00d2bc4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:50.902132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:50.903823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f99f3ef1-2b39-4887-be6a-694d29aa7096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:50.905845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1696/3367] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:50 2022] DELETE /identity/v3/projects/777b69fbf63541678476e7e00d2bc4a8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:50.910599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a320-ed3f-4e6d-8126-60bc619e0a0c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.910898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a320-ed3f-4e6d-8126-60bc619e0a0c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.911488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a320-ed3f-4e6d-8126-60bc619e0a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.920545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812c3cb-ddc3-435c-a174-5779c2885979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4168be2884ab40388299ef1fea92e901, user_id=e160ed8d8d6e485b9cf0f7df067f9bb1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:50.924526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812c3cb-ddc3-435c-a174-5779c2885979 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:50.942733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-80a4a320-ed3f-4e6d-8126-60bc619e0a0c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:50.945419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80a4a320-ed3f-4e6d-8126-60bc619e0a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:50.951830 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1672/3368] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:50 2022] PUT /identity/v3/projects/4168be2884ab40388299ef1fea92e901/users/e160ed8d8d6e485b9cf0f7df067f9bb1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:50.953406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f32be-8547-4627-88f6-5d359367a16c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:50.953813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f32be-8547-4627-88f6-5d359367a16c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:50.954086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f32be-8547-4627-88f6-5d359367a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:50.976368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-616f32be-8547-4627-88f6-5d359367a16c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:50.977362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-616f32be-8547-4627-88f6-5d359367a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:51.078552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1697/3369] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:51.085302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.085684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.085938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.091513 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1673/3370] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:51.103643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f32be-8547-4627-88f6-5d359367a16c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.106633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-616f32be-8547-4627-88f6-5d359367a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:51.114267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:51.116355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:51.135297 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1698/3371] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:51.136522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.145921 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:51.165692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967160a-0451-43df-8601-2c953bcde0aa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.178958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.179650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.179936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.181526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.182277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:51.182611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.184216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.247742 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1699/3372] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:51.260426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.294235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc193e-3e33-4201-a339-d3141afabdd4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.303580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f32be-8547-4627-88f6-5d359367a16c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.317470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.321531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.322540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.323200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.323485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.323766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.324960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.325237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.325967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.332243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.353349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.355464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.376507 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1674/3373] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:55:51.378565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.380730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:51.396331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1700/3374] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:51 2022] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:51.400968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.419079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b77f-6eac-4d93-8b43-119884da0dbb service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.551098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.552604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.554088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.555585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.561120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:51.563690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c428a1-882f-4350-86d8-9fe0cdfebeb8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.573896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.574924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.575244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.575531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.577309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.579315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.608634 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:51.632480 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1701/3375] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:51 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:51.633594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.670652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae808b0-24f7-41a1-885b-334c27380913 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.686021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.686735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.687028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.687309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.693259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.699067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.725811 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1702/3376] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:51.730151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.762776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95bea-cfa4-45f1-b54c-6e9a1a6725ca admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.785682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d8f1-afbb-4aee-adf1-67f0dbf5478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.786587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d8f1-afbb-4aee-adf1-67f0dbf5478c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.786777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.786897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d8f1-afbb-4aee-adf1-67f0dbf5478c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.787712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d8f1-afbb-4aee-adf1-67f0dbf5478c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.788476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d8f1-afbb-4aee-adf1-67f0dbf5478c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.791300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.791633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d8f1-afbb-4aee-adf1-67f0dbf5478c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.813205 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1675/3377] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:51.826202 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1703/3378] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:51.830842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:51.852361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e22bd4-2a12-4c29-a8c9-eef33a2e032d service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:51.867878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:51.873833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.874485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.875748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] PATH_INFO: `/v3/projects/473eed82ddf94aedb049755e3358fbf0/users/a22d9f081e3d44aeb511a68f13f62277/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:51.934356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=473eed82ddf94aedb049755e3358fbf0, user_id=a22d9f081e3d44aeb511a68f13f62277, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:51.939562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:51.994214 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1676/3379] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:51 2022] PUT /identity/v3/projects/473eed82ddf94aedb049755e3358fbf0/users/a22d9f081e3d44aeb511a68f13f62277/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:51.999414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:51.999695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:51.999976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:52.033057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:52.034306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:52.139415 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1704/3380] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:52.286624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:52.407025 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:52.480439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cb2f6-06a0-430a-b9ef-c97959adad6f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:52.494165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04527-f39f-4e92-85e3-8d7e0e1537a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:52.494872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04527-f39f-4e92-85e3-8d7e0e1537a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:52.495159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04527-f39f-4e92-85e3-8d7e0e1537a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:52.495604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04527-f39f-4e92-85e3-8d7e0e1537a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:52.523564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04527-f39f-4e92-85e3-8d7e0e1537a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:52.525312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04527-f39f-4e92-85e3-8d7e0e1537a8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:52.580863 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1677/3381] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:53.716367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:53.718084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:53.740067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706e46-4fd2-4ae8-9668-057396b2e35f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:53.758648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:53.759966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:53.760266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:53.760550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] PATH_INFO: `/v3/users/dd39c50fe510415a834e941f6d433aef` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:53.762010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd39c50fe510415a834e941f6d433aef)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:53.764131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:53.898623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd39c50fe510415a834e941f6d433aef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:53.899383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd39c50fe510415a834e941f6d433aef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:53.920630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd39c50fe510415a834e941f6d433aef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:53.922873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd39c50fe510415a834e941f6d433aef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:53.946487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd39c50fe510415a834e941f6d433aef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:53.988827 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1705/3382] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:53 2022] DELETE /identity/v3/users/dd39c50fe510415a834e941f6d433aef => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:54.175511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5544c-d70d-4a2d-9e23-da0090edf111 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:54.176028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5544c-d70d-4a2d-9e23-da0090edf111 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:54.176124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5544c-d70d-4a2d-9e23-da0090edf111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:54.210676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-20f5544c-d70d-4a2d-9e23-da0090edf111 None None] MFA Rules not processed for user `e211fbf1e8644f95a0c40f705c42531d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:54.211933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20f5544c-d70d-4a2d-9e23-da0090edf111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:54.239685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:54.241339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:54.349195 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1678/3383] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:54.369652 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:54.391005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b9dec-b1fe-4f9c-be96-8bd5f4189cb2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:54.398952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:54.399849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:54.400141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:54.400422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] PATH_INFO: `/v3/projects/37ffec2403734313a6e8f170d31984df` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:54.401670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ffec2403734313a6e8f170d31984df)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:54.404266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:54.504133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ffec2403734313a6e8f170d31984df', 'request_id': 'req-1a7499a8-8afb-482c-b629-0115e45dd719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:54.531709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ffec2403734313a6e8f170d31984df', 'request_id': 'req-1a7499a8-8afb-482c-b629-0115e45dd719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:54.544730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ffec2403734313a6e8f170d31984df', 'request_id': 'req-1a7499a8-8afb-482c-b629-0115e45dd719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:54.588417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] The token cache is being invalidate because project 37ffec2403734313a6e8f170d31984df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:55:54.588796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:54.589615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7499a8-8afb-482c-b629-0115e45dd719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:54.592979 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1706/3384] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:55:54 2022] DELETE /identity/v3/projects/37ffec2403734313a6e8f170d31984df => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:54.597667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:54.598185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:54.598693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:54.628952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:54.630258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:54.726687 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1679/3385] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:54.728456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:54.729266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:54.730290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:54.768061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:54.777954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:54.800578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1707/3386] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:54.806073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:54.825166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6904b01-2356-44db-8d4a-9c576aa9ccef None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:54.840199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:54.841837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:54.843234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:54.844847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:54.846749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:55:54.847836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:54.853090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:54.908754 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1680/3387] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:55:54.909081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:54.919530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc6d01-59fb-4fb2-9bd8-cdceed3df6e2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:54.942634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:54.943684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:54.943684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:54.944503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:54.944602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:54.946554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:55.034707 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1708/3388] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:55:54 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:55.039484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:55.088804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83275e-86a5-4125-af8d-91b8093246b6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:55.254565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:55.257808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:55.258100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:55.258374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:55.261279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:55.264818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:55.302152 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:55.322736 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1681/3389] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:55:55 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:55:55.323689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:55.337164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae90e3-cd74-47de-b264-f7a3482e4e64 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:55.356250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:55.356963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:55.357250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:55.357536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:55.367947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:55.369625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:55.415375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:55.415551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1709/3390] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:55.434327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5a1c0-0bd7-4ed8-91fb-4bf756592b7c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:55.442075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d622454-9c36-4154-b6de-53ccfc776743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:55.443072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d622454-9c36-4154-b6de-53ccfc776743 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:55.444091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d622454-9c36-4154-b6de-53ccfc776743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:55.444539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d622454-9c36-4154-b6de-53ccfc776743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:55.445428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d622454-9c36-4154-b6de-53ccfc776743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:55.447394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d622454-9c36-4154-b6de-53ccfc776743 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:55.478646 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1682/3391] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:55:55.482570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:55.500962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59b438-6667-41db-91cb-923026d45434 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:55.520509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157cd92-b5f8-4eda-8aa6-0930e64efa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:55.524013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157cd92-b5f8-4eda-8aa6-0930e64efa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:55.524360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157cd92-b5f8-4eda-8aa6-0930e64efa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:55.524652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157cd92-b5f8-4eda-8aa6-0930e64efa75 admin admin] PATH_INFO: `/v3/projects/88640cd6665646f8ad2ea2802fb2408f/users/17bc63378aaf4789813a10660a4d7673/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:55.586358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157cd92-b5f8-4eda-8aa6-0930e64efa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88640cd6665646f8ad2ea2802fb2408f, user_id=17bc63378aaf4789813a10660a4d7673, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:55.618361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157cd92-b5f8-4eda-8aa6-0930e64efa75 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:55.701012 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1710/3392] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:55:55 2022] PUT /identity/v3/projects/88640cd6665646f8ad2ea2802fb2408f/users/17bc63378aaf4789813a10660a4d7673/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:55.719393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:55.719703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:55.720059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:55.859160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] MFA Rules not processed for user `17bc63378aaf4789813a10660a4d7673`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:55.859160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:56.026163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1683/3393] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:56.036851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7688b4-5c96-4963-a9fc-180066eac166 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:56.038445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7688b4-5c96-4963-a9fc-180066eac166 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:56.039037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7688b4-5c96-4963-a9fc-180066eac166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:56.072040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7f7688b4-5c96-4963-a9fc-180066eac166 None None] MFA Rules not processed for user `17bc63378aaf4789813a10660a4d7673`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:56.083641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7f7688b4-5c96-4963-a9fc-180066eac166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:56.137127 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1711/3394] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:56.632477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:56.634207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:56.805001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff157-c209-4d40-b171-5e4ed3196a6a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:56.828532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8b9e1-2904-43e9-b5a1-3191f0c4a30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:56.829224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8b9e1-2904-43e9-b5a1-3191f0c4a30c service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:56.829507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8b9e1-2904-43e9-b5a1-3191f0c4a30c service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:56.829783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8b9e1-2904-43e9-b5a1-3191f0c4a30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:56.854258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8b9e1-2904-43e9-b5a1-3191f0c4a30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:56.858927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8b9e1-2904-43e9-b5a1-3191f0c4a30c service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:56.881849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1684/3395] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:56.921665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:56.921941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:56.922306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:56.960186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] MFA Rules not processed for user `17bc63378aaf4789813a10660a4d7673`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:56.961445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:56.979977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1712/3396] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:57.191274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119259ed-3a54-4110-9d3c-86932848822c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:57.191853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119259ed-3a54-4110-9d3c-86932848822c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:57.192281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119259ed-3a54-4110-9d3c-86932848822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:57.251615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-119259ed-3a54-4110-9d3c-86932848822c None None] MFA Rules not processed for user `17bc63378aaf4789813a10660a4d7673`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:57.252867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-119259ed-3a54-4110-9d3c-86932848822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.302968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1685/3397] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:57.339931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:57.341457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.468757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718365d-c9a2-45c0-b38f-6e50c1e0110b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:57.485019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:57.487292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:57.488676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:57.489879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:57.493692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.512858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:57.514599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae78c56-0a74-41cb-b6c4-0e3b461dd064 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:57.530391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1713/3398] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:57.690972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:57.691539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:57.691539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:57.721885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] MFA Rules not processed for user `17bc63378aaf4789813a10660a4d7673`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:57.723524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.732293 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1686/3399] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:55:57.813049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa9b9-8e62-4b1a-951c-b0a806843fb0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:57.813485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa9b9-8e62-4b1a-951c-b0a806843fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:57.813785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa9b9-8e62-4b1a-951c-b0a806843fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:57.820012 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:57.875194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f9bfa9b9-8e62-4b1a-951c-b0a806843fb0 None None] MFA Rules not processed for user `17bc63378aaf4789813a10660a4d7673`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:57.877036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f9bfa9b9-8e62-4b1a-951c-b0a806843fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:57.901140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1714/3400] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:57.919520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:58.065411 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:58.087313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b303b3-7020-4d66-9741-b882eeff7f38 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:58.092705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:58.095292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:58.095652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:58.095937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] PATH_INFO: `/v3/users/17bc63378aaf4789813a10660a4d7673` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:58.097373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bc63378aaf4789813a10660a4d7673)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:58.100255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:58.166264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bc63378aaf4789813a10660a4d7673'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:58.183950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bc63378aaf4789813a10660a4d7673'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:58.194155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bc63378aaf4789813a10660a4d7673'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:58.205502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bc63378aaf4789813a10660a4d7673'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:58.206330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bc63378aaf4789813a10660a4d7673'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:55:58.220321 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1687/3401] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:55:57 2022] DELETE /identity/v3/users/17bc63378aaf4789813a10660a4d7673 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:55:58.222259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:58.222754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:58.223109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:58.244915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:58.246304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:58.380611 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1715/3402] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:58.450333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:58.452712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:58.544818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e36f6-7a1a-4e5d-ab58-7effbc38c36e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:58.549745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc7944-2911-4b85-84d9-23b97a19d0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:58.550610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc7944-2911-4b85-84d9-23b97a19d0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:58.550896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc7944-2911-4b85-84d9-23b97a19d0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:58.551171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc7944-2911-4b85-84d9-23b97a19d0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:58.565718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc7944-2911-4b85-84d9-23b97a19d0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:58.579996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc7944-2911-4b85-84d9-23b97a19d0e1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:58.610377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1688/3403] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:00.607708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:00.613189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:00.681388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2656e-4952-4e3b-90af-caf8bce261c8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:00.696282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:00.697739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:00.698180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:00.698821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] PATH_INFO: `/v3/projects/88640cd6665646f8ad2ea2802fb2408f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:00.700969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88640cd6665646f8ad2ea2802fb2408f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:00.705318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:00.806402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88640cd6665646f8ad2ea2802fb2408f', 'request_id': 'req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:00.820046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88640cd6665646f8ad2ea2802fb2408f', 'request_id': 'req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:00.830588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88640cd6665646f8ad2ea2802fb2408f', 'request_id': 'req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:00.848505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] The token cache is being invalidate because project 88640cd6665646f8ad2ea2802fb2408f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:00.848505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:00.849123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4ae99fb9-68ac-4ccd-ba8a-99cf3e37eda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:00.866882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1716/3404] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:00 2022] DELETE /identity/v3/projects/88640cd6665646f8ad2ea2802fb2408f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:00.871771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:00.872690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:00.873120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:00.903097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:00.904615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.022079 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1689/3405] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:01.031650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.031949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.032468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.135128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:01.140523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.175432 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1717/3406] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:01.178143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.188576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbd65e-e5bd-4892-8afe-753d56f77e2f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.239777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.243278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.243576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.243858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.245141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:01.245141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.270885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.295130 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:01.325447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1690/3407] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:01.329743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.348163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7c25-d6cf-4f8d-863e-b9778a448668 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.365984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.369224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.369620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.373369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.375491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.383625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.456760 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1718/3408] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:01 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:01.462289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.481232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59b20-4fad-4774-b5ea-818764474ab2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.650359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.651081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.651416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.652151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.652873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.657235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.689142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1691/3409] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:01 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:01.693306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.699908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.705034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.720602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd9562-33a0-4563-800e-ee3b3fcf740a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.737888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.738755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.739150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.739536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.741080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.745954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.777570 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1719/3410] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:01.779665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.789594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.838212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff421cd-1e42-433e-ac49-e8b0fdc6955b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.845007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.845728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.848539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.849223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.852041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:01.879455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.883666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.919097 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1692/3411] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:01.920034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:01.953351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e3b0-de08-4d6a-a55f-830684dcd7f5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:01.960937 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:01.968025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:01.968716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:01.969000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:01.969282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:01.970028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:01.972454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:01.999589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442acc34-0a20-4d1c-9c79-1c52e2a05099 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.008022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190c6b9-625b-4d78-bc00-6d58d4b3f2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.008665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1693/3412] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:02.009653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.009956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190c6b9-625b-4d78-bc00-6d58d4b3f2cb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.010466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190c6b9-625b-4d78-bc00-6d58d4b3f2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.010964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190c6b9-625b-4d78-bc00-6d58d4b3f2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.036805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ee9b-f5c4-44f9-876a-3a6a5d0aae92 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.039483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190c6b9-625b-4d78-bc00-6d58d4b3f2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.055900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190c6b9-625b-4d78-bc00-6d58d4b3f2cb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.064978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.066009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.066358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.066719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] PATH_INFO: `/v3/projects/40deffb43c3e4e66887212d5f04f1cbf/users/f7280287d0694430a75ae054fdc631e2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.074801 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1720/3413] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:02.110230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40deffb43c3e4e66887212d5f04f1cbf, user_id=f7280287d0694430a75ae054fdc631e2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.112935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.144333 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1694/3414] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:02 2022] PUT /identity/v3/projects/40deffb43c3e4e66887212d5f04f1cbf/users/f7280287d0694430a75ae054fdc631e2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:02.145943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.146990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.147342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.176739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:02.178702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:02.325726 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1721/3415] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:02.409989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:02.412935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:02.625687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5fd1b-2e2c-4d44-b2b4-3db46109cf24 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:02.632083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:02.633197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:02.634211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:02.634924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:02.646883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:02.648982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:02.657259 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:02.673713 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1695/3416] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:04.387653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:04.389969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.590389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933c88-67b9-4368-94ff-b92cabe1ac76 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:04.598448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:04.599188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:04.600020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:04.600374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:04.604515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.708440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:04.711008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:04.727646 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1722/3417] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:04.933637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:04.935497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:04.992711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b807-94b8-4960-892c-9a17601a5438 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.012171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.012862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.014878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.016643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.024328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:05.060767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.062386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.079440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:05.097110 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1696/3418] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:05.106769 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:05.127944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5dc0-2385-43ec-beba-b2090f55de45 service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:05.148335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:05.151581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:05.152223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:05.152751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:05.159229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:05.185679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:05.187404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05004-b115-4cf7-aa28-a3889c8b6afc service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:05.203375 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1723/3419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:06.531072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:06.545549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac397d-bcb5-4b37-bfd9-5d5a32cf3160 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:06.564945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:06.566203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:06.566517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:06.566798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:06.576306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:06.702267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:06.704583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a209c-f69e-4859-ad0e-f1693d7b9caf service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:06.731074 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1697/3420] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:07.445911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.447817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.448387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.530142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:07.534074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:07.702222 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1724/3421] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:07.716469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e5f41-743d-45f2-82bc-71d3cad86366 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.718354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e5f41-743d-45f2-82bc-71d3cad86366 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.719307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e5f41-743d-45f2-82bc-71d3cad86366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:07.744161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fe3e5f41-743d-45f2-82bc-71d3cad86366 None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:07.745498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe3e5f41-743d-45f2-82bc-71d3cad86366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:07.771623 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1698/3422] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:07.969602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:07.986694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec3f5-4760-4fd5-9659-592860f7e020 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:07.994596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e50b01-c808-4b0a-b710-e1a236860a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:07.995361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50b01-c808-4b0a-b710-e1a236860a50 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:07.995748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50b01-c808-4b0a-b710-e1a236860a50 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:07.996738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50b01-c808-4b0a-b710-e1a236860a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.018687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e50b01-c808-4b0a-b710-e1a236860a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:08.021807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e50b01-c808-4b0a-b710-e1a236860a50 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:08.048660 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1725/3423] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:08.219113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:08.219665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:08.220193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.344461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] MFA Rules not processed for user `e160ed8d8d6e485b9cf0f7df067f9bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:08.345740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:08.610671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1699/3424] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:08.621281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08265a-1ad4-4976-a5bc-4d8297e16648 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:08.621828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08265a-1ad4-4976-a5bc-4d8297e16648 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:08.621955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08265a-1ad4-4976-a5bc-4d8297e16648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:08.653031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8c08265a-1ad4-4976-a5bc-4d8297e16648 None None] MFA Rules not processed for user `e160ed8d8d6e485b9cf0f7df067f9bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:08.654407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c08265a-1ad4-4976-a5bc-4d8297e16648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:08.684565 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1726/3425] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:09.536411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:09.556993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7e26d-4138-490a-8aa1-2abe10362fda None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:09.589581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ca347-6fb4-49b5-ac0e-79edc385604b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:09.590605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ca347-6fb4-49b5-ac0e-79edc385604b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:09.591757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ca347-6fb4-49b5-ac0e-79edc385604b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:09.593892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ca347-6fb4-49b5-ac0e-79edc385604b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:09.624289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ca347-6fb4-49b5-ac0e-79edc385604b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:09.626910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ca347-6fb4-49b5-ac0e-79edc385604b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:09.650675 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1700/3426] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:11.369498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013c3a-4d69-410c-b944-1024cb85975c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:11.372729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013c3a-4d69-410c-b944-1024cb85975c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:11.373145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013c3a-4d69-410c-b944-1024cb85975c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:11.378804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1727/3427] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:56:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:56:11.387488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:11.387931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:11.388296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:11.435178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:11.438344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:11.564086 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:11.619483 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1701/3428] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:11.647368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb013c3a-4d69-410c-b944-1024cb85975c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:11.650405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fb013c3a-4d69-410c-b944-1024cb85975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:11.689077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb013c3a-4d69-410c-b944-1024cb85975c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:11.709671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede747a-59bd-4c09-8720-5a558cd8b386 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:11.711947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede747a-59bd-4c09-8720-5a558cd8b386 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:11.712737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede747a-59bd-4c09-8720-5a558cd8b386 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:11.713189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede747a-59bd-4c09-8720-5a558cd8b386 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:11.735030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede747a-59bd-4c09-8720-5a558cd8b386 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:11.738956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede747a-59bd-4c09-8720-5a558cd8b386 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:11.759918 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1728/3429] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:12.214753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:12.216571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:12.242844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fffdf-50e4-4755-a04c-efffc064417e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:12.263261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:12.263960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:12.264251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:12.264533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:12.271764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:12.302011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:12.307325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:12.353876 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1702/3430] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:13.504867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:13.506009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:13.506009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:13.633139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:13.634389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:13.853763 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1729/3431] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:13.868942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:13.871048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:14.190587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbe730-42e9-44d4-be34-fafdb2bbd7de service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:14.199168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3c8d-8d5a-4afa-b20c-e90fd193bb07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:14.200372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3c8d-8d5a-4afa-b20c-e90fd193bb07 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:14.200649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3c8d-8d5a-4afa-b20c-e90fd193bb07 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:14.200930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3c8d-8d5a-4afa-b20c-e90fd193bb07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:14.217776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3c8d-8d5a-4afa-b20c-e90fd193bb07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:14.220909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3c8d-8d5a-4afa-b20c-e90fd193bb07 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:14.236855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1703/3432] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:56:21.021069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:21.035129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebf73-3cbd-4188-a44e-6b1c2ca9c08c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:21.054349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:21.055137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:21.055501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:21.055875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:21.066785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:21.087489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:21.089218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524deff-bbe5-4a7f-9727-f89f7e8a3625 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:21.109504 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1730/3433] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:22.190232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:22.190750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:22.191017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:22.281389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] MFA Rules not processed for user `f7280287d0694430a75ae054fdc631e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:22.291317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:22.472915 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1704/3434] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:22.483326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:22.484713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:22.484713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:22.507459 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:22.519336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] MFA Rules not processed for user `f7280287d0694430a75ae054fdc631e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:22.523205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:22.543413 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1731/3435] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:22.585730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:22.587550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:22.627276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b74b1-34aa-436a-a0f0-77f03e58b1ed None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:22.643622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:22.644299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:22.644682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:22.644881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:22.665289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:22.668500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:22.704872 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1705/3436] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:24.602518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:24.627640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e719c3-959c-4fff-92a0-ab64895b8e4e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:24.653741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:24.654751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:24.655370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:24.655801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:24.664349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:24.710431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:24.714093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:24.758471 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1732/3437] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:25.964653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:26.008522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30324c-d9f9-4215-a271-4cdc1ab8c07a service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:26.049139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:26.054980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:26.058128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:26.059843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:26.065096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:26.126114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:26.134448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:26.183930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1706/3438] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:30.948350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:30.973750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6b84-d45a-4bab-8772-8f106c2a72bc service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:30.989534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:30.990563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:30.991081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:30.991541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:30.997219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:31.034969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:31.036948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:31.080401 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1733/3439] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:32.638976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:32.640437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:32.660275 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:32.671740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7be72-2736-4034-ae1b-2b0175590211 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:32.696159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:32.697041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:32.697326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:32.697604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] PATH_INFO: `/v3/users/812aa819ccb64ebd96cce7a991010268` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:32.700970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=812aa819ccb64ebd96cce7a991010268)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:32.707597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:32.819565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812aa819ccb64ebd96cce7a991010268'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:32.847387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812aa819ccb64ebd96cce7a991010268'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:32.870794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812aa819ccb64ebd96cce7a991010268'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:32.884111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812aa819ccb64ebd96cce7a991010268'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:32.884983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6fd4bced-7d3b-4287-8f78-ed0c10744edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812aa819ccb64ebd96cce7a991010268'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:32.897037 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1707/3440] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:32 2022] DELETE /identity/v3/users/812aa819ccb64ebd96cce7a991010268 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:33.391012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:33.411816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b740b2-1c40-4c97-83ef-aacb9b7e3ae5 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:33.564933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:33.566435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:33.566986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:33.568184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] PATH_INFO: `/v3/projects/26a1b7e9b12045f49a90510bc57ff5ca` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:33.570040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a1b7e9b12045f49a90510bc57ff5ca)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:33.574102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:33.713503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a1b7e9b12045f49a90510bc57ff5ca', 'request_id': 'req-855edafe-acef-4502-9abe-02b3728bce10'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:33.747094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a1b7e9b12045f49a90510bc57ff5ca', 'request_id': 'req-855edafe-acef-4502-9abe-02b3728bce10'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:33.769269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a1b7e9b12045f49a90510bc57ff5ca', 'request_id': 'req-855edafe-acef-4502-9abe-02b3728bce10'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:33.809065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] The token cache is being invalidate because project 26a1b7e9b12045f49a90510bc57ff5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:33.809665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:33.810530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-855edafe-acef-4502-9abe-02b3728bce10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:33.817153 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1734/3441] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:33 2022] DELETE /identity/v3/projects/26a1b7e9b12045f49a90510bc57ff5ca => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:33.818334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37affd64-cfef-436c-8371-db1051be745a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:33.818823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37affd64-cfef-436c-8371-db1051be745a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:33.819063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37affd64-cfef-436c-8371-db1051be745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:33.852186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-37affd64-cfef-436c-8371-db1051be745a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:33.857847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37affd64-cfef-436c-8371-db1051be745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.007036 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1708/3442] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:34.017017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.017555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.017979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.040806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:34.043311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.087879 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1735/3443] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:34.089057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37affd64-cfef-436c-8371-db1051be745a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.111692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37affd64-cfef-436c-8371-db1051be745a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:34.119553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:34.120624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.121182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.121639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.122647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:34.123151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:34.126563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e09e91-986e-4a2e-8b17-608b1cd54ed7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:34.164196 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1709/3444] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:34.164660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.184154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f856f-989a-461d-b3b0-18976efce743 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:34.196048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:34.197032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.197500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.197929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.200772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:34.202739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:34.244214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce34b01-02cb-4055-9928-f3f9f0c53609 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.244631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce34b01-02cb-4055-9928-f3f9f0c53609 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.245024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce34b01-02cb-4055-9928-f3f9f0c53609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.287603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0ce34b01-02cb-4055-9928-f3f9f0c53609 None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:34.289062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ce34b01-02cb-4055-9928-f3f9f0c53609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.298125 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1736/3445] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:34.299355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.367335 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:34.376676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1710/3446] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:34.438871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c554-f60d-42cf-b761-133b33186d1c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:34.443476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.443476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.443900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.451009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:34.451962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.453068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.453685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.455567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:34.458506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:34.498991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:34.500836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.515227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1737/3447] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:34.516259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.517744 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:34.547664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc0265-8ff2-4a20-9db5-4c84b293b8d3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:34.559359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:34.560760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.561122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.561478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.562937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:34.565053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:34.581548 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1738/3448] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:34.589286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.635530 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1711/3449] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:34.642681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8dbb-dfd3-4b7b-be0a-8ccab12675db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:34.658695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eff2e-14c4-4f57-8411-1e8185c10234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:34.666559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eff2e-14c4-4f57-8411-1e8185c10234 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.667980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eff2e-14c4-4f57-8411-1e8185c10234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.668369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eff2e-14c4-4f57-8411-1e8185c10234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.673995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eff2e-14c4-4f57-8411-1e8185c10234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:34.678433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eff2e-14c4-4f57-8411-1e8185c10234 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:34.709848 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1739/3450] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:34.710318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.718534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b879-d376-46bb-9edb-bff846e4f9d2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:34.720463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a415856-8131-4316-bd2d-1891c3ccc135 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.720945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a415856-8131-4316-bd2d-1891c3ccc135 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.721428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a415856-8131-4316-bd2d-1891c3ccc135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.724531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f710c-4c3f-40d4-9067-792acafe2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:34.725640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f710c-4c3f-40d4-9067-792acafe2c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.726058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f710c-4c3f-40d4-9067-792acafe2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.726402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f710c-4c3f-40d4-9067-792acafe2c03 admin admin] PATH_INFO: `/v3/projects/ab831cad9f1e4ffdbbc871744a87c99a/users/832ffd94ca494d889319abe2a2dd3fd3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.744510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8a415856-8131-4316-bd2d-1891c3ccc135 None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:34.746623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8a415856-8131-4316-bd2d-1891c3ccc135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.750436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f710c-4c3f-40d4-9067-792acafe2c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab831cad9f1e4ffdbbc871744a87c99a, user_id=832ffd94ca494d889319abe2a2dd3fd3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:34.754226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f710c-4c3f-40d4-9067-792acafe2c03 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:34.757030 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1740/3451] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:34.779437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1712/3452] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:34 2022] PUT /identity/v3/projects/ab831cad9f1e4ffdbbc871744a87c99a/users/832ffd94ca494d889319abe2a2dd3fd3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:34.782922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.783522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.784021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.790843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e255a3-45b5-4950-9699-3dc5ff75bec1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.791315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e255a3-45b5-4950-9699-3dc5ff75bec1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.791516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e255a3-45b5-4950-9699-3dc5ff75bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.813250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-80e255a3-45b5-4950-9699-3dc5ff75bec1 None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:34.814693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80e255a3-45b5-4950-9699-3dc5ff75bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.815753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:34.821107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:34.913768 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1713/3453] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:34.934011 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1741/3454] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:34.966123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:34.966440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:34.966856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:34.972947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:34.974440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:35.000484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] MFA Rules not processed for user `a22d9f081e3d44aeb511a68f13f62277`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:35.002701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:35.034588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1714/3455] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:35.097522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0237de-8446-40a5-9fdd-71c58ef57010 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:35.101027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27396619-40c4-4d48-b8b8-6b7d9c0d743d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:35.101722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396619-40c4-4d48-b8b8-6b7d9c0d743d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:35.102012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396619-40c4-4d48-b8b8-6b7d9c0d743d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:35.102374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396619-40c4-4d48-b8b8-6b7d9c0d743d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:35.116965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27396619-40c4-4d48-b8b8-6b7d9c0d743d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:35.118800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27396619-40c4-4d48-b8b8-6b7d9c0d743d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:35.152027 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1742/3456] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:37.827319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:37.828777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:37.854331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df4638-f09b-4b9a-ab72-ea70daa895cf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:37.870038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:37.871289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:37.871573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:37.871850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] PATH_INFO: `/v3/users/55e38f4c2a814efab3873507d136dda8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:37.873161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e38f4c2a814efab3873507d136dda8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:37.890100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:37.991995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e38f4c2a814efab3873507d136dda8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:38.014402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e38f4c2a814efab3873507d136dda8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:38.088576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e38f4c2a814efab3873507d136dda8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:38.107719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e38f4c2a814efab3873507d136dda8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:38.108429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e38f4c2a814efab3873507d136dda8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:38.112164 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:38.126864 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1715/3457] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:37 2022] DELETE /identity/v3/users/55e38f4c2a814efab3873507d136dda8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:38.128483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:38.128983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:38.129069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:38.163904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:38.167759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:38.248354 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:38.315606 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1743/3458] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:38.332602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:38.337948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:38.450038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a7a96-5f34-49fa-af8d-203e23fb6b94 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:38.457985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:38.461841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:38.462728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:38.463096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:38.483033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:38.485114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:38.508969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1716/3459] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:56:39.076816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.079049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.096968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7f6b1-1a38-4cc1-889b-387715619939 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.105171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:39.106306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.109467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.109467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] PATH_INFO: `/v3/projects/57e75af784304a4b84a72531faa44111` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.111061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e75af784304a4b84a72531faa44111)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:39.114588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:39.187379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e75af784304a4b84a72531faa44111', 'request_id': 'req-a6bc0f4e-38ca-4563-bc4f-dac401c348da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.200478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e75af784304a4b84a72531faa44111', 'request_id': 'req-a6bc0f4e-38ca-4563-bc4f-dac401c348da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.210776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e75af784304a4b84a72531faa44111', 'request_id': 'req-a6bc0f4e-38ca-4563-bc4f-dac401c348da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.241119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] The token cache is being invalidate because project 57e75af784304a4b84a72531faa44111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:39.241489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.242289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.247891 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1744/3460] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:39 2022] DELETE /identity/v3/projects/57e75af784304a4b84a72531faa44111 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:39.249386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.264262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffbe9-95e7-4e42-8154-502aa270efd9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.362072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:39.363244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.363648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.364070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] PATH_INFO: `/v3/users/57e9c1ef0cdd47348b85fd6be6b6f484` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.366341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e9c1ef0cdd47348b85fd6be6b6f484)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:39.368450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:39.489653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e9c1ef0cdd47348b85fd6be6b6f484'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.518735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e9c1ef0cdd47348b85fd6be6b6f484'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.557375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e9c1ef0cdd47348b85fd6be6b6f484'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.571095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e9c1ef0cdd47348b85fd6be6b6f484'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.571840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c471df78-b7f3-49d5-95f5-f35c328697b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e9c1ef0cdd47348b85fd6be6b6f484'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:39.587696 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1717/3461] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:39 2022] DELETE /identity/v3/users/57e9c1ef0cdd47348b85fd6be6b6f484 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:39.839491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:39.842122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:39.865469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0f4e-38ca-4563-bc4f-dac401c348da admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:39.939494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:39.940392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:39.940677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:39.941632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] PATH_INFO: `/v3/projects/dab99adf73684625af3e04b7604e80ca` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:39.943486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab99adf73684625af3e04b7604e80ca)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:39.946273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.008830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab99adf73684625af3e04b7604e80ca', 'request_id': 'req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:40.018846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab99adf73684625af3e04b7604e80ca', 'request_id': 'req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:40.047733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab99adf73684625af3e04b7604e80ca', 'request_id': 'req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:40.047733 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:40.074974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] The token cache is being invalidate because project dab99adf73684625af3e04b7604e80ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:40.074974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:40.075207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-26b59a40-c41f-4eae-b4bc-3bc85f5b4734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:40.084377 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1745/3462] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:39 2022] DELETE /identity/v3/projects/dab99adf73684625af3e04b7604e80ca => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:40.085683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc03f-c3e5-4830-afc1-d85fea817f4d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.086255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc03f-c3e5-4830-afc1-d85fea817f4d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.086756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc03f-c3e5-4830-afc1-d85fea817f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.088368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.089801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.090112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.111723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-00fbc03f-c3e5-4830-afc1-d85fea817f4d None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:40.114396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00fbc03f-c3e5-4830-afc1-d85fea817f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.139699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:40.140828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.143551 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:40.227282 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1718/3463] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:40.242566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1746/3464] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:40.258600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.259101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.259213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.261397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.263991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.311732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:40.313005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:40.340353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1719/3465] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:40.344738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.356449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a7c0e-43f0-450d-92ae-7daecdf1f31a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.361518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.362306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.362661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.363008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.364564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:40.364938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.366724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.401121 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1720/3466] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:56:40.404988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.416840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21652e9d-0f41-437e-8e92-39551f43d6fa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.417994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc1cb-2916-4971-8209-91ac04d927f8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.437174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.438230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.438524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.438655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.439151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.439746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.441203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.441695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.442782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.444156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.461153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.463653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.488271 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1747/3467] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:56:40.504671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1721/3468] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:40.521683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.547996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017b1b-006a-4798-8d13-ba79a783bb41 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.733471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.734632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.735095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.735617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.736989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.748598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.817189 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1748/3469] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:40 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:40.828772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.844931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825259-be75-4d3b-adf3-2e33f12ab7cc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.866469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.868005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.870775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.873549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.877222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.896879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:40.928676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:40.940951 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1722/3470] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:40.943617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0205-0a17-4b2d-8241-722615d9f7a4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:40.975094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6db3da-745e-4745-b467-9770c415a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:40.975801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db3da-745e-4745-b467-9770c415a1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:40.976089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db3da-745e-4745-b467-9770c415a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:40.979032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db3da-745e-4745-b467-9770c415a1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:40.979838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6db3da-745e-4745-b467-9770c415a1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:40.983416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6db3da-745e-4745-b467-9770c415a1f1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.007900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.020942 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1749/3471] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:41.023938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed9a7-8a08-43df-be46-5d6907fac20f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.030865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.031878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.032225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.032564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] PATH_INFO: `/v3/projects/d73b3f6ec50d40ce85671178a8903ee9/users/f9b1d5590dd2426083844dcc6e93c6af/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.055431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73b3f6ec50d40ce85671178a8903ee9, user_id=f9b1d5590dd2426083844dcc6e93c6af, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.059621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.111062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1723/3472] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:41 2022] PUT /identity/v3/projects/d73b3f6ec50d40ce85671178a8903ee9/users/f9b1d5590dd2426083844dcc6e93c6af/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:41.118162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.118785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.119066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.127157 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:41.167020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] MFA Rules not processed for user `f9b1d5590dd2426083844dcc6e93c6af`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:41.168666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:41.270647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1750/3473] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:41.275444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.352183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dec37d-3d4d-443d-ae4c-8062da9502ff admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.363485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.364388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.364843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.365126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.365974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.368187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.422112 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1724/3474] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:41.426007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.456310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b696-111d-44d6-b7fc-ffbb35c4220a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.572372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.573197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.573615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.573967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.575377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.579081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.626939 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1751/3475] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:41 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:41.631630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.688936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4274b12-d35e-4cfe-8b38-83d5b2904670 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.705187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.706159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.708119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.708573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.712070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.713930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.737597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1725/3476] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:41.739293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.757307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d8be-149b-4369-a60a-b7ce0d92e9ea admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.777295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.778307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.778721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.779097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] PATH_INFO: `/v3/projects/4665e989891d4da1a1c42f993eb81674/users/6e788ca522a0419d889e09138fd66b68/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.809084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4665e989891d4da1a1c42f993eb81674, user_id=6e788ca522a0419d889e09138fd66b68, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.812870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.854743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1752/3477] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:41 2022] PUT /identity/v3/projects/4665e989891d4da1a1c42f993eb81674/users/6e788ca522a0419d889e09138fd66b68/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:56:41.858866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:41.875911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec2264-fce0-4d8b-803a-a4a6ecaa082e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:41.925929 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:41.977024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d154-16d7-4c0a-ba25-934e4f922bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:41.977738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d154-16d7-4c0a-ba25-934e4f922bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:41.978026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d154-16d7-4c0a-ba25-934e4f922bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:41.978465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d154-16d7-4c0a-ba25-934e4f922bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:41.979398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4d154-16d7-4c0a-ba25-934e4f922bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:41.981063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4d154-16d7-4c0a-ba25-934e4f922bdd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:41.994169 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1726/3478] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:41.998244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.009591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea655-f21b-45d0-a42d-d0db7b486b21 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.021655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.023538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.023703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.023986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] PATH_INFO: `/v3/projects/4665e989891d4da1a1c42f993eb81674/users/6e788ca522a0419d889e09138fd66b68/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.026229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4665e989891d4da1a1c42f993eb81674, user_id=6e788ca522a0419d889e09138fd66b68, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.029002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.046627 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1753/3479] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:41 2022] PUT /identity/v3/projects/4665e989891d4da1a1c42f993eb81674/users/6e788ca522a0419d889e09138fd66b68/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:42.057820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464269c9-28ad-491d-998a-b4468d2c85bb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.058173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464269c9-28ad-491d-998a-b4468d2c85bb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.058463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464269c9-28ad-491d-998a-b4468d2c85bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.103102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-464269c9-28ad-491d-998a-b4468d2c85bb None None] MFA Rules not processed for user `6e788ca522a0419d889e09138fd66b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:42.104504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-464269c9-28ad-491d-998a-b4468d2c85bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.231616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1727/3480] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:42.241023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.373856 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:42.432254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e781ef4-5d9a-4f5d-910e-6d5b8364efdb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.453052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.453963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.454259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.454566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] PATH_INFO: `/v3/users/f9b1d5590dd2426083844dcc6e93c6af` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.461862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b1d5590dd2426083844dcc6e93c6af)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:42.468763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:42.569819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b1d5590dd2426083844dcc6e93c6af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:42.570443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b1d5590dd2426083844dcc6e93c6af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:42.591624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b1d5590dd2426083844dcc6e93c6af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:42.593887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b1d5590dd2426083844dcc6e93c6af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:42.613766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b1d5590dd2426083844dcc6e93c6af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:42.649111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1754/3481] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:42 2022] DELETE /identity/v3/users/f9b1d5590dd2426083844dcc6e93c6af => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:42.650662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.651244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.652561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:42.677252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:42.678819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.800046 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1728/3482] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:42.830591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:42.832038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:42.967891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444136a-0238-480e-95fb-a2a8ba2d8382 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:42.980900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:42.982822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:42.984271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:42.985317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:43.000770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:43.003120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:43.030180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1755/3483] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:44.235706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:44.237208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:44.285486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ea933-c81f-4c67-b5e0-86595732195c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:44.290653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:44.298033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:44.298656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:44.299162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] PATH_INFO: `/v3/projects/d73b3f6ec50d40ce85671178a8903ee9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:44.300809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73b3f6ec50d40ce85671178a8903ee9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:44.302947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:44.381591 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:44.400148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73b3f6ec50d40ce85671178a8903ee9', 'request_id': 'req-c867c991-db47-4874-8830-df70687854f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.411957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73b3f6ec50d40ce85671178a8903ee9', 'request_id': 'req-c867c991-db47-4874-8830-df70687854f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.432525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73b3f6ec50d40ce85671178a8903ee9', 'request_id': 'req-c867c991-db47-4874-8830-df70687854f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.452703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] The token cache is being invalidate because project d73b3f6ec50d40ce85671178a8903ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:44.453347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.454701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c867c991-db47-4874-8830-df70687854f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.458246 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1729/3484] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:44 2022] DELETE /identity/v3/projects/d73b3f6ec50d40ce85671178a8903ee9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:44.461921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:44.474731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca9baa-898f-48c3-ab27-4e90ada4bbad service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:44.595680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:44.597419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:44.598039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:44.600332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d970bd-7cc5-402a-b60c-1ec6e3d5f43e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:44.600929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d970bd-7cc5-402a-b60c-1ec6e3d5f43e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:44.602194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d970bd-7cc5-402a-b60c-1ec6e3d5f43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:44.608942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] PATH_INFO: `/v3/users/6e788ca522a0419d889e09138fd66b68` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:44.615988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e788ca522a0419d889e09138fd66b68)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:44.618916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:44.635566 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:44.667964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d4d970bd-7cc5-402a-b60c-1ec6e3d5f43e None None] MFA Rules not processed for user `832ffd94ca494d889319abe2a2dd3fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:44.669233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4d970bd-7cc5-402a-b60c-1ec6e3d5f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:44.714187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e788ca522a0419d889e09138fd66b68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.715729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e788ca522a0419d889e09138fd66b68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.749188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e788ca522a0419d889e09138fd66b68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.749990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e788ca522a0419d889e09138fd66b68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.776810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e788ca522a0419d889e09138fd66b68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:44.798962 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1730/3485] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:44.810665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:44.810871 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1756/3486] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:44 2022] DELETE /identity/v3/users/6e788ca522a0419d889e09138fd66b68 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:44.810969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:44.810969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:44.833521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] MFA Rules not processed for user `832ffd94ca494d889319abe2a2dd3fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:44.836163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:44.928170 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1731/3487] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:45.068177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.073724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.240600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b2c5-6e08-4056-b127-a132f9fd840a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.250959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:45.251768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.252116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.252613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.281014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:45.282614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:45.307001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1757/3488] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:45.436724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.438240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.565114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081db66-ad4a-48a7-ae58-72cf52d51c85 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.572175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:45.573065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.573628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.573770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] PATH_INFO: `/v3/projects/4665e989891d4da1a1c42f993eb81674` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.575325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4665e989891d4da1a1c42f993eb81674)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:45.582823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:45.591999 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:45.691242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4665e989891d4da1a1c42f993eb81674', 'request_id': 'req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.708631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4665e989891d4da1a1c42f993eb81674', 'request_id': 'req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.730638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4665e989891d4da1a1c42f993eb81674', 'request_id': 'req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.744136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] The token cache is being invalidate because project 4665e989891d4da1a1c42f993eb81674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:45.744540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.746078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ebd188-a6ef-4166-b1bc-980cdee41c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:45.747955 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1732/3489] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:45 2022] DELETE /identity/v3/projects/4665e989891d4da1a1c42f993eb81674 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:45.749418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.753078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.756635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d376b-e49e-4f0b-9225-07b313c7cb76 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.757195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d376b-e49e-4f0b-9225-07b313c7cb76 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.757690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d376b-e49e-4f0b-9225-07b313c7cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.779625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-546d376b-e49e-4f0b-9225-07b313c7cb76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:45.781021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-546d376b-e49e-4f0b-9225-07b313c7cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.876941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda68b-4c36-471b-9601-3c8b887feab0 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.891895 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1733/3490] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:45.894377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.894727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.895667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:45.928603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:45.932785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:45.944819 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:45.963122 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1734/3491] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:45.965293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:45.976613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a9d90-7774-4d0a-aa93-8b3f7eba84a6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:45.996555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:45.998021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:45.998580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:45.999083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.001287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:46.006794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.008076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.008424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.008757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.010867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:46.012104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.013920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.017509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.019727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.040526 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1735/3492] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:46.041454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.046568 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1758/3493] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:46.070706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7c04-dabe-4791-92c4-fa96c5f0d616 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.081499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.083548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.084054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.084425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.085209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.087737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.148447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1736/3494] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:46.150027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.170173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25019-9d30-4b23-a8c3-c210de9ecf20 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.362662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.363386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.364197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.364477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.365183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.370370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.443189 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1759/3495] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:46 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:46.447880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.467186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b8db-561a-4f60-a580-4bd560e68a10 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.476057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.476925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.477314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.477743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.488383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.488383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.497597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1737/3496] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:46.501681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.516144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a50c9f-58dc-47bb-864e-65aa746238f2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.523145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4345a-cea8-4e25-99e5-64487d0af047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.523883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4345a-cea8-4e25-99e5-64487d0af047 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.524223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4345a-cea8-4e25-99e5-64487d0af047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.524652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4345a-cea8-4e25-99e5-64487d0af047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.525679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4345a-cea8-4e25-99e5-64487d0af047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.527459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4345a-cea8-4e25-99e5-64487d0af047 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.542943 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1760/3497] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:46.544666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.567893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e82f1e-594c-4ee5-8587-9b0d645e1ff0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:46.577433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:46.579750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.580110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.580412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] PATH_INFO: `/v3/projects/c149e19843a64c8a91d342e8449e80ad/users/0e78e24929f447249783722dbd04d342/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.617372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c149e19843a64c8a91d342e8449e80ad, user_id=0e78e24929f447249783722dbd04d342, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:46.620786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:46.644870 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1738/3498] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:46 2022] PUT /identity/v3/projects/c149e19843a64c8a91d342e8449e80ad/users/0e78e24929f447249783722dbd04d342/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:46.646015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:46.646790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:46.647408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:46.729187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:46.734679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:46.984276 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1761/3499] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:46.995227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:46.998664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:47.064806 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:47.154331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298cbb9-d978-4bb4-9835-bd23df25205d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:47.158735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:47.159612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:47.160050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:47.160532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:47.174912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:47.177434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:47.189740 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1739/3500] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:53.229725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:53.233106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:53.257129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a37b-0c3f-4a0a-8286-03e7e0c2b8bc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:53.269349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:53.274456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:53.275110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:53.275601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] PATH_INFO: `/v3/users/a22d9f081e3d44aeb511a68f13f62277` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:53.279064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22d9f081e3d44aeb511a68f13f62277)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:53.283011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:53.379453 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:53.386938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22d9f081e3d44aeb511a68f13f62277'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.388538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22d9f081e3d44aeb511a68f13f62277'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.411413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22d9f081e3d44aeb511a68f13f62277'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.412363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22d9f081e3d44aeb511a68f13f62277'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.424158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-05a03987-89b0-493b-9236-e7075508a5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22d9f081e3d44aeb511a68f13f62277'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.465254 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1762/3501] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:53 2022] DELETE /identity/v3/users/a22d9f081e3d44aeb511a68f13f62277 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:54.853118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.866704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1693-15b9-416d-b1f1-944172ac5896 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.942183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.943264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.943603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.943951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] PATH_INFO: `/v3/projects/473eed82ddf94aedb049755e3358fbf0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.945455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] RBAC: Authorizing `identity:delete_project(project_id=473eed82ddf94aedb049755e3358fbf0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.947657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.056339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473eed82ddf94aedb049755e3358fbf0', 'request_id': 'req-725483a4-f8c2-4588-85a8-2a676e42269e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.066899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473eed82ddf94aedb049755e3358fbf0', 'request_id': 'req-725483a4-f8c2-4588-85a8-2a676e42269e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.080344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473eed82ddf94aedb049755e3358fbf0', 'request_id': 'req-725483a4-f8c2-4588-85a8-2a676e42269e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.104334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] The token cache is being invalidate because project 473eed82ddf94aedb049755e3358fbf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:55.106079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.107740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-725483a4-f8c2-4588-85a8-2a676e42269e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:55.115210 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1740/3502] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:54 2022] DELETE /identity/v3/projects/473eed82ddf94aedb049755e3358fbf0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:55.117893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.117893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.118447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.139914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.141155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.217682 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1763/3503] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:55.227929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.227929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.228192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.250946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.252188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.262538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1741/3504] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:55.265796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.280204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232cda-86c9-4899-8c08-ea0bd0d3ae54 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.286810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.287684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.288231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.288833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.289682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:55.290099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.291867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.310306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1764/3505] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:55.311976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.327379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956116d-af7c-44dc-b856-edc97a8123b1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.333810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.334523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.335381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.335381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.335935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.338400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.376800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1742/3506] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/projects => generated 395 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:55.380802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.395950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ac62-7507-4c56-a87c-67fe427219cb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.501152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.502110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.502530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.503637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.505328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.507745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.534668 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1765/3507] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:55.537297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.548354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359aa13-2bc7-49be-92b3-4058e8c9bcd1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.555692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.556377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.556667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.556955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.557906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.559385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.574813 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1743/3508] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:55.576088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.588965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e35be1-4055-47d9-b388-5ea49a4713df admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.595766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca5bc-0629-4545-89b7-a3b02a59ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.596646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca5bc-0629-4545-89b7-a3b02a59ad99 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.597002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca5bc-0629-4545-89b7-a3b02a59ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.598401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca5bc-0629-4545-89b7-a3b02a59ad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.598761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ca5bc-0629-4545-89b7-a3b02a59ad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.600573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ca5bc-0629-4545-89b7-a3b02a59ad99 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.618251 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1766/3509] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:56:55.619499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.652880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edff4fa-a5da-40bc-b08b-439d5e517e47 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.662669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.663976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.664607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.665680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] PATH_INFO: `/v3/projects/4029e4d2dd2343bb8ad84763db25befe/users/1a48db2b71e046eeb90bb5fc9bd450c6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.677099 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:55.693058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4029e4d2dd2343bb8ad84763db25befe, user_id=1a48db2b71e046eeb90bb5fc9bd450c6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.695789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.725673 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1744/3510] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:55 2022] PUT /identity/v3/projects/4029e4d2dd2343bb8ad84763db25befe/users/1a48db2b71e046eeb90bb5fc9bd450c6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:55.730724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5a1a6-82e1-4ac0-833c-4c7906d58bca None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.731071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5a1a6-82e1-4ac0-833c-4c7906d58bca None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.731670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5a1a6-82e1-4ac0-833c-4c7906d58bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.766464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-58e5a1a6-82e1-4ac0-833c-4c7906d58bca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.767751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58e5a1a6-82e1-4ac0-833c-4c7906d58bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.812903 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:55.867187 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1767/3511] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:55.883891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.886006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.999359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fc28-d7c7-464f-a068-d2ba08686839 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.006251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.007114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.007408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.007692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.042336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.045520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.075245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1745/3512] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:00.439019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:00.439606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:00.439606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:00.497587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] MFA Rules not processed for user `0e78e24929f447249783722dbd04d342`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:00.499092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:00.658551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1768/3513] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:00.925397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:00.927562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:01.063004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffbb6b-46e3-4e54-9b29-2fa59a21f79c service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:01.069555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:01.070238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:01.070563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:01.070840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:01.081208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:01.083681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:01.098901 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1746/3514] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:03.508927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:03.511480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:03.552004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb0811-c771-44c8-846d-a59353f9cad2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:03.567225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:03.568247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:03.569951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:03.570303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] PATH_INFO: `/v3/users/f7280287d0694430a75ae054fdc631e2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:03.592065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7280287d0694430a75ae054fdc631e2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:03.594173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:03.687095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7280287d0694430a75ae054fdc631e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.688006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7280287d0694430a75ae054fdc631e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.707432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7280287d0694430a75ae054fdc631e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.708711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7280287d0694430a75ae054fdc631e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.728339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-541c67a1-23b5-4ef8-99e4-f40519c1b680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7280287d0694430a75ae054fdc631e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:03.754827 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1769/3515] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:03 2022] DELETE /identity/v3/users/f7280287d0694430a75ae054fdc631e2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:04.191120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:04.212745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f038ad-7af2-4667-95e1-b497926870ce service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:04.406455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:04.408895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:04.409469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:04.410584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] PATH_INFO: `/v3/projects/40deffb43c3e4e66887212d5f04f1cbf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:04.412089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40deffb43c3e4e66887212d5f04f1cbf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:04.414767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:04.456048 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:04.553495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40deffb43c3e4e66887212d5f04f1cbf', 'request_id': 'req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:04.561513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40deffb43c3e4e66887212d5f04f1cbf', 'request_id': 'req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:04.577911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40deffb43c3e4e66887212d5f04f1cbf', 'request_id': 'req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:04.615199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] The token cache is being invalidate because project 40deffb43c3e4e66887212d5f04f1cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:04.615499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:04.619053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22698e6b-ebe5-4516-bad6-e5b3bc6aea1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:04.621466 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1747/3516] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:04 2022] DELETE /identity/v3/projects/40deffb43c3e4e66887212d5f04f1cbf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:04.627917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:04.629411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:04.629926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:04.663678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:04.682022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:04.760265 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:04.852723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1770/3517] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:04.864157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:04.864519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:04.864731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:04.901360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:04.902747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:04.926460 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1748/3518] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:04.927536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:04.946986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3db8-9a9e-4bfe-886a-2e18fbd92e17 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:04.959443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:04.960464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:04.960939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:04.961404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:04.962326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:04.962835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:04.965009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:04.990769 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1771/3519] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:04.995730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.013822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70022c00-1de0-4e77-833f-e4b42f717b57 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:05.019181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:05.019873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:05.020165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:05.020446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:05.021171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:05.026909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:05.125617 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1749/3520] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:04 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:05.130344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.148568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d132e-31bd-4de0-a7c9-9073eadfbb7f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:05.315084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:05.316285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:05.316782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:05.317279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:05.318528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:05.321717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:05.408190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.409060 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1772/3521] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:05 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:05.436591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e773b-4d08-4fc4-9455-0d3ec536ec86 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:05.459951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:05.461437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:05.462383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:05.463071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:05.468132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:05.484370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:05.525654 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1750/3522] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:05.529750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.547036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4681-493b-46e2-9b2a-4632969ad702 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:05.577371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda7ce2-01dd-46a4-a139-99d9c6018300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:05.578164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7ce2-01dd-46a4-a139-99d9c6018300 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:05.578334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7ce2-01dd-46a4-a139-99d9c6018300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:05.578642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7ce2-01dd-46a4-a139-99d9c6018300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:05.579377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda7ce2-01dd-46a4-a139-99d9c6018300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:05.586052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda7ce2-01dd-46a4-a139-99d9c6018300 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:05.608723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.608938 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1773/3523] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:05.633057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63603f7-6711-450b-a2c8-b1dc55cfa93f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:05.657022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:05.658043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:05.658405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:05.658791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] PATH_INFO: `/v3/projects/914f653344fa4feab9672982c06d6f2f/users/2686b83fe2564a44a9938f9d543d6d48/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:05.695572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914f653344fa4feab9672982c06d6f2f, user_id=2686b83fe2564a44a9938f9d543d6d48, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:05.698466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:05.729889 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1751/3524] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:05 2022] PUT /identity/v3/projects/914f653344fa4feab9672982c06d6f2f/users/2686b83fe2564a44a9938f9d543d6d48/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:05.741666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dd1e3-16cf-47b8-9436-1773ac039d6a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:05.741666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dd1e3-16cf-47b8-9436-1773ac039d6a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:05.741666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dd1e3-16cf-47b8-9436-1773ac039d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:05.782014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-be2dd1e3-16cf-47b8-9436-1773ac039d6a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:05.783959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be2dd1e3-16cf-47b8-9436-1773ac039d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:05.922858 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1774/3525] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:05.943758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:05.945606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:06.119462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aadab-b6a2-49ca-bc25-95f18761c519 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:06.136228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88f0b4-41aa-4ac0-aef2-43ba0a67939a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:06.137246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88f0b4-41aa-4ac0-aef2-43ba0a67939a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:06.137715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88f0b4-41aa-4ac0-aef2-43ba0a67939a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:06.138181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88f0b4-41aa-4ac0-aef2-43ba0a67939a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:06.154344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88f0b4-41aa-4ac0-aef2-43ba0a67939a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:06.159020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88f0b4-41aa-4ac0-aef2-43ba0a67939a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:06.187800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1752/3526] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:09.665624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0381eca-edb3-4117-9c02-814e040bf86f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:09.666797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0381eca-edb3-4117-9c02-814e040bf86f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:09.667310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0381eca-edb3-4117-9c02-814e040bf86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:09.741765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b0381eca-edb3-4117-9c02-814e040bf86f None None] MFA Rules not processed for user `1a48db2b71e046eeb90bb5fc9bd450c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:09.743548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b0381eca-edb3-4117-9c02-814e040bf86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:09.820607 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:09.945135 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1775/3527] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:09.947084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:09.947545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:09.947833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:09.983323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] MFA Rules not processed for user `1a48db2b71e046eeb90bb5fc9bd450c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:09.986963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:10.018256 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1753/3528] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:11.517302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b923b-ed91-4e5a-9678-e4c1087dec5e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.517766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b923b-ed91-4e5a-9678-e4c1087dec5e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.517874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b923b-ed91-4e5a-9678-e4c1087dec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:11.611781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7d5b923b-ed91-4e5a-9678-e4c1087dec5e None None] MFA Rules not processed for user `e160ed8d8d6e485b9cf0f7df067f9bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:11.620762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d5b923b-ed91-4e5a-9678-e4c1087dec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.637220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:11.639355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:11.817593 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:11.910582 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1776/3529] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:11.954055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80483-302a-4568-8e21-092d8b32ec7b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:11.975941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb08c3-37ff-46c8-a9e7-801fd255b45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:11.976800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb08c3-37ff-46c8-a9e7-801fd255b45b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:11.976940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb08c3-37ff-46c8-a9e7-801fd255b45b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:11.977560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb08c3-37ff-46c8-a9e7-801fd255b45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:12.004892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb08c3-37ff-46c8-a9e7-801fd255b45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:12.006967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb08c3-37ff-46c8-a9e7-801fd255b45b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:12.036500 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1754/3530] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:21.869001 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=41 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:22.027038 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=17 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:22.500627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:22.500929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:22.501223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:22.559469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] MFA Rules not processed for user `2686b83fe2564a44a9938f9d543d6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:22.561332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:22.677157 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1777/3531] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:22.688770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0badfd-e678-41c9-8002-fd6fcd55e5d3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:22.689261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0badfd-e678-41c9-8002-fd6fcd55e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:22.689697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0badfd-e678-41c9-8002-fd6fcd55e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:22.710806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9a0badfd-e678-41c9-8002-fd6fcd55e5d3 None None] MFA Rules not processed for user `2686b83fe2564a44a9938f9d543d6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:22.712253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a0badfd-e678-41c9-8002-fd6fcd55e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:22.724512 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1755/3532] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:22.998461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:23.000533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:23.023899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977fe0a-1b08-4d2e-9187-c7e43c9c2bc7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:23.031465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:23.032364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:23.032701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:23.032991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:23.061669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:23.063403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:23.075179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1778/3533] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:26.258131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:26.259050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:26.259473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:26.291460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] MFA Rules not processed for user `2686b83fe2564a44a9938f9d543d6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:26.292912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:26.349804 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1756/3534] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:29.123171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:29.140793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fd32a-c49f-4b7c-aa69-72ccb1989e66 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:29.145670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:29.146984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:29.147476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:29.148043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:29.150925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:29.167037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:29.169151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:29.189083 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1779/3535] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:33.530564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:33.532950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:33.589896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5ab23-e688-4fa2-8265-7f045ea4ffcf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:33.603900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:33.606263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:33.606815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:33.607751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] PATH_INFO: `/v3/users/9eeeb36672a2487db7c86faf03c82d48` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:33.611061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eeeb36672a2487db7c86faf03c82d48)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:33.616279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:33.688725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eeeb36672a2487db7c86faf03c82d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:33.702806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eeeb36672a2487db7c86faf03c82d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:33.715588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eeeb36672a2487db7c86faf03c82d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:33.725561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eeeb36672a2487db7c86faf03c82d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:33.726624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eeeb36672a2487db7c86faf03c82d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:33.734359 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1757/3536] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:33 2022] DELETE /identity/v3/users/9eeeb36672a2487db7c86faf03c82d48 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:34.648778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:34.652574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:34.683804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae88141-edb7-4320-8f06-90e39503f6ad service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:34.783152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:34.785166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:34.863685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:34.864986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:34.865488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:34.865992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] PATH_INFO: `/v3/users/e211fbf1e8644f95a0c40f705c42531d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:34.867596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e211fbf1e8644f95a0c40f705c42531d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:34.870067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:34.936393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cc8ff-0344-4ce7-b962-cb2cf237f06f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:34.943974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:34.945271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:34.945774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:34.946271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] PATH_INFO: `/v3/projects/66df1b6b667d481c8df867b34e8a5cfb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:34.948960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66df1b6b667d481c8df867b34e8a5cfb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:34.953371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:34.991967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e211fbf1e8644f95a0c40f705c42531d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:34.998757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e211fbf1e8644f95a0c40f705c42531d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.027640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e211fbf1e8644f95a0c40f705c42531d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.032688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e211fbf1e8644f95a0c40f705c42531d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.041790 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:35.064470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2a550178-d30c-4395-a803-8a137fc8c859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e211fbf1e8644f95a0c40f705c42531d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.093434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66df1b6b667d481c8df867b34e8a5cfb', 'request_id': 'req-f890b25e-3234-4c35-ae27-736a34932c01'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.105907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66df1b6b667d481c8df867b34e8a5cfb', 'request_id': 'req-f890b25e-3234-4c35-ae27-736a34932c01'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.109530 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:35.120889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1780/3537] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:34 2022] DELETE /identity/v3/users/e211fbf1e8644f95a0c40f705c42531d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:35.125261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66df1b6b667d481c8df867b34e8a5cfb', 'request_id': 'req-f890b25e-3234-4c35-ae27-736a34932c01'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.147466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] The token cache is being invalidate because project 66df1b6b667d481c8df867b34e8a5cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:35.147761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.150387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f890b25e-3234-4c35-ae27-736a34932c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:35.165082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1758/3538] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:34 2022] DELETE /identity/v3/projects/66df1b6b667d481c8df867b34e8a5cfb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:35.168575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.169131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.169644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.217732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:35.219325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:35.326765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.327320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.327795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.337725 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1781/3539] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:35.391211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:35.394639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:35.424606 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1759/3540] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:35.425158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:35.436372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4a34-2618-41a9-a3a6-1e58ac71033c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:35.444707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:35.445406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.446307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.446647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.447409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:35.447722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.450459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:35.469701 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1782/3541] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:35.472925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:35.492775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e44983-6a39-43d4-8e16-a70bba5cf5b8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:35.499037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:35.499882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.500233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.500578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.501587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.504854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:35.556674 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1760/3542] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:35.559566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:35.579972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867f071-b3a0-4eee-8371-827eb35d2f93 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:35.689995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:35.691927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.692215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.692646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.694805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.698331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:35.742577 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1783/3543] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:35 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:35.746797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:35.761897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d1a6-c239-46f3-8992-f51c0035145d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:35.772064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:35.773111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.773860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.774374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.775534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.778026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:35.811811 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1761/3544] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:35.816631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:35.830859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d0ca9-d4c1-4346-985f-ce6a24c16335 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:35.840189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3195a21-0078-48b9-ab50-3a355cdd15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:35.841121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3195a21-0078-48b9-ab50-3a355cdd15c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.841745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3195a21-0078-48b9-ab50-3a355cdd15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.842345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3195a21-0078-48b9-ab50-3a355cdd15c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.844075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3195a21-0078-48b9-ab50-3a355cdd15c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.847475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3195a21-0078-48b9-ab50-3a355cdd15c2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:35.866963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1784/3545] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:35.869286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:35.886358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657103-ec91-4563-8697-792e13759e72 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:35.915567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:35.916515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:35.916802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:35.917100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] PATH_INFO: `/v3/projects/f70ab5063f1c47b687c49b5523bfcf24/users/a42653add5034d729963854ac520ddad/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:35.992759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70ab5063f1c47b687c49b5523bfcf24, user_id=a42653add5034d729963854ac520ddad, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.996687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:36.025537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1762/3546] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:35 2022] PUT /identity/v3/projects/f70ab5063f1c47b687c49b5523bfcf24/users/a42653add5034d729963854ac520ddad/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:36.036368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:36.036663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:36.036943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:36.095865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] MFA Rules not processed for user `a42653add5034d729963854ac520ddad`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:36.098962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:36.225718 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:36.273861 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1785/3547] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:36.623567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:36.625544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:36.642902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:36.646452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:36.768442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f50d2-6b43-479c-bf08-c4d81d0cf535 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:36.778751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811730e-1143-4688-87ed-104e5681fad2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:36.785464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:36.786649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:36.787133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:36.787604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] PATH_INFO: `/v3/projects/1c45a1519cee4defa2cf2c971b29b456` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:36.788179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:36.788842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:36.789193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:36.789583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:36.790139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c45a1519cee4defa2cf2c971b29b456)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:36.792982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:36.800321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:36.802440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:36.814778 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1763/3548] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:36.860162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c45a1519cee4defa2cf2c971b29b456', 'request_id': 'req-d275786f-7cb5-4be3-b52d-6d89d5b3213a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:36.869943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:36.888514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2c354-026f-49e4-b18a-9466e23f5317 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:36.889224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c45a1519cee4defa2cf2c971b29b456', 'request_id': 'req-d275786f-7cb5-4be3-b52d-6d89d5b3213a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:36.898326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c45a1519cee4defa2cf2c971b29b456', 'request_id': 'req-d275786f-7cb5-4be3-b52d-6d89d5b3213a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:36.932325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] The token cache is being invalidate because project 1c45a1519cee4defa2cf2c971b29b456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:36.932325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:36.934349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d275786f-7cb5-4be3-b52d-6d89d5b3213a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:36.941535 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1786/3549] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:36 2022] DELETE /identity/v3/projects/1c45a1519cee4defa2cf2c971b29b456 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:36.947065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93e8fb-e2c5-4455-a980-39ac02de30c8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:36.947513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93e8fb-e2c5-4455-a980-39ac02de30c8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:36.947660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93e8fb-e2c5-4455-a980-39ac02de30c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:36.965414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:36.967350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:36.967709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:36.967961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] PATH_INFO: `/v3/users/a42653add5034d729963854ac520ddad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:36.969280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42653add5034d729963854ac520ddad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:36.971937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:36.988898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ec93e8fb-e2c5-4455-a980-39ac02de30c8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:36.990941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec93e8fb-e2c5-4455-a980-39ac02de30c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:36.992236 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:37.016569 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1787/3550] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:37.024971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.025310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.025593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.059204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42653add5034d729963854ac520ddad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:37.060599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:37.061826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:37.081913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42653add5034d729963854ac520ddad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:37.087216 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1788/3551] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:37.094175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.096820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42653add5034d729963854ac520ddad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:37.111504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42653add5034d729963854ac520ddad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:37.112458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5fd23-6fc1-470f-87a5-790510dd84b6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.113755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd0d7f60-e0e1-4d29-8d28-6c19c222e3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42653add5034d729963854ac520ddad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:37.118376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.119567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.120031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.120475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.121651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:37.122274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.124369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.131185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1764/3552] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:36 2022] DELETE /identity/v3/users/a42653add5034d729963854ac520ddad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:37.136037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.136945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.137392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.144626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1789/3553] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:37.145940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.150365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:37.167447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ddf8d-ab4b-4927-97f1-a53ec4a5b08c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.170973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:37.172710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:37.225319 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:37.251863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.253777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.254134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.254483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.255600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.257807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.290102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1765/3554] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:37.312169 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1790/3555] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:37 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:37.316622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.328243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3713-f50c-4c9c-9fb9-8dd87940359b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.336968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.339197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:37.424717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b2434-b3c7-405d-bfad-e27d0988b05b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.429949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.430640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.430932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.431213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.441608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.443051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.443582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.445500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.448081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.455133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.495144 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1766/3556] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:37 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:37.496217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.507073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.508533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.509290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01628dbd-9f73-413c-8b41-d14b84a17ceb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.516517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.517327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.517714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.518257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.519278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.519948 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1791/3557] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:37.528866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.545889 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1767/3558] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:37.550884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.561989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00cee1-3eec-4710-8e69-7208604b89f4 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.567542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea352-9661-4544-9456-93df755b8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.568481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea352-9661-4544-9456-93df755b8459 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.568807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea352-9661-4544-9456-93df755b8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.569142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea352-9661-4544-9456-93df755b8459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.570059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea352-9661-4544-9456-93df755b8459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.571815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea352-9661-4544-9456-93df755b8459 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.586672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1792/3559] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:37.587986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.603152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe1bf3-1255-4904-a765-7e17af0e658f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:37.611328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:37.613303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.613885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.614346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] PATH_INFO: `/v3/projects/e6f0b063995347d4ac931b993d656020/users/bbca12357748486ebcd038c9b56b5bd5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.620530 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:37.642893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f0b063995347d4ac931b993d656020, user_id=bbca12357748486ebcd038c9b56b5bd5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:37.646427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:37.682970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:37.683322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:37.683608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:37.685933 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1768/3560] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:37 2022] PUT /identity/v3/projects/e6f0b063995347d4ac931b993d656020/users/bbca12357748486ebcd038c9b56b5bd5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:37.707859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:37.709423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:37.794576 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1793/3561] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:37.899263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:37.999026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a4bc-c195-41e3-bbeb-6e41cd2cdedc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:38.004653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed381c2c-19a3-4fbc-baa2-405e41ffd038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:38.005400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381c2c-19a3-4fbc-baa2-405e41ffd038 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:38.005693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381c2c-19a3-4fbc-baa2-405e41ffd038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:38.005973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381c2c-19a3-4fbc-baa2-405e41ffd038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:38.021148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed381c2c-19a3-4fbc-baa2-405e41ffd038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:38.031396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed381c2c-19a3-4fbc-baa2-405e41ffd038 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:38.064661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1769/3562] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:38.871417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:38.873660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:38.911694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490713be-5fbb-4840-8734-144d1bec76b5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:38.932413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:38.936947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:38.939281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:38.942246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] PATH_INFO: `/v3/projects/f70ab5063f1c47b687c49b5523bfcf24` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:38.944175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70ab5063f1c47b687c49b5523bfcf24)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:38.947601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:38.951933 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:39.093996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70ab5063f1c47b687c49b5523bfcf24', 'request_id': 'req-b2133800-f11b-49f4-9847-edd92d422953'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.115814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70ab5063f1c47b687c49b5523bfcf24', 'request_id': 'req-b2133800-f11b-49f4-9847-edd92d422953'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.134853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70ab5063f1c47b687c49b5523bfcf24', 'request_id': 'req-b2133800-f11b-49f4-9847-edd92d422953'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.179672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] The token cache is being invalidate because project f70ab5063f1c47b687c49b5523bfcf24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:39.185311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.186170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2133800-f11b-49f4-9847-edd92d422953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.192959 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1794/3563] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:38 2022] DELETE /identity/v3/projects/f70ab5063f1c47b687c49b5523bfcf24 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:39.194254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.194733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.194843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.219335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:39.220798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:39.323042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.323313 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1770/3564] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:39.323429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.323655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.347616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:39.349496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:39.368099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.389292 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1795/3565] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:39.391252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbe093-0692-4924-8fca-8b93eb2f6ebe None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.399579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.400419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.400913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.401264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.402158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:39.402568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.404858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.423871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1771/3566] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:39.425917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.444828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f3cf-b4d5-4ca2-ab04-2eacfdd69a42 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.457388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.458444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.458984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.459527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.460486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.468275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.509357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1796/3567] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:39 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:39.510540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.521334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c63ce-35e6-4a72-accd-7a16885c15d9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.609407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.610104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.610395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.610708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.611571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.614689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.649013 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1772/3568] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:39 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:39.650827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.672652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55425f-3a21-43be-a4b0-75b668ba2d57 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.687975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.690896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.691192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.691477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.692259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.693926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.711934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.719277 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1797/3569] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:39.719985 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:39.725327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063463c-edfb-4bf1-a8a7-ce464a0c1350 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.732203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab621fa-4aaf-4fe3-9444-d5161ac0348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.733180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab621fa-4aaf-4fe3-9444-d5161ac0348c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.735841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab621fa-4aaf-4fe3-9444-d5161ac0348c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.736150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab621fa-4aaf-4fe3-9444-d5161ac0348c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.737710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab621fa-4aaf-4fe3-9444-d5161ac0348c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.739619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab621fa-4aaf-4fe3-9444-d5161ac0348c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.765170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.773739 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1773/3570] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:39.777953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0191dd-e856-4d20-bce0-7683d88fd81e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.783470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.785043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.785346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.785678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] PATH_INFO: `/v3/projects/c3fc42ba48594c0daaaf8d0401d37f5c/users/0da27327e3044940b606ef03c4fe1585/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.805788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fc42ba48594c0daaaf8d0401d37f5c, user_id=0da27327e3044940b606ef03c4fe1585, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.813048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.842409 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1798/3571] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:39 2022] PUT /identity/v3/projects/c3fc42ba48594c0daaaf8d0401d37f5c/users/0da27327e3044940b606ef03c4fe1585/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:39.850321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.850651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.850938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.907102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:39.908368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.082093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1774/3572] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:40.127419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.129579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.275442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013997-24ca-4abd-9392-66ad1cf74971 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.290232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76249c26-2d1f-433c-82a5-40af15c3771b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.291305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76249c26-2d1f-433c-82a5-40af15c3771b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.291305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76249c26-2d1f-433c-82a5-40af15c3771b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.291490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76249c26-2d1f-433c-82a5-40af15c3771b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.314399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76249c26-2d1f-433c-82a5-40af15c3771b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.316544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76249c26-2d1f-433c-82a5-40af15c3771b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:40.344619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1799/3573] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:40.907477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.909141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.941430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04cf93-517c-426e-a398-c6cd37beef7c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.947321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.948496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.949031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.949597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] PATH_INFO: `/v3/users/0e78e24929f447249783722dbd04d342` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.952340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e78e24929f447249783722dbd04d342)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.954754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.062578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e78e24929f447249783722dbd04d342'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.082581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e78e24929f447249783722dbd04d342'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.091662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e78e24929f447249783722dbd04d342'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.102184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e78e24929f447249783722dbd04d342'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.102991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74b43399-ce40-4acc-81f6-9b7afc80e739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e78e24929f447249783722dbd04d342'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.117845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1775/3574] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:40 2022] DELETE /identity/v3/users/0e78e24929f447249783722dbd04d342 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:41.655659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.656543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.656981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.720707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] MFA Rules not processed for user `0da27327e3044940b606ef03c4fe1585`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:41.722907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:41.770318 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:41.902400 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1800/3575] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:41.913846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.914806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.915303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.956054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] MFA Rules not processed for user `0da27327e3044940b606ef03c4fe1585`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:41.958273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:41.971307 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1776/3576] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:42.008356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.009888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.232919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008c07-11ab-48c9-a963-a98d0bf984be None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.248230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.251876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.255681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.257224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] PATH_INFO: `/v3/projects/c149e19843a64c8a91d342e8449e80ad` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.260987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c149e19843a64c8a91d342e8449e80ad)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.269898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.444628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c149e19843a64c8a91d342e8449e80ad', 'request_id': 'req-cf1323cd-bca7-46e5-a802-f251bb762794'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.476037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c149e19843a64c8a91d342e8449e80ad', 'request_id': 'req-cf1323cd-bca7-46e5-a802-f251bb762794'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.512972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c149e19843a64c8a91d342e8449e80ad', 'request_id': 'req-cf1323cd-bca7-46e5-a802-f251bb762794'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.516037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.517462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.536693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] The token cache is being invalidate because project c149e19843a64c8a91d342e8449e80ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:42.537228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.538113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf1323cd-bca7-46e5-a802-f251bb762794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.539899 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1801/3577] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:42 2022] DELETE /identity/v3/projects/c149e19843a64c8a91d342e8449e80ad => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:42.545438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa027a-511f-46e7-986a-53a53c883827 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.545879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa027a-511f-46e7-986a-53a53c883827 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.546436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa027a-511f-46e7-986a-53a53c883827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.580614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d3fa027a-511f-46e7-986a-53a53c883827 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:42.582465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3fa027a-511f-46e7-986a-53a53c883827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.672689 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:42.691730 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:42.735868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4f2a-fde6-46dc-8b5d-411c4ff60eca None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.741879 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1802/3578] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:42.743406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.743702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.744133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.784185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:42.785620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.809164 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1803/3579] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:42.813754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.852332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b03b3-456e-41f7-ada5-4b85cec5e53a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.869053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.869749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.870035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.870312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.871098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:42.871408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.873036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.901266 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1804/3580] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:57:42.904750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.905711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.906156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.906620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.907067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.912806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.924715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af440932-391d-4d5f-846f-8af4c64feda6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.936303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.937164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.937398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.940972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.942096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.946754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:43.017696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1805/3581] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:43.021521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:43.054625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:43.056005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:43.073336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1777/3582] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:43.115280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029ea2e-867e-446a-aab5-5abdcdee91d3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:43.123148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:43.123992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:43.124350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:43.124704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:43.125477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:43.128169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:43.154777 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1806/3583] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:43 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:43.158988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:43.174948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c0e1-8cf4-4c9d-a059-9a6324edf70b service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:43.180412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:43.181581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:43.182071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:43.182585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:43.184262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:43.186100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:43.204691 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1778/3584] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:43.206089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:43.221531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c9745-699c-45b0-b8a1-c6d11d8ba145 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:43.228444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921c5a-754b-46e6-b2a0-25ff06bed277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:43.228444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921c5a-754b-46e6-b2a0-25ff06bed277 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:43.228758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921c5a-754b-46e6-b2a0-25ff06bed277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:43.229162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921c5a-754b-46e6-b2a0-25ff06bed277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:43.230077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf921c5a-754b-46e6-b2a0-25ff06bed277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:43.234506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf921c5a-754b-46e6-b2a0-25ff06bed277 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:43.251238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1807/3585] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:43.253576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:43.266975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf123-6cce-4444-b865-5bd92d5ff9f0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:43.274683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:43.275997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:43.276518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:43.277019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] PATH_INFO: `/v3/projects/da0227dfa20844958b8b1a28185efb3d/users/5cb4ed7241d54db2854e6c660ff660f1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:43.300640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0227dfa20844958b8b1a28185efb3d, user_id=5cb4ed7241d54db2854e6c660ff660f1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:43.306236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:43.337941 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1779/3586] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:43 2022] PUT /identity/v3/projects/da0227dfa20844958b8b1a28185efb3d/users/5cb4ed7241d54db2854e6c660ff660f1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:43.341191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:43.341754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:43.342233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:43.409436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] MFA Rules not processed for user `5cb4ed7241d54db2854e6c660ff660f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:43.410869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:43.590194 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1808/3587] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:43.925759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:43.928707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:44.107603 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:44.143332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52526f-4ae6-4fa4-901a-c75e84e20986 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:44.160090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:44.160776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:44.161065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:44.161848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:44.171196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:44.173378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:44.189083 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1780/3588] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:44.401689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:44.404363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:44.444207 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:44.546947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb3af-a26d-4de7-bd9e-4bae7c60ec34 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:44.563120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:44.565656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:44.566485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:44.569457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:44.572533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:44.719066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:44.727031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:44.750217 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1809/3589] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:45.135299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:45.136871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:45.159703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4b29f-bd35-47bc-b30f-4470c468c80b service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:45.173097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:45.174006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:45.174522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:45.174840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] PATH_INFO: `/v3/users/0da27327e3044940b606ef03c4fe1585` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:45.183532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da27327e3044940b606ef03c4fe1585)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:45.188688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:45.281727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da27327e3044940b606ef03c4fe1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.308226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da27327e3044940b606ef03c4fe1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.318623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da27327e3044940b606ef03c4fe1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.330023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da27327e3044940b606ef03c4fe1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.331791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-89c2908f-dd5e-40cf-b62d-3faeaa911095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da27327e3044940b606ef03c4fe1585'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.343938 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1781/3590] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:45 2022] DELETE /identity/v3/users/0da27327e3044940b606ef03c4fe1585 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:45.638154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:45.659624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbf213-da57-4439-98bc-76fd62b5566f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:45.793059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:45.793946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:45.795141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:45.795598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] PATH_INFO: `/v3/projects/c3fc42ba48594c0daaaf8d0401d37f5c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:45.798950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fc42ba48594c0daaaf8d0401d37f5c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:45.806679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:45.891488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fc42ba48594c0daaaf8d0401d37f5c', 'request_id': 'req-a361b45d-216a-455e-8022-17af4692f330'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.903783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fc42ba48594c0daaaf8d0401d37f5c', 'request_id': 'req-a361b45d-216a-455e-8022-17af4692f330'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.916510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fc42ba48594c0daaaf8d0401d37f5c', 'request_id': 'req-a361b45d-216a-455e-8022-17af4692f330'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.926433 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:45.958014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] The token cache is being invalidate because project c3fc42ba48594c0daaaf8d0401d37f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:45.958374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.960330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a361b45d-216a-455e-8022-17af4692f330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:45.963839 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1810/3591] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:45 2022] DELETE /identity/v3/projects/c3fc42ba48594c0daaaf8d0401d37f5c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:45.976825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:45.977575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:45.978015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.002487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:46.003775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:46.116909 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1782/3592] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:46.119778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.120074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.120355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.164858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:46.170691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:46.197760 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1811/3593] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:46.199145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:46.214770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490007-a1b0-4c46-815a-5c5cc41a154f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:46.228816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:46.229520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.231672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.232010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.235109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:46.235710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:46.237444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:46.259694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1783/3594] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:57:46.272136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:46.286864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44900d-0523-4713-81c0-142bbe2c48e3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:46.303793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:46.304571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.304957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.305342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.306121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:46.308659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:46.365464 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1812/3595] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:46 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:46.366626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:46.408370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346615-15a2-486c-be9f-9cec729767d2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:46.506147 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:46.541323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:46.542311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.542723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.543182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.543938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:46.546220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:46.594569 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1784/3596] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:46 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:46.598778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:46.615515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98702-c0c5-4898-9424-6812fb1df661 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:46.622547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:46.623194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.623484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.623764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.624794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:46.626646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:46.642183 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1813/3597] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:46.646578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:46.659389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b90b42-d56a-4199-aafa-6752e1ec2d08 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:46.670871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba983a4-1575-469c-9782-dfce7732cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:46.671686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba983a4-1575-469c-9782-dfce7732cf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.672165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba983a4-1575-469c-9782-dfce7732cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.673040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba983a4-1575-469c-9782-dfce7732cf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.674276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba983a4-1575-469c-9782-dfce7732cf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:46.676137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba983a4-1575-469c-9782-dfce7732cf10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:46.696401 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1785/3598] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:46.696651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:46.708832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ce47-3551-487b-bc28-472bbc0b5728 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:46.718735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:46.720044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.720476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.721222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] PATH_INFO: `/v3/projects/72df4743aaf445349005b13309fcae44/users/afdfacab70114f24a18d63bd2c8400f5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.740802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72df4743aaf445349005b13309fcae44, user_id=afdfacab70114f24a18d63bd2c8400f5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:46.744041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:46.763597 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1814/3599] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:46 2022] PUT /identity/v3/projects/72df4743aaf445349005b13309fcae44/users/afdfacab70114f24a18d63bd2c8400f5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:46.776175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.776709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.777068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:46.813778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] MFA Rules not processed for user `afdfacab70114f24a18d63bd2c8400f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:46.819122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:46.924645 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1786/3600] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:46.925125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.020294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6bf1f-4ba9-4646-8f81-2e2b1f554663 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.026014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.026840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.027195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.027545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.028318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.035278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.072748 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1815/3601] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:46 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:47.076952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.091819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aba6a-0b49-45b2-935e-aea4060d7452 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.190633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.191421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.191770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.192117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.193051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.194973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.231353 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1787/3602] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:47.232644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.257750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79dfb-8401-49db-bec5-43171d3989cc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.264775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.265455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.265791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.266013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.266774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.271088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.297811 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1816/3603] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:47.299773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.312722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17efe1-afb8-45ec-aab7-31ec6c98ebcc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.332134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.333056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.333345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.333735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] PATH_INFO: `/v3/projects/258c3b145b82471a8eeb4bb017f00bc2/users/cef64f54003b4e54a431dceb6b9172f8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.362919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258c3b145b82471a8eeb4bb017f00bc2, user_id=cef64f54003b4e54a431dceb6b9172f8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.365744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.383572 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1788/3604] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:47 2022] PUT /identity/v3/projects/258c3b145b82471a8eeb4bb017f00bc2/users/cef64f54003b4e54a431dceb6b9172f8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:47.387347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.403327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269429-6afb-4259-9565-6a4ca66a3e1a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.472652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcafa-c00e-45e4-99fe-76ca2ffba891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.473518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcafa-c00e-45e4-99fe-76ca2ffba891 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.474620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcafa-c00e-45e4-99fe-76ca2ffba891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.474620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcafa-c00e-45e4-99fe-76ca2ffba891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.475189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcafa-c00e-45e4-99fe-76ca2ffba891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.476460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcafa-c00e-45e4-99fe-76ca2ffba891 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.492964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.494709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1817/3605] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:47.506443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7329-d46e-41bd-9c42-a8d3d9f89661 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.516198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.516198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.516198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.516198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] PATH_INFO: `/v3/projects/258c3b145b82471a8eeb4bb017f00bc2/users/cef64f54003b4e54a431dceb6b9172f8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.516701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258c3b145b82471a8eeb4bb017f00bc2, user_id=cef64f54003b4e54a431dceb6b9172f8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.518669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.539530 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1789/3606] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:47 2022] PUT /identity/v3/projects/258c3b145b82471a8eeb4bb017f00bc2/users/cef64f54003b4e54a431dceb6b9172f8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:47.541293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.541714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.541867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.552590 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:47.575327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.579274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:47.590339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] MFA Rules not processed for user `cef64f54003b4e54a431dceb6b9172f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:47.593354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:47.596527 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:47.693080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d07b-f921-4b3b-934a-735611f29309 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.701236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.702313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.702614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.702900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] PATH_INFO: `/v3/users/5cb4ed7241d54db2854e6c660ff660f1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.707351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb4ed7241d54db2854e6c660ff660f1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.713143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.755510 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1818/3607] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:47.758799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.771032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f856a1-91e6-4fd9-beac-e579e295f65c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.778153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.779168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.779459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.779808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.783029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.784342 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:47.784342 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:47.784342 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:47.785171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.808877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb4ed7241d54db2854e6c660ff660f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:47.815166 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1819/3608] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/services => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:47.819803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.833379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb4ed7241d54db2854e6c660ff660f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:47.843679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb4ed7241d54db2854e6c660ff660f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:47.855794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb4ed7241d54db2854e6c660ff660f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:47.856664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5843b68a-1f9c-42f5-8b37-3b08b36da717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb4ed7241d54db2854e6c660ff660f1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:47.868279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1fab-df27-4a84-af96-d61f8c9ac4e8 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.875773 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1790/3609] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:47 2022] DELETE /identity/v3/users/5cb4ed7241d54db2854e6c660ff660f1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:47.888252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.889177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.889520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.889741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.890566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.890686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.891710 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:47.891710 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:47.891710 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:47.892054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.892586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.892999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.926537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:47.929880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: 'False' Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise error Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'False' Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.932800 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 14:57:47.934259 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'False' Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:47.935821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1820/3610] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/endpoints => generated 283 bytes in 115 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 14:57:47.940715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.943743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:47.980064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde378-2a6a-4127-8eb0-ec88e301aad3 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.151495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.152193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.152485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.152767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.153532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.155371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.159863 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1791/3611] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:48.166929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.171296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: 'True' Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise error Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'True' Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.172326 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 14:57:48.173713 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'True' Jul 11 14:57:48.175391 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.184579 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1821/3612] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/endpoints => generated 281 bytes in 245 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 14:57:48.185724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.206190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827410b-1b98-4385-84c1-69dfde15ca74 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.215771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.217808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.218306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.219200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.220170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.222649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.227176 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:48.283012 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-598016376. To ensure interoperability, identifiers should be a valid uuid. Jul 11 14:57:48.283012 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 14:57:48.283012 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:48.354972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1822/3613] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 14:57:48 2022] POST /identity/v3/endpoints => generated 359 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:48.358886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.370140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d899c7-24d4-4cb0-8cde-7e0a82761d16 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.402289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ffe87-ba9f-4bfb-8c25-869a5aab4d3d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.404203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.406260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.406670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.407115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.420736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.422726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.425937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.426859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.427150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.427432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/regions/tempest-region-598016376` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.428196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-598016376)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.429330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.437730 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1823/3614] 10.222.0.77 () {58 vars in 1202 bytes} [Mon Jul 11 14:57:48 2022] GET /identity/v3/regions/tempest-region-598016376 => generated 178 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:48.438689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.457467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1792/3615] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3543 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:48.461447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019d142-52d6-426a-83d9-53c49588c19b tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.487978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.488874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.489211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.489444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints/e023c12200be4b568e2f07e070ddd94c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.520044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e023c12200be4b568e2f07e070ddd94c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.521470 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:48.521470 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:48.521470 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:48.523087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: 'False' Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise error Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'False' Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.538402 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 14:57:48.539863 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'False' Jul 11 14:57:48.540876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:48.546081 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1824/3616] 10.222.0.77 () {60 vars in 1254 bytes} [Mon Jul 11 14:57:48 2022] PATCH /identity/v3/endpoints/e023c12200be4b568e2f07e070ddd94c => generated 283 bytes in 108 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 14:57:48.549575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.571111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b54a3-6a89-49a9-a1d9-3412db52c819 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.583382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.585184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.585478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.585765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints/e023c12200be4b568e2f07e070ddd94c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.588445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e023c12200be4b568e2f07e070ddd94c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.589849 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:48.589849 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:48.589849 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:48.591286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.623918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e023c12200be4b568e2f07e070ddd94c', 'request_id': 'req-fcb67d0a-8f4e-4c5f-a744-b2520d3b5477'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:48.650271 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1793/3617] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 14:57:48 2022] DELETE /identity/v3/endpoints/e023c12200be4b568e2f07e070ddd94c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:48.654707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.663083 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:48.672348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7be44-7975-4683-a5d6-3e7bd392ec70 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.692818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.694181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.694676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.695267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/regions/tempest-region-598016376` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.696298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-598016376)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.697861 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:48.697861 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:48.697861 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:48.699169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.738578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.739318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.739765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.747878 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1825/3618] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 14:57:48 2022] DELETE /identity/v3/regions/tempest-region-598016376 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:48.754129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.763112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] MFA Rules not processed for user `832ffd94ca494d889319abe2a2dd3fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:48.764594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:48.793876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fdb84-198c-4953-8c77-e4e78d2bd504 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.823777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.825834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.827017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.827496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.828785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.831026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.854608 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1169440793. To ensure interoperability, identifiers should be a valid uuid. Jul 11 14:57:48.854608 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 14:57:48.854608 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:48.858674 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1794/3619] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:48.903491 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1826/3620] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 14:57:48 2022] POST /identity/v3/endpoints => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:48.907101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.921202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cc039-b074-4df7-99ad-d7bdf9be6aa0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.944065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.945018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.945305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.945585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/regions/tempest-region-1169440793` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:48.946247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1169440793)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:48.947548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:48.953408 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1795/3621] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 14:57:48 2022] GET /identity/v3/regions/tempest-region-1169440793 => generated 180 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:48.954775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.978834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:48.985323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d50b-2bbd-4ec6-8fba-cfc065c54c4f tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:48.986033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:48.991922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:48.992899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:48.993187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:48.993515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints/ad03be94fc7445f3a04ca9e69fac9c45` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.002359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=ad03be94fc7445f3a04ca9e69fac9c45)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.004118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: On instance['enabled']: Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: 'True' Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise error Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'True' Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.020998 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 14:57:49.022876 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['enabled']: Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'True' Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:57:49.024310 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1827/3622] 10.222.0.77 () {60 vars in 1254 bytes} [Mon Jul 11 14:57:48 2022] PATCH /identity/v3/endpoints/ad03be94fc7445f3a04ca9e69fac9c45 => generated 281 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 14:57:49.026401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.038661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae915d-c8e3-486e-ab0d-18939157c41e tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.042466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535dcb9-06fc-4fd8-9f1f-1fa773e60074 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.062416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.065536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.066420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.070432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.070761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.071046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] PATH_INFO: `/v3/projects/da0227dfa20844958b8b1a28185efb3d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.071879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.072187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/endpoints/ad03be94fc7445f3a04ca9e69fac9c45` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.077714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0227dfa20844958b8b1a28185efb3d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.079482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.081753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ad03be94fc7445f3a04ca9e69fac9c45)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.082435 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:49.082435 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:49.082435 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:49.100846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.124504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ad03be94fc7445f3a04ca9e69fac9c45', 'request_id': 'req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.150015 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1828/3623] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 14:57:49 2022] DELETE /identity/v3/endpoints/ad03be94fc7445f3a04ca9e69fac9c45 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:49.155990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.175095 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:49.186976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0227dfa20844958b8b1a28185efb3d', 'request_id': 'req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.195112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0227dfa20844958b8b1a28185efb3d', 'request_id': 'req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.197050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12140e7c-c166-46a7-8e1b-f6bb5412c5e9 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.209173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0227dfa20844958b8b1a28185efb3d', 'request_id': 'req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.223482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] The token cache is being invalidate because project da0227dfa20844958b8b1a28185efb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:49.223778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.225294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6069cb81-7e73-456f-8b0b-2c5b921ab5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.226640 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1796/3624] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:48 2022] DELETE /identity/v3/projects/da0227dfa20844958b8b1a28185efb3d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:49.231507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.231795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.232075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.254004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:49.255353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.280918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.281780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.282073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.282356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/regions/tempest-region-1169440793` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.283167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1169440793)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.284835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.312599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1829/3625] 10.222.0.77 () {58 vars in 1208 bytes} [Mon Jul 11 14:57:49 2022] DELETE /identity/v3/regions/tempest-region-1169440793 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:49.312599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.314139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.351799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1797/3626] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:49.352615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.354352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.370876 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:49.383372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f06f-5aff-417d-877a-1eeb91c1446b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.389838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef64f54003b4e54a431dceb6b9172f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '258c3b145b82471a8eeb4bb017f00bc2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.390922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.391210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.391566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] PATH_INFO: `/v3/services/21d2bfe572f34317bce73f8529c6590f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.392321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorizing `identity:delete_service(service_id=21d2bfe572f34317bce73f8529c6590f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.394350 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:49.394350 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:49.394350 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:49.395592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453f2fc-5dfc-43c0-b264-7c2d29ccfc1d tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.407543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ee8f-eb21-4f7a-8a4e-2b0b77e2dd94 tempest-EndpointsNegativeTestJSON-1059448072 tempest-EndpointsNegativeTestJSON-1059448072-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.411947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.412864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.413226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.413694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.418235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.431954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.433783 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1798/3627] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:49 2022] DELETE /identity/v3/services/21d2bfe572f34317bce73f8529c6590f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:49.434909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.435661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.436096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.436543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.454741 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1830/3628] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:49.459717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.463214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.473171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:49.474435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.485640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8d3f-1dd6-4fbf-9804-8ba773fe2d90 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.505128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.506122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.506410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.506723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] PATH_INFO: `/v3/users/afdfacab70114f24a18d63bd2c8400f5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.508242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdfacab70114f24a18d63bd2c8400f5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.509921 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1799/3629] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:49.510376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.514424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.524993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e87b-a4e7-4aac-b27e-738138420f14 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.530106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.530815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.531174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.531448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.532139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:49.532445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.534429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.554786 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1800/3630] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:49.555797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.567697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ffe5a-f3ae-4a20-a4dc-03f26a1a7e30 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.570404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdfacab70114f24a18d63bd2c8400f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.571130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdfacab70114f24a18d63bd2c8400f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.573353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.574173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.574565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.575997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.576370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.578585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.587901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdfacab70114f24a18d63bd2c8400f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.588726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdfacab70114f24a18d63bd2c8400f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.598191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1baeaeeb-8ac2-4b65-b8fb-ea130bee26c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdfacab70114f24a18d63bd2c8400f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:49.619784 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1831/3631] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:49 2022] DELETE /identity/v3/users/afdfacab70114f24a18d63bd2c8400f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:49.619985 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1801/3632] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:49 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:49.621695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.623615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.634047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.634410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.634907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.664119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:49.665675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.680473 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:49.720397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0c28-cb84-47b3-a07a-2d620c1271ff admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.762772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1832/3633] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:49.774044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.776340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:49.811161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.812268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.812772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.813306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.815175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.818724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.828394 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:49.851842 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1802/3634] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:49 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:49.856020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.870067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1677e-61d2-4f40-9f54-47210047e723 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.883622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.891455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.891651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.891919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.892705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.894697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.906292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45ea9-78e6-45d4-8db7-9940fee5f987 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.914638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.914638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.914638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.914638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.930783 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1803/3635] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:49.935506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:49.954451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.956103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.957634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318b6e-1262-43c9-869f-2f8a9ab9a592 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:49.969026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005bc33-d899-4436-adda-3c0f72a434d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:49.970322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005bc33-d899-4436-adda-3c0f72a434d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:49.971169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005bc33-d899-4436-adda-3c0f72a434d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:49.971468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005bc33-d899-4436-adda-3c0f72a434d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:49.972220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005bc33-d899-4436-adda-3c0f72a434d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:49.991222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005bc33-d899-4436-adda-3c0f72a434d5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:49.998270 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1833/3636] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:50.017896 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1804/3637] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:50.018311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:50.051296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bee16a-4b51-46fa-a6c1-e71d5b0e045e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:50.066345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:50.067305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:50.067594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:50.067869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] PATH_INFO: `/v3/projects/1a3851928bfa4adf9d8b8a06da0f6a67/users/1d550d0bfe3d49c3b34d8a2b27dd0909/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:50.095007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3851928bfa4adf9d8b8a06da0f6a67, user_id=1d550d0bfe3d49c3b34d8a2b27dd0909, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:50.098670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:50.119963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1834/3638] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:50 2022] PUT /identity/v3/projects/1a3851928bfa4adf9d8b8a06da0f6a67/users/1d550d0bfe3d49c3b34d8a2b27dd0909/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:50.125163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bc783-b484-420e-90dd-3d434ac38329 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:50.125490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bc783-b484-420e-90dd-3d434ac38329 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:50.125777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bc783-b484-420e-90dd-3d434ac38329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:50.159247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-499bc783-b484-420e-90dd-3d434ac38329 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:50.160553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-499bc783-b484-420e-90dd-3d434ac38329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:50.308771 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1805/3639] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:50.351525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:50.444351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3f71-c8aa-4641-9387-ccb03743dbe6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:50.451906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017abed4-4d33-4d07-b93d-d2a47dbcc2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:50.452735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abed4-4d33-4d07-b93d-d2a47dbcc2be service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:50.453199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abed4-4d33-4d07-b93d-d2a47dbcc2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:50.453767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abed4-4d33-4d07-b93d-d2a47dbcc2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:50.486032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017abed4-4d33-4d07-b93d-d2a47dbcc2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:50.490224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017abed4-4d33-4d07-b93d-d2a47dbcc2be service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:50.517306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1835/3640] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:50.702272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:50.702851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:50.702967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:50.733543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:50.735221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:50.840873 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:50.910618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:50.911187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:50.911333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:50.914127 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1806/3641] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:50.946282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:50.950427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:50.985524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:50.987352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:51.006235 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1836/3642] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:51.216698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453023-7650-4946-92d7-0f77c0822b31 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:51.234173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:51.240877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:51.241472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:51.245524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:51.283951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:51.285394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:51.297954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:51.300151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:51.311682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accc1b-d487-4ae0-a4ed-2b5090a68be0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:51.327217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:51.328097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:51.328387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:51.332327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] PATH_INFO: `/v3/projects/72df4743aaf445349005b13309fcae44` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:51.334274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1807/3643] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:57:51.335898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72df4743aaf445349005b13309fcae44)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:51.338391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:51.420109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72df4743aaf445349005b13309fcae44', 'request_id': 'req-4116f12d-2842-48ca-ac77-b1d76b03e1c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.431397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72df4743aaf445349005b13309fcae44', 'request_id': 'req-4116f12d-2842-48ca-ac77-b1d76b03e1c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.440169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72df4743aaf445349005b13309fcae44', 'request_id': 'req-4116f12d-2842-48ca-ac77-b1d76b03e1c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.467654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] The token cache is being invalidate because project 72df4743aaf445349005b13309fcae44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:51.468031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.469116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.480817 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1837/3644] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:51 2022] DELETE /identity/v3/projects/72df4743aaf445349005b13309fcae44 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:51.484619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:51.499382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff30010-b058-43f0-9f66-c527fcd634a4 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:51.584625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:51.585720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:51.586337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:51.586746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] PATH_INFO: `/v3/users/cef64f54003b4e54a431dceb6b9172f8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:51.588471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef64f54003b4e54a431dceb6b9172f8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:51.590788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:51.674604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef64f54003b4e54a431dceb6b9172f8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.692125 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:51.695417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef64f54003b4e54a431dceb6b9172f8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.707943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef64f54003b4e54a431dceb6b9172f8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.721385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef64f54003b4e54a431dceb6b9172f8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.722935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-64672fcb-e56c-48c0-bf24-79538d22eac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef64f54003b4e54a431dceb6b9172f8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:51.734919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1808/3645] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:51 2022] DELETE /identity/v3/users/cef64f54003b4e54a431dceb6b9172f8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:53.711419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:53.713111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:53.759931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116f12d-2842-48ca-ac77-b1d76b03e1c2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:53.808828 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:53.999194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:54.004200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:54.004685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:54.005871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] PATH_INFO: `/v3/projects/258c3b145b82471a8eeb4bb017f00bc2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:54.015591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258c3b145b82471a8eeb4bb017f00bc2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:54.025395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:54.230776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258c3b145b82471a8eeb4bb017f00bc2', 'request_id': 'req-af8acd80-29ac-4a4d-a582-f7d5643a9910'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:54.247828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258c3b145b82471a8eeb4bb017f00bc2', 'request_id': 'req-af8acd80-29ac-4a4d-a582-f7d5643a9910'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:54.270129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258c3b145b82471a8eeb4bb017f00bc2', 'request_id': 'req-af8acd80-29ac-4a4d-a582-f7d5643a9910'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:54.308649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] The token cache is being invalidate because project 258c3b145b82471a8eeb4bb017f00bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:54.309014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:54.310366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af8acd80-29ac-4a4d-a582-f7d5643a9910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:54.316442 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1838/3646] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:53 2022] DELETE /identity/v3/projects/258c3b145b82471a8eeb4bb017f00bc2 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:54.321198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:54.322204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:54.322723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:54.358861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:54.360447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:54.490773 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1809/3647] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:54.500219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:54.501955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:54.502532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:54.551269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:54.552540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:54.572559 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1839/3648] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:54.576853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:54.595231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194b942-6e3d-4df4-a192-67a6da940590 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:54.612318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:54.613186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:54.613482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:54.613755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:54.614519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:54.614819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:54.616450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:54.649349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1810/3649] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:54.650792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:54.668477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be981bd-61f3-4cc5-b459-f07c8f926496 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:54.689175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:54.689881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:54.690039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:54.690923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:54.691660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:54.693628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:54.771393 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1840/3650] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:54 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:54.775392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:54.786752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b917079-4f7d-4650-8b02-f25156f44a10 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:54.957422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:54.958117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:54.958403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:54.958707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:54.959416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:54.961560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:55.008671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1811/3651] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:54 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:55.012796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:55.036961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3308230-d4a2-4642-93fb-27201ccf529c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:55.054955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:55.055889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:55.056330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:55.056748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:55.057804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:55.061258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:55.104331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1841/3652] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:55.108077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:55.124365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f92d-b4df-4094-9e2b-a671022cba68 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:55.147341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c478a79-2df2-4059-bc86-893306c6745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:55.148030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c478a79-2df2-4059-bc86-893306c6745a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:55.148318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c478a79-2df2-4059-bc86-893306c6745a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:55.148595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c478a79-2df2-4059-bc86-893306c6745a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:55.149330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c478a79-2df2-4059-bc86-893306c6745a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:55.151760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c478a79-2df2-4059-bc86-893306c6745a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:55.195312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1812/3653] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:55.196874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:55.213721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef6fea-1cef-49ec-b5e0-4919c418627e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:55.228001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:55.228947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:55.229237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:55.229520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] PATH_INFO: `/v3/projects/4a66cfdb0149425d999d26632c0b8a0a/users/2af8de96789f4cb88a0e87eb08930a01/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:55.269737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a66cfdb0149425d999d26632c0b8a0a, user_id=2af8de96789f4cb88a0e87eb08930a01, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:55.273477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:55.339723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1842/3654] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:55 2022] PUT /identity/v3/projects/4a66cfdb0149425d999d26632c0b8a0a/users/2af8de96789f4cb88a0e87eb08930a01/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:55.427029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:55.427538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:55.428107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:55.530251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] MFA Rules not processed for user `2af8de96789f4cb88a0e87eb08930a01`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:55.531623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:55.633457 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:55.707914 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1813/3655] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:55.713585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:55.804156 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:55.835067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca25f1-5627-4c95-afd4-466341f6d0b0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:55.842422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:55.844650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:55.845189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:55.846309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:55.847321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:55.849838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:55.923613 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1843/3656] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:55 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:55.927511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:55.951870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54425401-6e7f-48b2-8096-be72f13bd2ca None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.087273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.087992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.088354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.089120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.089360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.097000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.164380 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1814/3657] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:55 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:56.168167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.208443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a308c-b9a3-4f44-9419-41962849d7e2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.235239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.235939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.236258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.236540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.237375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.239075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.276124 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1844/3658] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:56.280311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.310358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6782e-cd42-4336-ab9e-26d7cd003344 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.329391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.330434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.330738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.331026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] PATH_INFO: `/v3/projects/206b6a6c2f4745fb826d63f471741ab6/users/d259c220ee224191b1e570773e5ca1de/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.366202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206b6a6c2f4745fb826d63f471741ab6, user_id=d259c220ee224191b1e570773e5ca1de, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.369125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.398540 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1815/3659] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:56 2022] PUT /identity/v3/projects/206b6a6c2f4745fb826d63f471741ab6/users/d259c220ee224191b1e570773e5ca1de/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:56.402655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.418176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ac85-7ba0-47e9-81dc-4b472ebf6329 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.601682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d61c-e92e-4842-a2c2-0de33e24b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.601961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d61c-e92e-4842-a2c2-0de33e24b77b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.602109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d61c-e92e-4842-a2c2-0de33e24b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.602306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d61c-e92e-4842-a2c2-0de33e24b77b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.603103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d61c-e92e-4842-a2c2-0de33e24b77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.604758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d61c-e92e-4842-a2c2-0de33e24b77b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.635690 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1845/3660] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:56.636644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.650112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8c6a-9d3b-438a-93df-d57c58f62078 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.662131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.663665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.663958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.664328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] PATH_INFO: `/v3/projects/206b6a6c2f4745fb826d63f471741ab6/users/d259c220ee224191b1e570773e5ca1de/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.672913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=206b6a6c2f4745fb826d63f471741ab6, user_id=d259c220ee224191b1e570773e5ca1de, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.685513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.722642 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1816/3661] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:56 2022] PUT /identity/v3/projects/206b6a6c2f4745fb826d63f471741ab6/users/d259c220ee224191b1e570773e5ca1de/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:56.735742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.736060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.736353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.784842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] MFA Rules not processed for user `d259c220ee224191b1e570773e5ca1de`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:56.786454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:56.895295 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1846/3662] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:56.899949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.924471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb3b0e-eaa3-4f00-9a7d-2048e2efc80b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:56.943528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:56.944413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:56.944825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:56.946935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:56.949585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:56.951984 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:56.951984 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:56.951984 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:56.954007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:56.982981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:56.983628 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1817/3663] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 14:57:56 2022] POST /identity/v3/domains => generated 276 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:56.998095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce788d1-d43c-4627-9613-cad0b1d85710 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.071128 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:57.093651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.096072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.096072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.096072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.096072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.102020 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:57.102020 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:57.102020 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:57.102020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.152592 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1847/3664] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:57:56 2022] POST /identity/v3/groups => generated 279 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:57.156708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.184733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212b1c-a776-4318-8128-dd95f14bda94 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.196024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.196981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.197304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.197594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/5694ab82d222499eb2ab07bd01e0c196` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.216409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:update_group(group_id=5694ab82d222499eb2ab07bd01e0c196)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.217391 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:57.217391 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:57.217391 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:57.218611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.281721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.303411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1818/3665] 10.222.0.77 () {60 vars in 1246 bytes} [Mon Jul 11 14:57:57 2022] PATCH /identity/v3/groups/5694ab82d222499eb2ab07bd01e0c196 => generated 292 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:57.306810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d8999-5b9c-4132-b77f-8a1c5bc21e12 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.313201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.314090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.315109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.315396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/5694ab82d222499eb2ab07bd01e0c196` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.323227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:get_group(group_id=5694ab82d222499eb2ab07bd01e0c196)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.324286 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:57.324286 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:57.324286 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:57.325766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.331051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1848/3666] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:57 2022] GET /identity/v3/groups/5694ab82d222499eb2ab07bd01e0c196 => generated 292 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:57.332088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.344595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f702a-1054-4d85-b463-b98d94f87d29 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.364237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.364516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.364805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.365086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/5694ab82d222499eb2ab07bd01e0c196` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.366441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:update_group(group_id=5694ab82d222499eb2ab07bd01e0c196)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.368447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.402221 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1819/3667] 10.222.0.77 () {60 vars in 1245 bytes} [Mon Jul 11 14:57:57 2022] PATCH /identity/v3/groups/5694ab82d222499eb2ab07bd01e0c196 => generated 309 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:57:57.406798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.441934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb59662-2aba-44b1-a3b6-2ed5a012e3d0 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.458130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.460703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.461160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.461594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/5694ab82d222499eb2ab07bd01e0c196` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.473068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5694ab82d222499eb2ab07bd01e0c196)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.475460 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:57.475460 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:57.475460 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:57.476698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.558171 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1849/3668] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:57:57 2022] DELETE /identity/v3/groups/5694ab82d222499eb2ab07bd01e0c196 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:57.566110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.599812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5cc55-f8f0-4df7-b56d-275de8f2963a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.677087 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:57.724680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.727952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.728411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.728999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.729827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.736333 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:57.736333 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:57.736333 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:57.740847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.775181 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1820/3669] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:57:57 2022] POST /identity/v3/groups => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:57.776622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.801130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e256-cf1a-47b3-9766-fc19b21cab20 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.812906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.814283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.815116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.815400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:57.816107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:57.818002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:57.819489 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.common [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:57:57.859757 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1850/3670] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:57 2022] POST /identity/v3/users => generated 321 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:57.860140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:57.890862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8222633-6a65-4b1f-93f5-46983d3c73b8 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:57.907026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:57.909679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:57.910901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:57.914070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/c0d7dacbe5604f49aac50b748ce74873` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.007738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=c0d7dacbe5604f49aac50b748ce74873)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.011948 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:58.011948 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:58.011948 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:58.016328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.108129 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1821/3671] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 14:57:57 2022] PUT /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/c0d7dacbe5604f49aac50b748ce74873 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:58.114105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.128213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee92c-ec57-4f13-817a-5947585b41d2 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.275095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.275789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.276086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.276369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.277085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.280796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.360616 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1851/3672] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:58 2022] POST /identity/v3/users => generated 323 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:58.360865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.375899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cf50a-fea1-463c-a583-900fd315eb1c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.390138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.390653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.391100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.391634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/74b8f1f8986443128d54ac8f0c7b42b7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.434375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=74b8f1f8986443128d54ac8f0c7b42b7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.440310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.504414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1822/3673] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 14:57:58 2022] PUT /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/74b8f1f8986443128d54ac8f0c7b42b7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:58.508728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.532541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c9d10-b9d6-4960-99d1-fb0a87b8e74a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.609000 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:58.638800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.639626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.640007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.641056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.642017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.644507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.686008 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1852/3674] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:58 2022] POST /identity/v3/users => generated 323 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:58.687587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.701995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d9f9-ec69-41f3-bf5e-8fba4a4ce18c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.712169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.713099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.713383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.713665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/5c6de4039440458883e9521de92d2f68` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.735157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=5c6de4039440458883e9521de92d2f68)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.738714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.768460 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1823/3675] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 14:57:58 2022] PUT /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/5c6de4039440458883e9521de92d2f68 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:58.772737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.783782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c719-0ebc-44db-80c3-9ffb8f60fad7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.870658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.871728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.872087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.872749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.877788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=0c87f644c8a6438485331bb6b52cd13e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.879133 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:58.879133 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:58.879133 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:58.880699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.904817 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1853/3676] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 14:57:58 2022] GET /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users => generated 1083 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:58.909353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.920250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c011528-cb20-4167-a5f1-e081531a709c tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.925777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.926838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.927176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.927526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/c0d7dacbe5604f49aac50b748ce74873` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.931475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=c0d7dacbe5604f49aac50b748ce74873)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.932152 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:58.932152 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:58.932152 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:58.933314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.951651 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1824/3677] 10.222.0.77 () {58 vars in 1341 bytes} [Mon Jul 11 14:57:58 2022] HEAD /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/c0d7dacbe5604f49aac50b748ce74873 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:58.957005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:58.968938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee29dcf-6d3e-49e5-9bf6-aba8f9ff93cb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:58.977583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:58.978657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:58.979069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:58.979420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/c0d7dacbe5604f49aac50b748ce74873` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:58.982413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=c0d7dacbe5604f49aac50b748ce74873)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:58.983620 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:58.983620 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:57:58.983620 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:57:58.984870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:58.999388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c0d7dacbe5604f49aac50b748ce74873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.024928 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1854/3678] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 14:57:58 2022] DELETE /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/c0d7dacbe5604f49aac50b748ce74873 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:59.026105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.039391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18363-1db2-4728-a1b6-0a5d569bdf35 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.146711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.147693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.147981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.148277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/74b8f1f8986443128d54ac8f0c7b42b7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.150114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=74b8f1f8986443128d54ac8f0c7b42b7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.152107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.168062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1825/3679] 10.222.0.77 () {58 vars in 1341 bytes} [Mon Jul 11 14:57:59 2022] HEAD /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/74b8f1f8986443128d54ac8f0c7b42b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:59.172177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.187050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04416354-4b57-41d3-ab83-d1775a648ffe tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.209168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.211082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.211748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.212742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/74b8f1f8986443128d54ac8f0c7b42b7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.215468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=74b8f1f8986443128d54ac8f0c7b42b7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.218907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.235030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '74b8f1f8986443128d54ac8f0c7b42b7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.263421 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1855/3680] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 14:57:59 2022] DELETE /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/74b8f1f8986443128d54ac8f0c7b42b7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:59.268725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.279241 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:59.287164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb1b94-7d1a-4855-ba99-5ddaeefe4ddf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.418171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.420749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.421175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.421562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/5c6de4039440458883e9521de92d2f68` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.423968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=5c6de4039440458883e9521de92d2f68)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.427079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.455806 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1826/3681] 10.222.0.77 () {58 vars in 1341 bytes} [Mon Jul 11 14:57:59 2022] HEAD /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/5c6de4039440458883e9521de92d2f68 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:59.457114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.485703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c13e1-16cd-4716-99fe-0631833b9193 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.502707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.512595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.512905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.518279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/5c6de4039440458883e9521de92d2f68` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.524379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0c87f644c8a6438485331bb6b52cd13e, user_id=5c6de4039440458883e9521de92d2f68)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.526360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.545690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5c6de4039440458883e9521de92d2f68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:59.592703 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1856/3682] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 14:57:59 2022] DELETE /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users/5c6de4039440458883e9521de92d2f68 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:59.598049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.616435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732302c2-789f-4342-90d0-b4e15b8b8445 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.824169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.827587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.831805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.832237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.836602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=0c87f644c8a6438485331bb6b52cd13e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.838142 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:57:59.838142 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:57:59.838142 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:57:59.842807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:59.882019 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1827/3683] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 14:57:59 2022] GET /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e/users => generated 145 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:59.886533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:59.907995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e449d82-6623-448d-8ed1-0d29af085642 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:59.916793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:59.917995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:59.918450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:59.918921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users/5c6de4039440458883e9521de92d2f68` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:59.920646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5c6de4039440458883e9521de92d2f68)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:59.922954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:00.061535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6de4039440458883e9521de92d2f68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.063874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6de4039440458883e9521de92d2f68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.077669 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:INSERT=6,keystone:DELETE=13 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:00.092589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6de4039440458883e9521de92d2f68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.093501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6de4039440458883e9521de92d2f68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.110692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6de4039440458883e9521de92d2f68'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.155150 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1857/3684] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:59 2022] DELETE /identity/v3/users/5c6de4039440458883e9521de92d2f68 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:00.159481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.161246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:00.190051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853dc7f-f27e-462e-8d11-650d6d9dbadb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.302243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.303370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.303790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.304149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users/74b8f1f8986443128d54ac8f0c7b42b7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.305518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_user(user_id=74b8f1f8986443128d54ac8f0c7b42b7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.308605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:00.382239 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:00.390207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b8f1f8986443128d54ac8f0c7b42b7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.430238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b8f1f8986443128d54ac8f0c7b42b7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.441051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b8f1f8986443128d54ac8f0c7b42b7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.455183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b8f1f8986443128d54ac8f0c7b42b7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.458140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b8f1f8986443128d54ac8f0c7b42b7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.472402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1828/3685] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:00 2022] DELETE /identity/v3/users/74b8f1f8986443128d54ac8f0c7b42b7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:00.476407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.490007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ac74-0c9b-4984-a682-eeea1ce1a1c9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.620954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.622475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.623017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.623966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users/c0d7dacbe5604f49aac50b748ce74873` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.635619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c0d7dacbe5604f49aac50b748ce74873)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.638191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:00.707392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d7dacbe5604f49aac50b748ce74873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.708416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d7dacbe5604f49aac50b748ce74873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.730438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d7dacbe5604f49aac50b748ce74873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.731202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d7dacbe5604f49aac50b748ce74873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.743167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d7dacbe5604f49aac50b748ce74873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:00.770361 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1858/3686] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:00 2022] DELETE /identity/v3/users/c0d7dacbe5604f49aac50b748ce74873 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:00.771526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:00.775001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:00.810327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4d779-dd27-4672-9756-9da504dc24d9 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:00.961679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:00.962888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:00.963560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:00.963947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/0c87f644c8a6438485331bb6b52cd13e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:00.965348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0c87f644c8a6438485331bb6b52cd13e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:00.968697 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:58:00.968697 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:58:00.968697 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:58:00.971677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.059597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.060197 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1829/3687] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:58:00 2022] DELETE /identity/v3/groups/0c87f644c8a6438485331bb6b52cd13e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:01.061549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:01.080992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686bc7b-1ed6-4342-bd78-8c16db6f7e9a tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.167337 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:01.192145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.193082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.193543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.194968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.195908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.200005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.233643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.235261 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1859/3688] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:58:01 2022] POST /identity/v3/groups => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:01.245539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97801b-6a46-4488-ad06-b25972469fd7 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.253497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.254342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.254723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.255089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.255942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.258280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.280192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1830/3689] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:58:01 2022] POST /identity/v3/groups => generated 325 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:01.281564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.294035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c5f56-05c1-42fa-822a-b51c14f30be5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.300186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.301049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.301436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.301778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.302588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.304949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.330572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1860/3690] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:58:01 2022] POST /identity/v3/groups => generated 325 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:01.331883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.343873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1765bc9-a88d-48e1-9c63-80a89f3b17aa tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.349390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.350094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.350374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.350820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.351553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.352590 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:58:01.352590 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:58:01.352590 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:58:01.353855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.366476 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1831/3691] 10.222.0.77 () {58 vars in 1124 bytes} [Mon Jul 11 14:58:01 2022] GET /identity/v3/groups => generated 1485 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:01.368083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.381261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb78c-d9c2-4cfe-81d1-5df813a74450 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.386930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.387818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.388103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.388382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/97581883b18e4019baddd29834981b67` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.397443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=97581883b18e4019baddd29834981b67)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.400807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.476458 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1861/3692] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:58:01 2022] DELETE /identity/v3/groups/97581883b18e4019baddd29834981b67 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:01.480820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.527282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a897090-67cb-4f1b-94c0-0b821af40bdf tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:01.636057 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:01.675002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:01.675892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:01.676288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:01.676594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/74377aa5b21c45749b67bf56755fefac` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:01.685094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=74377aa5b21c45749b67bf56755fefac)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:01.687265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:01.848587 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1832/3693] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:58:01 2022] DELETE /identity/v3/groups/74377aa5b21c45749b67bf56755fefac => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:01.849967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:01.866718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af89c3-f150-46c8-9763-9d5d20699749 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:02.037024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:02.037921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:02.038210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:02.038532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/09802e2d8600499ea7ce646cee737080` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:02.061715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=09802e2d8600499ea7ce646cee737080)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:02.063705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:02.128551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1862/3694] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:58:01 2022] DELETE /identity/v3/groups/09802e2d8600499ea7ce646cee737080 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:02.130103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:02.156138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08bd44-b4ed-42e4-8214-922db486c79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:02.294258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:02.295187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:02.295545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:02.295897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:02.296707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:02.299193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:02.365374 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1833/3695] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:02 2022] POST /identity/v3/users => generated 321 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:02.378073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:02.408527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5821-ea3d-4306-aac2-eb64824bf750 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:02.428290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:02.429881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:02.432271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:02.444403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:02.446355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:02.456286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:02.492127 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1863/3696] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:58:02 2022] POST /identity/v3/groups => generated 326 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:02.498152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:02.526373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef53e9-e8bb-4a7d-99ab-eda0de69f06b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:02.535525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:02.536724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:02.537112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:02.537542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/4fc1e3b7a77c4460be952d1a9373c898/users/8baf0379c32e4f1cacbd02d9ad41ddd0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:02.643343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4fc1e3b7a77c4460be952d1a9373c898, user_id=8baf0379c32e4f1cacbd02d9ad41ddd0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:02.646058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:02.716354 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1834/3697] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 14:58:02 2022] PUT /identity/v3/groups/4fc1e3b7a77c4460be952d1a9373c898/users/8baf0379c32e4f1cacbd02d9ad41ddd0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:02.721093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:02.739445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcedc7-63a1-407c-a298-368fe9791991 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:02.757721 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:02.834300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:02.835260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:02.835730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:02.836262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:02.837915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:02.852548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:02.874838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1864/3698] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 14:58:02 2022] POST /identity/v3/groups => generated 327 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:02.876166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:02.887511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a093a-fbe7-4f6d-bbb7-f505331bfd7d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:02.893112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:02.894320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:02.894818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:02.895254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/8b40546278ab4bb19c349bf969170d40/users/8baf0379c32e4f1cacbd02d9ad41ddd0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:02.907580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8b40546278ab4bb19c349bf969170d40, user_id=8baf0379c32e4f1cacbd02d9ad41ddd0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:02.911001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:02.948952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:02.949570 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1835/3699] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 14:58:02 2022] PUT /identity/v3/groups/8b40546278ab4bb19c349bf969170d40/users/8baf0379c32e4f1cacbd02d9ad41ddd0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:02.973771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de015b61-dc48-41b7-b516-96a01b78f79d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:03.064786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:03.065839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:03.066538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:03.067089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users/8baf0379c32e4f1cacbd02d9ad41ddd0/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:03.068983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=8baf0379c32e4f1cacbd02d9ad41ddd0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:03.078717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:03.102563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1865/3700] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 14:58:02 2022] GET /identity/v3/users/8baf0379c32e4f1cacbd02d9ad41ddd0/groups => generated 839 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:03.106744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:03.126209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206a5b5-eb53-40fc-8bef-5861ffb2d273 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:03.132957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:03.133729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:03.134011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:03.134292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/8b40546278ab4bb19c349bf969170d40` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:03.140476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8b40546278ab4bb19c349bf969170d40)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:03.145138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:03.188093 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:03.223244 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1836/3701] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:58:03 2022] DELETE /identity/v3/groups/8b40546278ab4bb19c349bf969170d40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:03.224401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:03.235619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e14438-54af-46b6-b1c8-3729f3c2a841 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:03.315258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:03.316326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:03.316670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:03.316877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/groups/4fc1e3b7a77c4460be952d1a9373c898` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:03.318177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4fc1e3b7a77c4460be952d1a9373c898)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:03.320233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:03.398389 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:03.409704 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1866/3702] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 14:58:03 2022] DELETE /identity/v3/groups/4fc1e3b7a77c4460be952d1a9373c898 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:03.411906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:03.429758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d045d14-b908-4037-994f-b2b2d0d684fb tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:03.524073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:03.525421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:03.526232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:03.526690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/users/8baf0379c32e4f1cacbd02d9ad41ddd0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:03.528150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8baf0379c32e4f1cacbd02d9ad41ddd0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:03.531522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:03.630527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baf0379c32e4f1cacbd02d9ad41ddd0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:03.647318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baf0379c32e4f1cacbd02d9ad41ddd0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:03.664472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baf0379c32e4f1cacbd02d9ad41ddd0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:03.691708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baf0379c32e4f1cacbd02d9ad41ddd0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:03.693380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baf0379c32e4f1cacbd02d9ad41ddd0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:03.730032 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1837/3703] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:03 2022] DELETE /identity/v3/users/8baf0379c32e4f1cacbd02d9ad41ddd0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:03.730929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:03.733482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:03.758089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e660a-cca5-42ad-a9a9-04180592ed78 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:03.931547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:03.932444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:03.932733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:03.933618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/domains/bcfb5df2320b470b99a2b096fc0cb84b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:03.939751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bcfb5df2320b470b99a2b096fc0cb84b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:03.952956 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:58:03.952956 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:58:03.952956 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:58:03.954000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:04.007223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.016223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.101033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.103612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.111952 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1867/3704] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 14:58:03 2022] PATCH /identity/v3/domains/bcfb5df2320b470b99a2b096fc0cb84b => generated 277 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:04.115180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:04.136279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88193c75-3b7f-45f3-8d1d-52e32ecebea5 tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:04.226360 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:04.234395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd259c220ee224191b1e570773e5ca1de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '206b6a6c2f4745fb826d63f471741ab6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:04.235394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:04.235962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:04.236967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] PATH_INFO: `/v3/domains/bcfb5df2320b470b99a2b096fc0cb84b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:04.267740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bcfb5df2320b470b99a2b096fc0cb84b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:04.268896 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:58:04.268896 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 14:58:04.268896 n-d-master-1 devstack@keystone.service[80990]: Jul 11 14:58:04.269951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:04.306965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.314987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.401221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b', 'request_id': 'req-e0ed3746-9d62-4421-a476-27fae077142b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.409901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b', 'request_id': 'req-e0ed3746-9d62-4421-a476-27fae077142b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.420972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b', 'request_id': 'req-e0ed3746-9d62-4421-a476-27fae077142b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.438647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] The token cache is being invalidate because project bcfb5df2320b470b99a2b096fc0cb84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:04.440156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.440854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.453992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b', 'request_id': 'req-e0ed3746-9d62-4421-a476-27fae077142b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.459556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b', 'request_id': 'req-e0ed3746-9d62-4421-a476-27fae077142b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.460460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0ed3746-9d62-4421-a476-27fae077142b tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bcfb5df2320b470b99a2b096fc0cb84b', 'request_id': 'req-e0ed3746-9d62-4421-a476-27fae077142b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.466534 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1838/3705] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 14:58:04 2022] DELETE /identity/v3/domains/bcfb5df2320b470b99a2b096fc0cb84b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:04.470572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:04.472144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:04.547525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:04.547823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:04.548102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:04.590811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303db139-5dcb-4f85-be44-c44f1da74b3d tempest-GroupsV3TestJSON-890057730 tempest-GroupsV3TestJSON-890057730-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:04.613343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] MFA Rules not processed for user `1d550d0bfe3d49c3b34d8a2b27dd0909`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:04.615074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:04.739271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:04.740723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:04.740948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:04.741227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] PATH_INFO: `/v3/users/2af8de96789f4cb88a0e87eb08930a01` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:04.745092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af8de96789f4cb88a0e87eb08930a01)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:04.747085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:04.786719 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:04.801629 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1839/3706] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:04.802575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:04.805485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:04.855145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bc33-a88b-4c89-a4a6-38f09adf0a5e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:04.887065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:04.891128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:04.891128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:04.891128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:04.893761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af8de96789f4cb88a0e87eb08930a01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.894860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:04.898864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af8de96789f4cb88a0e87eb08930a01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.901839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:04.937754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af8de96789f4cb88a0e87eb08930a01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.939082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af8de96789f4cb88a0e87eb08930a01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.951720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3f2c88b7-1ec9-4f61-a0ef-b7d0f99f6f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af8de96789f4cb88a0e87eb08930a01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:04.969862 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1840/3707] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:04 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:04.971636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:04.979681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:04.980115 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1868/3708] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:04 2022] DELETE /identity/v3/users/2af8de96789f4cb88a0e87eb08930a01 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:04.987381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:04.987696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:04.989624 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:04.990886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.028665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:05.030727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:05.108631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a3ba-3bdf-4e67-9df7-9d49f637bca9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:05.184693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1869/3709] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:05.184997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:05.186031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:05.186329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:05.186655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.187459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:05.189503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:05.194020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:05.197947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:05.225229 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1841/3710] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:04 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:05.230609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:05.249184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbd780-02cf-4200-8092-7778d67d6de3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:05.259855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:05.260666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:05.260967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:05.261225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.261968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:05.263770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:05.283577 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1842/3711] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:05.304200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:05.325277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066edb8-be71-42a3-8de4-b5ba253222a9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:05.328076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f69ca-5c67-47cf-8985-4e8da5d2932f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:05.337214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:05.338454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:05.341184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:05.341772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.343310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:05.346838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:05.346838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:05.347090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] PATH_INFO: `/v3/projects/2980ab146ce8405aa64423e00d0375c5/users/1a17808ef78f4d3882b96a2146ceb20b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.361776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:05.370631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:05.379130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2980ab146ce8405aa64423e00d0375c5, user_id=1a17808ef78f4d3882b96a2146ceb20b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:05.382108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:05.384925 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1870/3712] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:58:05.398365 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1843/3713] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:05 2022] PUT /identity/v3/projects/2980ab146ce8405aa64423e00d0375c5/users/1a17808ef78f4d3882b96a2146ceb20b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:05.402431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:05.415890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6d18-c0bb-45d7-b102-3a5137914b8c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:05.457349 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:05.491534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:05.492821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:05.494370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:05.495020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.498421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:05.500245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:05.518543 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1871/3714] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:05.523999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:05.542325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b905c08-ad3a-4c15-9537-46fabb2717ca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:05.547740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:05.548720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:05.549012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:05.549292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] PATH_INFO: `/v3/projects/2980ab146ce8405aa64423e00d0375c5/users/1a17808ef78f4d3882b96a2146ceb20b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:05.551566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2980ab146ce8405aa64423e00d0375c5, user_id=1a17808ef78f4d3882b96a2146ceb20b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:05.554243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:05.574128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1844/3715] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:05 2022] PUT /identity/v3/projects/2980ab146ce8405aa64423e00d0375c5/users/1a17808ef78f4d3882b96a2146ceb20b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:06.539638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:06.551311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:06.573437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35b8ce-6710-4c41-893b-42d28617751f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:06.644727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:06.646856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:06.710877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:06.717914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:06.718797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:06.719089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] PATH_INFO: `/v3/projects/4a66cfdb0149425d999d26632c0b8a0a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:06.725314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a66cfdb0149425d999d26632c0b8a0a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:06.728563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:06.846793 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:06.862914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a66cfdb0149425d999d26632c0b8a0a', 'request_id': 'req-23857513-e8ca-463f-b3e0-f627a5d3e2af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:06.898604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a66cfdb0149425d999d26632c0b8a0a', 'request_id': 'req-23857513-e8ca-463f-b3e0-f627a5d3e2af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:06.919945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a66cfdb0149425d999d26632c0b8a0a', 'request_id': 'req-23857513-e8ca-463f-b3e0-f627a5d3e2af'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:06.928429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af609a-d5c9-4f1d-9e31-028e7d130a13 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:06.940299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] The token cache is being invalidate because project 4a66cfdb0149425d999d26632c0b8a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:06.940595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:06.944342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:06.950741 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1872/3716] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:06 2022] DELETE /identity/v3/projects/4a66cfdb0149425d999d26632c0b8a0a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:06.951690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:06.956076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:07.093379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:07.098734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:07.099081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:07.099264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:07.103790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:07.118216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:07.120500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:07.135098 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1845/3717] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:07.136280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:07.138523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:07.160663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857513-e8ca-463f-b3e0-f627a5d3e2af admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:07.179120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:07.180075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:07.180303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:07.180648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] PATH_INFO: `/v3/users/bf59a9e902304a60939b4d5309b90714` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:07.181818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf59a9e902304a60939b4d5309b90714)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:07.184125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:07.185415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893895-f50c-4339-9f7f-0f1559e335a3 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:07.194538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:07.195562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:07.195849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:07.195997 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:07.196140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] PATH_INFO: `/v3/users/d259c220ee224191b1e570773e5ca1de` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:07.198704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d259c220ee224191b1e570773e5ca1de)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:07.200904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:07.287830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf59a9e902304a60939b4d5309b90714'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.289270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf59a9e902304a60939b4d5309b90714'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.307244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf59a9e902304a60939b4d5309b90714'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.308253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf59a9e902304a60939b4d5309b90714'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.318917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd259c220ee224191b1e570773e5ca1de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.326364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf59a9e902304a60939b4d5309b90714'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.354114 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1873/3718] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:06 2022] DELETE /identity/v3/users/bf59a9e902304a60939b4d5309b90714 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:07.354678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd259c220ee224191b1e570773e5ca1de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.371821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd259c220ee224191b1e570773e5ca1de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.387027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd259c220ee224191b1e570773e5ca1de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.388014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd259c220ee224191b1e570773e5ca1de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:07.408208 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1846/3719] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:07 2022] DELETE /identity/v3/users/d259c220ee224191b1e570773e5ca1de => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:08.038825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:08.040321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.043243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:08.045309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.208706 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:08.247872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8c70-23e7-4533-963d-c2644747d6e1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:08.262989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:08.265167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.265593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.266104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] PATH_INFO: `/v3/projects/206b6a6c2f4745fb826d63f471741ab6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.268950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=206b6a6c2f4745fb826d63f471741ab6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:08.270453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9f26-8fbc-4495-8db9-7cfaaa947247 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:08.271183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:08.284791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:08.285767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.286118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.286457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] PATH_INFO: `/v3/projects/efe013099b8a416ba5edb8829a9a17d4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.290315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe013099b8a416ba5edb8829a9a17d4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:08.293592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:08.369078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe013099b8a416ba5edb8829a9a17d4', 'request_id': 'req-709d183a-9342-49c9-bc20-bfd0d5ffe252'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.377617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206b6a6c2f4745fb826d63f471741ab6', 'request_id': 'req-fd9666b4-4424-4b80-ab8c-50abd39b1176'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.382637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe013099b8a416ba5edb8829a9a17d4', 'request_id': 'req-709d183a-9342-49c9-bc20-bfd0d5ffe252'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.397762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe013099b8a416ba5edb8829a9a17d4', 'request_id': 'req-709d183a-9342-49c9-bc20-bfd0d5ffe252'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.401440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206b6a6c2f4745fb826d63f471741ab6', 'request_id': 'req-fd9666b4-4424-4b80-ab8c-50abd39b1176'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.420733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206b6a6c2f4745fb826d63f471741ab6', 'request_id': 'req-fd9666b4-4424-4b80-ab8c-50abd39b1176'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.425813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] The token cache is being invalidate because project efe013099b8a416ba5edb8829a9a17d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:08.426180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.428104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.434941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1874/3720] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:08 2022] DELETE /identity/v3/projects/efe013099b8a416ba5edb8829a9a17d4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:08.438109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:08.440902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.445154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] The token cache is being invalidate because project 206b6a6c2f4745fb826d63f471741ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:08.445645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.446600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd9666b4-4424-4b80-ab8c-50abd39b1176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.450793 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1847/3721] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:08 2022] DELETE /identity/v3/projects/206b6a6c2f4745fb826d63f471741ab6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:08.457769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923540e6-d9c4-4a85-92a9-d46c2d767b49 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.464647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923540e6-d9c4-4a85-92a9-d46c2d767b49 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.465110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923540e6-d9c4-4a85-92a9-d46c2d767b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.475592 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:08.491888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-923540e6-d9c4-4a85-92a9-d46c2d767b49 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:08.509177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-923540e6-d9c4-4a85-92a9-d46c2d767b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.610125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d183a-9342-49c9-bc20-bfd0d5ffe252 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:08.624292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:08.625232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.625487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.625980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] PATH_INFO: `/v3/users/839be0adb459435da71015e49cc81728` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.629740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839be0adb459435da71015e49cc81728)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:08.632485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:08.672387 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1848/3722] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:08.675530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.675819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.676139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.711296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839be0adb459435da71015e49cc81728'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.712173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839be0adb459435da71015e49cc81728'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.723972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:08.725402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:08.735445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839be0adb459435da71015e49cc81728'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.736264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839be0adb459435da71015e49cc81728'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.754366 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1849/3723] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:08.754366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:08.755393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839be0adb459435da71015e49cc81728'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:08.767798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e19c8-1734-46bc-a559-98d8df90e45c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:08.779877 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1875/3724] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:08 2022] DELETE /identity/v3/users/839be0adb459435da71015e49cc81728 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:08.781187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:08.784123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.785333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.785719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.786617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:08.788402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:08.793390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:08.819628 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1850/3725] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:08.824033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:08.957391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8b252-2689-4c4a-a906-0d5a892c4804 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:08.963532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:08.964500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:08.964949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:08.965532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:08.966414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:08.968741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.005775 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1876/3726] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:08 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:09.010994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.023176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ea77-d64f-460b-813f-f7576aa8dbeb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.114894 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:09.122843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.124489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.125194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.125718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.126572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.129037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.174108 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1851/3727] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:09 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:09.174647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.190288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d28b1-8fdd-4612-a25a-291bc3ddebbb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.210833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.211544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.211840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.212127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.213706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.214546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.241813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1877/3728] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:09.244698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.272148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84dd97-b0db-4bd8-8bc7-1b46015748f8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.273404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.275263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:09.288705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.289568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.290184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.290467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.291735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.293849 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:09.306209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42fe69-701b-4c01-90d9-726e962bc9a4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.307706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.314402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.315373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.315672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.319879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] PATH_INFO: `/v3/projects/922e39a6de404676b3e335d262ae6169` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.321605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922e39a6de404676b3e335d262ae6169)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.324079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.334627 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1852/3729] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:09.336280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.349731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e348f-5290-46c1-94e5-66f1372761c2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.369524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07447-f63d-4596-ad3f-34fac4e7d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.382027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07447-f63d-4596-ad3f-34fac4e7d69e admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.383458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07447-f63d-4596-ad3f-34fac4e7d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.386223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07447-f63d-4596-ad3f-34fac4e7d69e admin admin] PATH_INFO: `/v3/projects/279bf0a7bb74480b8f876c45f7b57d7a/users/f94e9cffbe144325a2806ebb2f276615/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.434847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07447-f63d-4596-ad3f-34fac4e7d69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=279bf0a7bb74480b8f876c45f7b57d7a, user_id=f94e9cffbe144325a2806ebb2f276615, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.441530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07447-f63d-4596-ad3f-34fac4e7d69e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.458666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922e39a6de404676b3e335d262ae6169', 'request_id': 'req-653a3f04-6b04-42a3-8848-64295cef5a90'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:09.474301 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1853/3730] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:09 2022] PUT /identity/v3/projects/279bf0a7bb74480b8f876c45f7b57d7a/users/f94e9cffbe144325a2806ebb2f276615/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:09.483711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922e39a6de404676b3e335d262ae6169', 'request_id': 'req-653a3f04-6b04-42a3-8848-64295cef5a90'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:09.488651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.488651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.492247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.530512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922e39a6de404676b3e335d262ae6169', 'request_id': 'req-653a3f04-6b04-42a3-8848-64295cef5a90'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:09.560755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] MFA Rules not processed for user `f94e9cffbe144325a2806ebb2f276615`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:09.562031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:09.567179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] The token cache is being invalidate because project 922e39a6de404676b3e335d262ae6169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:09.567932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:09.570647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-653a3f04-6b04-42a3-8848-64295cef5a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:09.575743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1878/3731] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:09 2022] DELETE /identity/v3/projects/922e39a6de404676b3e335d262ae6169 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:09.580886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4813701-7ec2-4cdd-aa23-c5ff2658390d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.581465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4813701-7ec2-4cdd-aa23-c5ff2658390d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.581909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4813701-7ec2-4cdd-aa23-c5ff2658390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.632789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b4813701-7ec2-4cdd-aa23-c5ff2658390d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:09.634178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4813701-7ec2-4cdd-aa23-c5ff2658390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:09.719367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1854/3732] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:09.720888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.722426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:09.819772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1879/3733] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:58:09.830050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.830394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.831449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.882229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:09.883517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:09.899147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32909-bbe9-4a27-94f6-bc4835ebd30e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.911044 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1880/3734] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:09.916334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:09.923278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.927524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.931381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.931824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.933963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.943430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581cd3-fd80-40cf-9b83-10e4f8430d58 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:09.946634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.958882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:09.965061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:09.965061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:09.965061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:09.965889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:09.965889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:09.967624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:09.996028 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1881/3735] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:10.002270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.027350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56db34-8895-46e0-a04d-bfc866fe6130 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.041378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.042725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.043013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.049289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.049289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.052514 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1855/3736] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:09 2022] POST /identity/v3/projects => generated 375 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:10.053698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.066139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.131397 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1882/3737] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:10 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:10.132896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.140450 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:10.245416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4367e5-de5a-4ba4-8fc1-a4a0ef2475f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.258693 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:10.288352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d4ca-2dc8-4f60-b2c4-c930235d31e9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.302488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.303225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.303515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.303794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.304499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.306450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.350536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1883/3738] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:10 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:10.352352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.366819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a393d1-b7f9-417e-9e33-2d9510530e4d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.368537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.373057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.373575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.374392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.375084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.376344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.377186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.377503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.378214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.379773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.379953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.386917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.407127 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1884/3739] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:10.408847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.426483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c273f4-9905-4d1f-8b5a-fb1c4c7e8524 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.436765 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1856/3740] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:10 2022] POST /identity/v3/users => generated 294 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:10.440379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.448212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.448904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.449191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.449472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.450932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.452982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.472998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4bccf-0316-4579-b9b3-3019e10ee561 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.478057 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1885/3741] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:10.479017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.484151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.492173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.492605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.492985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.496599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.498455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.514782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4b12d-974a-40bc-8fdd-500e6e757d0e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.533354 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1857/3742] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:10.535861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.541377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a3e42-f21c-4f3f-b939-56812741f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.542306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3e42-f21c-4f3f-b939-56812741f834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.542615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3e42-f21c-4f3f-b939-56812741f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.542894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3e42-f21c-4f3f-b939-56812741f834 admin admin] PATH_INFO: `/v3/projects/0c52196f02cb471eb30487e1664f0adf/users/2498f2b4e9bb4e4baedc83e1462867b4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.562205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88895d-a332-4b74-8307-d88130ecc386 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.582626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.583548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.583834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.584115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] PATH_INFO: `/v3/projects/1b3be08bf34846eaa02f51c60c8bcab2/users/83f7266e6fae433485fb8864bbd2fc33/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.602553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a3e42-f21c-4f3f-b939-56812741f834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c52196f02cb471eb30487e1664f0adf, user_id=2498f2b4e9bb4e4baedc83e1462867b4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.605122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a3e42-f21c-4f3f-b939-56812741f834 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.619047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3be08bf34846eaa02f51c60c8bcab2, user_id=83f7266e6fae433485fb8864bbd2fc33, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.621634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.635138 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1886/3743] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:10 2022] PUT /identity/v3/projects/0c52196f02cb471eb30487e1664f0adf/users/2498f2b4e9bb4e4baedc83e1462867b4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:10.637087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.637612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.638107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.658524 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1858/3744] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:10 2022] PUT /identity/v3/projects/1b3be08bf34846eaa02f51c60c8bcab2/users/83f7266e6fae433485fb8864bbd2fc33/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:10.659973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.673805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:10.680941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:10.819073 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1887/3745] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:10.833428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9f49-3703-44b0-94fb-fd292eea1e56 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.840054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.840629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.841447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.841837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.842215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.842529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:10.843197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.845639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.858863 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1859/3746] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:10.874713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:10.904997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e79d42-9a69-402a-92ad-ad6d55e79d8b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:10.939704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b445a1-9802-4a3a-8f2a-16bce3a00537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:10.945465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b445a1-9802-4a3a-8f2a-16bce3a00537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:10.946290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b445a1-9802-4a3a-8f2a-16bce3a00537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:10.947593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b445a1-9802-4a3a-8f2a-16bce3a00537 admin admin] PATH_INFO: `/v3/projects/1b3be08bf34846eaa02f51c60c8bcab2/users/83f7266e6fae433485fb8864bbd2fc33/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:10.952751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b445a1-9802-4a3a-8f2a-16bce3a00537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3be08bf34846eaa02f51c60c8bcab2, user_id=83f7266e6fae433485fb8864bbd2fc33, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:10.958548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b445a1-9802-4a3a-8f2a-16bce3a00537 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:10.996971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1860/3747] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:10 2022] PUT /identity/v3/projects/1b3be08bf34846eaa02f51c60c8bcab2/users/83f7266e6fae433485fb8864bbd2fc33/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:11.010566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.012362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.015817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.052916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f60a2-3455-4e96-a151-0eb2c09b7966 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.129549 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:11.155444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] MFA Rules not processed for user `83f7266e6fae433485fb8864bbd2fc33`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:11.164313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:11.214002 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:11.233113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.233709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.234106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.234514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.482454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1861/3748] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:11.484451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.518784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88b89c-3aaa-4788-977e-3bfd8af42f6c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.547600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.551840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.579017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.582590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.583739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.585591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.586340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.592540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.598126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1888/3749] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:58:11.654614 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1862/3750] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:11 2022] POST /identity/v3/projects => generated 333 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:11.655965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.677593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db99ca-e9f0-4fd3-a4c6-26aabb02c596 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:11.785375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:11.786288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:11.788541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:11.789540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:11.791574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:11.793477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:11.852748 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1889/3751] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 14:58:11 2022] POST /identity/v3/projects => generated 333 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:11.854263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:11.870181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616010-d35f-4eda-b111-4c5024fbe152 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:12.076957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:12.078108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:12.078395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:12.078903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:12.081981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:12.088631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:12.206224 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1863/3752] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:11 2022] POST /identity/v3/projects => generated 358 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:12.209435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:12.239260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93f7c-b41b-4a50-8194-f55b571ffcb3 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:12.373172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:12.373172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:12.378071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:12.378407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:12.379244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:12.380498 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:58:12.380498 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 14:58:12.380498 n-d-master-1 devstack@keystone.service[80989]: Jul 11 14:58:12.381652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:12.435512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1890/3753] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 14:58:12 2022] GET /identity/v3/projects => generated 7243 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:12.437687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:12.458402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d1ec-06af-4884-900e-dd4230112cad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:12.468905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:12.469745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:12.470196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:12.470672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:12.471566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:12.472031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:12.475407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:12.518356 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1864/3754] 10.222.0.77 () {58 vars in 1157 bytes} [Mon Jul 11 14:58:12 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:12.526082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:12.538631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9fd1d-8079-4b30-b19b-938b694b91ad tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:12.561616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:12.562375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:12.562820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:12.563257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:12.564218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Adding query filter params (parent_id=8783805841024ed1804174ffc13f3dad) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:12.564639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:12.566652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:12.608481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1891/3755] 10.222.0.77 () {58 vars in 1215 bytes} [Mon Jul 11 14:58:12 2022] GET /identity/v3/projects?parent_id=8783805841024ed1804174ffc13f3dad => generated 498 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:12.614460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:12.629778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f05b4c-ca4f-4648-a2fe-77c61a107264 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:12.641331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:12.643195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:12.643953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:12.645094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects/3571b35eac534ee4a242ee06ec978588` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:12.648394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3571b35eac534ee4a242ee06ec978588)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:12.653868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:12.702737 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:12.717847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3571b35eac534ee4a242ee06ec978588', 'request_id': 'req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:12.726852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3571b35eac534ee4a242ee06ec978588', 'request_id': 'req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:12.741422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3571b35eac534ee4a242ee06ec978588', 'request_id': 'req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:12.765476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] The token cache is being invalidate because project 3571b35eac534ee4a242ee06ec978588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:12.765953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:12.766950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:12.771745 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1865/3756] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:12 2022] DELETE /identity/v3/projects/3571b35eac534ee4a242ee06ec978588 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:12.774815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:12.776937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:12.790315 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:12.801773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9b57-222f-4d29-bb2f-15149ebcfae9 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:12.937102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:12.937986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:12.938279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:12.938667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects/8783805841024ed1804174ffc13f3dad` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:12.940419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8783805841024ed1804174ffc13f3dad)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:12.943294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:13.030336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8783805841024ed1804174ffc13f3dad', 'request_id': 'req-3b651f80-8e1b-442d-a9a8-bffd4855ca11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.042802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8783805841024ed1804174ffc13f3dad', 'request_id': 'req-3b651f80-8e1b-442d-a9a8-bffd4855ca11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.063052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8783805841024ed1804174ffc13f3dad', 'request_id': 'req-3b651f80-8e1b-442d-a9a8-bffd4855ca11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.076384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] The token cache is being invalidate because project 8783805841024ed1804174ffc13f3dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:13.076685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.077464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.079409 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1892/3757] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:12 2022] DELETE /identity/v3/projects/8783805841024ed1804174ffc13f3dad => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:13.083140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:13.093585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb5c6-7468-4f50-b034-2fbf31d8bfb8 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:13.193138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f7266e6fae433485fb8864bbd2fc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3be08bf34846eaa02f51c60c8bcab2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:13.194905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:13.195900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:13.196305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] PATH_INFO: `/v3/projects/fdc45801515742a3bc4fbbb05ed548e4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:13.197822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fdc45801515742a3bc4fbbb05ed548e4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:13.200855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:13.280080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc45801515742a3bc4fbbb05ed548e4', 'request_id': 'req-38b08fc0-47c1-4498-a394-1fd4a3abe1df'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.288523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc45801515742a3bc4fbbb05ed548e4', 'request_id': 'req-38b08fc0-47c1-4498-a394-1fd4a3abe1df'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.298130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc45801515742a3bc4fbbb05ed548e4', 'request_id': 'req-38b08fc0-47c1-4498-a394-1fd4a3abe1df'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.316194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] The token cache is being invalidate because project fdc45801515742a3bc4fbbb05ed548e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:13.316500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.320317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38b08fc0-47c1-4498-a394-1fd4a3abe1df tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.323538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1866/3758] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:13 2022] DELETE /identity/v3/projects/fdc45801515742a3bc4fbbb05ed548e4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:13.327976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:13.329997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:13.441228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651f80-8e1b-442d-a9a8-bffd4855ca11 tempest-ListProjectsTestJSON-756809066 tempest-ListProjectsTestJSON-756809066-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:13.497680 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:13.512464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:13.513415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:13.513745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:13.514026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] PATH_INFO: `/v3/users/f94e9cffbe144325a2806ebb2f276615` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:13.515537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94e9cffbe144325a2806ebb2f276615)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:13.520055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:13.613535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94e9cffbe144325a2806ebb2f276615'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.622991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94e9cffbe144325a2806ebb2f276615'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.647221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94e9cffbe144325a2806ebb2f276615'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.648066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94e9cffbe144325a2806ebb2f276615'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.667108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94e9cffbe144325a2806ebb2f276615'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:13.693241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1893/3759] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:13 2022] DELETE /identity/v3/users/f94e9cffbe144325a2806ebb2f276615 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:13.695324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:13.695618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:13.695946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:13.723166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:13.724946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:13.800314 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:13.831886 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1867/3760] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:13.872985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:13.877058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:14.101970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04a2-935b-483b-9789-ae7c98ba00f7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:14.109364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:14.110574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:14.111649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:14.112372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:14.146336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:14.152130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:14.189587 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1894/3761] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:15.143226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:15.145655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:15.165672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5f44a-0d71-4364-9783-8eaa0a4b35d5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:15.178782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:15.179714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:15.185469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:15.186241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] PATH_INFO: `/v3/projects/279bf0a7bb74480b8f876c45f7b57d7a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:15.187810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279bf0a7bb74480b8f876c45f7b57d7a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:15.191038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:15.319833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279bf0a7bb74480b8f876c45f7b57d7a', 'request_id': 'req-f0c32ac1-727f-469c-a8e4-978e1d97e832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.329005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279bf0a7bb74480b8f876c45f7b57d7a', 'request_id': 'req-f0c32ac1-727f-469c-a8e4-978e1d97e832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.340061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279bf0a7bb74480b8f876c45f7b57d7a', 'request_id': 'req-f0c32ac1-727f-469c-a8e4-978e1d97e832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.356352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] The token cache is being invalidate because project 279bf0a7bb74480b8f876c45f7b57d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:15.356726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.357484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f0c32ac1-727f-469c-a8e4-978e1d97e832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.365135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:15.365662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1868/3762] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:15 2022] DELETE /identity/v3/projects/279bf0a7bb74480b8f876c45f7b57d7a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:15.380043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ac09-1bcd-417d-8a88-779f7bf36248 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:15.469789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:15.471237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:15.471530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:15.471810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] PATH_INFO: `/v3/users/83f7266e6fae433485fb8864bbd2fc33` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:15.473394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f7266e6fae433485fb8864bbd2fc33)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:15.476806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:15.483558 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:15.576756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f7266e6fae433485fb8864bbd2fc33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.577445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f7266e6fae433485fb8864bbd2fc33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.604833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f7266e6fae433485fb8864bbd2fc33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.605588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f7266e6fae433485fb8864bbd2fc33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.617049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69890e00-1557-4719-8201-b63eac036e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f7266e6fae433485fb8864bbd2fc33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:15.653611 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1895/3763] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:15 2022] DELETE /identity/v3/users/83f7266e6fae433485fb8864bbd2fc33 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:16.040094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:16.040394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:16.040683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:16.093737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:16.108510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:16.282069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1869/3764] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:16.811167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:16.811740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:16.811965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:16.864186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] MFA Rules not processed for user `1a17808ef78f4d3882b96a2146ceb20b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:16.866199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:16.969424 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1896/3765] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:16.988725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:16.994701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:17.011239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:17.017196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:17.167512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d6ff-5943-48d8-8fe1-2612f0796022 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:17.173527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:17.174660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:17.175078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1af28-4c9f-4023-b61e-64423e758f2a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:17.175373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:17.176108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:17.180567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:17.181558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:17.181781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:17.182377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:17.183543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] PATH_INFO: `/v3/projects/1b3be08bf34846eaa02f51c60c8bcab2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:17.187904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3be08bf34846eaa02f51c60c8bcab2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:17.190387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:17.211401 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:17.229284 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:17.295116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:17.296778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d645bdb-c954-4c89-87ef-e7800ef62241 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:17.325155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1870/3766] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:17.325907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3be08bf34846eaa02f51c60c8bcab2', 'request_id': 'req-3acdd143-2050-47a3-91f3-ba5dd6856e5b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:17.357945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3be08bf34846eaa02f51c60c8bcab2', 'request_id': 'req-3acdd143-2050-47a3-91f3-ba5dd6856e5b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:17.373270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3be08bf34846eaa02f51c60c8bcab2', 'request_id': 'req-3acdd143-2050-47a3-91f3-ba5dd6856e5b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:17.399730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] The token cache is being invalidate because project 1b3be08bf34846eaa02f51c60c8bcab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:17.405440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:17.406456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3acdd143-2050-47a3-91f3-ba5dd6856e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:17.409919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1897/3767] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:17 2022] DELETE /identity/v3/projects/1b3be08bf34846eaa02f51c60c8bcab2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:17.415605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:17.415605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:17.415999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:17.461339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:17.464347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:17.644919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1871/3768] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:58:17.654806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:17.655329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:17.655924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:17.698044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:17.701011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:17.718657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:17.721966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1898/3769] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:17.744943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3787-aa84-4275-9fa2-a22c1eb555f7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:17.761260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:17.762032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:17.762326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:17.766643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:17.767122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:17.767434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:17.772655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:17.820043 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1872/3770] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:58:17.825440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:17.841834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e46adc-753d-4c9b-961f-285fdbc1b540 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:17.851552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:17.852236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:17.852516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:17.852963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:17.853836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:17.859269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:17.916240 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1899/3771] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:17 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:17.922845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:17.941206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ba3c4-5fda-40f8-ac30-7f5872f69396 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:18.155131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:18.156072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.156510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.156973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.157959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:18.160735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:18.208621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1873/3772] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:17 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:18.212770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:18.224010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19f8f-6c11-4d53-afde-32b2ffc0426c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:18.234991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:18.235779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.236070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.236352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.237100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:18.238889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:18.270142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1900/3773] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:18.272619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:18.283560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503ac8c-4a18-41fa-8cf7-be4b02ad1432 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:18.290579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f2d08-bf90-4e0f-b965-e84f61fb2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:18.290579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f2d08-bf90-4e0f-b965-e84f61fb2f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.290579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f2d08-bf90-4e0f-b965-e84f61fb2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.290939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f2d08-bf90-4e0f-b965-e84f61fb2f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.291739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f2d08-bf90-4e0f-b965-e84f61fb2f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:18.293468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f2d08-bf90-4e0f-b965-e84f61fb2f8c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:18.304510 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1874/3774] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:18.308802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:18.319833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe778b-c4b9-45d1-a97b-8a93dfc653c7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:18.325114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:18.326020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.326303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.326622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] PATH_INFO: `/v3/projects/6ba150d2bb7344a3b7855d9f963acceb/users/ba411b308fd4439abab7f6ae13ac4211/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.352255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba150d2bb7344a3b7855d9f963acceb, user_id=ba411b308fd4439abab7f6ae13ac4211, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:18.354965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:18.375484 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1901/3775] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:18 2022] PUT /identity/v3/projects/6ba150d2bb7344a3b7855d9f963acceb/users/ba411b308fd4439abab7f6ae13ac4211/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:18.387243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.387606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.387897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.428066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] MFA Rules not processed for user `ba411b308fd4439abab7f6ae13ac4211`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:18.434542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:18.471602 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:18.590581 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1875/3776] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:18.595228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:18.795335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b31924-2129-45d7-8e33-c7a3a52432dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:18.808275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:18.809178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.809709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.810314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.811206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:18.820769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:18.898688 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1902/3777] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:18.901413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:18.914566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf15f11-9cf3-4acb-b746-484bb63ed11b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:18.991424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:18.992336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:18.992806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:18.993237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:18.994332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:18.996507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:19.022162 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1876/3778] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:18 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:19.026228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:19.042361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb86783-9e93-4697-a287-d9b329f5929e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:19.065403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:19.067167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:19.068036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:19.071250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:19.072015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:19.073898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:19.105363 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1903/3779] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:19.107584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:19.124427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a79e-fed9-4509-9270-938d85d8debb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:19.138043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:19.139190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:19.139578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:19.139958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] PATH_INFO: `/v3/projects/5a4f9f906ee447c499bea0c1cd2c90ad/users/2940239c83114654a536bf5171086edc/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:19.177168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4f9f906ee447c499bea0c1cd2c90ad, user_id=2940239c83114654a536bf5171086edc, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:19.185015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:19.218112 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1877/3780] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:19 2022] PUT /identity/v3/projects/5a4f9f906ee447c499bea0c1cd2c90ad/users/2940239c83114654a536bf5171086edc/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:19.219464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:19.235248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18230b-0bee-44a1-80aa-589f09d66e26 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:19.246384 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:19.397394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa673e9-59e1-47bd-8a60-09254d63cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:19.398297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa673e9-59e1-47bd-8a60-09254d63cac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:19.398717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa673e9-59e1-47bd-8a60-09254d63cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:19.405393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa673e9-59e1-47bd-8a60-09254d63cac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:19.409100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa673e9-59e1-47bd-8a60-09254d63cac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:19.413320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa673e9-59e1-47bd-8a60-09254d63cac9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:19.443626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1904/3781] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:19.447556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:19.461258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5536-04ea-444c-81b7-5fd0d1456074 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:19.481172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:19.482237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:19.482664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:19.483090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] PATH_INFO: `/v3/projects/5a4f9f906ee447c499bea0c1cd2c90ad/users/2940239c83114654a536bf5171086edc/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:19.489941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4f9f906ee447c499bea0c1cd2c90ad, user_id=2940239c83114654a536bf5171086edc, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:19.492888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:19.522165 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1878/3782] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:19 2022] PUT /identity/v3/projects/5a4f9f906ee447c499bea0c1cd2c90ad/users/2940239c83114654a536bf5171086edc/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:19.533111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:19.533787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:19.534333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:19.615529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] MFA Rules not processed for user `2940239c83114654a536bf5171086edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:19.617034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:19.797260 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1905/3783] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:19.799377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:19.816794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980944-3eb7-43cb-b33d-648e60606787 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:19.830188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2940239c83114654a536bf5171086edc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f9f906ee447c499bea0c1cd2c90ad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:19.832252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:19.832677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:19.833099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:19.834656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:19.839392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:19.940402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1879/3784] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:19 2022] POST /identity/v3/projects => generated 358 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:19.941864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:20.133275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c202537-ab1d-49df-86b9-e23b9a56ff5a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:20.230204 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:20.274952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba411b308fd4439abab7f6ae13ac4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ba150d2bb7344a3b7855d9f963acceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:20.277160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:20.277547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:20.277941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] PATH_INFO: `/v3/projects/40f59897b2304bba9295a67d8a1a4d7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:20.284112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] RBAC: Authorizing `identity:delete_project(project_id=40f59897b2304bba9295a67d8a1a4d7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 11 14:58:20.306622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 11 14:58:20.307848 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 14:58:20.311003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1906/3785] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:19 2022] DELETE /identity/v3/projects/40f59897b2304bba9295a67d8a1a4d7b => generated 136 bytes in 370 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 11 14:58:20.315866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:20.498218 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:20.522240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf84d-a990-4a9b-ad8a-013c28e597f6 tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:20.534121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2940239c83114654a536bf5171086edc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f9f906ee447c499bea0c1cd2c90ad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:20.535056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:20.535333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:20.535611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] PATH_INFO: `/v3/projects/40f59897b2304bba9295a67d8a1a4d7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:20.536878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] RBAC: Authorizing `identity:delete_project(project_id=40f59897b2304bba9295a67d8a1a4d7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:20.539333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:20.651246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f59897b2304bba9295a67d8a1a4d7b', 'request_id': 'req-7031c4a7-03a1-405d-8721-8f74feac3dba'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:20.677723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f59897b2304bba9295a67d8a1a4d7b', 'request_id': 'req-7031c4a7-03a1-405d-8721-8f74feac3dba'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:20.694993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f59897b2304bba9295a67d8a1a4d7b', 'request_id': 'req-7031c4a7-03a1-405d-8721-8f74feac3dba'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:20.720185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] The token cache is being invalidate because project 40f59897b2304bba9295a67d8a1a4d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:20.721074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:20.722869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7031c4a7-03a1-405d-8721-8f74feac3dba tempest-ProjectsNegativeTestJSON-1546822026 tempest-ProjectsNegativeTestJSON-1546822026-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:20.726674 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1880/3786] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:20 2022] DELETE /identity/v3/projects/40f59897b2304bba9295a67d8a1a4d7b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:20.732614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:20.735044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:20.990829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ca15-d29d-4128-b65d-d4e594b0c424 tempest-ProjectsNegativeTestJSON-1707205825 tempest-ProjectsNegativeTestJSON-1707205825-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:21.183599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:21.185049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:21.185635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:21.185932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] PATH_INFO: `/v3/users/ba411b308fd4439abab7f6ae13ac4211` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:21.188954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba411b308fd4439abab7f6ae13ac4211)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:21.191979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:21.300884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba411b308fd4439abab7f6ae13ac4211'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:21.303273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba411b308fd4439abab7f6ae13ac4211'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:21.347842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba411b308fd4439abab7f6ae13ac4211'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:21.350058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba411b308fd4439abab7f6ae13ac4211'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:21.369263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba411b308fd4439abab7f6ae13ac4211'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:21.404879 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1907/3787] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:20 2022] DELETE /identity/v3/users/ba411b308fd4439abab7f6ae13ac4211 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:21.416828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:21.417541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:21.417541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:21.457814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:21.459560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:21.565733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1881/3788] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:21.607484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:21.609006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:21.664026 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:21.822748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471e045-460c-42c0-9881-ad51276c0c40 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:21.836308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:21.838206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:21.839442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:21.841277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:21.865376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:21.867168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:21.899238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1908/3789] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:24.223868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:24.226233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:24.262568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd5964-b3d8-4f6f-83ec-de1e5a6c4216 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:24.281685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:24.282855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:24.283300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:24.283583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] PATH_INFO: `/v3/projects/6ba150d2bb7344a3b7855d9f963acceb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:24.284903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba150d2bb7344a3b7855d9f963acceb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:24.287385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:24.385037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba150d2bb7344a3b7855d9f963acceb', 'request_id': 'req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.393359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba150d2bb7344a3b7855d9f963acceb', 'request_id': 'req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.404708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba150d2bb7344a3b7855d9f963acceb', 'request_id': 'req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.434484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] The token cache is being invalidate because project 6ba150d2bb7344a3b7855d9f963acceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:24.436002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.438812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-21a5dbd1-feb3-424a-b3d0-6dacd85e6727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.451061 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1882/3790] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:24 2022] DELETE /identity/v3/projects/6ba150d2bb7344a3b7855d9f963acceb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:24.454812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:24.469537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7decbc-b607-43f2-9240-a7365473b32f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:24.658462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:24.658644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:24.660857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:24.665086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] PATH_INFO: `/v3/users/2940239c83114654a536bf5171086edc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:24.669395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2940239c83114654a536bf5171086edc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:24.674898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:24.894438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2940239c83114654a536bf5171086edc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.895684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2940239c83114654a536bf5171086edc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.945154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2940239c83114654a536bf5171086edc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.945154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2940239c83114654a536bf5171086edc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:24.978193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2940239c83114654a536bf5171086edc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:25.012236 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1909/3791] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:24 2022] DELETE /identity/v3/users/2940239c83114654a536bf5171086edc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:26.076466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.076925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.077047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.095720 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:26.137134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] MFA Rules not processed for user `2498f2b4e9bb4e4baedc83e1462867b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:26.139448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:26.186290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:26.189299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:26.270071 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:26.304437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1883/3792] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:26.306094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:26.308333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:26.363547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce4f9a-a838-4a8d-8eb7-f77702af1a95 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:26.366006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cd60d-f7ff-4a38-9a14-1db4aeba62a7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:26.372508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:26.373167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.373632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.374074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.375207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:26.377853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:26.383412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:26.387250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.388120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.390386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] PATH_INFO: `/v3/projects/5a4f9f906ee447c499bea0c1cd2c90ad` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.393001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4f9f906ee447c499bea0c1cd2c90ad)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:26.398699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:26.416220 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1884/3793] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:26 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:26.423694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:26.514626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4f9f906ee447c499bea0c1cd2c90ad', 'request_id': 'req-3b9c06d3-fa04-4477-8bd7-07acc75679e7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:26.530940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4f9f906ee447c499bea0c1cd2c90ad', 'request_id': 'req-3b9c06d3-fa04-4477-8bd7-07acc75679e7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:26.544074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4f9f906ee447c499bea0c1cd2c90ad', 'request_id': 'req-3b9c06d3-fa04-4477-8bd7-07acc75679e7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:26.569820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ceccd-80a8-4ac2-a300-8de7262aa7fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:26.574032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] The token cache is being invalidate because project 5a4f9f906ee447c499bea0c1cd2c90ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:26.574032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:26.576206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3b9c06d3-fa04-4477-8bd7-07acc75679e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:26.579899 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1910/3794] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:26 2022] DELETE /identity/v3/projects/5a4f9f906ee447c499bea0c1cd2c90ad => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:26.589067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c472a-ee53-4649-ae5b-a6d678e778dc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.589547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c472a-ee53-4649-ae5b-a6d678e778dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.590839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c472a-ee53-4649-ae5b-a6d678e778dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.640885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8a8c472a-ee53-4649-ae5b-a6d678e778dc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:26.644392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8a8c472a-ee53-4649-ae5b-a6d678e778dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:26.659067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:26.660260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.661122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.661516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.662348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:26.665331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:26.706644 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1885/3795] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:26 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:26.708509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:26.717995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:26.751873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f54d-083c-440e-be17-600337c3f3d6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:26.765416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:26.770338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.770781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.770968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.778412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:26.780278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:26.794297 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:26.804002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1911/3796] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:26.816103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.816103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.816103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.816515 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1886/3797] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:26.820466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:26.863434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75289a3-0034-49aa-a15d-5b2efb737148 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:26.877181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:26.878459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:26.890208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:26.893703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.894237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.896639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] PATH_INFO: `/v3/projects/a23b3445ae7644aebcb89b0e354520e2/users/add4037503cf4a86af4777047f854e6e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.925654 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1912/3798] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:26.929916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:26.942330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23b3445ae7644aebcb89b0e354520e2, user_id=add4037503cf4a86af4777047f854e6e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:26.948377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:26.954931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa9cd3-3aa0-4291-84fc-2c0e5ce1f660 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:26.979778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:26.980740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:26.980916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:26.981299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:26.982144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:26.982554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:26.984476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:26.998667 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1887/3799] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:26 2022] PUT /identity/v3/projects/a23b3445ae7644aebcb89b0e354520e2/users/add4037503cf4a86af4777047f854e6e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:27.001391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.017014 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1913/3800] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:27.020662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.066861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f55bb-73a8-4c44-8281-024d68793520 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.107206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a19b-fb02-425b-9564-571120129422 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.117138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.120378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.121036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.122809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.124118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.127670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:27.153508 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1888/3801] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:27.161004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.191629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ccaf7-d265-40d2-a10d-46628c1900bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.210686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.213660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.214959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.216857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] PATH_INFO: `/v3/projects/a23b3445ae7644aebcb89b0e354520e2/users/add4037503cf4a86af4777047f854e6e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.222308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23b3445ae7644aebcb89b0e354520e2, user_id=add4037503cf4a86af4777047f854e6e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.232217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:27.232833 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:27.264999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.265974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.266128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1889/3802] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:27 2022] PUT /identity/v3/projects/a23b3445ae7644aebcb89b0e354520e2/users/add4037503cf4a86af4777047f854e6e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:27.267902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.269199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.270070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.274786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:27.365332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1914/3803] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:27.366338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.505195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecccef4-0a02-4e38-951a-1e5425392a54 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.625406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.627355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.628071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.628449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.631332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.637277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:27.665992 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:27.682576 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1890/3804] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:27 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:27.686292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.725293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3bc2f-7b22-4896-8eda-5f9d27365f4e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.751521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.752471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.752471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.752786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.753485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.755152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:27.837444 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1915/3805] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:27.839247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.853069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b570b-9dd8-40a2-89af-6b55551dc62f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.864023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491451a-d365-4a06-b5ff-38ad4621c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.864723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491451a-d365-4a06-b5ff-38ad4621c0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.865013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491451a-d365-4a06-b5ff-38ad4621c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.865294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491451a-d365-4a06-b5ff-38ad4621c0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.866046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491451a-d365-4a06-b5ff-38ad4621c0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.869862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491451a-d365-4a06-b5ff-38ad4621c0cb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:27.896729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1891/3806] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:27.901887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:27.915576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c222-9ea5-4976-aa10-f43288b57ed4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:27.932504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:27.933431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:27.933723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:27.934014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] PATH_INFO: `/v3/projects/dddf3ff32e50473ca888ddb1a75f440a/users/ed6cc6057cd2442a912c6b2803f5c7cf/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:27.965995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddf3ff32e50473ca888ddb1a75f440a, user_id=ed6cc6057cd2442a912c6b2803f5c7cf, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:27.969162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:28.011099 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1916/3807] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:27 2022] PUT /identity/v3/projects/dddf3ff32e50473ca888ddb1a75f440a/users/ed6cc6057cd2442a912c6b2803f5c7cf/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:28.012325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:28.012708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:28.012977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:28.081208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] MFA Rules not processed for user `ed6cc6057cd2442a912c6b2803f5c7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:28.082760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:28.263405 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1892/3808] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:58:28.268052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:28.280860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d65e4b-2cbc-412d-a0b0-18cce1f1de8f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:28.288580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becb3e1-f6af-49ac-8db6-c335619ee4fa tempest-DefaultDomainTestJSON-2067191780 tempest-DefaultDomainTestJSON-2067191780-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cc6057cd2442a912c6b2803f5c7cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dddf3ff32e50473ca888ddb1a75f440a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:28.289432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb3e1-f6af-49ac-8db6-c335619ee4fa tempest-DefaultDomainTestJSON-2067191780 tempest-DefaultDomainTestJSON-2067191780-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:28.289724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb3e1-f6af-49ac-8db6-c335619ee4fa tempest-DefaultDomainTestJSON-2067191780 tempest-DefaultDomainTestJSON-2067191780-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:28.290007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becb3e1-f6af-49ac-8db6-c335619ee4fa tempest-DefaultDomainTestJSON-2067191780 tempest-DefaultDomainTestJSON-2067191780-project] PATH_INFO: `/v3/domains/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:28.292069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becb3e1-f6af-49ac-8db6-c335619ee4fa tempest-DefaultDomainTestJSON-2067191780 tempest-DefaultDomainTestJSON-2067191780-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:28.293794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becb3e1-f6af-49ac-8db6-c335619ee4fa tempest-DefaultDomainTestJSON-2067191780 tempest-DefaultDomainTestJSON-2067191780-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:28.301052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:28.301495 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1917/3809] 10.222.0.77 () {58 vars in 1151 bytes} [Mon Jul 11 14:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:28.450542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6b52f-8666-4efa-a895-a82c2ecc5b24 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:28.466335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:28.467632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:28.467918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:28.468196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] PATH_INFO: `/v3/users/ed6cc6057cd2442a912c6b2803f5c7cf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:28.473202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6cc6057cd2442a912c6b2803f5c7cf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:28.475287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:28.588607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6cc6057cd2442a912c6b2803f5c7cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:28.629057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6cc6057cd2442a912c6b2803f5c7cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:28.662871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6cc6057cd2442a912c6b2803f5c7cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:28.671581 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:28.693861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6cc6057cd2442a912c6b2803f5c7cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:28.706574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6cc6057cd2442a912c6b2803f5c7cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:28.721470 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1893/3810] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:28 2022] DELETE /identity/v3/users/ed6cc6057cd2442a912c6b2803f5c7cf => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:28.725666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:28.726074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:28.726485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:28.773632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:28.776023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:28.948190 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1918/3811] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:28.988338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:28.990166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:29.150533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26572-8a51-4822-ae57-963766cd5f3a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:29.168147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5f9bd-47d3-4e20-b97e-8276d0da2000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:29.170596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5f9bd-47d3-4e20-b97e-8276d0da2000 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:29.171021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5f9bd-47d3-4e20-b97e-8276d0da2000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:29.171538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5f9bd-47d3-4e20-b97e-8276d0da2000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:29.185091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5f9bd-47d3-4e20-b97e-8276d0da2000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:29.187137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5f9bd-47d3-4e20-b97e-8276d0da2000 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:29.210119 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1894/3812] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:30.742953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:30.744651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:30.765901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aacbf4-62e8-4654-93ea-2e84cbc50349 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:30.783856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:30.785342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:30.785860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:30.786340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] PATH_INFO: `/v3/projects/dddf3ff32e50473ca888ddb1a75f440a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:30.789387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dddf3ff32e50473ca888ddb1a75f440a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:30.793147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:30.914895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dddf3ff32e50473ca888ddb1a75f440a', 'request_id': 'req-d865fdd8-a509-44af-bf2c-6e728eeac469'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:30.936337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dddf3ff32e50473ca888ddb1a75f440a', 'request_id': 'req-d865fdd8-a509-44af-bf2c-6e728eeac469'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:30.965497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dddf3ff32e50473ca888ddb1a75f440a', 'request_id': 'req-d865fdd8-a509-44af-bf2c-6e728eeac469'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:30.999816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] The token cache is being invalidate because project dddf3ff32e50473ca888ddb1a75f440a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:31.000159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.003695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d865fdd8-a509-44af-bf2c-6e728eeac469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:31.014467 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1919/3813] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:30 2022] DELETE /identity/v3/projects/dddf3ff32e50473ca888ddb1a75f440a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:31.016885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.017372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.017472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.060793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:31.062050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:31.268941 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1895/3814] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:31.276622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.276913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.277194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.328197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:31.329531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:31.355715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1920/3815] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:31.360571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.376818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb04dc9-3504-40ce-bde1-37b100b3b148 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.393173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.393871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.394160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.394439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.395238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:31.395549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.397226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.430949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1896/3816] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:31.435706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.455046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c60d9-9131-4bfe-8708-41f5aa5e5270 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.462761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.463187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.463480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.463762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.464484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.466464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.482452 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:31.528531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1921/3817] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:31 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:58:31.534242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.554689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254be9d7-905f-4eeb-8e01-12139f33a0d9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.682066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.682795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.683649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.683649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.684276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.686430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.726928 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1897/3818] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:31 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:31.731710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.747960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239d41-afd7-4719-970c-14ebbba1bf40 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.754397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.755424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.755889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.756331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.757779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.759834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.806178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1922/3819] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:58:31.810679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.827806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c18fb-e324-4f2f-b874-92b000bba784 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.841553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e43f3-9582-4f6f-9231-f6708e761e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.845221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e43f3-9582-4f6f-9231-f6708e761e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.845753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e43f3-9582-4f6f-9231-f6708e761e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.846230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e43f3-9582-4f6f-9231-f6708e761e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.853898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e43f3-9582-4f6f-9231-f6708e761e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.858100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e43f3-9582-4f6f-9231-f6708e761e2c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.887646 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1898/3820] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:31.892114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:31.913922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377a29-9b13-4939-b621-8e02286142a4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:31.920655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:31.921918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.923012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.923511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] PATH_INFO: `/v3/projects/0f6e07c978e5464aa8928bbf21ea24bd/users/6a52620e40654fa59c04f91a5865e8ab/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:31.942838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6e07c978e5464aa8928bbf21ea24bd, user_id=6a52620e40654fa59c04f91a5865e8ab, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:31.946407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:31.983457 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1923/3821] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:31 2022] PUT /identity/v3/projects/0f6e07c978e5464aa8928bbf21ea24bd/users/6a52620e40654fa59c04f91a5865e8ab/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:31.994760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:31.995515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:31.996034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:32.009157 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:32.063267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] MFA Rules not processed for user `6a52620e40654fa59c04f91a5865e8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:32.065333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:32.307776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1899/3822] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:32.322395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:32.325651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:32.563877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa829a9-d376-4d3f-8c82-7c5d8f015378 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:32.575410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ac3d-9b95-49f5-9739-5ee3bc7d43be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:32.576264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ac3d-9b95-49f5-9739-5ee3bc7d43be service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:32.576698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ac3d-9b95-49f5-9739-5ee3bc7d43be service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:32.577080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ac3d-9b95-49f5-9739-5ee3bc7d43be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:32.601161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ac3d-9b95-49f5-9739-5ee3bc7d43be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:32.603205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ac3d-9b95-49f5-9739-5ee3bc7d43be service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:32.624490 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1924/3823] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:32.804356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:33.005439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81d2b-f6e9-40ec-8917-012c82ae9961 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:33.014679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:33.021344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:33.023832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:33.026281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] PATH_INFO: `/v3/users/6a52620e40654fa59c04f91a5865e8ab` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:33.028553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a52620e40654fa59c04f91a5865e8ab)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:33.030929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:33.215747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a52620e40654fa59c04f91a5865e8ab'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.260915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a52620e40654fa59c04f91a5865e8ab'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.290747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a52620e40654fa59c04f91a5865e8ab'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.316064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a52620e40654fa59c04f91a5865e8ab'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.323009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a52620e40654fa59c04f91a5865e8ab'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:33.335285 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1900/3824] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:32 2022] DELETE /identity/v3/users/6a52620e40654fa59c04f91a5865e8ab => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:33.340006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:33.340824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:33.341266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:33.378622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:33.380093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:33.528171 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1925/3825] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:33.589090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:33.590715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:33.618373 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:33.698938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0f30-085e-4264-b5eb-79cd7cc1f6a6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:33.721716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cda53-ff14-48bb-a9a8-579c8283d36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:33.721716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cda53-ff14-48bb-a9a8-579c8283d36a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:33.721716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cda53-ff14-48bb-a9a8-579c8283d36a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:33.722148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cda53-ff14-48bb-a9a8-579c8283d36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:33.739571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cda53-ff14-48bb-a9a8-579c8283d36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:33.741519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cda53-ff14-48bb-a9a8-579c8283d36a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:33.756322 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1901/3826] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:34.986220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:34.988744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:35.018876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af1ce-4ea0-47e7-8ba5-0d335fcb1db7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.038950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.039859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.040142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.040416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] PATH_INFO: `/v3/projects/0f6e07c978e5464aa8928bbf21ea24bd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.044679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6e07c978e5464aa8928bbf21ea24bd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.055581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:35.193288 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:35.226813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6e07c978e5464aa8928bbf21ea24bd', 'request_id': 'req-14375784-c739-4e0e-93c2-83f69ef3f35e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.243999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6e07c978e5464aa8928bbf21ea24bd', 'request_id': 'req-14375784-c739-4e0e-93c2-83f69ef3f35e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.260615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6e07c978e5464aa8928bbf21ea24bd', 'request_id': 'req-14375784-c739-4e0e-93c2-83f69ef3f35e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.300515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] The token cache is being invalidate because project 0f6e07c978e5464aa8928bbf21ea24bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:35.300810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.306873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14375784-c739-4e0e-93c2-83f69ef3f35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:35.315245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1926/3827] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:34 2022] DELETE /identity/v3/projects/0f6e07c978e5464aa8928bbf21ea24bd => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:35.320121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.321043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.321505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.367077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:35.368911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:35.545613 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1902/3828] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:35.553843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.554619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.555149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.577006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:35.579008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:35.593212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1927/3829] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:35.594704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:35.609537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc368-6058-4c8a-ba65-fd932345bd59 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.615805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.616830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.617358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.617870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.618902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:35.619480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.621370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:35.649265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:35.658114 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1903/3830] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:35.661578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d63b96-b8ef-4e2f-8b3a-68e1c0cd3e61 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.671658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.673295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.673912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.674414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.675397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.677589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:35.752978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:35.761120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1928/3831] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:35 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:35.765118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1320c8-1a70-4f48-955b-beca91376ee5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.874470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.876143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.876677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.877276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.878101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.880614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:35.913597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1904/3832] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:35 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:35.918883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:35.932865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fcd59-cc45-4d22-853f-b1f4c432ba2b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:35.947453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:35.955040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:35.956337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:35.956698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:35.958266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:35.960881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:35.986553 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1929/3833] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:35.990663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.004195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b4725-c05b-4708-8a5e-4d4a847c1125 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.025728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2d3a-35f9-489a-b7ef-ca9e90ac4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.026750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2d3a-35f9-489a-b7ef-ca9e90ac4a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.027209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2d3a-35f9-489a-b7ef-ca9e90ac4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.027659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2d3a-35f9-489a-b7ef-ca9e90ac4a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.028629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2d3a-35f9-489a-b7ef-ca9e90ac4a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.030787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2d3a-35f9-489a-b7ef-ca9e90ac4a8d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.056444 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1905/3834] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:36.060414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.077159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856e61e-c068-4467-bf24-cc331c50c443 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.083894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.085072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.085369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.085656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] PATH_INFO: `/v3/projects/1cd766ebce03476f84cd45e36534e5ab/users/55745de345914d6cbf248632d6b92e2d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.106832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd766ebce03476f84cd45e36534e5ab, user_id=55745de345914d6cbf248632d6b92e2d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.111020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.135456 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1930/3835] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:36 2022] PUT /identity/v3/projects/1cd766ebce03476f84cd45e36534e5ab/users/55745de345914d6cbf248632d6b92e2d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:36.146787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.146787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.147094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.206854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] MFA Rules not processed for user `55745de345914d6cbf248632d6b92e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:36.209804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:36.223284 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:36.390450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1906/3836] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:36.403036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:36.405247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:36.510552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502621b4-efac-4dd8-b825-d9cc06b1957d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:36.527940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8f3e1-59a6-440e-b74a-d33815caf904 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:36.528226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8f3e1-59a6-440e-b74a-d33815caf904 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:36.528441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8f3e1-59a6-440e-b74a-d33815caf904 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:36.528709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8f3e1-59a6-440e-b74a-d33815caf904 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:36.548318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8f3e1-59a6-440e-b74a-d33815caf904 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:36.549787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8f3e1-59a6-440e-b74a-d33815caf904 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:36.567367 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1931/3837] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:37.512807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:37.657323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c79671-a26d-4df9-8eb1-0b133e23bc5f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:37.666456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:37.667412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:37.667696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:37.667972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] PATH_INFO: `/v3/users/55745de345914d6cbf248632d6b92e2d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:37.669465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55745de345914d6cbf248632d6b92e2d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:37.671719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:37.746478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55745de345914d6cbf248632d6b92e2d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:37.766476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55745de345914d6cbf248632d6b92e2d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:37.779315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55745de345914d6cbf248632d6b92e2d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:37.791059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55745de345914d6cbf248632d6b92e2d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:37.792121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55745de345914d6cbf248632d6b92e2d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:37.809068 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1907/3838] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:37 2022] DELETE /identity/v3/users/55745de345914d6cbf248632d6b92e2d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:37.813859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:37.814358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:37.814456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:37.845994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:37.848798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:38.035565 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1932/3839] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:38.076011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:38.078225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:38.155302 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:38.228845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ade76-e99a-41d9-9776-05a66d59580d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:38.245297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6882-8b2d-4f67-8743-3172202ee693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:38.246738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6882-8b2d-4f67-8743-3172202ee693 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:38.247100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6882-8b2d-4f67-8743-3172202ee693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:38.248075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6882-8b2d-4f67-8743-3172202ee693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:38.265862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff6882-8b2d-4f67-8743-3172202ee693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:38.267513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff6882-8b2d-4f67-8743-3172202ee693 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:38.294477 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1908/3840] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:40.513984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:40.516205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:40.551315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a271-c351-4270-a5a6-995788b58608 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:40.559245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:40.560394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:40.560870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:40.561306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] PATH_INFO: `/v3/projects/1cd766ebce03476f84cd45e36534e5ab` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:40.566284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd766ebce03476f84cd45e36534e5ab)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:40.568779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:40.574123 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:40.683957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd766ebce03476f84cd45e36534e5ab', 'request_id': 'req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:40.700992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd766ebce03476f84cd45e36534e5ab', 'request_id': 'req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:40.718048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd766ebce03476f84cd45e36534e5ab', 'request_id': 'req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:40.739446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] The token cache is being invalidate because project 1cd766ebce03476f84cd45e36534e5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:40.740089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:40.740998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-405462bb-4ab1-45b2-ad7e-831ea69cd8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:40.749943 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1933/3841] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:40 2022] DELETE /identity/v3/projects/1cd766ebce03476f84cd45e36534e5ab => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:40.751950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:40.752475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:40.752575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:40.802210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:40.807627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:41.038120 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1909/3842] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:41.045490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.045836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.046122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.088115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:41.089505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:41.110136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:41.115860 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1934/3843] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:41.131699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb82d9-191f-4f2c-a75c-905121560ba5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:41.149831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:41.161382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.161989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.162557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.163582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:41.164097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:41.166628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:41.192167 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1910/3844] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:41.193426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:41.206408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f14267-7a92-410a-b7a9-d64244235859 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:41.220992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:41.221680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.222065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.222747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.222942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:41.224900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:41.341423 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1935/3845] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:41 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:41.343471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:41.360342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8b4d-32c0-4d54-a7f5-3785bddf6f11 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:41.528179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:41.528932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.529226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.529507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.530220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:41.549491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:41.603923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1911/3846] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:41 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:41.604709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:41.621226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f2233-ab03-4191-9828-8c2c32a1e27b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:41.641801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:41.646120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.646900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.647346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.651324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:41.653401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:41.680566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1936/3847] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:41.684353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:41.704285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27259e-c7c3-4ab7-acdc-e54529689ebc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:41.712316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373e176-713d-456e-b362-1bce919a952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:41.713008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373e176-713d-456e-b362-1bce919a952e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.713308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373e176-713d-456e-b362-1bce919a952e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.713649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373e176-713d-456e-b362-1bce919a952e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.714322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373e176-713d-456e-b362-1bce919a952e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:41.726530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373e176-713d-456e-b362-1bce919a952e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:41.787744 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1912/3848] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:41.789596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:41.801676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e552d7-d7ad-4783-b4c0-f331b62ec714 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:41.806128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13857d-a672-43ed-9a22-9a4f609b1357 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.807610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13857d-a672-43ed-9a22-9a4f609b1357 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.808072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13857d-a672-43ed-9a22-9a4f609b1357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.819625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eef0ed-f2e0-4303-b6f6-9c0f90639a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:41.821316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef0ed-f2e0-4303-b6f6-9c0f90639a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.822718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef0ed-f2e0-4303-b6f6-9c0f90639a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.823226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef0ed-f2e0-4303-b6f6-9c0f90639a1a admin admin] PATH_INFO: `/v3/projects/0c8f17f4c9ae4dd980dbedbd71ad23d5/users/840d7c0c5b024dd29eb6dd9941676ff7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.863184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eef0ed-f2e0-4303-b6f6-9c0f90639a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8f17f4c9ae4dd980dbedbd71ad23d5, user_id=840d7c0c5b024dd29eb6dd9941676ff7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:41.869077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eef0ed-f2e0-4303-b6f6-9c0f90639a1a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:41.891956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ea13857d-a672-43ed-9a22-9a4f609b1357 None None] MFA Rules not processed for user `add4037503cf4a86af4777047f854e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:41.894669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea13857d-a672-43ed-9a22-9a4f609b1357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:41.919485 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1937/3849] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:41 2022] PUT /identity/v3/projects/0c8f17f4c9ae4dd980dbedbd71ad23d5/users/840d7c0c5b024dd29eb6dd9941676ff7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:41.929917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:41.930339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:41.930936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:41.997421 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:42.024802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] MFA Rules not processed for user `840d7c0c5b024dd29eb6dd9941676ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:42.026484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:42.121823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1913/3850] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:42.136381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:42.137534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:42.137996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:42.173720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] MFA Rules not processed for user `2498f2b4e9bb4e4baedc83e1462867b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:42.181404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:42.304088 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1938/3851] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:58:42.305492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:42.370322 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:42.381413 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1914/3852] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:58:42.503243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:42.510024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:42.580344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4be69-54b0-43d0-ae3c-23b8706fcafd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:42.593760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:42.595365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:42.595365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:42.595365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:42.595997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:42.597995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:42.642784 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1939/3853] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:42 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:42.647022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:42.660341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7327062-67ee-4ee1-88a4-d3f2f64ad677 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:42.785300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:42.798913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:42.799924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:42.800431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] PATH_INFO: `/v3/users/e160ed8d8d6e485b9cf0f7df067f9bb1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:42.802018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e160ed8d8d6e485b9cf0f7df067f9bb1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:42.804588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:42.825328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656043e4-72f6-4db6-ba59-f5040959069e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:42.831204 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:42.859012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:42.860392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:42.860761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:42.861246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:42.862202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:42.864317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:42.930295 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1940/3854] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:42 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:42.938417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:42.943907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e160ed8d8d6e485b9cf0f7df067f9bb1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:42.975759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e160ed8d8d6e485b9cf0f7df067f9bb1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:42.979547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e3a4-3544-4552-954e-059d821fa1c7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:42.999394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e160ed8d8d6e485b9cf0f7df067f9bb1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:43.000373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:43.003096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:43.004114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:43.008767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:43.011796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:43.015412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:43.017912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e160ed8d8d6e485b9cf0f7df067f9bb1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:43.018802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e160ed8d8d6e485b9cf0f7df067f9bb1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:43.037297 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1915/3855] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:58:42 2022] DELETE /identity/v3/users/e160ed8d8d6e485b9cf0f7df067f9bb1 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:58:43.066905 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1941/3856] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:43.068060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:43.070311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:43.185733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:43.187729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:43.372341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9578a0f-b900-4a2a-88be-5b9344579abd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:43.373906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9496fb-a69a-46ae-be5d-d71ca70a5af2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:43.394368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:43.395762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:43.395762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:43.395990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] PATH_INFO: `/v3/projects/c3d2415ad76a451d83c0bed10af6cd7f/users/b4ddf1847e1542a48bd02e0f0e1ac5bd/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:43.426096 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:43.472428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d2415ad76a451d83c0bed10af6cd7f, user_id=b4ddf1847e1542a48bd02e0f0e1ac5bd, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:43.476718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:43.525968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1916/3857] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:43 2022] PUT /identity/v3/projects/c3d2415ad76a451d83c0bed10af6cd7f/users/b4ddf1847e1542a48bd02e0f0e1ac5bd/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:43.529736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:43.611001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:43.613859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:43.614413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:43.616996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:43.623327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:43.763798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e831-501a-435d-a178-c39a3bc05022 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:43.775410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:43.776103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:43.776414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:43.776785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:43.777539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:43.795602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:43.824232 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1917/3858] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:43.826990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:43.853108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:43.854759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea09a-0edd-4dc6-a814-273bfa67ff0c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:43.860389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcdaab-8930-4d80-a3e0-f65f67404b6e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:43.873063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:43.873981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:43.874268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:43.874565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] PATH_INFO: `/v3/projects/c3d2415ad76a451d83c0bed10af6cd7f/users/b4ddf1847e1542a48bd02e0f0e1ac5bd/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:43.878617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d2415ad76a451d83c0bed10af6cd7f, user_id=b4ddf1847e1542a48bd02e0f0e1ac5bd, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:43.881300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:43.903929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1942/3859] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:43.928961 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:43.952565 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1918/3860] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:43 2022] PUT /identity/v3/projects/c3d2415ad76a451d83c0bed10af6cd7f/users/b4ddf1847e1542a48bd02e0f0e1ac5bd/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:43.954381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:43.954824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:43.954997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:43.974530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:43.976334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:44.065954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] MFA Rules not processed for user `b4ddf1847e1542a48bd02e0f0e1ac5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:44.067249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:44.163321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1776fd-1bb8-4606-b6fc-c5ca3d067326 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:44.178102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:44.179210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:44.179598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:44.179983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] PATH_INFO: `/v3/projects/4168be2884ab40388299ef1fea92e901` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:44.181830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4168be2884ab40388299ef1fea92e901)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:44.187507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:44.288279 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1943/3861] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:44.315761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4168be2884ab40388299ef1fea92e901', 'request_id': 'req-2522cb15-3708-4da1-bb98-3a9db42465aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:44.332619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4168be2884ab40388299ef1fea92e901', 'request_id': 'req-2522cb15-3708-4da1-bb98-3a9db42465aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:44.347777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4168be2884ab40388299ef1fea92e901', 'request_id': 'req-2522cb15-3708-4da1-bb98-3a9db42465aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:44.365003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:44.366806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:44.373770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] The token cache is being invalidate because project 4168be2884ab40388299ef1fea92e901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:58:44.374068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:44.377932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2522cb15-3708-4da1-bb98-3a9db42465aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:58:44.380240 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1919/3862] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:58:43 2022] DELETE /identity/v3/projects/4168be2884ab40388299ef1fea92e901 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:44.386396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2eb05-25a8-48f6-94fd-c8e0558aff47 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:44.387091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2eb05-25a8-48f6-94fd-c8e0558aff47 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:44.387485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2eb05-25a8-48f6-94fd-c8e0558aff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:44.439023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a5e2eb05-25a8-48f6-94fd-c8e0558aff47 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:44.444731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a5e2eb05-25a8-48f6-94fd-c8e0558aff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:44.515903 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:44.557666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b96817-4e9a-4b74-b2f8-5ec345eeb92e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:44.645245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1920/3863] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:44.646057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:44.648219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:44.648626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:44.698004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:44.699345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:44.721937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:44.722671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:44.722960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:44.723240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:44.725306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:44.732004 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1921/3864] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:44.736277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:44.760332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff36f-2ae7-4e96-be4a-28967da5d491 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:44.780522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:44.782142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:44.782564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:44.782950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:44.784554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:58:44.785029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:44.789334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:44.829138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1922/3865] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:58:44.836443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:44.872614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dacf7f-540c-4d3e-900b-5e06c56538bf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:44.886622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:44.888227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:44.888382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:44.890112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:44.890422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:44.891722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:44.892472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:44.899822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:44.913868 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1944/3866] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:44.932217 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:44.988927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1923/3867] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:58:44 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:44.993989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:45.019984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85683e64-baec-4ba2-9012-8e969341aafa service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:45.242703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:45.243418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:45.243714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:45.243999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:45.244719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:45.249709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:45.304536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1945/3868] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:58:44 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:58:45.313607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:45.360532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122e10-c9ff-465a-a7a9-e70a07ea86d0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:45.388185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:45.388890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:45.389225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:45.389599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:45.390244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:45.392802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:45.437088 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1924/3869] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:45.442459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:45.467710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f73a2-6961-4b0b-bbc9-4c4461cb3813 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:45.487727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dfd1-21f5-4a82-a0b1-e1839f869638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:45.488756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dfd1-21f5-4a82-a0b1-e1839f869638 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:45.489366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dfd1-21f5-4a82-a0b1-e1839f869638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:45.489366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dfd1-21f5-4a82-a0b1-e1839f869638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:45.490052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dfd1-21f5-4a82-a0b1-e1839f869638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:45.492788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dfd1-21f5-4a82-a0b1-e1839f869638 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:45.528903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1946/3870] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:58:45.530527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:45.546393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097cbe6-eea8-4468-b46b-936399366040 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:45.582854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:45.583775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:45.584065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:45.584360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] PATH_INFO: `/v3/projects/2de3e68b2ca14b6a8a28e08e1a2b9674/users/7858298a317d42e4b7f7dc25bde4b9e4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:45.642420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de3e68b2ca14b6a8a28e08e1a2b9674, user_id=7858298a317d42e4b7f7dc25bde4b9e4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:45.649261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:45.709590 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1925/3871] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:58:45 2022] PUT /identity/v3/projects/2de3e68b2ca14b6a8a28e08e1a2b9674/users/7858298a317d42e4b7f7dc25bde4b9e4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:58:45.712375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:45.712674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:45.712961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:45.770305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:45.800640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:45.861964 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:45.976067 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1947/3872] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:46.084359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:46.086042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:46.127571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:46.129138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:46.248650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec0f04-0b64-4036-8a89-51dfb9d109c8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:46.256714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831f48-ed90-42ee-8355-962988fb4830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:46.260441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831f48-ed90-42ee-8355-962988fb4830 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:46.260833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831f48-ed90-42ee-8355-962988fb4830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:46.261121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831f48-ed90-42ee-8355-962988fb4830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:46.290858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d831f48-ed90-42ee-8355-962988fb4830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:46.304180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d831f48-ed90-42ee-8355-962988fb4830 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:46.309190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f76b-4014-4a81-92d8-845f3ff3410d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:46.327817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:46.329166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:46.329451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:46.329727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:46.342071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:46.346685 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1926/3873] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:46.507660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:46.509125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:46.542304 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1948/3874] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:58:55.094350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5766-5781-4a87-ad4d-8a58589dde06 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:55.095362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5766-5781-4a87-ad4d-8a58589dde06 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:55.095804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5766-5781-4a87-ad4d-8a58589dde06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:55.115967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-759a5766-5781-4a87-ad4d-8a58589dde06 None None] MFA Rules not processed for user `832ffd94ca494d889319abe2a2dd3fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:58:55.117543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-759a5766-5781-4a87-ad4d-8a58589dde06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:55.238306 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1927/3875] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:56.519691 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=63 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:57.384185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:57.386006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:57.522463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fa6ab-de76-4f83-a32e-6aaef77b7ba6 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:57.528594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:57.529488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:57.529938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:57.530377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:57.532421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:58:57.547176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:57.549611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:57.561769 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1949/3876] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:00.729289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:00.730214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:00.730731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:00.832787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] MFA Rules not processed for user `7858298a317d42e4b7f7dc25bde4b9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:00.834355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:00.998844 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:01.085024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1928/3877] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:05.029488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:05.031552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:05.065133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af838e9-f58b-4da0-8e8e-1821ff5e6cdc service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:05.074250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:05.075522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:05.075911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:05.076292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:05.083829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:05.113997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:05.115350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dfd61-50a9-4182-aa3a-29bf3d7600dd service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:05.139353 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1950/3878] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:07.786767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:07.788909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:08.001116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a58b4e-b72d-4747-89bc-7b55c69d0c84 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:08.007302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:08.008286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:08.008732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:08.009270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:08.011555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:08.094833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:08.096731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf830-3699-42e3-94d9-f604c470e916 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:08.110018 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1929/3879] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:10.794077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3b603-7a67-4f9b-ac79-bc388f27798c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:10.794691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3b603-7a67-4f9b-ac79-bc388f27798c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:10.794822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3b603-7a67-4f9b-ac79-bc388f27798c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:10.797315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1951/3880] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 14:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:59:10.807958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:10.808532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:10.808661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:10.847211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:10.848459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:10.898885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3b603-7a67-4f9b-ac79-bc388f27798c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:10.902891 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1930/3881] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:10.940383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3b603-7a67-4f9b-ac79-bc388f27798c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:10.957154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:10.957841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:10.958126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:10.958621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:10.983888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:10.985730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:11.011394 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1952/3882] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:12.104529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:12.107172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:12.135254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce85ee-01bb-4df7-a9f1-87089110e0a2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:12.151508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:12.157470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:12.161469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:12.162003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:12.168087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:12.222336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:12.238062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e9258-41a6-48c7-8f27-f0bf107c0536 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:12.272940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1931/3883] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:12.456692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:12.471517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a60067-7a93-4c8b-a35d-7da1cb96cd3f service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:12.481054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:12.481731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:12.482020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:12.482297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:12.484749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:12.507859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:12.509455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:12.532914 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1953/3884] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:14.060837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:14.061480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:14.061480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:14.106549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] MFA Rules not processed for user `2686b83fe2564a44a9938f9d543d6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:14.110022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:14.235346 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:14.275408 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1932/3885] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:14.790124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:14.792566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:14.831960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f6fb-63ca-4af1-80eb-8c715db85191 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:14.841667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:14.843919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:14.845138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:14.846226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] PATH_INFO: `/v3/users/1a48db2b71e046eeb90bb5fc9bd450c6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:14.849033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a48db2b71e046eeb90bb5fc9bd450c6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:14.853851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:14.941711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a48db2b71e046eeb90bb5fc9bd450c6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:14.944159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a48db2b71e046eeb90bb5fc9bd450c6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:14.966097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a48db2b71e046eeb90bb5fc9bd450c6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:14.967495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a48db2b71e046eeb90bb5fc9bd450c6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:14.979486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da48a41a-44be-4cdf-865b-691e0e075d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a48db2b71e046eeb90bb5fc9bd450c6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:15.004655 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1954/3886] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:14 2022] DELETE /identity/v3/users/1a48db2b71e046eeb90bb5fc9bd450c6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:15.143204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:15.144678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:15.162754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da33d-9900-441f-83c1-e3fe43ea4910 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:15.242687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:15.244600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:15.245004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:15.245575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] PATH_INFO: `/v3/users/840d7c0c5b024dd29eb6dd9941676ff7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:15.257643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=840d7c0c5b024dd29eb6dd9941676ff7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:15.259841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:15.352818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840d7c0c5b024dd29eb6dd9941676ff7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:15.370712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840d7c0c5b024dd29eb6dd9941676ff7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:15.380874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840d7c0c5b024dd29eb6dd9941676ff7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:15.391039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840d7c0c5b024dd29eb6dd9941676ff7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:15.393017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840d7c0c5b024dd29eb6dd9941676ff7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:15.407442 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1933/3887] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:15 2022] DELETE /identity/v3/users/840d7c0c5b024dd29eb6dd9941676ff7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:15.408953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:15.409270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:15.409556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:15.436274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:15.437899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:15.462538 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:15.563330 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1955/3888] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:15.606194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:15.607912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:15.716791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671c10d-c350-4f69-9893-e159ec3c7d1b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:15.722059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37acb3f-a45f-48c6-9685-6a35ee749d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:15.722892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37acb3f-a45f-48c6-9685-6a35ee749d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:15.723185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37acb3f-a45f-48c6-9685-6a35ee749d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:15.723516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37acb3f-a45f-48c6-9685-6a35ee749d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:15.752067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37acb3f-a45f-48c6-9685-6a35ee749d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:15.756580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37acb3f-a45f-48c6-9685-6a35ee749d8f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:15.773131 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1934/3889] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:16.091497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:16.093830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.108877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3da5c-9029-4d6e-a255-fdf69eb4385c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:16.114806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:16.115962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.116517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.117587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] PATH_INFO: `/v3/users/7858298a317d42e4b7f7dc25bde4b9e4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.121218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7858298a317d42e4b7f7dc25bde4b9e4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:16.129026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:16.164621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.165161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.165161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.196343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:16.207806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7858298a317d42e4b7f7dc25bde4b9e4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.208096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.208744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7858298a317d42e4b7f7dc25bde4b9e4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.217544 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:16.257811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7858298a317d42e4b7f7dc25bde4b9e4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.258616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7858298a317d42e4b7f7dc25bde4b9e4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.268103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7858298a317d42e4b7f7dc25bde4b9e4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.294350 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1935/3890] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:16.295362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:16.300458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.304657 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1956/3891] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:16 2022] DELETE /identity/v3/users/7858298a317d42e4b7f7dc25bde4b9e4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:16.317028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063591a-06be-4d8c-8b5d-68c90bd5c742 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:16.368242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:16.370334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.423924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:16.440022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.440691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.441175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] PATH_INFO: `/v3/projects/4029e4d2dd2343bb8ad84763db25befe` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.444407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4029e4d2dd2343bb8ad84763db25befe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:16.448076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:16.518953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e10b-b9e7-49e7-8b87-a41b3f06d811 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:16.538078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:16.539058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.549597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.550215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] PATH_INFO: `/v3/projects/0c8f17f4c9ae4dd980dbedbd71ad23d5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.553647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8f17f4c9ae4dd980dbedbd71ad23d5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:16.559394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:16.587192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4029e4d2dd2343bb8ad84763db25befe', 'request_id': 'req-60a8c502-3a6e-40b5-89c1-f88d71d37705'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.596176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4029e4d2dd2343bb8ad84763db25befe', 'request_id': 'req-60a8c502-3a6e-40b5-89c1-f88d71d37705'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.609482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4029e4d2dd2343bb8ad84763db25befe', 'request_id': 'req-60a8c502-3a6e-40b5-89c1-f88d71d37705'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.626715 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:16.628463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] The token cache is being invalidate because project 4029e4d2dd2343bb8ad84763db25befe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:16.628687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.629827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-60a8c502-3a6e-40b5-89c1-f88d71d37705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.633154 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1936/3892] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:16 2022] DELETE /identity/v3/projects/4029e4d2dd2343bb8ad84763db25befe => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:16.641555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72bc2-8290-49b8-90dd-0bffc8ec2222 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.641555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72bc2-8290-49b8-90dd-0bffc8ec2222 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.641908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72bc2-8290-49b8-90dd-0bffc8ec2222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.663771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e6a72bc2-8290-49b8-90dd-0bffc8ec2222 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:16.665025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e6a72bc2-8290-49b8-90dd-0bffc8ec2222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.674660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8f17f4c9ae4dd980dbedbd71ad23d5', 'request_id': 'req-1f32b76e-563a-4e88-b9a8-de86e5feb176'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.690959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8f17f4c9ae4dd980dbedbd71ad23d5', 'request_id': 'req-1f32b76e-563a-4e88-b9a8-de86e5feb176'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.710119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8f17f4c9ae4dd980dbedbd71ad23d5', 'request_id': 'req-1f32b76e-563a-4e88-b9a8-de86e5feb176'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.732247 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:16.742118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] The token cache is being invalidate because project 0c8f17f4c9ae4dd980dbedbd71ad23d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:16.746025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.749545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.753774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1957/3893] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:16 2022] DELETE /identity/v3/projects/0c8f17f4c9ae4dd980dbedbd71ad23d5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:16.757464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:16.763570 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1937/3894] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:16.763570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.763570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.764004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.766814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.789800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b76e-563a-4e88-b9a8-de86e5feb176 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:16.795455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:16.797239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:16.801965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:16.802963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.803251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.803527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] PATH_INFO: `/v3/users/b4ddf1847e1542a48bd02e0f0e1ac5bd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.805754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ddf1847e1542a48bd02e0f0e1ac5bd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:16.807627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:16.816639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1938/3895] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:16.821310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:16.843387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51362e-91dd-4fd9-9d6d-3b67a25805d6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:16.864875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:16.865535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.865821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.866105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.866870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:16.867175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:16.868896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:16.898712 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1939/3896] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:16.902154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:16.948716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922263-bf42-4481-85e0-80bec2bfc44b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:16.953529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ddf1847e1542a48bd02e0f0e1ac5bd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.954680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ddf1847e1542a48bd02e0f0e1ac5bd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.963362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:16.964800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:16.965241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:16.965676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:16.966935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:16.971270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:16.988817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ddf1847e1542a48bd02e0f0e1ac5bd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.989691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ddf1847e1542a48bd02e0f0e1ac5bd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:16.999110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ddf1847e1542a48bd02e0f0e1ac5bd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:17.025471 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1958/3897] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:16 2022] DELETE /identity/v3/users/b4ddf1847e1542a48bd02e0f0e1ac5bd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:17.026412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.029591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.036852 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1940/3898] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:16 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:17.040265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.043975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.176809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089df11-c2d2-46da-98e8-8b42aa177621 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.246242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2444-9db6-4ebd-b70f-bfffae14364a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.251759 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:17.258768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.260562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.261441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.262411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.263201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.269171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.275817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.277140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.277890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.278393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] PATH_INFO: `/v3/projects/2de3e68b2ca14b6a8a28e08e1a2b9674` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.279951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de3e68b2ca14b6a8a28e08e1a2b9674)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.282775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.319858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1941/3899] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:17 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:17.322117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.353734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f370668-577c-49d1-af2f-ade1c4645d3e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.376199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de3e68b2ca14b6a8a28e08e1a2b9674', 'request_id': 'req-f1477d3b-f922-4e23-9946-20236bdb25f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:17.402605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de3e68b2ca14b6a8a28e08e1a2b9674', 'request_id': 'req-f1477d3b-f922-4e23-9946-20236bdb25f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:17.415031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de3e68b2ca14b6a8a28e08e1a2b9674', 'request_id': 'req-f1477d3b-f922-4e23-9946-20236bdb25f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:17.433923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.435098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.435517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.436080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.438521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.440748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.443880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] The token cache is being invalidate because project 2de3e68b2ca14b6a8a28e08e1a2b9674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:17.445016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:17.446892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1477d3b-f922-4e23-9946-20236bdb25f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:17.456164 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1959/3900] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:17 2022] DELETE /identity/v3/projects/2de3e68b2ca14b6a8a28e08e1a2b9674 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:17.458613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd60b6-e4d3-48a4-8ca3-deec2142d899 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.458951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd60b6-e4d3-48a4-8ca3-deec2142d899 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.459239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd60b6-e4d3-48a4-8ca3-deec2142d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.463436 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1942/3901] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:17.469949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.479221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.497181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5cdd60b6-e4d3-48a4-8ca3-deec2142d899 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:17.500408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5cdd60b6-e4d3-48a4-8ca3-deec2142d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.509057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d5bee-c76c-4e96-9b13-161640bc0d03 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.520143 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1960/3902] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:17.522066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.522366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.522860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.525260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.526290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.526656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.527072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.528087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.530025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.559661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1943/3903] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:17.564302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.567485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:17.568757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.585141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d0091-1f0e-4244-8675-a3ad9f75b71b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.595389 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1961/3904] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:17.596374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.602609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac111f-fb87-40d9-8539-888dd1e7370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.603533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac111f-fb87-40d9-8539-888dd1e7370b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.603827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac111f-fb87-40d9-8539-888dd1e7370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.604265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac111f-fb87-40d9-8539-888dd1e7370b admin admin] PATH_INFO: `/v3/projects/1899713e76a441fca0f9eeb6601366fc/users/292c78c8b8484e748687b637d6ca62fa/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.621295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2092a0-b1ad-4a8e-a6ed-ea3f06cf2e01 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.628844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac111f-fb87-40d9-8539-888dd1e7370b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1899713e76a441fca0f9eeb6601366fc, user_id=292c78c8b8484e748687b637d6ca62fa, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.631726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac111f-fb87-40d9-8539-888dd1e7370b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.636644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.637328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.637615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.637884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.638646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:17.638977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.641149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.644453 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:17.652781 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1944/3905] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:17 2022] PUT /identity/v3/projects/1899713e76a441fca0f9eeb6601366fc/users/292c78c8b8484e748687b637d6ca62fa/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:17.666481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.671875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.672469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.702323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1962/3906] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:17.702323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.709695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.721686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:17.723819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:17.872414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac10cd-42cd-4412-babb-29f18df57f34 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.877685 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1945/3907] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:17.878661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.898033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f9d5-81c3-41b5-b301-5b93514c546f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:17.918473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:17.918473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:17.918947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:17.919167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:17.921333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:17.928764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:17.973521 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:17.986072 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1946/3908] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:17 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:17.989108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:17.993197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.021580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.024541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.024832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.025122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.033713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.071726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.074171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.098357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1963/3909] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:18.098760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.103516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.167530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d10c7-2458-4feb-b599-08a8396bf58e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.178728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.180765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.181051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.181328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] PATH_INFO: `/v3/projects/c3d2415ad76a451d83c0bed10af6cd7f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.187376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d2415ad76a451d83c0bed10af6cd7f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.191685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.199671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f20a2-0c34-46ba-940f-f613c2d44ac4 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.305786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.306468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.306778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.307059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.318965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d2415ad76a451d83c0bed10af6cd7f', 'request_id': 'req-520a0ff2-f980-4a87-a742-fc9039c338bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:18.329127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.332502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.333668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d2415ad76a451d83c0bed10af6cd7f', 'request_id': 'req-520a0ff2-f980-4a87-a742-fc9039c338bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:18.348237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d2415ad76a451d83c0bed10af6cd7f', 'request_id': 'req-520a0ff2-f980-4a87-a742-fc9039c338bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:18.351578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1964/3910] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:18.352619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.364807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] The token cache is being invalidate because project c3d2415ad76a451d83c0bed10af6cd7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:18.365446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:18.366051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-520a0ff2-f980-4a87-a742-fc9039c338bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:18.369253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1947/3911] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:17 2022] DELETE /identity/v3/projects/c3d2415ad76a451d83c0bed10af6cd7f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:18.370764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572504-e133-4694-8753-2752a84337a5 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.371182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572504-e133-4694-8753-2752a84337a5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.371577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572504-e133-4694-8753-2752a84337a5 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.373292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb0a00-4717-432a-aea3-d9048bc58caa service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.373665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1948/3912] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 14:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:59:18.375187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08d20-d58e-459b-b32f-61300ffa5647 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.376411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08d20-d58e-459b-b32f-61300ffa5647 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.376798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08d20-d58e-459b-b32f-61300ffa5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.393519 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:18.407045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-49c08d20-d58e-459b-b32f-61300ffa5647 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:18.409646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-49c08d20-d58e-459b-b32f-61300ffa5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.493897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e61cee-00dd-46fa-8711-fde4e7328420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.494632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e61cee-00dd-46fa-8711-fde4e7328420 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.494909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e61cee-00dd-46fa-8711-fde4e7328420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.495187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e61cee-00dd-46fa-8711-fde4e7328420 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.508613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e61cee-00dd-46fa-8711-fde4e7328420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.511046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e61cee-00dd-46fa-8711-fde4e7328420 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.538594 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1949/3913] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:18.538594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.538594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.538594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.560182 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1965/3914] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:18.563393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.563881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.564248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:18.564655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.565828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.588003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:18.589330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.601611 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1966/3915] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:18.604926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.604926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.619447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9c443-522a-49dd-9546-111e7337f7ff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.627152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.627896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.628180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.628512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.629364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.631082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.645503 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1950/3916] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:18.646640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.650536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1967/3917] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:18.656185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.659674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bf83a-e8d6-45c8-a732-0267001b7068 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.665556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.666662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.666956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.667595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.668402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:18.668719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.670544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.672027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81737f3-61cf-4c33-8dd1-8cc6202d6ee3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.679118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.679996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.680401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.680773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.681702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.683771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.689665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1951/3918] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:18.689665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.691709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:18.697257 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:18.708861 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1968/3919] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:18.711058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.712525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907463fb-24be-4e78-b943-97db53806ff8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.723261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.725255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.725552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.726945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.730615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904c4e-5a09-4c14-bb63-7c82d6c68875 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.745550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.746654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.746842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.748307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.749469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.749714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.753248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.754136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.777387 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1952/3920] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:18.778682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.810028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071acfc7-1787-455c-a5f8-7af5d9469fc9 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:18.823421 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1969/3921] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:18.825999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:18.837505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b9fc7-280a-43f8-a39f-a1240c6964e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:18.840281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b9fc7-280a-43f8-a39f-a1240c6964e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.840798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b9fc7-280a-43f8-a39f-a1240c6964e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.853358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b9fc7-280a-43f8-a39f-a1240c6964e8 admin admin] PATH_INFO: `/v3/projects/7a25b8d20ee541e7976b54c5cf234dae/users/3b0551622c74490abc17d4e0c34d5528/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:18.915074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b9fc7-280a-43f8-a39f-a1240c6964e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a25b8d20ee541e7976b54c5cf234dae, user_id=3b0551622c74490abc17d4e0c34d5528, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:18.922952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b9fc7-280a-43f8-a39f-a1240c6964e8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:18.966252 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1953/3922] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:18 2022] PUT /identity/v3/projects/7a25b8d20ee541e7976b54c5cf234dae/users/3b0551622c74490abc17d4e0c34d5528/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:18.975687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:18.976026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:18.976253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.069511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:19.071700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:19.095362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e9e6a-692b-4fef-8beb-3fbb1e0dccd6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:19.174667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088fdf0-f178-4cd0-911d-90c2ada450e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:19.175527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088fdf0-f178-4cd0-911d-90c2ada450e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.175817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088fdf0-f178-4cd0-911d-90c2ada450e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.176097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088fdf0-f178-4cd0-911d-90c2ada450e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.181853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088fdf0-f178-4cd0-911d-90c2ada450e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:19.185777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088fdf0-f178-4cd0-911d-90c2ada450e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:19.251413 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1970/3923] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/users => generated 285 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:19.253384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.253698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.254419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.284866 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:19.327498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:19.342561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:19.346432 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1954/3924] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:19.348740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:19.363054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc016e5-0cba-43bf-9014-56b4e6c9baf1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:19.368988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:19.369665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.370064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.370396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.371297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:19.372936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:19.388994 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1955/3925] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:19.390884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:19.410840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6473a08-a80a-41a2-8e80-010349b1a61f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:19.420228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:19.421345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.421863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.422361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.423465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:19.427110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:19.456647 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1956/3926] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:19.456647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:19.457313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:19.491575 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1971/3927] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:19.491575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:19.531831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3b5c-30b6-4b99-94b8-0cc63f02f1bf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:19.537043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826006-d702-430c-8125-4b876bce78aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:19.537954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826006-d702-430c-8125-4b876bce78aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.538241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826006-d702-430c-8125-4b876bce78aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.538549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826006-d702-430c-8125-4b876bce78aa admin admin] PATH_INFO: `/v3/projects/e2f5681dc7a746dbbeeb0d14a0dc405e/users/40a26ef6092148de9c233b04ddb2d943/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.575811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826006-d702-430c-8125-4b876bce78aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f5681dc7a746dbbeeb0d14a0dc405e, user_id=40a26ef6092148de9c233b04ddb2d943, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:19.579008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826006-d702-430c-8125-4b876bce78aa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:19.583691 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:19.589097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1e54-75fa-4acd-ba75-e7c4f472e541 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:19.598956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:19.599680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.599976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.600343 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1972/3928] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:19 2022] PUT /identity/v3/projects/e2f5681dc7a746dbbeeb0d14a0dc405e/users/40a26ef6092148de9c233b04ddb2d943/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:19.601025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.610520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101556-9f0c-48c3-978e-48287e848948 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.610810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101556-9f0c-48c3-978e-48287e848948 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.611092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101556-9f0c-48c3-978e-48287e848948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.615227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:19.616929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:19.639155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1957/3929] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:19.657322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-14101556-9f0c-48c3-978e-48287e848948 None None] MFA Rules not processed for user `40a26ef6092148de9c233b04ddb2d943`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:19.658876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-14101556-9f0c-48c3-978e-48287e848948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:19.799895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1973/3930] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:19.805010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:19.834463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97879e-dc72-4b6e-a5df-2889425d6833 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:19.948919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:19.952336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:19.952649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:19.952931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:19.953651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:19.955645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.015729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1958/3931] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:19 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:20.019772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101556-9f0c-48c3-978e-48287e848948 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:20.033117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101556-9f0c-48c3-978e-48287e848948 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:20.113774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:20.114621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.115263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.115673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.116473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:20.120334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.162298 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1974/3932] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:20 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:20.166222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:20.177451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cedd2-719b-4e4a-a1d2-32541868d944 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:20.182910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:20.183605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.184101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.184292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.185021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:20.187393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.199426 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1959/3933] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:20.204233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:20.217388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f73c-58c1-4429-af20-2bf98110a642 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:20.222736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf457829-7b35-4be8-91d9-12d0da2cb3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:20.223648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf457829-7b35-4be8-91d9-12d0da2cb3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.223935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf457829-7b35-4be8-91d9-12d0da2cb3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.224389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf457829-7b35-4be8-91d9-12d0da2cb3d7 admin admin] PATH_INFO: `/v3/projects/2cf78042a5dc4d1c85ba4ee66335885e/users/fc51362a1c674041b1df69b517582656/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.242520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf457829-7b35-4be8-91d9-12d0da2cb3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf78042a5dc4d1c85ba4ee66335885e, user_id=fc51362a1c674041b1df69b517582656, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:20.245690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf457829-7b35-4be8-91d9-12d0da2cb3d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.264786 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1975/3934] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:20 2022] PUT /identity/v3/projects/2cf78042a5dc4d1c85ba4ee66335885e/users/fc51362a1c674041b1df69b517582656/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:20.271550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:20.279286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2bef7-d61c-41f6-9ea6-ea88cadf5c52 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.279584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2bef7-d61c-41f6-9ea6-ea88cadf5c52 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.280651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2bef7-d61c-41f6-9ea6-ea88cadf5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.291154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475e9d-abb6-4546-9d03-4f588d49faaf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:20.307484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6dc2bef7-d61c-41f6-9ea6-ea88cadf5c52 None None] MFA Rules not processed for user `1d550d0bfe3d49c3b34d8a2b27dd0909`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:20.311286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dc2bef7-d61c-41f6-9ea6-ea88cadf5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:20.342852 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:20.362232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:20.363097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.363487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.363905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.364819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:20.368244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.383058 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1960/3935] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:20.385703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:20.396305 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:20.402787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f98d12-e904-43fd-8410-048f205e5758 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:20.410283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df3c71-85e0-4fd8-a0c3-d910315c80f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:20.411256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3c71-85e0-4fd8-a0c3-d910315c80f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.411597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3c71-85e0-4fd8-a0c3-d910315c80f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.411876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3c71-85e0-4fd8-a0c3-d910315c80f2 admin admin] PATH_INFO: `/v3/projects/2cf78042a5dc4d1c85ba4ee66335885e/users/fc51362a1c674041b1df69b517582656/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.413963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1976/3936] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:20.414958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df3c71-85e0-4fd8-a0c3-d910315c80f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf78042a5dc4d1c85ba4ee66335885e, user_id=fc51362a1c674041b1df69b517582656, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:20.417695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df3c71-85e0-4fd8-a0c3-d910315c80f2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.425070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.425363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.425648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.435622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1961/3937] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:20 2022] PUT /identity/v3/projects/2cf78042a5dc4d1c85ba4ee66335885e/users/fc51362a1c674041b1df69b517582656/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:20.447012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.447305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.447587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.455923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] MFA Rules not processed for user `1d550d0bfe3d49c3b34d8a2b27dd0909`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:20.457399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:20.500701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] MFA Rules not processed for user `fc51362a1c674041b1df69b517582656`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:20.502159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:20.583526 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1977/3938] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:20.685980 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1962/3939] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:20.755135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:20.893874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800900ea-acc2-4c90-98a2-287d5a77e5fa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:20.901124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83076c-f205-40fe-a928-893252e3a9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:20.914344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83076c-f205-40fe-a928-893252e3a9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:20.914924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83076c-f205-40fe-a928-893252e3a9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:20.918841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83076c-f205-40fe-a928-893252e3a9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:20.931716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83076c-f205-40fe-a928-893252e3a9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:20.934017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83076c-f205-40fe-a928-893252e3a9d9 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:20.949578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1978/3940] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:27.114588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:27.247271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4c8e-b173-4b21-a280-bce08314fcd1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:27.257475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:27.258377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:27.258740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:27.259025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] PATH_INFO: `/v3/users/40a26ef6092148de9c233b04ddb2d943` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:27.262551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a26ef6092148de9c233b04ddb2d943)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:27.265372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:27.381131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a26ef6092148de9c233b04ddb2d943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:27.393805 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:27.413124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a26ef6092148de9c233b04ddb2d943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:27.437241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a26ef6092148de9c233b04ddb2d943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:27.484638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a26ef6092148de9c233b04ddb2d943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:27.485871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a26ef6092148de9c233b04ddb2d943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:27.522314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1963/3941] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:27 2022] DELETE /identity/v3/users/40a26ef6092148de9c233b04ddb2d943 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:27.527124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:27.527645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:27.528941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:27.573415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:27.576390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:27.704271 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1979/3942] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:27.791278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:27.793418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:27.933026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202c34-8bd3-4a88-a6d6-3c70e04089a2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:27.950062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:27.950770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:27.951057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:27.951338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:27.974956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:27.976634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:28.000555 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1964/3943] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:29.787737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:29.789544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:29.808400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53d44a-4e96-4429-85db-83a0b8da3ea3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:29.819934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:29.820916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:29.821307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:29.821657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] PATH_INFO: `/v3/projects/e2f5681dc7a746dbbeeb0d14a0dc405e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:29.823247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f5681dc7a746dbbeeb0d14a0dc405e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:29.825610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:29.920177 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:29.932760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f5681dc7a746dbbeeb0d14a0dc405e', 'request_id': 'req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:29.952472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f5681dc7a746dbbeeb0d14a0dc405e', 'request_id': 'req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:29.962595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f5681dc7a746dbbeeb0d14a0dc405e', 'request_id': 'req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:29.978523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] The token cache is being invalidate because project e2f5681dc7a746dbbeeb0d14a0dc405e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:29.979598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:29.980666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:29.982664 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1980/3944] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:29 2022] DELETE /identity/v3/projects/e2f5681dc7a746dbbeeb0d14a0dc405e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:29.986667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:30.000428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa50d-c93d-470a-b6e8-c5ed25bc1cb3 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:30.142354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:30.143847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:30.144489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:30.144872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] PATH_INFO: `/v3/users/fc51362a1c674041b1df69b517582656` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:30.146638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc51362a1c674041b1df69b517582656)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:30.148796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:30.181779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:30.184031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:30.243370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc51362a1c674041b1df69b517582656'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:30.270273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc51362a1c674041b1df69b517582656'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:30.287201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc51362a1c674041b1df69b517582656'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:30.308358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc51362a1c674041b1df69b517582656'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:30.309440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc51362a1c674041b1df69b517582656'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:30.311923 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:30.328185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1965/3945] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:29 2022] DELETE /identity/v3/users/fc51362a1c674041b1df69b517582656 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:30.345490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacf9fc-2d85-49b4-8979-bbd74bc4210f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:30.484799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:30.485948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:30.486560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:30.487092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:30.489426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:30.715762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:30.717451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0873fe-7b94-4da3-8b0f-a4fb7fb7815d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:30.736534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1981/3946] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:59:31.218060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:31.220947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:31.363938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9986f7-a3f2-489c-8a2d-8bedded3fa93 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:31.375745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:31.376804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:31.377128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:31.377447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] PATH_INFO: `/v3/projects/2cf78042a5dc4d1c85ba4ee66335885e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:31.381357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf78042a5dc4d1c85ba4ee66335885e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:31.387723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:31.507856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf78042a5dc4d1c85ba4ee66335885e', 'request_id': 'req-69e2892e-07db-4820-9b98-5146308f295a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:31.520702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf78042a5dc4d1c85ba4ee66335885e', 'request_id': 'req-69e2892e-07db-4820-9b98-5146308f295a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:31.534622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf78042a5dc4d1c85ba4ee66335885e', 'request_id': 'req-69e2892e-07db-4820-9b98-5146308f295a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:31.575479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] The token cache is being invalidate because project 2cf78042a5dc4d1c85ba4ee66335885e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:31.583154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:31.584211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-69e2892e-07db-4820-9b98-5146308f295a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:31.586933 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1966/3947] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:31 2022] DELETE /identity/v3/projects/2cf78042a5dc4d1c85ba4ee66335885e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:31.592470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:31.593023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:31.593689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:31.640548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:31.644230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:31.678985 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:31.809262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1982/3948] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:31.818888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:31.819189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:31.819476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:31.877948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:31.884960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:31.912192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1967/3949] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:31.916118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:31.929924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9081763-b199-40c1-a8ff-a4416fe19988 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:31.944305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:31.944997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:31.945285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:31.945564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:31.946313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:31.946666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:31.959575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:32.007895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1983/3950] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:32.008032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:32.022184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2b4ff-7041-4660-9321-e4b6dff908f0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:32.038697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:32.039519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:32.039806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:32.040120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:32.040835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:32.044406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:32.121610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1968/3951] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:32 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:59:32.125019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:32.146344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfd14d-10d9-4ea0-b2b7-6678454bcbde admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:32.390658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:32.391906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:32.392424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:32.392921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:32.394082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:32.397918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:32.461734 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1984/3952] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:32 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:32.462622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:32.484180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c419-eb40-4148-9e4e-3305747c3e1a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:32.498993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:32.499893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:32.500184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:32.500466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:32.501210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:32.516243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:32.560009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1969/3953] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:32.562240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:32.579005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c97c9-06b2-4cb7-a353-6ab7ff071434 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:32.595678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6af21-e4db-47db-891f-46a7c80c5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:32.597764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6af21-e4db-47db-891f-46a7c80c5b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:32.600063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6af21-e4db-47db-891f-46a7c80c5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:32.601242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6af21-e4db-47db-891f-46a7c80c5b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:32.603615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6af21-e4db-47db-891f-46a7c80c5b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:32.611447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6af21-e4db-47db-891f-46a7c80c5b52 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:32.657780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:32.658034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1985/3954] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:32.674931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4f882-dcaa-4ed4-9308-db238a5661a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:32.686127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:32.687277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:32.687721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:32.690316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] PATH_INFO: `/v3/projects/36960750ab1147e9b24f7b0facb6a46c/users/237e35e1f9fc4ea78e5f0787d3bda31f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:32.778792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36960750ab1147e9b24f7b0facb6a46c, user_id=237e35e1f9fc4ea78e5f0787d3bda31f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:32.782758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:32.812398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1970/3955] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:32 2022] PUT /identity/v3/projects/36960750ab1147e9b24f7b0facb6a46c/users/237e35e1f9fc4ea78e5f0787d3bda31f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:59:32.830257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7cba-46d1-40a6-b076-d335b7c58209 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:32.830728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7cba-46d1-40a6-b076-d335b7c58209 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:32.830995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7cba-46d1-40a6-b076-d335b7c58209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:32.902480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f94b7cba-46d1-40a6-b076-d335b7c58209 None None] MFA Rules not processed for user `237e35e1f9fc4ea78e5f0787d3bda31f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:32.904064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f94b7cba-46d1-40a6-b076-d335b7c58209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:33.056247 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1986/3956] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:33.076894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:33.078700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:33.157498 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:33.244352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9360f9-d60d-474f-84bc-970914423c29 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:33.256062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03242d00-94c2-433c-bb20-2c5dbbaabd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:33.256907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03242d00-94c2-433c-bb20-2c5dbbaabd33 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:33.257028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03242d00-94c2-433c-bb20-2c5dbbaabd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:33.257301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03242d00-94c2-433c-bb20-2c5dbbaabd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:33.284298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03242d00-94c2-433c-bb20-2c5dbbaabd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:33.288538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03242d00-94c2-433c-bb20-2c5dbbaabd33 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:33.306885 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1971/3957] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:36.803247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:36.803728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:36.803844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:36.948558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] MFA Rules not processed for user `3b0551622c74490abc17d4e0c34d5528`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:36.976392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:37.021181 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:37.143953 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1987/3958] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:37.432227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752667cc-d8d9-4892-a177-ef6dd23a2270 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:37.433159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752667cc-d8d9-4892-a177-ef6dd23a2270 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:37.433617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752667cc-d8d9-4892-a177-ef6dd23a2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:37.474907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-752667cc-d8d9-4892-a177-ef6dd23a2270 None None] MFA Rules not processed for user `2498f2b4e9bb4e4baedc83e1462867b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:37.476146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-752667cc-d8d9-4892-a177-ef6dd23a2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:37.572840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:37.574306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:37.627643 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1972/3959] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:37.721473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d4f5-f21e-49a4-98de-bafc1c35fb6b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:37.739144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:37.739825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:37.740103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:37.740385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:37.757666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:37.759344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:37.778894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1988/3960] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:59:38.875288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6523-7535-4a13-a365-ea2527a9c7b9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:38.875892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6523-7535-4a13-a365-ea2527a9c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:38.876242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6523-7535-4a13-a365-ea2527a9c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:38.945115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c73f6523-7535-4a13-a365-ea2527a9c7b9 None None] MFA Rules not processed for user `292c78c8b8484e748687b637d6ca62fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:38.946554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c73f6523-7535-4a13-a365-ea2527a9c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:39.131778 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1973/3961] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:59:40.728844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:40.748151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eba01-c1f2-4df3-adc9-65ca018bbc7a service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:40.771117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ff979-36e7-4e6e-ae52-555d6d568cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:40.772006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ff979-36e7-4e6e-ae52-555d6d568cc5 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:40.772923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ff979-36e7-4e6e-ae52-555d6d568cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:40.772923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ff979-36e7-4e6e-ae52-555d6d568cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:40.798184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ff979-36e7-4e6e-ae52-555d6d568cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:40.804597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ff979-36e7-4e6e-ae52-555d6d568cc5 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:40.867943 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1989/3962] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:47.778695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:47.781274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:47.781770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:47.813605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] MFA Rules not processed for user `3b0551622c74490abc17d4e0c34d5528`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:47.815461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:47.823972 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1974/3963] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:49.675379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110600-afbf-4b92-965a-aea8cf87c734 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:49.679463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110600-afbf-4b92-965a-aea8cf87c734 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:49.679820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110600-afbf-4b92-965a-aea8cf87c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:49.722335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c2110600-afbf-4b92-965a-aea8cf87c734 None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:49.727733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c2110600-afbf-4b92-965a-aea8cf87c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:49.984729 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1990/3964] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:52.763713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:52.766226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:52.958051 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:52.976994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8b9cc-b6ef-43e4-b735-e98fa46eb840 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:52.986310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:52.987470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:52.989258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:52.989721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] PATH_INFO: `/v3/users/832ffd94ca494d889319abe2a2dd3fd3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:52.995891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832ffd94ca494d889319abe2a2dd3fd3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:52.998595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:53.014533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:53.015734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:53.016245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:53.094574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] MFA Rules not processed for user `292c78c8b8484e748687b637d6ca62fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:53.103642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:53.124348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832ffd94ca494d889319abe2a2dd3fd3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:53.153735 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1991/3965] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:53.170106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832ffd94ca494d889319abe2a2dd3fd3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:53.187243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832ffd94ca494d889319abe2a2dd3fd3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:53.215124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832ffd94ca494d889319abe2a2dd3fd3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:53.218109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-948ff0a0-8b92-42e0-84c0-10d8ec8a19e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832ffd94ca494d889319abe2a2dd3fd3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:53.247978 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1975/3966] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 14:59:52 2022] DELETE /identity/v3/users/832ffd94ca494d889319abe2a2dd3fd3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:54.866783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:54.888813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fdba6-f3fc-4a21-9579-c90c9cec8c07 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:54.926144 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:55.022260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:55.023286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.023572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.023848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] PATH_INFO: `/v3/projects/ab831cad9f1e4ffdbbc871744a87c99a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.027286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab831cad9f1e4ffdbbc871744a87c99a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:55.029876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:55.136059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab831cad9f1e4ffdbbc871744a87c99a', 'request_id': 'req-bd87fc99-b028-4402-a52e-7392dc80d81f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:55.149596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab831cad9f1e4ffdbbc871744a87c99a', 'request_id': 'req-bd87fc99-b028-4402-a52e-7392dc80d81f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:55.159282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab831cad9f1e4ffdbbc871744a87c99a', 'request_id': 'req-bd87fc99-b028-4402-a52e-7392dc80d81f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:55.180863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] The token cache is being invalidate because project ab831cad9f1e4ffdbbc871744a87c99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:59:55.181155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:55.182194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd87fc99-b028-4402-a52e-7392dc80d81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:59:55.193276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.194191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.194718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.196754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1992/3967] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 14:59:54 2022] DELETE /identity/v3/projects/ab831cad9f1e4ffdbbc871744a87c99a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:59:55.226646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:55.227890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:55.377738 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1976/3968] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:55.386980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.387292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.387555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.431978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:55.433365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:55.461330 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1993/3969] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:55.462519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:55.476758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f91c25-60ee-4abd-9b0b-9ee511f9d637 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:55.487986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:55.490639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.490639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.490941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.491657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:59:55.491973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:55.498843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:55.529619 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1977/3970] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 14:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:59:55.531215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:55.548899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a87fa-4a71-4cd5-8f3e-6dfde6f28075 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:55.555312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:55.556006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.556291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.556569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.557290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:55.559260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:55.640621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:55.643856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1994/3971] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 14:59:55 2022] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:59:55.655896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04aee6-8cb3-4a61-95ea-f6c3700a3d1b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:55.865519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:55.866528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.866528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.866810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.867612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:55.870274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:55.882925 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:55.915230 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1978/3972] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 14:59:55 2022] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:59:55.920142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:55.940957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442ac1a-6685-4b3d-9e00-a16a901c60a5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:55.946077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:55.947012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:55.947523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:55.947867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:55.948715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:55.950857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:55.990626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1995/3973] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:59:55.995016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:56.012679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9940f-25eb-452d-812b-9ca4db49ebff admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:56.030252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8553a-d41f-47f9-b6b2-c4bee452d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:56.031268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8553a-d41f-47f9-b6b2-c4bee452d191 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:56.031744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8553a-d41f-47f9-b6b2-c4bee452d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:56.032209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8553a-d41f-47f9-b6b2-c4bee452d191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:56.033150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8553a-d41f-47f9-b6b2-c4bee452d191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:56.034825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8553a-d41f-47f9-b6b2-c4bee452d191 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:56.080073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1979/3974] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 14:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:59:56.080394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:56.104257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749bfa-7085-49f8-b817-4da682c284f5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:56.123950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:56.124876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:56.133091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:56.133304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] PATH_INFO: `/v3/projects/81f4e9ba7e2a412db497d64e68092a78/users/38a7144ac9374ff7867c40bd146daa64/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:56.176533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f4e9ba7e2a412db497d64e68092a78, user_id=38a7144ac9374ff7867c40bd146daa64, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:56.181184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:56.243505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d5be-418c-4f55-87d1-a88846775208 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:56.244160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d5be-418c-4f55-87d1-a88846775208 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:56.244160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d5be-418c-4f55-87d1-a88846775208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:56.245484 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1996/3975] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 14:59:56 2022] PUT /identity/v3/projects/81f4e9ba7e2a412db497d64e68092a78/users/38a7144ac9374ff7867c40bd146daa64/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:59:56.283459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-32d4d5be-418c-4f55-87d1-a88846775208 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:59:56.285456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-32d4d5be-418c-4f55-87d1-a88846775208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:56.399438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1980/3976] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:59:56.468009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:56.471576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:56.611965 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:56.629542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb825f8-4d63-4858-a5bf-6786fd42d651 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:56.642139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547a3d-1165-4eed-aef9-2b704f67c0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:56.643251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547a3d-1165-4eed-aef9-2b704f67c0da service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:56.644236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547a3d-1165-4eed-aef9-2b704f67c0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:56.644743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547a3d-1165-4eed-aef9-2b704f67c0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:56.668430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547a3d-1165-4eed-aef9-2b704f67c0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:56.672936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547a3d-1165-4eed-aef9-2b704f67c0da service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:56.695481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1997/3977] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:00:06.137367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a361f6-fb1c-4f9b-b04b-6bc1d2257aa8 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:06.138920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a361f6-fb1c-4f9b-b04b-6bc1d2257aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:06.139261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a361f6-fb1c-4f9b-b04b-6bc1d2257aa8 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:06.140995 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1981/3978] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:00:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:00:06.147038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d839b-201b-4949-9607-7c950f89d4be None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:06.147616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d839b-201b-4949-9607-7c950f89d4be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:06.147771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d839b-201b-4949-9607-7c950f89d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:06.182442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f64d839b-201b-4949-9607-7c950f89d4be None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:06.184152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f64d839b-201b-4949-9607-7c950f89d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:06.282759 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1998/3979] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:00:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:06.314101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a361f6-fb1c-4f9b-b04b-6bc1d2257aa8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:06.316825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7a361f6-fb1c-4f9b-b04b-6bc1d2257aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:06.336039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a361f6-fb1c-4f9b-b04b-6bc1d2257aa8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:06.342953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123846-eb50-46d9-b536-ecb7b5768e3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:06.343852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123846-eb50-46d9-b536-ecb7b5768e3e service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:06.344140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123846-eb50-46d9-b536-ecb7b5768e3e service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:06.344466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123846-eb50-46d9-b536-ecb7b5768e3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:06.354947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123846-eb50-46d9-b536-ecb7b5768e3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:06.358245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123846-eb50-46d9-b536-ecb7b5768e3e service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:06.369641 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1982/3980] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:00:14.862053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:14.862575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:14.862691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:14.955763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] MFA Rules not processed for user `38a7144ac9374ff7867c40bd146daa64`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:14.958088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:15.107278 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 1999/3981] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:15.117303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7994-2a84-46e3-859e-482be7f0cfae None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:15.118378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7994-2a84-46e3-859e-482be7f0cfae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:15.118843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7994-2a84-46e3-859e-482be7f0cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:15.141360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7d0b7994-2a84-46e3-859e-482be7f0cfae None None] MFA Rules not processed for user `38a7144ac9374ff7867c40bd146daa64`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:15.143680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7d0b7994-2a84-46e3-859e-482be7f0cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:15.156960 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1983/3982] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:15.436242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:15.438122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:15.563457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcd91-db47-4089-baa8-27d549d2159c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:15.570187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:15.571175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:15.571502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:15.571780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:15.583597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:15.585647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:15.593907 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:15.621120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2000/3983] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:00:25.134143 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:30.765425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:30.766168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:30.766168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:30.798454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] MFA Rules not processed for user `2498f2b4e9bb4e4baedc83e1462867b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:30.800221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:30.901669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1984/3984] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:40.890317 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=25 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:47.677834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:47.708919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66936e56-d594-43b2-8b51-f051eafcc8dd service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:47.724482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:47.726415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:47.726599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:47.727102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] PATH_INFO: `/v3/users/38a7144ac9374ff7867c40bd146daa64` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:47.728925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a7144ac9374ff7867c40bd146daa64)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:47.732275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:47.863599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a7144ac9374ff7867c40bd146daa64'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:47.864575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a7144ac9374ff7867c40bd146daa64'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:47.885958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a7144ac9374ff7867c40bd146daa64'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:47.886987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a7144ac9374ff7867c40bd146daa64'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:47.900267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71a9ae3f-27f0-4391-9a53-5a680c1d8f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a7144ac9374ff7867c40bd146daa64'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:47.930121 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2001/3985] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:00:47 2022] DELETE /identity/v3/users/38a7144ac9374ff7867c40bd146daa64 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:00:48.262863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:48.288087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea222-5fc0-44b0-9577-946efb4ef1d9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:48.376128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:48.377212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:48.377641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:48.378113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] PATH_INFO: `/v3/projects/81f4e9ba7e2a412db497d64e68092a78` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:48.379577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f4e9ba7e2a412db497d64e68092a78)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:48.381781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:48.445551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f4e9ba7e2a412db497d64e68092a78', 'request_id': 'req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:48.463398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f4e9ba7e2a412db497d64e68092a78', 'request_id': 'req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:48.477827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f4e9ba7e2a412db497d64e68092a78', 'request_id': 'req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:48.496646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] The token cache is being invalidate because project 81f4e9ba7e2a412db497d64e68092a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:00:48.498425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:48.499803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f27b710a-7045-48a6-8ceb-aaeb22ad8fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:00:48.502822 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1985/3986] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:00:48 2022] DELETE /identity/v3/projects/81f4e9ba7e2a412db497d64e68092a78 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:00:48.508928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639553c-363a-482c-a096-1fe375b56236 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:48.509462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639553c-363a-482c-a096-1fe375b56236 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:48.509951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639553c-363a-482c-a096-1fe375b56236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:48.566292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2639553c-363a-482c-a096-1fe375b56236 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:48.569049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2639553c-363a-482c-a096-1fe375b56236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:48.666191 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2002/3987] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:00:48.673646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:48.674426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:48.675094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:48.696449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:48.698128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:48.716584 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1986/3988] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:48.720691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639553c-363a-482c-a096-1fe375b56236 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:48.732703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639553c-363a-482c-a096-1fe375b56236 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:48.739098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:48.740117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:48.740583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:48.741018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:48.741948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:00:48.742431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:48.744507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:48.773355 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2003/3989] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:00:48.777768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:48.794312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1428e-1e5f-4234-b940-12fd2548e837 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:48.806708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:48.807630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:48.808512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:48.808793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:48.809509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:48.813646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:48.863344 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1987/3990] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:00:48 2022] POST /identity/v3/projects => generated 397 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:00:48.865504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:48.878993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1047bc-2894-4900-9ccc-837257c03db4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:48.969639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:48.970342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:48.974589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:48.974926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:48.975665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:48.979196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:48.987625 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:49.012400 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2004/3991] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:00:48 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:00:49.012977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:49.026093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aeb0f-1c36-4772-8c0a-451a3fb8996a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:49.033975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:49.035951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:49.037320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:49.038030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:49.039629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:49.043947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:49.071568 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1988/3992] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:00:49.082871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:49.096053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba755b-2769-4307-bada-def0ecc0dc57 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:49.101105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523eeb-958b-4ca2-be0e-1feef22c6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:49.102277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523eeb-958b-4ca2-be0e-1feef22c6b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:49.102779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523eeb-958b-4ca2-be0e-1feef22c6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:49.103873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523eeb-958b-4ca2-be0e-1feef22c6b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:49.104792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb523eeb-958b-4ca2-be0e-1feef22c6b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:49.106602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb523eeb-958b-4ca2-be0e-1feef22c6b2e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:49.122631 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2005/3993] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:00:49.129483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:49.146567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0abe48-ac8f-483c-90ce-f4fde7e39e98 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:49.162711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:49.166407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:49.166407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:49.166407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] PATH_INFO: `/v3/projects/90ad31da65224cbea2855b957d0ef5f8/users/cbc5523d758c400eb83b02980349f6b3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:49.213464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ad31da65224cbea2855b957d0ef5f8, user_id=cbc5523d758c400eb83b02980349f6b3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:49.225630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:49.255795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1989/3994] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:00:49 2022] PUT /identity/v3/projects/90ad31da65224cbea2855b957d0ef5f8/users/cbc5523d758c400eb83b02980349f6b3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:00:49.260358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e73b-d802-402d-8654-3f40dfc6d479 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:49.260653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e73b-d802-402d-8654-3f40dfc6d479 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:49.261041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e73b-d802-402d-8654-3f40dfc6d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:49.321790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5e12e73b-d802-402d-8654-3f40dfc6d479 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:49.323098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5e12e73b-d802-402d-8654-3f40dfc6d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:49.489076 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2006/3995] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:49.516418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:49.518206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:49.594228 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:49.686484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76a372-106c-490a-92c6-bb9a6db9fe31 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:49.697269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:49.697950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:49.698240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:49.699083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:49.730876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:49.732352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:49.753474 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1990/3996] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:00:50.073979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:50.075313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:50.075313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:50.112479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:50.130850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:50.323074 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2007/3997] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:50.374585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:50.376747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:50.586858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38998766-ec75-4c48-97cd-827aaffcc8f6 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:50.593835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758727fe-9c6d-49a7-b220-989045952dc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:50.595030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758727fe-9c6d-49a7-b220-989045952dc1 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:50.595658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758727fe-9c6d-49a7-b220-989045952dc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:50.596107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758727fe-9c6d-49a7-b220-989045952dc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:50.606773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758727fe-9c6d-49a7-b220-989045952dc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:50.608911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758727fe-9c6d-49a7-b220-989045952dc1 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:50.629737 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1991/3998] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:00:51.518446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:51.534938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa9e4e-a527-4973-95ea-7f1ab6d90338 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:51.545109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:51.548188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:51.548898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:51.549532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:51.551925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:51.696857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:51.698461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:51.719344 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:00:51.732619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2008/3999] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:00:53.556408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2580-abaa-4737-848d-8aa0676a1b34 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:53.556988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2580-abaa-4737-848d-8aa0676a1b34 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:53.556988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2580-abaa-4737-848d-8aa0676a1b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:53.606521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d64b2580-abaa-4737-848d-8aa0676a1b34 None None] MFA Rules not processed for user `2686b83fe2564a44a9938f9d543d6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:00:53.610626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d64b2580-abaa-4737-848d-8aa0676a1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:53.847243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1992/4000] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:00:57.938293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:00:57.940013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:57.984916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee9c5-6e0d-4dd5-80a4-9c0378ea26c6 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:00:57.993842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:00:57.998695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:00:57.998987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:00:57.999268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:00:58.006739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:00:58.041656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:00:58.046853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278177e-70a3-4434-81bb-5e2850a9fa80 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:00:58.082355 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2009/4001] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:03.828229 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=75 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:03.841764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:03.842064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:03.842353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:03.902606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] MFA Rules not processed for user `cbc5523d758c400eb83b02980349f6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:03.903862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:04.118025 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1993/4002] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:04.132145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:04.133055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:04.133505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:04.186215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] MFA Rules not processed for user `cbc5523d758c400eb83b02980349f6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:04.187756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:04.198478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2010/4003] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:04.550198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:04.552060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:04.587427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ff0d7-81df-49ed-97fd-15dce29b5b50 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:04.605195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:04.606137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:04.606878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:04.607844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:04.627750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:04.630277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:04.655560 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1994/4004] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:08.328515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:08.330141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:08.394667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f844e-3a12-46c8-b726-70365b192f77 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:08.409950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:08.410698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:08.410989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:08.411268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:08.414388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:08.434335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:08.436069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:08.477781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2011/4005] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:08.941348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:08.956708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19778045-17ae-48a0-b498-da0bafdfb5a4 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:08.973280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:08.973956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:08.974238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:08.974544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:08.984384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:09.011884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:09.013849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ecac6-82bd-4310-b7ab-9bc4b1f540ff service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:09.034090 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1995/4006] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:18.444618 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=15 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:19.024403 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=44 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:21.801559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:21.816443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1c6c7-8627-45f0-94f3-60c8ec9b64aa service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:21.821270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:21.832632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:21.833326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:21.833612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:21.835954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:21.848034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:21.850065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:21.878909 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2012/4007] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:23.480770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831a043-81c8-4e36-aa50-e20dceccb318 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:23.480770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831a043-81c8-4e36-aa50-e20dceccb318 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:23.481362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831a043-81c8-4e36-aa50-e20dceccb318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:23.519842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6831a043-81c8-4e36-aa50-e20dceccb318 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:23.521381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6831a043-81c8-4e36-aa50-e20dceccb318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:23.531891 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1996/4008] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:23.548056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:23.578798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fab01-aa90-4acc-b442-52b2b79f0158 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:23.585684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:23.586705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:23.587191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:23.587963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:23.604140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:23.605730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:23.619480 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2013/4009] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:01:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:01:25.955467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c388913-b9f5-441e-ab48-2e6ed920b08e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:25.956446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c388913-b9f5-441e-ab48-2e6ed920b08e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:25.957074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c388913-b9f5-441e-ab48-2e6ed920b08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:25.978182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2c388913-b9f5-441e-ab48-2e6ed920b08e None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:25.980137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c388913-b9f5-441e-ab48-2e6ed920b08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:26.079012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1997/4010] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:27.755803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:27.757379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:27.920669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52c42-af66-4f96-8b4a-9fd5921772bc service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:27.942055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:27.942753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:27.943395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:27.943507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:27.945502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:27.970020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:27.971915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:28.012917 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2014/4011] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:28.316346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:28.316835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:28.316968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:28.377381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:28.379649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:28.422185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1998/4012] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:28.429701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:28.444844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb0717-0af1-4798-8630-46739e61b56d service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:28.472734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:28.472734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:28.472734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:28.472734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:28.504620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:28.514754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:28.538660 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2015/4013] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:01:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:01:29.935531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:29.964389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a3ef-abd6-43a6-8566-24d0293c7fcd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:29.992000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:29.996418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:29.999327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:30.000073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:30.008138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:30.073026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:30.075439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f095b3b-0379-440b-9791-b2f0b5198f97 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:30.101900 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 1999/4014] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:38.534836 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=50 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:40.090158 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=37 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:42.416613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:42.444849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdca6-db12-4ad6-9869-209dc43357bc service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:42.455946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:42.457246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:42.457886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:42.458412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:42.463580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:42.512449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:42.514724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eed3f-491b-4151-a1bd-b3c9b073762f service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:42.532725 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2016/4015] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:46.520564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b56b5-4b6c-45f6-8b84-1dce61319dea None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:46.521036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b56b5-4b6c-45f6-8b84-1dce61319dea None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:46.521152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b56b5-4b6c-45f6-8b84-1dce61319dea None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:46.522482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2000/4016] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:01:46.529554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:46.530124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:46.530124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:46.565583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:46.566865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:46.592744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2017/4017] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:46.620117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b56b5-4b6c-45f6-8b84-1dce61319dea None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:46.647845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b56b5-4b6c-45f6-8b84-1dce61319dea None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:46.661122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:46.662331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:46.662877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:46.663347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:46.674587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:46.696554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:46.711802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:46.727567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2001/4018] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:46.742420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983e15-f426-4cf2-ac35-626f488582a4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:46.759723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:46.760883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:46.761351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:46.761796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] PATH_INFO: `/v3/users/cbc5523d758c400eb83b02980349f6b3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:46.764252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc5523d758c400eb83b02980349f6b3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:46.767076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:46.869568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc5523d758c400eb83b02980349f6b3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:46.870526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc5523d758c400eb83b02980349f6b3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:46.904473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc5523d758c400eb83b02980349f6b3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:46.905271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc5523d758c400eb83b02980349f6b3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:46.924630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc5523d758c400eb83b02980349f6b3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:46.970193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2018/4019] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:01:46 2022] DELETE /identity/v3/users/cbc5523d758c400eb83b02980349f6b3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:01:47.223489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:47.237254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e37a4-c386-4354-9d67-31b492a2ae04 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:47.392981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:47.393720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:47.394379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:47.394754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:47.397019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:47.418378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:47.420847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:47.445160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:47.447145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e586d1-fa91-490f-89cf-936dcb64d27a service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:47.484414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2002/4020] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:47.601588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adb5db-d1d4-4004-a03d-a2bb77c5ea00 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:47.617703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:47.619204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:47.619495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:47.619777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] PATH_INFO: `/v3/projects/90ad31da65224cbea2855b957d0ef5f8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:47.623711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ad31da65224cbea2855b957d0ef5f8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:47.625880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:47.822540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ad31da65224cbea2855b957d0ef5f8', 'request_id': 'req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:47.832899 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:47.843723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ad31da65224cbea2855b957d0ef5f8', 'request_id': 'req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:47.851647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ad31da65224cbea2855b957d0ef5f8', 'request_id': 'req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:47.874316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] The token cache is being invalidate because project 90ad31da65224cbea2855b957d0ef5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:01:47.874967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:47.876597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de8454bd-b326-4abe-a8b3-f1ebe9e47e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:47.878710 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2019/4021] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:01:47 2022] DELETE /identity/v3/projects/90ad31da65224cbea2855b957d0ef5f8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:47.884297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:47.885188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:47.885726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:47.944604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:47.946257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:48.134241 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2003/4022] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:48.137186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.137791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.137791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.172141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:48.173552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:48.190605 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2020/4023] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:48.191951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:48.205196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904a10-5786-45c7-a453-959c92d84436 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:48.213248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:48.213934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.214219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.214516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.215253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:01:48.215559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:48.218200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:48.234537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2004/4024] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:01:48.236970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:48.253148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c596d02-fd9f-41fc-818d-fdf472e72421 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:48.260158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:48.261110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.261557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.262008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.262902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:48.265308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:48.309940 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2021/4025] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:01:48 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:01:48.317077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:48.380115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703451-b903-43d7-9d75-45388c80ffca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:48.511119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:48.512209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.512718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.513227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.514181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:48.519806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:48.544783 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:48.577694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2005/4026] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:01:48 2022] POST /identity/v3/users => generated 301 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:01:48.581740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:48.600530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46293dc8-df38-463d-b90a-c6083ee8766f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:48.624623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:48.626945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.629595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.629980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.630982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:48.636197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:48.671102 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2022/4027] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:01:48.675098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:48.700865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7e7a2-8472-4123-ac3e-fa1170930df4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:48.724129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84633004-b909-49b7-9a6b-ef6a3460a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:48.726540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84633004-b909-49b7-9a6b-ef6a3460a769 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.727028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84633004-b909-49b7-9a6b-ef6a3460a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.728474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84633004-b909-49b7-9a6b-ef6a3460a769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.732409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84633004-b909-49b7-9a6b-ef6a3460a769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:48.738729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84633004-b909-49b7-9a6b-ef6a3460a769 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:48.771927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2006/4028] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:01:48.776606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:48.792414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d8767-a328-4c07-9e48-a890d8236b84 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:48.805967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:48.809742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.811047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.811652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] PATH_INFO: `/v3/projects/b318c94e05b74de08e9b767a28077961/users/aee4b1f9fea54a5fb92c373005944ff8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:48.861769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b318c94e05b74de08e9b767a28077961, user_id=aee4b1f9fea54a5fb92c373005944ff8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:48.865510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:48.892051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2023/4029] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:01:48 2022] PUT /identity/v3/projects/b318c94e05b74de08e9b767a28077961/users/aee4b1f9fea54a5fb92c373005944ff8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:48.903626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890ece-2706-4b88-a770-02bf46cc19a2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:48.906080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890ece-2706-4b88-a770-02bf46cc19a2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:48.906725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890ece-2706-4b88-a770-02bf46cc19a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:49.040029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c3890ece-2706-4b88-a770-02bf46cc19a2 None None] MFA Rules not processed for user `aee4b1f9fea54a5fb92c373005944ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:49.041514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c3890ece-2706-4b88-a770-02bf46cc19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:49.295630 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2007/4030] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:49.683670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:49.833809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b58d1-4fab-4bb1-95b6-2d5c60eeed8e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:49.839912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:49.842030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:49.842530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:49.842996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] PATH_INFO: `/v3/users/aee4b1f9fea54a5fb92c373005944ff8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:49.844642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee4b1f9fea54a5fb92c373005944ff8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:49.846977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:50.018732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee4b1f9fea54a5fb92c373005944ff8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:50.018732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee4b1f9fea54a5fb92c373005944ff8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:50.048191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee4b1f9fea54a5fb92c373005944ff8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:50.049021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee4b1f9fea54a5fb92c373005944ff8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:50.063409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee4b1f9fea54a5fb92c373005944ff8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:50.079194 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:50.096861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:50.097358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:50.097358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:50.105113 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2024/4031] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:01:49 2022] DELETE /identity/v3/users/aee4b1f9fea54a5fb92c373005944ff8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:50.129163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:50.130396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:50.306211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:50.308509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:50.328996 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2008/4032] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:01:50.414918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c934b-abae-423e-a12b-2574a658ef61 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:50.419059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d471d6-064b-49b8-a57d-8b21abd02b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:50.419976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d471d6-064b-49b8-a57d-8b21abd02b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:50.420342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d471d6-064b-49b8-a57d-8b21abd02b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:50.420769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d471d6-064b-49b8-a57d-8b21abd02b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:50.432172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d471d6-064b-49b8-a57d-8b21abd02b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:50.433718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d471d6-064b-49b8-a57d-8b21abd02b3f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:50.468026 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2025/4033] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:01:51.367642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:51.370544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:51.394946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80bee4-a864-4552-9e79-e92aa4262ae2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:51.406090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:51.417943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:51.419924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:51.420788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] PATH_INFO: `/v3/projects/b318c94e05b74de08e9b767a28077961` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:51.423245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b318c94e05b74de08e9b767a28077961)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:51.426707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:51.585347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b318c94e05b74de08e9b767a28077961', 'request_id': 'req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:51.593029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b318c94e05b74de08e9b767a28077961', 'request_id': 'req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:51.607924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b318c94e05b74de08e9b767a28077961', 'request_id': 'req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:51.611508 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:51.641246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] The token cache is being invalidate because project b318c94e05b74de08e9b767a28077961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:01:51.641815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:51.643472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de2a4f1c-b4fb-4012-8df4-92cdb6b75555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:51.647656 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2009/4034] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:01:51 2022] DELETE /identity/v3/projects/b318c94e05b74de08e9b767a28077961 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:51.652998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:51.654057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:51.654762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:51.704199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:51.707648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:51.826623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2026/4035] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:51.887569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:51.888266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:51.888876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:51.912933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:51.915105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:51.929583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:51.941888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcf49f-2d45-44c4-a06f-f02b952b175d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:51.942272 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2010/4036] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:51.948969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:51.950294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:51.951124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:51.951124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:51.952035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:01:51.952474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:51.956056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:51.970304 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2027/4037] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:01:51.974792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:51.987562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92832375-70ef-4585-b8c2-eb48b2ea412e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:51.992809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:51.994327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:51.994704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:51.995003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:51.995795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:51.997836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:52.056428 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2011/4038] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:01:51 2022] POST /identity/v3/projects => generated 359 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:01:52.061568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:52.073913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe7ea5-99b3-44e2-9a03-c500f1060c61 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:52.142557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:52.143245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.143536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.143818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.144568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:52.146748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:52.178354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:52.179496 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2028/4039] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:01:52 2022] POST /identity/v3/users => generated 280 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:01:52.191869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4628-e3bd-4c90-bf04-a324c70fbf0d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:52.199060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:52.201637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.201785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.202037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.202750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:52.211382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:52.231265 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2012/4040] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:01:52.231486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:52.248307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0ae9-5426-4791-b919-ac921acf24ca admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:52.276298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be17e8-2ce3-4658-9ad1-fd03320347eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:52.278727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be17e8-2ce3-4658-9ad1-fd03320347eb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.279027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be17e8-2ce3-4658-9ad1-fd03320347eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.279314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be17e8-2ce3-4658-9ad1-fd03320347eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.280075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be17e8-2ce3-4658-9ad1-fd03320347eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:52.298746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be17e8-2ce3-4658-9ad1-fd03320347eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:52.344949 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2029/4041] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:01:52.348926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:52.361435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff441-26fa-4798-a7f5-ed8e3f537224 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:52.384342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:52.385300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.385589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.385870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] PATH_INFO: `/v3/projects/66677ba64fdb42ee986b0e8601162359/users/2bdbe7d8602e45b5aba88b8f759fc531/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.408056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66677ba64fdb42ee986b0e8601162359, user_id=2bdbe7d8602e45b5aba88b8f759fc531, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:52.411233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:52.458616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2013/4042] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:01:52 2022] PUT /identity/v3/projects/66677ba64fdb42ee986b0e8601162359/users/2bdbe7d8602e45b5aba88b8f759fc531/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:52.466535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e924-81a2-4eef-bc9a-d30423e16b59 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.466823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e924-81a2-4eef-bc9a-d30423e16b59 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.467105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e924-81a2-4eef-bc9a-d30423e16b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.483124 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:52.502125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0d96e924-81a2-4eef-bc9a-d30423e16b59 None None] MFA Rules not processed for user `2bdbe7d8602e45b5aba88b8f759fc531`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:52.503740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d96e924-81a2-4eef-bc9a-d30423e16b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:52.599460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2030/4043] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:52.672912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:52.744281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3243-06eb-45c7-909f-1c65e6c26151 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:52.749418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:52.750365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.750689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.750963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] PATH_INFO: `/v3/users/2bdbe7d8602e45b5aba88b8f759fc531` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.752250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdbe7d8602e45b5aba88b8f759fc531)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:52.754274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:52.830190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdbe7d8602e45b5aba88b8f759fc531'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:52.851324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdbe7d8602e45b5aba88b8f759fc531'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:52.861482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdbe7d8602e45b5aba88b8f759fc531'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:52.875338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdbe7d8602e45b5aba88b8f759fc531'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:52.876154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdbe7d8602e45b5aba88b8f759fc531'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:52.894578 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2014/4044] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:01:52 2022] DELETE /identity/v3/users/2bdbe7d8602e45b5aba88b8f759fc531 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:52.896176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:52.897014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:52.897612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:52.921564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:52.922837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:53.018420 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2031/4045] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:53.034803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:53.039952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:53.063624 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:53.151025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881606-a578-4e43-85f4-244382daf378 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:53.163027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cc795-57d8-4868-96f5-134c5b72ef75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:53.163852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cc795-57d8-4868-96f5-134c5b72ef75 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:53.164188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cc795-57d8-4868-96f5-134c5b72ef75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:53.164581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cc795-57d8-4868-96f5-134c5b72ef75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:53.184608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cc795-57d8-4868-96f5-134c5b72ef75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:53.184608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cc795-57d8-4868-96f5-134c5b72ef75 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:53.210447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2015/4046] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:54.005641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.007485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:54.027326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c9d0-0329-4518-8684-b7ad9b806bdb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.034477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.035601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.036068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.036509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] PATH_INFO: `/v3/projects/66677ba64fdb42ee986b0e8601162359` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.038539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66677ba64fdb42ee986b0e8601162359)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.041141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.111937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66677ba64fdb42ee986b0e8601162359', 'request_id': 'req-c98414dd-248b-4c05-a7ff-07eb3c02517f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:54.121722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66677ba64fdb42ee986b0e8601162359', 'request_id': 'req-c98414dd-248b-4c05-a7ff-07eb3c02517f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:54.130751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66677ba64fdb42ee986b0e8601162359', 'request_id': 'req-c98414dd-248b-4c05-a7ff-07eb3c02517f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:54.144355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] The token cache is being invalidate because project 66677ba64fdb42ee986b0e8601162359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:01:54.144652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:54.145335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c98414dd-248b-4c05-a7ff-07eb3c02517f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:01:54.148382 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2032/4047] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:01:54 2022] DELETE /identity/v3/projects/66677ba64fdb42ee986b0e8601162359 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:54.153740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.154243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.154354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.175389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:54.176707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:54.253322 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2016/4048] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:54.261575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.262548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.262870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.332687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:54.334671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:54.347385 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2033/4049] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:54.351313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.370207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f1f8-329c-4225-b5c2-6e3e6867aff8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.379763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.380465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.380739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.381077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.381823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:01:54.382135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.384068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.399528 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2017/4050] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:01:54.403510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.413170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a229fa-6cc9-4a26-ae93-f5f4f308ffa5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.420131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.420812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.421096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.422051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.422051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.424020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.439152 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:54.467073 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2034/4051] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:01:54 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:01:54.473585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.485906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e105a-0d3b-4c73-b881-6773cc801887 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.577091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.577091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.577503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.577971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.579935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.582117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.629785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.630934 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2018/4052] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:01:54 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:01:54.646656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac3b1-d9cd-4a27-b07f-f7819e1d10dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.651813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.652630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.652988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.653415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.654657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.656752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.673984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2035/4053] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:01:54.677353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.690974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775e8f4-f2dc-48f5-980b-0393f91da937 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.697705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59bf1-a215-4ac1-9a8c-e8adb758ee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.698938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59bf1-a215-4ac1-9a8c-e8adb758ee4a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.698938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59bf1-a215-4ac1-9a8c-e8adb758ee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.699879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59bf1-a215-4ac1-9a8c-e8adb758ee4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.700021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59bf1-a215-4ac1-9a8c-e8adb758ee4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.701979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59bf1-a215-4ac1-9a8c-e8adb758ee4a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.721376 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2019/4054] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:01:54.722361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:54.734759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e0f5-60f9-42cb-ad36-16a794b93b2c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:54.743419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:54.745477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.769690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.770780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] PATH_INFO: `/v3/projects/ce18ddeefc1d434f9ee7aa14dd3d018a/users/5c048e0d6b4f4cdabfaf7c3467aa6779/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.813753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce18ddeefc1d434f9ee7aa14dd3d018a, user_id=5c048e0d6b4f4cdabfaf7c3467aa6779, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:54.819999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:54.857265 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2036/4055] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:01:54 2022] PUT /identity/v3/projects/ce18ddeefc1d434f9ee7aa14dd3d018a/users/5c048e0d6b4f4cdabfaf7c3467aa6779/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:01:54.871115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:54.871545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:54.871932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:54.938705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] MFA Rules not processed for user `5c048e0d6b4f4cdabfaf7c3467aa6779`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:01:54.939984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:54.964018 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:55.063540 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2020/4056] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:01:55.481910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:55.484423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:55.575691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130cbf-d2b5-4e77-9ecb-1741c397706a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:55.582271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:55.583116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:55.583415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:55.583701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:55.593673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:55.595584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:55.609144 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2037/4057] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:01.156571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:01.158122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:01.225647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ffb19-d381-4e6b-9397-e8f1f2452c18 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:01.230030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:01.230706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:01.231002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:01.231403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:01.233437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:01.248374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:01.249834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:01.262516 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2021/4058] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:01.400557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:01.402439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:01.498385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70845d56-0264-4c19-aac7-06692bf56a69 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:01.513485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:01.522751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:01.522751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:01.522751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:01.523408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:01.536806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:01.538421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:01.560335 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2038/4059] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:01.825202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:01.862090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6eda-7bf9-4dcc-b197-9344ab6911f5 service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:01.868197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:01.869112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:01.869555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:01.870017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:01.872178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:01.905269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:01.907476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b0793-7122-4fb7-8199-a8a8bdebc912 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:01.922754 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2022/4060] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:10.125699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:10.202945 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:10.238736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777fe6-e50c-47bc-9241-596b27840412 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:10.251871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:10.253047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:10.253594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:10.254100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] PATH_INFO: `/v3/users/5c048e0d6b4f4cdabfaf7c3467aa6779` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:10.259122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c048e0d6b4f4cdabfaf7c3467aa6779)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:10.261347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:10.364602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c048e0d6b4f4cdabfaf7c3467aa6779'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:10.370945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c048e0d6b4f4cdabfaf7c3467aa6779'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:10.399332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c048e0d6b4f4cdabfaf7c3467aa6779'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:10.400244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c048e0d6b4f4cdabfaf7c3467aa6779'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:10.430338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c048e0d6b4f4cdabfaf7c3467aa6779'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:10.462227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2039/4061] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:10 2022] DELETE /identity/v3/users/5c048e0d6b4f4cdabfaf7c3467aa6779 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:10.466954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:10.467481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:10.467976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:10.505771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:10.507369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:10.659662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2023/4062] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:10.768771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:10.770380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:11.013759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7c9ee-6bdd-43c0-8860-a72a0a8d0c9e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:11.038331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3812f-bab2-46f9-9fcf-3a859643e357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:11.040905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3812f-bab2-46f9-9fcf-3a859643e357 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:11.040905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3812f-bab2-46f9-9fcf-3a859643e357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:11.040905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3812f-bab2-46f9-9fcf-3a859643e357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:11.087594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3812f-bab2-46f9-9fcf-3a859643e357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:11.095416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3812f-bab2-46f9-9fcf-3a859643e357 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:11.116960 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2040/4063] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:12.433714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:12.436055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:12.468233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca46924-d2d4-42b4-876f-a9f3027e2227 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:12.484493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:12.486191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:12.486567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:12.486915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] PATH_INFO: `/v3/projects/ce18ddeefc1d434f9ee7aa14dd3d018a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:12.492792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce18ddeefc1d434f9ee7aa14dd3d018a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:12.498482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:12.606154 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:12.639116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce18ddeefc1d434f9ee7aa14dd3d018a', 'request_id': 'req-684073b3-3239-4186-bb13-da3f71163044'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:12.653042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce18ddeefc1d434f9ee7aa14dd3d018a', 'request_id': 'req-684073b3-3239-4186-bb13-da3f71163044'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:12.670064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce18ddeefc1d434f9ee7aa14dd3d018a', 'request_id': 'req-684073b3-3239-4186-bb13-da3f71163044'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:12.688999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] The token cache is being invalidate because project ce18ddeefc1d434f9ee7aa14dd3d018a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:12.689293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:12.689984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-684073b3-3239-4186-bb13-da3f71163044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:12.697599 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2024/4064] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:12 2022] DELETE /identity/v3/projects/ce18ddeefc1d434f9ee7aa14dd3d018a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:12.699920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:12.700414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:12.700531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:12.732150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:12.733637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:12.904460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2041/4065] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:02:12.912659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:12.913017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:12.913304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:12.946380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:12.947785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:12.961991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2025/4066] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:12.963304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:12.978310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9edb0d-18e8-4aae-87c9-8bf9cd47f52b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:12.986853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:12.987836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:12.988253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:12.988562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:12.989466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:12.989780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:12.997522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:12.998555 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:13.025795 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2042/4067] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:13.026993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.064938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2799b5-20db-4953-889c-deef6ef8e475 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:13.082108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:13.085283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.087982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.089234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.091384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:13.095392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:13.190983 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2026/4068] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:13 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:13.195119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.213119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba51d1-3976-4b69-8070-3d52d4177ea8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:13.409249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:13.409944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.410228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.410535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.415600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:13.417741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:13.482288 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2043/4069] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:13 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:13.484783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.497811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81568a3-b9d6-4266-a9f8-3769a95201b1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:13.509204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:13.510195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.510731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.513540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.514663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:13.521680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:13.560930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2027/4070] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:13.565185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.580302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e31c-c289-4ed4-b558-21d77c1e55c0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:13.595234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab801b6-629a-48d6-a5c0-358c3ea56cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:13.596047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab801b6-629a-48d6-a5c0-358c3ea56cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.596384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab801b6-629a-48d6-a5c0-358c3ea56cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.596663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab801b6-629a-48d6-a5c0-358c3ea56cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.597398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab801b6-629a-48d6-a5c0-358c3ea56cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:13.599196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab801b6-629a-48d6-a5c0-358c3ea56cf3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:13.637567 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2044/4071] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:13.639136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.655732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95ca6-a3f9-45ac-93be-a07fc1fbde3b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:13.672558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:13.673945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.674404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.674881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] PATH_INFO: `/v3/projects/71beed80848342dca6a898e132b417fe/users/2087b4ab73154c6286a425f6a6fe2e5e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.708550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71beed80848342dca6a898e132b417fe, user_id=2087b4ab73154c6286a425f6a6fe2e5e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:13.711657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:13.737100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2028/4072] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:13 2022] PUT /identity/v3/projects/71beed80848342dca6a898e132b417fe/users/2087b4ab73154c6286a425f6a6fe2e5e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:13.749976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0698309-0605-440c-968d-70a52528b1e5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:13.750816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0698309-0605-440c-968d-70a52528b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:13.751274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0698309-0605-440c-968d-70a52528b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:13.816029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f0698309-0605-440c-968d-70a52528b1e5 None None] MFA Rules not processed for user `2087b4ab73154c6286a425f6a6fe2e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:13.817581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f0698309-0605-440c-968d-70a52528b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:13.952394 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2045/4073] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:13.966588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:13.969368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:14.111231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70706e-2b7c-4b7d-989d-b989f5342536 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:14.120005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad9a0-5be1-4d88-a356-cadbe08ec1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:14.120717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad9a0-5be1-4d88-a356-cadbe08ec1f5 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:14.121006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad9a0-5be1-4d88-a356-cadbe08ec1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:14.121285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad9a0-5be1-4d88-a356-cadbe08ec1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:14.132319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad9a0-5be1-4d88-a356-cadbe08ec1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:14.134404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad9a0-5be1-4d88-a356-cadbe08ec1f5 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:14.146233 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2029/4074] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:18.319442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:18.320033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:18.320033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:18.346452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] MFA Rules not processed for user `bbca12357748486ebcd038c9b56b5bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:18.347929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:18.457551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2046/4075] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:19.272225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:19.273755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:19.274298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:19.306927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:19.308670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:19.372256 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:19.405968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2030/4076] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:02:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:19.425946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:19.427596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:19.444020 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:19.656735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e4db2-8814-4d7e-81cd-e7e974617642 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:19.664154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae355646-875b-4b9e-bb8e-abe4030cb2e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:19.665076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae355646-875b-4b9e-bb8e-abe4030cb2e1 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:19.665587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae355646-875b-4b9e-bb8e-abe4030cb2e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:19.666173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae355646-875b-4b9e-bb8e-abe4030cb2e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:19.679993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae355646-875b-4b9e-bb8e-abe4030cb2e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:19.682714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae355646-875b-4b9e-bb8e-abe4030cb2e1 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:19.695095 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2047/4077] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:02:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:02:21.126521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:21.386763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a648-5731-4d13-bad8-aabfd3bec901 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:21.412067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:21.412971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:21.413259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:21.413589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] PATH_INFO: `/v3/users/2087b4ab73154c6286a425f6a6fe2e5e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:21.420881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2087b4ab73154c6286a425f6a6fe2e5e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:21.422940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:21.587358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2087b4ab73154c6286a425f6a6fe2e5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:21.634664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2087b4ab73154c6286a425f6a6fe2e5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:21.684493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2087b4ab73154c6286a425f6a6fe2e5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:21.712477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2087b4ab73154c6286a425f6a6fe2e5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:21.722081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2087b4ab73154c6286a425f6a6fe2e5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:21.753813 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2031/4078] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:21 2022] DELETE /identity/v3/users/2087b4ab73154c6286a425f6a6fe2e5e => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:21.754212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2db385-1df4-4d6a-91ad-98db6ee7d43b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:21.754212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2db385-1df4-4d6a-91ad-98db6ee7d43b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:21.754212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2db385-1df4-4d6a-91ad-98db6ee7d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:21.810880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6a2db385-1df4-4d6a-91ad-98db6ee7d43b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:21.812953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6a2db385-1df4-4d6a-91ad-98db6ee7d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:21.968299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:21.970849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:21.988461 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2048/4079] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:22.147754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24870cc-1b3b-4534-aa94-dec47c16c112 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:22.152887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9c10a-193f-4a4e-9e1d-6765a84bc0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:22.153867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c10a-193f-4a4e-9e1d-6765a84bc0ad service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:22.154637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c10a-193f-4a4e-9e1d-6765a84bc0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:22.155127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c10a-193f-4a4e-9e1d-6765a84bc0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:22.168854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9c10a-193f-4a4e-9e1d-6765a84bc0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:22.171256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9c10a-193f-4a4e-9e1d-6765a84bc0ad service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:22.190334 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2032/4080] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:23.041041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b6760-ca15-413a-ad15-445952717b1c None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:23.041635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b6760-ca15-413a-ad15-445952717b1c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:23.041635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b6760-ca15-413a-ad15-445952717b1c None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:23.049092 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2049/4081] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:02:23.070876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:23.072002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:23.072303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:23.105818 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:23.133842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:23.135767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:23.146826 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2033/4082] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:23.299835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b6760-ca15-413a-ad15-445952717b1c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:23.328082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b6760-ca15-413a-ad15-445952717b1c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:23.342879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:23.347081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:23.349549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:23.355022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:23.390763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:23.397008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:23.429891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:23.432591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:23.442588 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2050/4083] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:23.706139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7042a-ba7c-4749-bc0d-7f913c50d4fa None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:23.735699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:23.738718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:23.740201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:23.740468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:23.745975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:23.884776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:23.886776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ec2b5-29cc-47fb-b592-61baaf4f22da service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:23.931196 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2034/4084] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:24.010998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:24.014331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:24.084160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794ba6-853a-4522-b365-1e36631534bd service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:24.111609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:24.117075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:24.117568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:24.123854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] PATH_INFO: `/v3/projects/71beed80848342dca6a898e132b417fe` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:24.128310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71beed80848342dca6a898e132b417fe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:24.143583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:24.355754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71beed80848342dca6a898e132b417fe', 'request_id': 'req-baf13ac7-cfb0-40a6-9053-a0657991dcfc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:24.369995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71beed80848342dca6a898e132b417fe', 'request_id': 'req-baf13ac7-cfb0-40a6-9053-a0657991dcfc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:24.381360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71beed80848342dca6a898e132b417fe', 'request_id': 'req-baf13ac7-cfb0-40a6-9053-a0657991dcfc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:24.407954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] The token cache is being invalidate because project 71beed80848342dca6a898e132b417fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:24.408318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:24.415014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-baf13ac7-cfb0-40a6-9053-a0657991dcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:24.416990 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2051/4085] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:24 2022] DELETE /identity/v3/projects/71beed80848342dca6a898e132b417fe => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:24.422829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:24.423241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:24.423460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:24.442817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:24.457952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:24.603330 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2035/4086] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:24.611407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:24.612005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:24.612005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:24.636005 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:24.651311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:24.659000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:24.698529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:24.705522 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2052/4087] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:24.731214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5692f8-44e2-42b9-91dd-a3fd4ccc5f3e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:24.758082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:24.759184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:24.759651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:24.759940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:24.763408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:24.764370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:24.772126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:24.826864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:24.838374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d648-fe6a-4bbb-aad0-dae4c85da565 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:24.840105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2036/4088] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:24.855389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:24.857570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:24.859035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:24.859442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:24.860315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:24.871365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:24.927549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:24.934259 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2053/4089] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:24 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:24.940487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96766-5249-492c-a289-3333ed1d955e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:24.968288 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:25.113842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:25.117464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:25.118292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:25.118773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:25.119671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:25.125046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:25.211168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:25.219137 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2037/4090] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:24 2022] POST /identity/v3/users => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:25.228402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2e0c-980e-4d24-83d5-582ab7cb7246 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:25.260079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:25.260781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:25.261074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:25.261356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:25.265305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:25.267244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:25.335854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2054/4091] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:25.340208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:25.356896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df745-1dbc-49dc-b134-14fbe5f909a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:25.386407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7a3ec-43cc-4d97-a467-02c45892d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:25.392320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a3ec-43cc-4d97-a467-02c45892d353 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:25.392582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a3ec-43cc-4d97-a467-02c45892d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:25.392875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a3ec-43cc-4d97-a467-02c45892d353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:25.393642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7a3ec-43cc-4d97-a467-02c45892d353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:25.399810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7a3ec-43cc-4d97-a467-02c45892d353 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:25.455978 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2038/4092] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:25.457807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:25.474974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35558173-cdc8-434b-bfb9-8eb345080feb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:25.487033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:25.490561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:25.496998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:25.497685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] PATH_INFO: `/v3/projects/b7211654b1a249a3ae430ce18f6973fe/users/9261b07a0f3043a788d9b2cfb8ad35d2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:25.528329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7211654b1a249a3ae430ce18f6973fe, user_id=9261b07a0f3043a788d9b2cfb8ad35d2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:25.531572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:25.570785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2055/4093] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:25 2022] PUT /identity/v3/projects/b7211654b1a249a3ae430ce18f6973fe/users/9261b07a0f3043a788d9b2cfb8ad35d2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:25.574131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:25.575036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:25.575514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:25.644304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] MFA Rules not processed for user `9261b07a0f3043a788d9b2cfb8ad35d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:25.648529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:25.833366 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2039/4094] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:25.838626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:25.967774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eccd27-d8f3-4a5c-9f96-c0d2e20a30cb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:25.981619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:25.984057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:25.985346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:25.986636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:25.989480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:25.997416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.057282 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2056/4095] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:25 2022] POST /identity/v3/projects => generated 403 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:26.061264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:26.081562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892979af-775b-4307-9a5f-b8ee7dc1d2cb None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:26.216346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:26.217318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.217707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.218153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.219288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:26.221491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.251048 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2040/4096] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:26 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:26.256035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:26.276620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46cf83-b5d9-4bb0-a859-ffdd6cd4d37c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:26.289147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:26.291022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.291565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.292110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.301861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:26.304707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.320265 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2057/4097] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:26.324774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:26.337536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bff29f-18b0-4e7e-b4e4-64e28a2c657e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:26.346173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:26.349833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.351292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.353720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] PATH_INFO: `/v3/projects/1aea631c12c545f0a2081c0142de4c3e/users/f043a6ab3e224d10813dbd6175978e4a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.371949 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:26.380135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aea631c12c545f0a2081c0142de4c3e, user_id=f043a6ab3e224d10813dbd6175978e4a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:26.384240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.412577 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2041/4098] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:26 2022] PUT /identity/v3/projects/1aea631c12c545f0a2081c0142de4c3e/users/f043a6ab3e224d10813dbd6175978e4a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:26.417061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:26.430048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5345c0-b086-4cfe-aa4f-17437ce9dbc3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:26.624553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823348-1ebd-42fd-b56c-37a4deacaa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:26.625245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823348-1ebd-42fd-b56c-37a4deacaa37 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.625533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823348-1ebd-42fd-b56c-37a4deacaa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.626302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823348-1ebd-42fd-b56c-37a4deacaa37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.630318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823348-1ebd-42fd-b56c-37a4deacaa37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:26.634440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823348-1ebd-42fd-b56c-37a4deacaa37 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.673883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2058/4099] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:02:26.675680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:26.691488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362680-e32e-4682-8aec-8358d30d0e5f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:26.704898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:26.705814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.706105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.706390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] PATH_INFO: `/v3/projects/1aea631c12c545f0a2081c0142de4c3e/users/f043a6ab3e224d10813dbd6175978e4a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.723520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aea631c12c545f0a2081c0142de4c3e, user_id=f043a6ab3e224d10813dbd6175978e4a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:26.727635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:26.763474 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2042/4100] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:26 2022] PUT /identity/v3/projects/1aea631c12c545f0a2081c0142de4c3e/users/f043a6ab3e224d10813dbd6175978e4a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:26.775399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:26.775662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:26.776002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:26.843414 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:26.850071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] MFA Rules not processed for user `f043a6ab3e224d10813dbd6175978e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:26.854944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:27.104321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:27.115198 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2059/4101] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:27.119962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe985-6d74-4c50-b80a-0f7f66f7c76d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:27.133310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f043a6ab3e224d10813dbd6175978e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aea631c12c545f0a2081c0142de4c3e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:27.134635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:27.135555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:27.136169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:27.136639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:27.141414 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:27.141414 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:27.141414 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:27.142348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:27.180739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:27.189173 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2043/4102] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:02:27 2022] POST /identity/v3/roles => generated 239 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:27.192802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8222ce3-2fc2-4dbc-977e-4c13de133650 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:27.206091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276ce78-e22c-4aab-8ca0-e82ed0595bbf tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f043a6ab3e224d10813dbd6175978e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aea631c12c545f0a2081c0142de4c3e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:27.208890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276ce78-e22c-4aab-8ca0-e82ed0595bbf tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:27.209988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276ce78-e22c-4aab-8ca0-e82ed0595bbf tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:27.214229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276ce78-e22c-4aab-8ca0-e82ed0595bbf tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] PATH_INFO: `/v3/projects/b7211654b1a249a3ae430ce18f6973fe/users/9261b07a0f3043a788d9b2cfb8ad35d2/roles/db3c853810d846fcb86cc870d72928de` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:27.217350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276ce78-e22c-4aab-8ca0-e82ed0595bbf tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7211654b1a249a3ae430ce18f6973fe, user_id=9261b07a0f3043a788d9b2cfb8ad35d2, role_id=db3c853810d846fcb86cc870d72928de)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:27.223548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276ce78-e22c-4aab-8ca0-e82ed0595bbf tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:27.253780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2060/4103] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:27 2022] PUT /identity/v3/projects/b7211654b1a249a3ae430ce18f6973fe/users/9261b07a0f3043a788d9b2cfb8ad35d2/roles/db3c853810d846fcb86cc870d72928de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:27.255368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:27.395008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba2e4-2e25-4396-b080-955116a76769 tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:27.552097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9261b07a0f3043a788d9b2cfb8ad35d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7211654b1a249a3ae430ce18f6973fe', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-629352891', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:27.556151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:27.557313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:27.557664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] PATH_INFO: `/v3/users/9261b07a0f3043a788d9b2cfb8ad35d2/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:27.559689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] RBAC: Authorizing `identity:create_application_credential(user_id=9261b07a0f3043a788d9b2cfb8ad35d2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:27.562919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:27.827964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2044/4104] 10.222.0.77 () {60 vars in 1314 bytes} [Mon Jul 11 15:02:27 2022] POST /identity/v3/users/9261b07a0f3043a788d9b2cfb8ad35d2/application_credentials => generated 659 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:02:27.830230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:27.831514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:27.837346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:27.906543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] MFA Rules not processed for user `9261b07a0f3043a788d9b2cfb8ad35d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:27.911950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:28.198090 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2061/4105] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 11 15:02:28.202831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:28.225349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26f155-89f6-4013-9d41-13d88142d776 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:28.247022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9261b07a0f3043a788d9b2cfb8ad35d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7211654b1a249a3ae430ce18f6973fe', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-629352891', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:28.248368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:28.248597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:28.249215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] PATH_INFO: `/v3/users/9261b07a0f3043a788d9b2cfb8ad35d2/application_credentials/59a378064a3c4fbfb202a5c8eb604c03` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:28.255508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9261b07a0f3043a788d9b2cfb8ad35d2, application_credential_id=59a378064a3c4fbfb202a5c8eb604c03)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:28.257570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:28.267062 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:28.343399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2045/4106] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:02:28 2022] DELETE /identity/v3/users/9261b07a0f3043a788d9b2cfb8ad35d2/application_credentials/59a378064a3c4fbfb202a5c8eb604c03 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:28.347941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:28.416018 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:28.551513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c7bb-ae8e-4519-882d-9533a2bc9e5f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:28.566579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f043a6ab3e224d10813dbd6175978e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aea631c12c545f0a2081c0142de4c3e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:28.567512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:28.567837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:28.568153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] PATH_INFO: `/v3/roles/db3c853810d846fcb86cc870d72928de` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:28.570513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: Authorizing `identity:delete_role(role_id=db3c853810d846fcb86cc870d72928de)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:28.571811 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:28.571811 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:28.571811 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:28.572728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:28.668156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] Invalidating the token cache because role db3c853810d846fcb86cc870d72928de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:28.670166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:28.673198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b06c0c4e-d51e-46f1-9e54-26cf9b7ce32f tempest-ApplicationCredentialsV3AdminTest-1972491357 tempest-ApplicationCredentialsV3AdminTest-1972491357-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:28.689991 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2062/4107] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:28 2022] DELETE /identity/v3/roles/db3c853810d846fcb86cc870d72928de => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:28.695802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:28.697734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:28.968258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29558c8-b320-4f4f-8249-954af4a620a8 tempest-ApplicationCredentialsV3AdminTest-1477313581 tempest-ApplicationCredentialsV3AdminTest-1477313581-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:29.133752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:29.136750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:29.138030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:29.138936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] PATH_INFO: `/v3/users/9261b07a0f3043a788d9b2cfb8ad35d2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:29.144937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9261b07a0f3043a788d9b2cfb8ad35d2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:29.149760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:29.288731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9261b07a0f3043a788d9b2cfb8ad35d2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:29.329973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9261b07a0f3043a788d9b2cfb8ad35d2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:29.355935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9261b07a0f3043a788d9b2cfb8ad35d2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:29.397407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9261b07a0f3043a788d9b2cfb8ad35d2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:29.402294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9261b07a0f3043a788d9b2cfb8ad35d2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:29.432757 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2046/4108] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:28 2022] DELETE /identity/v3/users/9261b07a0f3043a788d9b2cfb8ad35d2 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:29.437851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:29.438338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:29.438579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:29.490622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:29.494309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:29.508815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:29.512001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:29.566003 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:29.693492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169500f-2331-4c37-b765-ecc70e7edf5b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:29.707858 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2063/4109] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:29.708197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:29.709251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:29.709604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:29.709832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:29.711882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:29.718587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:29.739796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aaafd-c186-4bc7-b2c5-d2b9edecc2cc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:29.745578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:29.747162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:29.750743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:29.751516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:29.751805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:29.752087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:29.771035 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2047/4110] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:29.776220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:29.778251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:29.796798 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2064/4111] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:30.836919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:30.838772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:30.858903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18eb2-d7bb-4dec-8436-d75b62d55be9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:30.873421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:30.874756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:30.875239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:30.875952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] PATH_INFO: `/v3/projects/b7211654b1a249a3ae430ce18f6973fe` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:30.878284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7211654b1a249a3ae430ce18f6973fe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:30.883871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:31.062181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7211654b1a249a3ae430ce18f6973fe', 'request_id': 'req-a91ee286-f83a-4dd8-873f-3df74cb257d1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.068253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7211654b1a249a3ae430ce18f6973fe', 'request_id': 'req-a91ee286-f83a-4dd8-873f-3df74cb257d1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.078092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7211654b1a249a3ae430ce18f6973fe', 'request_id': 'req-a91ee286-f83a-4dd8-873f-3df74cb257d1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.094255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] The token cache is being invalidate because project b7211654b1a249a3ae430ce18f6973fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:31.094556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.095367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.097679 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2048/4112] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:30 2022] DELETE /identity/v3/projects/b7211654b1a249a3ae430ce18f6973fe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:31.101747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:31.114626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e24f7-ac91-4d48-b106-89ae3a70c251 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:31.266899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:31.267890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:31.268255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:31.268781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] PATH_INFO: `/v3/users/f043a6ab3e224d10813dbd6175978e4a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:31.272781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f043a6ab3e224d10813dbd6175978e4a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:31.277492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:31.317970 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:31.374735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f043a6ab3e224d10813dbd6175978e4a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.375629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f043a6ab3e224d10813dbd6175978e4a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.391547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f043a6ab3e224d10813dbd6175978e4a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.392422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f043a6ab3e224d10813dbd6175978e4a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.402213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b1289462-3733-4d1e-874d-7e013631c975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f043a6ab3e224d10813dbd6175978e4a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:31.432643 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2065/4113] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:31 2022] DELETE /identity/v3/users/f043a6ab3e224d10813dbd6175978e4a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:33.355548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:33.358044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:33.385413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ee286-f83a-4dd8-873f-3df74cb257d1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:33.473509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:33.474530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:33.474915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:33.475268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] PATH_INFO: `/v3/projects/1aea631c12c545f0a2081c0142de4c3e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:33.477807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aea631c12c545f0a2081c0142de4c3e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:33.481212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:33.560877 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:33.573041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aea631c12c545f0a2081c0142de4c3e', 'request_id': 'req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:33.603855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aea631c12c545f0a2081c0142de4c3e', 'request_id': 'req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:33.637396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aea631c12c545f0a2081c0142de4c3e', 'request_id': 'req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:33.657423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] The token cache is being invalidate because project 1aea631c12c545f0a2081c0142de4c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:33.657727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:33.658843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-42c2ddf3-1975-4e58-8b4d-2ad342c1affd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:33.664654 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2049/4114] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:33 2022] DELETE /identity/v3/projects/1aea631c12c545f0a2081c0142de4c3e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:33.669466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:33.670335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:33.670335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:33.711942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:33.713165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:33.850121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:33.850516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:33.850814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:33.852407 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2066/4115] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:33.893549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:33.895146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:33.922201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:33.924328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2050/4116] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:33.937509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef00ac-8bde-4125-baa0-604897441f3a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:33.952531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:33.954318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:33.955775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:33.957631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:33.959559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:33.961012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:33.963894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.018325 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2067/4117] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:34.022876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:34.040935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816ddaf-0ce4-4a3f-b87d-b7ba7dc85161 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:34.048871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:34.049849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.051032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.051333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.053384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:34.056300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.124972 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2051/4118] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:34 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:34.129634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:34.144071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5ef2-391f-4bcc-a174-1055930a0967 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:34.300734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:34.312719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.313075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.313365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.315662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:34.317673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.348506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2068/4119] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:34 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:02:34.352747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:34.365688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7245ee-6c87-44fb-ab76-8c8ca64c07ac admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:34.372702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:34.373647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.374055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.374895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.375940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:34.378814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.394961 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2052/4120] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:34.399470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:34.415188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeabf34-b9da-4c85-99d8-c40db87b18b5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:34.422953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d00aa-7ffd-4fbe-9e48-4b6d9ce07413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:34.425380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d00aa-7ffd-4fbe-9e48-4b6d9ce07413 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.425782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d00aa-7ffd-4fbe-9e48-4b6d9ce07413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.426169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d00aa-7ffd-4fbe-9e48-4b6d9ce07413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.427548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d00aa-7ffd-4fbe-9e48-4b6d9ce07413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:34.433105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d00aa-7ffd-4fbe-9e48-4b6d9ce07413 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.440789 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:34.459054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:34.469459 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2069/4121] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:34.471371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762f22-fccb-48e6-8a09-f9cd534df2a2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:34.479825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:34.480842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.481130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.481454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] PATH_INFO: `/v3/projects/91e219f1fb2e4204a9f57171d777cdfc/users/7f4cc84a56f44eb0a6c5ea24218d3ec1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.502257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e219f1fb2e4204a9f57171d777cdfc, user_id=7f4cc84a56f44eb0a6c5ea24218d3ec1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:34.505533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.530548 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2053/4122] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:34 2022] PUT /identity/v3/projects/91e219f1fb2e4204a9f57171d777cdfc/users/7f4cc84a56f44eb0a6c5ea24218d3ec1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:34.539639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.539639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.540153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.568728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] MFA Rules not processed for user `7f4cc84a56f44eb0a6c5ea24218d3ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:34.570877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:34.747551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2070/4123] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:34.751714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:34.908019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af2441-0f5f-4695-a587-8707e6855ff1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:34.921165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:34.922674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:34.926847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:34.927359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:34.929371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:34.935083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:34.998360 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2054/4124] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:34 2022] POST /identity/v3/projects => generated 375 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:35.002454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:35.021362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290105a-b7a6-4515-894c-e559eb6b5eb5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:35.157073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:35.159771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:35.160064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:35.160432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:35.161282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:35.164161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:35.202639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2071/4125] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:35 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:35.206178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:35.220280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daf45-cd26-45fe-bda4-033379fef0d1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:35.226665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:35.227672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:35.228130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:35.228680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:35.229582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:35.232885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:35.251989 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2055/4126] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:35.256008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:35.272471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958553c4-8c3c-4597-b999-4f6c917ab636 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:35.280339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:35.281410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:35.281868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:35.282210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] PATH_INFO: `/v3/projects/a3f215f6b1514bbf9773e6aa72c97ebd/users/e6d2b8639cb441149ceb21efe98c50d0/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:35.305975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f215f6b1514bbf9773e6aa72c97ebd, user_id=e6d2b8639cb441149ceb21efe98c50d0, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:35.309044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:35.339431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2072/4127] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:35 2022] PUT /identity/v3/projects/a3f215f6b1514bbf9773e6aa72c97ebd/users/e6d2b8639cb441149ceb21efe98c50d0/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:35.340543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:35.353831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d29d2-eaa1-4163-90b1-6695aa18d132 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:35.412712 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:35.469211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07246962-ab44-4c3a-a1f6-87d42c44ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:35.470366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246962-ab44-4c3a-a1f6-87d42c44ca5c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:35.471018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246962-ab44-4c3a-a1f6-87d42c44ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:35.471470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246962-ab44-4c3a-a1f6-87d42c44ca5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:35.472576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07246962-ab44-4c3a-a1f6-87d42c44ca5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:35.474401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07246962-ab44-4c3a-a1f6-87d42c44ca5c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:35.490469 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2056/4128] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:35.495202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:35.516445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df581ef-d6dc-459b-b002-6a16e604f906 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:35.540005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:35.540957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:35.541254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:35.541527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] PATH_INFO: `/v3/projects/a3f215f6b1514bbf9773e6aa72c97ebd/users/e6d2b8639cb441149ceb21efe98c50d0/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:35.552213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f215f6b1514bbf9773e6aa72c97ebd, user_id=e6d2b8639cb441149ceb21efe98c50d0, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:35.577259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:35.638079 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2073/4129] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:35 2022] PUT /identity/v3/projects/a3f215f6b1514bbf9773e6aa72c97ebd/users/e6d2b8639cb441149ceb21efe98c50d0/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:35.651343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:35.651631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:35.651908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:35.736512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] MFA Rules not processed for user `e6d2b8639cb441149ceb21efe98c50d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:35.737836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:35.942074 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2057/4130] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:35.944668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.001031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c893-1e1c-4b9d-b9d4-4475d2974d65 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.023377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.024203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.025289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.030992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.031903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.037118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.129343 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2074/4131] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:02:35 2022] POST /identity/v3/projects => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:36.132095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.153901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471decf-23ba-4909-bef4-b39fa67f8bf7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.257078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.257949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.258426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.258763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.259470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.261383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.305338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2058/4132] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:36 2022] POST /identity/v3/projects => generated 351 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:36.312270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.334535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101942-57df-496f-a09c-216e98f32a4f tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.361969 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:36.466997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.468180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.468472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.468754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/users/7f4cc84a56f44eb0a6c5ea24218d3ec1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.470017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:get_user(user_id=7f4cc84a56f44eb0a6c5ea24218d3ec1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.472339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.474546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2075/4133] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:02:36 2022] GET /identity/v3/users/7f4cc84a56f44eb0a6c5ea24218d3ec1 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:36.479029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.496340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa45d2b-54bb-49ad-a56a-5b9919479c20 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.501545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.502378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.502711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.502994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.503762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.505919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.548028 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2059/4134] 10.222.0.77 () {60 vars in 1161 bytes} [Mon Jul 11 15:02:36 2022] POST /identity/v3/credentials => generated 430 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:36.549512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.566735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6783a7-0575-4c6a-acc6-9615959277f1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.573462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.574698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.574991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.575273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials/a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.578923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.581032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.583181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.584963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.606536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2076/4135] 10.222.0.77 () {60 vars in 1357 bytes} [Mon Jul 11 15:02:36 2022] PATCH /identity/v3/credentials/a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739 => generated 436 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:36.607926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.620473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8104-f8a7-42a0-ab29-b7601bc7eb93 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.629023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.630761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.631483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.632686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials/a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.635149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.637340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.644347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.645332 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2060/4136] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Jul 11 15:02:36 2022] GET /identity/v3/credentials/a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739 => generated 436 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:36.656366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad74fd-acf6-4964-877f-5c6345cd61aa tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.661992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.663420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.663955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.664500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials/a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.667111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.669353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.700284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.710652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e269cd-000d-43bb-9c0f-5c2f199e4b32 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.711085 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2077/4137] 10.222.0.77 () {58 vars in 1337 bytes} [Mon Jul 11 15:02:36 2022] DELETE /identity/v3/credentials/a74aa65592d327561b63c58902338e4a6ffb046d86e072f9924aa6b3e12be739 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:36.715920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.716713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.717084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.717441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.718527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.720291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.740302 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2061/4138] 10.222.0.77 () {60 vars in 1161 bytes} [Mon Jul 11 15:02:36 2022] POST /identity/v3/credentials => generated 430 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:36.744471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.757796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd2c4-64cb-425e-b2eb-26390a7361b0 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.763930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.764714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.765074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.766104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.766408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.768348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.801030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.802023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2078/4139] 10.222.0.77 () {60 vars in 1161 bytes} [Mon Jul 11 15:02:36 2022] POST /identity/v3/credentials => generated 430 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:36.812560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864b734-ab72-47d6-8c11-7db075317f74 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.827456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.828470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.828929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.829556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.830771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.841813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.853105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.856012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.858430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.860745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.863605 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2062/4140] 10.222.0.77 () {58 vars in 1139 bytes} [Mon Jul 11 15:02:36 2022] GET /identity/v3/credentials => generated 945 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:36.868089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:36.879591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753d75-b8d7-4881-ace9-7baf28f670c1 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:36.889085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:36.890127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:36.890504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:36.890865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials/2e2171eda6d4d4e43f1a3ae165e635ab056188f976493de27095799e2b72676e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:36.895666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2e2171eda6d4d4e43f1a3ae165e635ab056188f976493de27095799e2b72676e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:36.915464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:36.976192 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2079/4141] 10.222.0.77 () {58 vars in 1337 bytes} [Mon Jul 11 15:02:36 2022] DELETE /identity/v3/credentials/2e2171eda6d4d4e43f1a3ae165e635ab056188f976493de27095799e2b72676e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:36.981809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:37.013463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7758d-9a4d-4dbf-8d22-c4e79819a1df tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:37.020384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:37.021690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:37.021987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:37.023052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/credentials/ccdf5ad1b8e4b5eb120778b483bbc98db0fedf7f3bba3d63bf191c9b24cc44a6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:37.025280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=ccdf5ad1b8e4b5eb120778b483bbc98db0fedf7f3bba3d63bf191c9b24cc44a6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:37.029905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:37.041021 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:37.110195 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2063/4142] 10.222.0.77 () {58 vars in 1337 bytes} [Mon Jul 11 15:02:36 2022] DELETE /identity/v3/credentials/ccdf5ad1b8e4b5eb120778b483bbc98db0fedf7f3bba3d63bf191c9b24cc44a6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:37.111733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:37.129834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d320-23f1-457f-b76a-8a8571f95c9e tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:37.144819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:37.146255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:37.150848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:37.151167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/projects/05a115e6fa3f4e66832d7f3656f5f8d5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:37.154943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05a115e6fa3f4e66832d7f3656f5f8d5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:37.157178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:37.277018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a115e6fa3f4e66832d7f3656f5f8d5', 'request_id': 'req-8ccc4b4a-64ef-4783-8bf4-b2342945d387'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.292174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a115e6fa3f4e66832d7f3656f5f8d5', 'request_id': 'req-8ccc4b4a-64ef-4783-8bf4-b2342945d387'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.303533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a115e6fa3f4e66832d7f3656f5f8d5', 'request_id': 'req-8ccc4b4a-64ef-4783-8bf4-b2342945d387'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.329588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] The token cache is being invalidate because project 05a115e6fa3f4e66832d7f3656f5f8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:37.330288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.331467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.337004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2080/4143] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:37 2022] DELETE /identity/v3/projects/05a115e6fa3f4e66832d7f3656f5f8d5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:37.340748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:37.342852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:37.373988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad8863-c61e-4bf3-b21b-57bb54e88f36 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:37.457679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d2b8639cb441149ceb21efe98c50d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:37.460411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:37.460820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:37.461180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] PATH_INFO: `/v3/projects/a19887858bf54a5cac9d4058747121df` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:37.462719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a19887858bf54a5cac9d4058747121df)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:37.464906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:37.595006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19887858bf54a5cac9d4058747121df', 'request_id': 'req-3073110f-1931-4422-bc4e-671ed68a2ee3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.604892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19887858bf54a5cac9d4058747121df', 'request_id': 'req-3073110f-1931-4422-bc4e-671ed68a2ee3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.624252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19887858bf54a5cac9d4058747121df', 'request_id': 'req-3073110f-1931-4422-bc4e-671ed68a2ee3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.645787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] The token cache is being invalidate because project a19887858bf54a5cac9d4058747121df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:37.646656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.648741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3073110f-1931-4422-bc4e-671ed68a2ee3 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.651351 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2064/4144] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:37 2022] DELETE /identity/v3/projects/a19887858bf54a5cac9d4058747121df => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:37.654980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:37.656557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:37.720040 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:37.744968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4b4a-64ef-4783-8bf4-b2342945d387 tempest-CredentialsTestJSON-1240761816 tempest-CredentialsTestJSON-1240761816-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:37.820257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:37.821236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:37.821585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:37.822274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] PATH_INFO: `/v3/users/7f4cc84a56f44eb0a6c5ea24218d3ec1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:37.823695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4cc84a56f44eb0a6c5ea24218d3ec1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:37.825966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:37.894101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4cc84a56f44eb0a6c5ea24218d3ec1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.895132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4cc84a56f44eb0a6c5ea24218d3ec1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.918958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4cc84a56f44eb0a6c5ea24218d3ec1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.919496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4cc84a56f44eb0a6c5ea24218d3ec1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.930632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4cc84a56f44eb0a6c5ea24218d3ec1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:37.948672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2081/4145] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:37 2022] DELETE /identity/v3/users/7f4cc84a56f44eb0a6c5ea24218d3ec1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:37.955057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:37.955610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:37.956111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:37.981841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:37.983535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:38.148418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2065/4146] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:38.183915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:38.190428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:38.321556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4c27-4abc-4bac-84b5-fa7636801fb2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:38.329029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:38.329711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:38.329990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:38.330266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:38.364634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:38.366792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:38.398930 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2082/4147] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:39.424490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:39.429016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:39.473406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cac93-8bf8-4370-98e7-f1740a3cda0f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:39.492870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:39.495108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:39.497040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:39.499673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] PATH_INFO: `/v3/projects/91e219f1fb2e4204a9f57171d777cdfc` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:39.503089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e219f1fb2e4204a9f57171d777cdfc)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:39.516961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:39.539184 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:39.596867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e219f1fb2e4204a9f57171d777cdfc', 'request_id': 'req-08a43386-4526-4f7b-8dd0-49d7dea6d976'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.605015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e219f1fb2e4204a9f57171d777cdfc', 'request_id': 'req-08a43386-4526-4f7b-8dd0-49d7dea6d976'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.613661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e219f1fb2e4204a9f57171d777cdfc', 'request_id': 'req-08a43386-4526-4f7b-8dd0-49d7dea6d976'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.645089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] The token cache is being invalidate because project 91e219f1fb2e4204a9f57171d777cdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:39.645089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.646474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.649410 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2066/4148] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:39 2022] DELETE /identity/v3/projects/91e219f1fb2e4204a9f57171d777cdfc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:39.653941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:39.665244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee739b-9c72-4423-9411-3ae1e3ca3072 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:39.708753 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:39.765244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:39.766436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:39.766917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:39.767361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] PATH_INFO: `/v3/users/e6d2b8639cb441149ceb21efe98c50d0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:39.769559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d2b8639cb441149ceb21efe98c50d0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:39.771915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:39.843413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d2b8639cb441149ceb21efe98c50d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.847239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d2b8639cb441149ceb21efe98c50d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.849187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:39.851370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:39.881957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d2b8639cb441149ceb21efe98c50d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.886454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d2b8639cb441149ceb21efe98c50d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.896705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43386-4526-4f7b-8dd0-49d7dea6d976 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:39.898244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d2b8639cb441149ceb21efe98c50d0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:39.909187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:39.912251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:39.912571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:39.912889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] PATH_INFO: `/v3/users/2686b83fe2564a44a9938f9d543d6d48` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:39.915362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2686b83fe2564a44a9938f9d543d6d48)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:39.917849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:39.923919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2083/4149] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:39 2022] DELETE /identity/v3/users/e6d2b8639cb441149ceb21efe98c50d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:40.025939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2686b83fe2564a44a9938f9d543d6d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:40.041844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2686b83fe2564a44a9938f9d543d6d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:40.050916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2686b83fe2564a44a9938f9d543d6d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:40.061593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2686b83fe2564a44a9938f9d543d6d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:40.062322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2686b83fe2564a44a9938f9d543d6d48'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:40.072253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2067/4150] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:39 2022] DELETE /identity/v3/users/2686b83fe2564a44a9938f9d543d6d48 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:40.878555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:40.880036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:40.944863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:40.946952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:40.988155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c7c7-5980-4c1f-977e-a83c38510e00 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.034744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854bdb0-e4e0-4c21-a8ca-4154761d0b16 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.041801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.048735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.048735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.050060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] PATH_INFO: `/v3/projects/a3f215f6b1514bbf9773e6aa72c97ebd` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.053788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f215f6b1514bbf9773e6aa72c97ebd)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.060480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.085997 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:41.104869 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:41.107547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.108801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.109672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.110709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] PATH_INFO: `/v3/projects/914f653344fa4feab9672982c06d6f2f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.112887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=914f653344fa4feab9672982c06d6f2f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.116631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.168182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'request_id': 'req-addd6b73-ef5b-4ad6-9400-2a0099164c37'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.175765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'request_id': 'req-addd6b73-ef5b-4ad6-9400-2a0099164c37'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.194816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f215f6b1514bbf9773e6aa72c97ebd', 'request_id': 'req-addd6b73-ef5b-4ad6-9400-2a0099164c37'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.200489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914f653344fa4feab9672982c06d6f2f', 'request_id': 'req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.211628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914f653344fa4feab9672982c06d6f2f', 'request_id': 'req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.218845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] The token cache is being invalidate because project a3f215f6b1514bbf9773e6aa72c97ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:41.219146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.219817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-addd6b73-ef5b-4ad6-9400-2a0099164c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.220435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914f653344fa4feab9672982c06d6f2f', 'request_id': 'req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.224760 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2068/4151] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:40 2022] DELETE /identity/v3/projects/a3f215f6b1514bbf9773e6aa72c97ebd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:41.227391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c32e-3e6b-4980-aaf4-333a07c18866 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.227691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c32e-3e6b-4980-aaf4-333a07c18866 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.227974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c32e-3e6b-4980-aaf4-333a07c18866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.240669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] The token cache is being invalidate because project 914f653344fa4feab9672982c06d6f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:41.241146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.241837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53c23cfd-91fd-4b11-9b98-d68fbf7ef7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:41.243745 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2084/4152] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:40 2022] DELETE /identity/v3/projects/914f653344fa4feab9672982c06d6f2f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:41.249571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff75b1-cf3c-4a6c-9c57-98252ee92a9c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.250830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff75b1-cf3c-4a6c-9c57-98252ee92a9c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.251341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff75b1-cf3c-4a6c-9c57-98252ee92a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.252122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2ca4c32e-3e6b-4980-aaf4-333a07c18866 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:41.254142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ca4c32e-3e6b-4980-aaf4-333a07c18866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:41.280972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-50ff75b1-cf3c-4a6c-9c57-98252ee92a9c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:41.283340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-50ff75b1-cf3c-4a6c-9c57-98252ee92a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:41.349855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2069/4153] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:41.357432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.359982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.360377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.361502 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2085/4154] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:41.371253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.371625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.371923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.395125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:41.396371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:41.398305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:41.399854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:41.407417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2070/4155] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:41.411289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.411836 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2086/4156] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:41.415831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.421554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfcc5-872a-4ec4-909d-7f2262603e5e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.425401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdb9ee-3bf4-492a-b03a-ec83a922106d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.426704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.427583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.428081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.428731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.429489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:41.429995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.430830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.431526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.431650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.431895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.432241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.434533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:41.434533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.435753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.446261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2071/4157] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:41.450579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.453246 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2087/4158] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:41.457581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.470008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cee7a-5a5c-4015-bda4-f95bf418c5a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.476027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.476794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.477046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7cab6-91d0-4ac3-9183-c6f9214e74c6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.477199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.477394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.478041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.480151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.485228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.488650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.489247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.489883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.492193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.495380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.520533 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2072/4159] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:02:41.527090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.540103 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2088/4160] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:41.545113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.638264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e58b-2d5c-424a-b05c-804062d1490f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.647803 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:41.657289 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:41.709991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dbe1-80b6-431d-9cf5-f1a2ac8aeb57 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.725568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.726275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.727100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.727384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.728093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.735252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.785438 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2089/4161] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:41.787009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.788613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.789481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.789776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.790063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.790980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.793632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.811564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fd043-fcbf-4ca4-81b5-abbe2973b4c4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.821300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.822243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.822615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.822945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.823913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.826457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.831658 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2073/4162] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:41.837034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.839113 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2090/4163] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:41.843404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.858666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a63532-609e-4a53-b9d5-38869735793a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.865393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.867064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.867589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.868107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.869744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.869921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d7b1-6aad-48c0-aa0f-25785fac7449 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.872026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.883819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.884506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.884797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.885165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.886542 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2091/4164] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:02:41.887007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.888008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.890609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.902705 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2074/4165] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:41.913940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e70348-2f54-421a-acee-2ef3514a885f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.916446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.934364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.934364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.934364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.934364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] PATH_INFO: `/v3/projects/4597b6a38f07454dadb707fa171ffc98/users/0d365ffbdaf744f696e393b21b077d3c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.948778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99a3c-97a1-418b-a68f-6ce519e56750 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:41.951908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4597b6a38f07454dadb707fa171ffc98, user_id=0d365ffbdaf744f696e393b21b077d3c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.955149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.955558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78bcef-3c1d-45c8-a1d7-6d8d882ba6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:41.956530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78bcef-3c1d-45c8-a1d7-6d8d882ba6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.956881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78bcef-3c1d-45c8-a1d7-6d8d882ba6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.957249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78bcef-3c1d-45c8-a1d7-6d8d882ba6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:41.958170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78bcef-3c1d-45c8-a1d7-6d8d882ba6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:41.961094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78bcef-3c1d-45c8-a1d7-6d8d882ba6bf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:41.974436 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2092/4166] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:41 2022] PUT /identity/v3/projects/4597b6a38f07454dadb707fa171ffc98/users/0d365ffbdaf744f696e393b21b077d3c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:41.975652 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2075/4167] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:41.979581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:41.989645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092213-3970-4a45-8ab5-d2219ecd0f17 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:41.989964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092213-3970-4a45-8ab5-d2219ecd0f17 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:41.990243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092213-3970-4a45-8ab5-d2219ecd0f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.020808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-09092213-3970-4a45-8ab5-d2219ecd0f17 None None] MFA Rules not processed for user `0d365ffbdaf744f696e393b21b077d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:42.022057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-09092213-3970-4a45-8ab5-d2219ecd0f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:42.061556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126cc20-976f-4563-a3a2-4445bf4e697a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.067452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f836b-d9ef-4d63-b03f-10bc86be7c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.068387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f836b-d9ef-4d63-b03f-10bc86be7c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.068677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f836b-d9ef-4d63-b03f-10bc86be7c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.069032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f836b-d9ef-4d63-b03f-10bc86be7c59 admin admin] PATH_INFO: `/v3/projects/22014b24f374404eb05bd6464ef33ccd/users/d9fbd884e8914812bcea8c4cac8ceb9d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.088940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f836b-d9ef-4d63-b03f-10bc86be7c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22014b24f374404eb05bd6464ef33ccd, user_id=d9fbd884e8914812bcea8c4cac8ceb9d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.091617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f836b-d9ef-4d63-b03f-10bc86be7c59 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:42.109672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2093/4168] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:41 2022] PUT /identity/v3/projects/22014b24f374404eb05bd6464ef33ccd/users/d9fbd884e8914812bcea8c4cac8ceb9d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:42.121250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.121443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.121734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.126982 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2076/4169] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:02:42.140966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.141302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.141528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.151860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] MFA Rules not processed for user `d9fbd884e8914812bcea8c4cac8ceb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:42.153112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:42.166014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] MFA Rules not processed for user `0d365ffbdaf744f696e393b21b077d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:42.167456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:42.268814 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:42.296311 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2094/4170] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:42.297111 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2077/4171] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:02:42.302564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:42.410296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b9029-e457-4be0-a697-bc19258c17e8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.417084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.418353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.418943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.419691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.420739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.423182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:42.458533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2095/4172] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:42 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:42.462835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:42.479955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6efd7-778b-4c67-986d-05c2bc2dca8d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.498983 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:42.523070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:42.525900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:42.591165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.594333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.594959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.595407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.596289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.598482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:42.630028 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2078/4173] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:42 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:02:42.633861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:42.636733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a446e-8d15-403d-a1a9-410d62548d9e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.643761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.644619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.644908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.645185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.674692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee21a-7a00-4954-8b28-f3865382ce71 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.685035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.685710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.685994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.686274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.688746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.692325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:42.722251 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2079/4174] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:42.723214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:42.743261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97713f4-2ec0-4bb6-85af-6536cf26ca25 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.753205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.755352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:42.771821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.773538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.773986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.775492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] PATH_INFO: `/v3/projects/657d9925529146378a3d71e0abeeee61/users/14f4731432d448e4a4939e9926c6d30b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.780744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2096/4175] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:42.815611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=657d9925529146378a3d71e0abeeee61, user_id=14f4731432d448e4a4939e9926c6d30b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.819426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:42.839646 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2080/4176] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:42 2022] PUT /identity/v3/projects/657d9925529146378a3d71e0abeeee61/users/14f4731432d448e4a4939e9926c6d30b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:42.844643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:42.867822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6203d2f-19f0-48a6-9c81-1424af80d930 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:42.885921 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:42.958902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f75e7-5d1e-4336-9f24-6e5da53c137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:42.961088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f75e7-5d1e-4336-9f24-6e5da53c137c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:42.962236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f75e7-5d1e-4336-9f24-6e5da53c137c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:42.965768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f75e7-5d1e-4336-9f24-6e5da53c137c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:42.966772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f75e7-5d1e-4336-9f24-6e5da53c137c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:42.968753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f75e7-5d1e-4336-9f24-6e5da53c137c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.000619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2097/4177] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:43.004419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.027035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b67047-9a19-4df9-b58b-ef134e748dec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.045065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.045987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.049668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.049846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] PATH_INFO: `/v3/projects/657d9925529146378a3d71e0abeeee61/users/14f4731432d448e4a4939e9926c6d30b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.054817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657d9925529146378a3d71e0abeeee61, user_id=14f4731432d448e4a4939e9926c6d30b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.064002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.099943 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2081/4178] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:43 2022] PUT /identity/v3/projects/657d9925529146378a3d71e0abeeee61/users/14f4731432d448e4a4939e9926c6d30b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:43.104256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9cf22-12f2-4583-b8f7-648c75651802 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.104826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9cf22-12f2-4583-b8f7-648c75651802 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.105354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9cf22-12f2-4583-b8f7-648c75651802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.179928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1dc9cf22-12f2-4583-b8f7-648c75651802 None None] MFA Rules not processed for user `14f4731432d448e4a4939e9926c6d30b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:43.181206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1dc9cf22-12f2-4583-b8f7-648c75651802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:43.335408 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2098/4179] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:43.336434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.348932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f9ada-93ea-4049-b02d-da0ef26095a3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.354755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.355421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.355707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.356333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.357460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.359368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.379821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.380108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.380388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.416246 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2082/4180] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:02:43 2022] POST /identity/v3/domains => generated 275 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:43.421634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.427740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] MFA Rules not processed for user `0d365ffbdaf744f696e393b21b077d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:43.429500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:43.562040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aec27-cb23-435a-a523-fceb8847ee84 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.574198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.575498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.576977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.577985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.578761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.580518 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2099/4181] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:43.582102 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:43.582102 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:43.582102 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:43.583549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.676500 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2083/4182] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:02:43 2022] PUT /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config => generated 138 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:43.680874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.696532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04ffdd-2c55-4386-8ba0-1b0464e7f57f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.711851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.712768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.713448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.713448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.715152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b, group=identity)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.716690 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:43.716690 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:43.716690 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:43.717045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.731060 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2100/4183] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 11 15:02:43 2022] GET /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/identity => generated 45 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:43.732503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.743851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e532cc-1280-45de-9266-03aecc071058 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.757643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.758898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.759666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.760255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/identity/driver` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.769359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b, group=identity, option=driver)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.770940 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:43.770940 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:43.770940 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:43.771902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.779486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2084/4184] 10.222.0.77 () {58 vars in 1295 bytes} [Mon Jul 11 15:02:43 2022] GET /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/identity/driver => generated 31 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:43.783903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.799406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1823cb5-1315-4178-98bc-586fd5f4bb6a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.816276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.819333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.820618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.821612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/ldap` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.826537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b, group=ldap)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.828306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.843382 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2101/4185] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:02:43 2022] GET /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/ldap => generated 106 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:43.845148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.871118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab1a51-4772-4dd2-b6ad-04b63b10b041 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.924878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.927770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.931183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.931499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/ldap/url` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.936261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b, group=ldap, option=url)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:43.939090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:43.940863 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:43.950194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:43.950593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2085/4186] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 11 15:02:43 2022] GET /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/ldap/url => generated 46 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:43.967641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e3b0-7c83-4f43-91f5-6f1cd3eb8ab6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:43.981940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:43.983183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:43.985186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:43.985651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/ldap/user_tree_dn` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:43.989572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b, group=ldap, option=user_tree_dn)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:44.003898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:44.022462 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2102/4187] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 11 15:02:43 2022] GET /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config/ldap/user_tree_dn => generated 63 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:44.027775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:44.063780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e01f5-39d0-4fad-a73c-ee908843403a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:44.080869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:44.081748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:44.082039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:44.082328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:44.083033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c061760f59414c2ab4fcc33b73d0847b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:44.084130 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:44.084130 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:44.084130 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:44.085586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:44.106828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2086/4188] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:44 2022] DELETE /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b/config => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:44.110780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:44.128861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df028c-1b04-43d3-9106-211a5b1508bb tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:44.151293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:44.153043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:44.154036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:44.154631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:44.157005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c061760f59414c2ab4fcc33b73d0847b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:44.160926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:44.187219 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:44.211012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.212472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.252210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.252553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.256676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2103/4189] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:02:44 2022] PATCH /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b => generated 276 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:44.260422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:44.262402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:44.280458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df206a0f-501f-4ac2-ad61-199a57635e51 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:44.446829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:44.447845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:44.452774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:44.453077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:44.485363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c061760f59414c2ab4fcc33b73d0847b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:44.488412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:44.546343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.551223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.613673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b', 'request_id': 'req-72cf2c16-bf3b-48a2-9f63-14cea37ba694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.621172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b', 'request_id': 'req-72cf2c16-bf3b-48a2-9f63-14cea37ba694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.632095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b', 'request_id': 'req-72cf2c16-bf3b-48a2-9f63-14cea37ba694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.652120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] The token cache is being invalidate because project c061760f59414c2ab4fcc33b73d0847b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:44.652436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.653273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.663638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b', 'request_id': 'req-72cf2c16-bf3b-48a2-9f63-14cea37ba694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.667782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b', 'request_id': 'req-72cf2c16-bf3b-48a2-9f63-14cea37ba694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.668948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c061760f59414c2ab4fcc33b73d0847b', 'request_id': 'req-72cf2c16-bf3b-48a2-9f63-14cea37ba694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:44.679722 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2087/4190] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:44 2022] DELETE /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:44.685305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:44.697919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5fdf-b4ac-42af-8a29-4620edffced8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:44.829424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:44.830295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:44.830689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:44.831082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:44.831848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:44.833852 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:44.833852 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:44.833852 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:44.834892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:44.868908 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2104/4191] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:02:44 2022] POST /identity/v3/domains => generated 276 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:44.873515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:44.875426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:44.897679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf2c16-bf3b-48a2-9f63-14cea37ba694 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:44.944870 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:45.060460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.062016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.062213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.062518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.065569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.071214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.136475 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2088/4192] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:02:44 2022] PUT /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config => generated 138 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:45.141584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.161449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cc4e9-a22d-4941-a125-4a49221b7189 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.179545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.180348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.180686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.180930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.181864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.182951 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:45.182951 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:45.182951 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:45.183865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.273111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2105/4193] 10.222.0.77 () {60 vars in 1270 bytes} [Mon Jul 11 15:02:45 2022] PATCH /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config => generated 140 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:45.273861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.291405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75054-362a-4a40-8ff3-eba1a97c564e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.302475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.303937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.304443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.304911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.310167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.312057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.328132 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2089/4194] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:45 2022] GET /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config => generated 140 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:45.332501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.359280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69f4b-7d0d-43d1-8ead-e2f38cf79f21 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.374783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.375875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.376282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.376669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.377450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.381063 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:45.381063 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:45.381063 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:45.382347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.404177 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2106/4195] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:45 2022] DELETE /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:45.408628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.422212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dcb44-f0fb-40f0-803e-cffeaab5514c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.427645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.429273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.429894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.430226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.431705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.433601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Could not find any options in domain configuration for domain 2ad7eaf40758420b8d10c545b45c3008.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 2ad7eaf40758420b8d10c545b45c3008. Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:02:45.447945 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 2ad7eaf40758420b8d10c545b45c3008. Jul 11 15:02:45.449540 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:45.455602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.473661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2090/4196] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:45 2022] GET /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config => generated 151 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:02:45.476938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be069e47-32a0-4079-8196-0c756694a4db tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.482256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.483281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.483641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.483998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.484758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.486544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.499082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.509669 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2107/4197] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:45 2022] DELETE /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008/config => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:45.510459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7fafe-6443-4f0d-bf33-8356695a2e01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.515756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.517245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.517245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.517495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.519088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.520095 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:45.520095 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:45.520095 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:45.521116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.546510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:45.547464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:45.612600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:45.614535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:45.627401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:45.629610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:45.632247 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2091/4198] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:02:45 2022] PATCH /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008 => generated 277 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:45.654692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bf416-9347-4306-880d-c2e54bd96fc2 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:45.802988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:45.805177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:45.805521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:45.806299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:45.825939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2ad7eaf40758420b8d10c545b45c3008)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:45.827125 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:45.827125 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:45.827125 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:45.828512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:45.837756 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:45.885886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:45.894377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:45.988121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008', 'request_id': 'req-896bad51-e2a2-45e5-bff9-f2240fe14531'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.003042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008', 'request_id': 'req-896bad51-e2a2-45e5-bff9-f2240fe14531'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.015192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008', 'request_id': 'req-896bad51-e2a2-45e5-bff9-f2240fe14531'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.033108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] The token cache is being invalidate because project 2ad7eaf40758420b8d10c545b45c3008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:46.033416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.034190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.070295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008', 'request_id': 'req-896bad51-e2a2-45e5-bff9-f2240fe14531'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.073792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008', 'request_id': 'req-896bad51-e2a2-45e5-bff9-f2240fe14531'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.078697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2ad7eaf40758420b8d10c545b45c3008', 'request_id': 'req-896bad51-e2a2-45e5-bff9-f2240fe14531'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:46.087543 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2108/4199] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:45 2022] DELETE /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:46.093562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.105980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082e1a-8401-4869-98e7-11d1be79e2ae tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.230318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.231234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.232460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.233169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.234123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.236056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:46.261594 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2092/4200] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:02:46 2022] POST /identity/v3/domains => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:46.262020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.263747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:46.284003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bad51-e2a2-45e5-bff9-f2240fe14531 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.363195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.364380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.364638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.364965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.366656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.368195 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:46.368195 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:46.368195 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:46.369304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:46.436116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2109/4201] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:02:46 2022] PUT /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config => generated 138 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:02:46.440031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.453996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed880f-cda5-4923-9917-7811efb38918 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.466913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.467790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.468078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.468415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.469372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11, group=identity)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.470411 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:46.470411 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:46.470411 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:46.471333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:46.566321 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:46.595727 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2093/4202] 10.222.0.77 () {60 vars in 1296 bytes} [Mon Jul 11 15:02:46 2022] PATCH /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity => generated 175 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:46.597154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.619255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ccaa-5192-4d98-9125-28562fb13ce5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.636490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.637427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.637716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.637998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity/driver` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.638796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11, group=identity, option=driver)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.645312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:46.693979 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:46.718773 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2110/4203] 10.222.0.77 () {60 vars in 1317 bytes} [Mon Jul 11 15:02:46 2022] PATCH /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity/driver => generated 176 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:46.721816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.743922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f36d8a-f024-4333-ba6d-827020c0b38c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.764337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.765412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.765821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.766223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity/driver` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.766848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11, group=identity, option=driver)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.768493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:46.818320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2094/4204] 10.222.0.77 () {58 vars in 1298 bytes} [Mon Jul 11 15:02:46 2022] DELETE /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity/driver => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:46.822863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.843286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6507d-d0c9-4e87-9407-35a2965e6861 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.848511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.849753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.850783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.851222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity/driver` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.852988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11, group=identity, option=driver)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.855555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Could not find option driver in group identity in domain configuration for domain 8bb7794dd8b6459e92942e755d2f7a11.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:02:46.921179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:46.922622 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:02:46.925794 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2111/4205] 10.222.0.77 () {58 vars in 1295 bytes} [Mon Jul 11 15:02:46 2022] GET /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity/driver => generated 171 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:02:46.930856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:46.963585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ff895-695c-42ef-82ce-7394f305adac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:46.979249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff4e23-0ef0-4041-b911-0ec278a13f2b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:46.980360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4e23-0ef0-4041-b911-0ec278a13f2b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:46.980830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4e23-0ef0-4041-b911-0ec278a13f2b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:46.981272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4e23-0ef0-4041-b911-0ec278a13f2b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:46.982116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff4e23-0ef0-4041-b911-0ec278a13f2b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11, group=identity)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:46.984179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff4e23-0ef0-4041-b911-0ec278a13f2b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:47.024925 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2095/4206] 10.222.0.77 () {58 vars in 1277 bytes} [Mon Jul 11 15:02:46 2022] DELETE /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:47.028853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:47.044723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1182996-1d09-4e5c-8ea8-bbb147c18573 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:47.082352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:47.083265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:47.083557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:47.083845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:47.087132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11, group=identity)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:47.093769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Could not find group identity in domain configuration for domain 8bb7794dd8b6459e92942e755d2f7a11.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:02:47.116126 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:47.117485 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:02:47.118822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2112/4207] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 11 15:02:47 2022] GET /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config/identity => generated 154 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:02:47.122565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:47.123089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:47.123991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:47.131711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:47.144684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7ccf-b22c-4662-820a-16c3bedd5c9d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:47.148954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:47.150520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:47.157287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:47.158259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:47.159688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:47.160081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:47.162120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8bb7794dd8b6459e92942e755d2f7a11)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:47.166013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:47.186366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2113/4208] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:47 2022] DELETE /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11/config => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:47.192345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:47.223152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8ef3b-a991-4bf9-8b73-dfb3fa39ba71 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:47.238218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:47.239296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:47.239582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:47.239866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:47.247919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8bb7794dd8b6459e92942e755d2f7a11)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:47.249758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:47.273613 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2096/4209] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:02:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:47.292674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:47.296844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.299454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:47.310123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.346676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.347937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.354475 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2114/4210] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:02:47 2022] PATCH /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11 => generated 276 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:47.358944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:47.360699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:47.409927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3b04-4916-45db-b741-3168ecedc2c9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:47.471395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70380-3f34-4fec-a1da-083cb250b6f6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:47.481502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:47.483831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:47.484383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:47.484807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:47.501972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8bb7794dd8b6459e92942e755d2f7a11)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:47.504829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:47.517180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:47.518712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:47.519012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:47.519319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:47.534328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:47.546721 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:47.592304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.601607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.717858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:47.719654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:47.751497 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2097/4211] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:02:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:02:47.752664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11', 'request_id': 'req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.760950 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:47.772085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11', 'request_id': 'req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.794811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11', 'request_id': 'req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.828418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] The token cache is being invalidate because project 8bb7794dd8b6459e92942e755d2f7a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:47.828803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.829546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.840439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11', 'request_id': 'req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.841247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11', 'request_id': 'req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.848350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8bb7794dd8b6459e92942e755d2f7a11', 'request_id': 'req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:47.856383 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2115/4212] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:47 2022] DELETE /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:47.861945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:47.878191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d627ae1-2002-4538-b1e5-3fa7a0190a73 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.106446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.107393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.108693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.109695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.111625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.113049 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:48.113049 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:48.113049 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:48.122867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.136243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2098/4213] 10.222.0.77 () {58 vars in 1172 bytes} [Mon Jul 11 15:02:47 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:48.140643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.142755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:48.192953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689b0d9-6f48-4af3-a6b1-265bd86d35ad tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.220358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.223660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.224558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.226323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.229737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.232595 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:48.232595 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:48.232595 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:48.233918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.242647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.243859 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2116/4214] 10.222.0.77 () {58 vars in 1199 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.262821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b5b1-159c-4c94-a427-a5d714e64bd5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.269503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.270677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.271250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.271825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.272783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.275246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.281815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.283250 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2099/4215] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.297064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef052e-8985-4c37-abe9-cbfe5f5ffd36 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.303019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.306621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.307570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.308187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.309168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.311983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.316968 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2117/4216] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.319633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.334630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a1785-f7dc-456a-996d-23ad2993f380 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.353392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.354649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.355194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.355707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.356592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.359659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.367398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.376650 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2100/4217] 10.222.0.77 () {58 vars in 1187 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:48.382934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dddb0-3434-4cb9-a573-538ce263c1a8 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.391567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.393463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.394017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.394593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.395828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.398070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.405481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.413693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2118/4218] 10.222.0.77 () {58 vars in 1199 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.421019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ace03-8b39-478c-a6b3-d6bb1635b1ac tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.430841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.432486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.433026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.433545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.434437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.436536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.437959 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2101/4219] 10.222.0.77 () {58 vars in 1202 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.442690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.457582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd736786-8592-4790-9fcb-b58308b9270c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.466859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.468146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.468784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.469280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.470209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.473146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.481255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.483118 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2119/4220] 10.222.0.77 () {58 vars in 1208 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.493748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3180d-eb45-4fb9-aa3f-33c12c14dbe0 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.505327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.506322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.506725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.506913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.507590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.509778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.511948 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2102/4221] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.516042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.534286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9bf7-d1d4-4525-9844-cccc777cc5c7 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.555402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.556659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.556659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.556891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.557746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.559283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.564435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.566887 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2120/4222] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.590592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284651f-74e0-4b87-b62f-dafd098423fe tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.605769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.611188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.614763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.615631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.617981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.622825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.629709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.636099 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2103/4223] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:48.657317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868d451-c940-4e40-bf3b-f2f07008bc7a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.668147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.669146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.669594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.669878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.670878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.672998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.678841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.685315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2121/4224] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:48.692392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698002e-3714-4af6-948c-fc5a5b63f5d5 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.698653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.700049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.700365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.700794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.701476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.703558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.710985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.719171 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2104/4225] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:48.724031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166aac3-832e-4650-9640-34d9862804fc tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.729981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.731300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.731690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.732007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.739819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.739819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.740999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.750954 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2122/4226] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.760554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb9eea-e33d-44ee-bd45-d24a3e844325 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.775186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.776075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.776249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.776575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.777247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.778883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.780053 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2105/4227] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.784083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.797876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa0e7-e57b-40ad-840c-3b6e75df6350 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.819742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.820548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.820839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.821122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.821795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.823433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.829008 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2123/4228] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.829198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.849264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cdbb2-9ad9-4f2e-a31a-7d2cf6fac732 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.855108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.857202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.857731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.858187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.859171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.861009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.862927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2106/4229] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.866479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.879620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58a28d-a008-4684-814f-37cbf131e83a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.890972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.892666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.893245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.893757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.899209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.900888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.902392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2124/4230] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:48.906332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.917630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce242296-360e-482d-8452-d39c3dddf85a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.925742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.926595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.926988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.927284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.928003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.929610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.931681 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2107/4231] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:48.935576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.950209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f6a9-d8d6-4411-bf0f-62586542338d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:48.957403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:48.957776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:48.958053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:48.958344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:48.959077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:48.972148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:48.972148 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2125/4232] 10.222.0.77 () {58 vars in 1268 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:48.972826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:48.983781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b4b6-02ea-4a91-80ae-b1314f8e7e6b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.015257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.016078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.016368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.016650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.017326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.019141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.024006 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2108/4233] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:48 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.027462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.040236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff3d18-4fec-45ce-a556-058aa6223b8c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.051982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.052213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.052567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.052778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.053497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.055893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.061412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.064647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2126/4234] 10.222.0.77 () {58 vars in 1256 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.080764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4c6ac-cf5d-4dc2-94ef-5b6ebfa2ee7f tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.090261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.091097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.091388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.091840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.092698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.094143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.095350 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2109/4235] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:49.099654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.114813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80349980-02d5-4866-9cf5-366b4cbab318 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.130688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.133508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.133673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.134061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.135295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.137061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.143051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.143589 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2127/4236] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.161351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a5561-ba77-4c97-bdac-877c815ceba4 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.177216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.180190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.181825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.182903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.184335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.186283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.187852 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2110/4237] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.192602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.205649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2282d5-97d9-4ca9-9311-27da26757261 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.226542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.226542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.226542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.228481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.228481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.228481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.228481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2128/4238] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.230533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.247484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641e03c-5ae2-4d02-9758-034801ef2509 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.258098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.259109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.259582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.260159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.260923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.267593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.269734 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2111/4239] 10.222.0.77 () {58 vars in 1289 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.273652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.284958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e63d-f2de-4bfc-a93f-7e8f6b5fc842 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.298691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.300706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.301239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.301731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.302785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.305328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.306859 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2129/4240] 10.222.0.77 () {58 vars in 1256 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.311406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.332280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53da6-b1a7-411c-851e-eb07fa03025a tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.349836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.349836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.349836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.350206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.350206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.350635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.351810 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2112/4241] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.355907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.388097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebdb38-d164-4274-86d2-57f031e3bf52 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.402414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.403106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.403391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.403670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.404338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.407410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.408685 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2130/4242] 10.222.0.77 () {58 vars in 1307 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.412749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.425525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee297-1aa2-4e5e-ac49-6ec8e3c35236 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.465474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.466334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.466655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.466943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.467631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.469264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.470451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2113/4243] 10.222.0.77 () {58 vars in 1289 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:49.475228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.492337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e016b7-22eb-4d16-a1f1-6f06982aec82 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.503876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.505114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.505566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.506144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.507502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.509964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.511482 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2131/4244] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.515577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.535818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea717-9874-4a17-8632-93bb10ef7d48 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.553692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.554450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.554784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.555073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.555751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.557913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.561342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2114/4245] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.563321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.577701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae9f7-d8e2-443f-9903-9d043b0fc928 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.606978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.606978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.606978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.607688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.614129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.643102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.643287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.643451 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2132/4246] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.658926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a372-776f-4d5a-96f3-9906042af349 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.677317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.678738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.679036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.679320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.679999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.681645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.687492 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2115/4247] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:49.689019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.706457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492451-6f1f-45dc-aa06-b1e7c8fa379e tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.716275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.717255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.717575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.717869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.718567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.720508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.725499 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2133/4248] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.728126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.739852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d652a-62fd-4fee-aa58-f6c5e11a7122 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.747079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.748225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.748588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.748945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.749745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.751556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.756544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2116/4249] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:49.757989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.776757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdf5f-813a-4082-a462-ff1626831357 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.796369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.799455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.799761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.800078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.800950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.806140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.809857 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2134/4250] 10.222.0.77 () {58 vars in 1256 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.812516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.831457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9dd9-ae0f-48d3-90a9-fc31032be595 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.842790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.843905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.844275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.845230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.845990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.851048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.855850 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2117/4251] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.857031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.870429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe108-7c95-4db6-878f-5837ee1e200b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.887284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.888005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.888290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.888572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.889237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.890865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.892387 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2135/4252] 10.222.0.77 () {58 vars in 1256 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.896133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.915319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16a14-f26f-49d1-8f80-e799a8317ce6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.921532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.922567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.923066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.923352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.924132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.926366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.931323 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2118/4253] 10.222.0.77 () {58 vars in 1292 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.932746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.947558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0ba0-5ace-4997-8a25-725883c0eb16 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:49.953979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:49.955013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:49.956163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:49.956792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:49.958247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:49.960640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:49.962063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2136/4254] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:49.966346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:49.991703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3bc5-6c66-473b-886d-fd7885447868 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.008294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.009258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.009672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.010049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.010859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.012978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.014903 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2119/4255] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:49 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.018670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.040860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fb69-f79a-4a0e-b461-3f8d73fd312c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.076924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.077933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.078530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.078989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.080295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.082808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.085173 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2137/4256] 10.222.0.77 () {58 vars in 1211 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.089723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.109397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912b6a-d7dd-4ccd-8b3b-04930a1d10fa tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.118817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.120542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.121010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.121865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.122878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.125447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.127062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2120/4257] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:50.131212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.145651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad28c0-623b-41b7-9a26-cdafa9b54a5d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.155135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.155804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.156120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.156404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.157063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.158687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.165105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.172512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2138/4258] 10.222.0.77 () {58 vars in 1214 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.177001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047daba-d65c-4f7a-89e3-34fde43d134b tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.182430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.183632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.184320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.184773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.185617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.187710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.189296 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2121/4259] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.193514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.204977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cfdf-0709-47eb-a9c6-93fa2dfd3b01 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.211927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.213570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.214045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.214526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.215846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.219706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.221196 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2139/4260] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.225746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.243983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7754878-8505-458b-9788-7397afd09417 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.257399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.259204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.259664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.260110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.260972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.262776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.265142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2122/4261] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.269702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.284785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd345d74-aef6-4f96-aa7d-d26e15994872 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.299965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.301679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.301983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.302243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.303263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.304860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.309461 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2140/4262] 10.222.0.77 () {58 vars in 1259 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.310161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.316762 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:50.322306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88229ac6-3bda-48dd-905e-a1d36c7fecef tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.332823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.333955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.335091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.335796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.337552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.340604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.342553 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2123/4263] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:50.356438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.369705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af9a2-8260-46f6-b168-0b6fda97a7ba tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.403241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.404433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.404899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.405481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.407145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.408947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.414511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.415600 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2141/4264] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:02:50.434553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52bef-6ec8-48a9-8fb6-4b931d3923cd tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.461772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.462949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.463430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.463903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.464761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.467873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.473320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2124/4265] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:50.473853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.503249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d56e7-6189-476c-8ab8-bb171c949b09 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.523574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.524400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.524696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.525000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.525669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.531357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:50.532696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2142/4266] 10.222.0.77 () {58 vars in 1277 bytes} [Mon Jul 11 15:02:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 11 15:02:50.546601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.558186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709e448-3e03-4a74-84ed-92bab470277d tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.562683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.563619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.563914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.564267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/8bb7794dd8b6459e92942e755d2f7a11` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.609986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Could not find domain: 8bb7794dd8b6459e92942e755d2f7a11.: keystone.exception.DomainNotFound: Could not find domain: 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:02:50.635557 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:02:50.637048 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:02:50.638233 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8bb7794dd8b6459e92942e755d2f7a11. Jul 11 15:02:50.639486 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:50.639486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2125/4267] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:02:50 2022] PATCH /identity/v3/domains/8bb7794dd8b6459e92942e755d2f7a11 => generated 112 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:02:50.641533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.653749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbbd40-9f41-47cb-8bc5-df668dc05279 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.660247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.661630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.662007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.662625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/2ad7eaf40758420b8d10c545b45c3008` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.672167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Could not find domain: 2ad7eaf40758420b8d10c545b45c3008.: keystone.exception.DomainNotFound: Could not find domain: 2ad7eaf40758420b8d10c545b45c3008. Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2ad7eaf40758420b8d10c545b45c3008. Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:02:50.683078 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:02:50.684219 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:02:50.685345 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2ad7eaf40758420b8d10c545b45c3008. Jul 11 15:02:50.686556 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:02:50.688881 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2143/4268] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:02:50 2022] PATCH /identity/v3/domains/2ad7eaf40758420b8d10c545b45c3008 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:02:50.694112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.704924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171df50-1f30-4f62-ad67-ddd83a284cc6 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.717188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502632b-b804-4c5f-97e5-0f2c76b21b6c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f4731432d448e4a4939e9926c6d30b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657d9925529146378a3d71e0abeeee61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.718374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502632b-b804-4c5f-97e5-0f2c76b21b6c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.718919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502632b-b804-4c5f-97e5-0f2c76b21b6c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.719369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502632b-b804-4c5f-97e5-0f2c76b21b6c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] PATH_INFO: `/v3/domains/c061760f59414c2ab4fcc33b73d0847b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.733302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502632b-b804-4c5f-97e5-0f2c76b21b6c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-0502632b-b804-4c5f-97e5-0f2c76b21b6c tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Could not find domain: c061760f59414c2ab4fcc33b73d0847b.: keystone.exception.DomainNotFound: Could not find domain: c061760f59414c2ab4fcc33b73d0847b. Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c061760f59414c2ab4fcc33b73d0847b. Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:02:50.745647 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:02:50.747027 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:02:50.748428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c061760f59414c2ab4fcc33b73d0847b. Jul 11 15:02:50.749792 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:02:50.752886 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2126/4269] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:02:50 2022] PATCH /identity/v3/domains/c061760f59414c2ab4fcc33b73d0847b => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:02:50.754022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:50.755896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:50.869091 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:50.890015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71374e0-f8e9-49b5-9da7-8140aad38c28 tempest-DomainConfigurationTestJSON-819601459 tempest-DomainConfigurationTestJSON-819601459-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:50.896263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:50.897946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:50.898287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:50.898519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] PATH_INFO: `/v3/users/d9fbd884e8914812bcea8c4cac8ceb9d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:50.900597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fbd884e8914812bcea8c4cac8ceb9d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:50.902709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:51.026096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fbd884e8914812bcea8c4cac8ceb9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:51.030437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fbd884e8914812bcea8c4cac8ceb9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:51.053756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fbd884e8914812bcea8c4cac8ceb9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:51.055115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fbd884e8914812bcea8c4cac8ceb9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:51.065540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fbd884e8914812bcea8c4cac8ceb9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:51.091074 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2144/4270] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:50 2022] DELETE /identity/v3/users/d9fbd884e8914812bcea8c4cac8ceb9d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:51.096190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:51.097953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:51.098559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:51.126117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:51.129082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:51.138033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:51.143011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:51.207267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f79d88-7a8b-470a-8a95-8fa072dda475 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:51.233447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:51.234408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:51.234895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:51.235396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:51.242384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:51.299656 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2127/4271] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:51.329237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:51.331167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:51.427431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:51.429698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:51.453564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e378b9-a596-49bc-8e85-23a44a06c120 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:51.460175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:51.461035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:51.461508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:51.461941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:51.462546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2145/4272] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:51.494601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:51.496043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:51.513190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2128/4273] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:52.483267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:52.485264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:52.520457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d89cd-63af-4421-91d0-cc7412d1d88b service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:52.526767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:52.528123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:52.528717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:52.529753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] PATH_INFO: `/v3/projects/22014b24f374404eb05bd6464ef33ccd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:52.531372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22014b24f374404eb05bd6464ef33ccd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:52.534169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:52.601290 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:52.680193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22014b24f374404eb05bd6464ef33ccd', 'request_id': 'req-4232986f-8cd5-4d74-90c0-5040a87ba792'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.703981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22014b24f374404eb05bd6464ef33ccd', 'request_id': 'req-4232986f-8cd5-4d74-90c0-5040a87ba792'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.714051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22014b24f374404eb05bd6464ef33ccd', 'request_id': 'req-4232986f-8cd5-4d74-90c0-5040a87ba792'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.729624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] The token cache is being invalidate because project 22014b24f374404eb05bd6464ef33ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:52.730011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.730700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.736226 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2146/4274] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:52 2022] DELETE /identity/v3/projects/22014b24f374404eb05bd6464ef33ccd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:52.737391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:52.749958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6d48-afe1-489d-82c1-a121dfd7cea5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:52.847789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:52.848916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:52.849570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:52.850625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] PATH_INFO: `/v3/users/14f4731432d448e4a4939e9926c6d30b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:52.852187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f4731432d448e4a4939e9926c6d30b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:52.855695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:52.885255 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:52.933425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f4731432d448e4a4939e9926c6d30b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.953015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f4731432d448e4a4939e9926c6d30b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.963656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f4731432d448e4a4939e9926c6d30b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.978687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f4731432d448e4a4939e9926c6d30b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.979490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3ae0971-fff4-4a14-8d40-752447dcfd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f4731432d448e4a4939e9926c6d30b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:52.993992 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2129/4275] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:52 2022] DELETE /identity/v3/users/14f4731432d448e4a4939e9926c6d30b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:53.680369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:53.684071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:53.712051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232986f-8cd5-4d74-90c0-5040a87ba792 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:53.859227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:53.860289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:53.860656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:53.861010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] PATH_INFO: `/v3/projects/657d9925529146378a3d71e0abeeee61` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:53.862322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657d9925529146378a3d71e0abeeee61)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:53.864950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:53.958890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657d9925529146378a3d71e0abeeee61', 'request_id': 'req-4c66949a-6c15-493f-a1b1-4ac6d548ac82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:53.976801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657d9925529146378a3d71e0abeeee61', 'request_id': 'req-4c66949a-6c15-493f-a1b1-4ac6d548ac82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:53.991075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657d9925529146378a3d71e0abeeee61', 'request_id': 'req-4c66949a-6c15-493f-a1b1-4ac6d548ac82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:54.007243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] The token cache is being invalidate because project 657d9925529146378a3d71e0abeeee61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:54.007243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:54.019967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c66949a-6c15-493f-a1b1-4ac6d548ac82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:54.025947 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2147/4276] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:53 2022] DELETE /identity/v3/projects/657d9925529146378a3d71e0abeeee61 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:54.030919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.031477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.031586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.076749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:54.078059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:54.189661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.190689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.191613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.210910 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2130/4277] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:54.236096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:54.238785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:54.250436 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2148/4278] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:54.255173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:54.269969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc5c4-824f-48eb-9de6-3e8101ba675e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:54.276280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:54.276966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.277254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.277698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.278447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:54.278790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:54.280923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:54.305496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:54.312491 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2131/4279] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:54.321709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de946ba-3769-432e-b005-b81f4bedf22b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:54.340882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:54.342666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.343403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.343851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.344946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:54.349131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:54.392399 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2149/4280] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:54 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:54.401031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:54.427082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc95b0-eb4f-4882-85e3-29ff9dac3ef6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:54.505933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:54.513572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.513926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.514209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.515284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:54.517489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:54.554886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:54.555165 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2132/4281] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:54 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:54.569382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa9f7-129c-4448-8072-2b122cebb018 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:54.577040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:54.578064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.578725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.579232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.580714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:54.586693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:54.606091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:54.622484 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2150/4282] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:02:54.627350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7947a-dbf9-45b7-b88d-172a018efca1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:54.635763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c16f-881c-4214-88dd-014ae3e477a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:54.636519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c16f-881c-4214-88dd-014ae3e477a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.636878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c16f-881c-4214-88dd-014ae3e477a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.637267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c16f-881c-4214-88dd-014ae3e477a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.639101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4c16f-881c-4214-88dd-014ae3e477a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:54.640960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4c16f-881c-4214-88dd-014ae3e477a0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:54.663081 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2133/4283] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:02:54.664272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:54.671322 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:54.677390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8d1a-e29e-45ae-9ec6-9c1810c73101 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:54.684941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:54.686061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.686482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.687117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] PATH_INFO: `/v3/projects/7c86bf7fa8fe44c2a7a1f165bde7679e/users/ab50898a209e4dc2a581cdfee927cb10/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.711794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c86bf7fa8fe44c2a7a1f165bde7679e, user_id=ab50898a209e4dc2a581cdfee927cb10, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:54.714671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:54.743879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:54.744405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:54.744885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:54.745176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2151/4284] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:54 2022] PUT /identity/v3/projects/7c86bf7fa8fe44c2a7a1f165bde7679e/users/ab50898a209e4dc2a581cdfee927cb10/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:54.764780 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:54.784329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] MFA Rules not processed for user `ab50898a209e4dc2a581cdfee927cb10`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:54.787003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:54.912103 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2134/4285] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:54.916578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.034477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed491-3b33-4dad-be8f-1fd39d2bd7d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.039466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.040130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.040424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.040706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.041407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.049429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.091066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.091568 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2152/4286] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:54 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:55.092562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:55.098920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.191718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be604c-28a2-49a7-ab7c-23266d349092 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.196640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9e290-dcf2-4add-9766-21261132b838 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.198896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.200163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.200460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.200742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.201465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.204806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.239697 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2153/4287] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:55 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:55.243638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.282766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56748703-1105-4042-862b-d28a719b1feb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.305116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.305828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.306118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.306400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.306552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.307127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.307417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.307698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.308440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.310416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.312404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:55.332212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2154/4288] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:55.333287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.338284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.339830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.350910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27248b-99f4-4cd2-963e-137439c84a40 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.357202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.358526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.358983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.359363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] PATH_INFO: `/v3/projects/68e028bb78b943eb800803b819a8c2db/users/a011bacc08934bbabac408f47632a16d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.367264 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2135/4289] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:55.404691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e028bb78b943eb800803b819a8c2db, user_id=a011bacc08934bbabac408f47632a16d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.407854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.433126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2155/4290] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:55 2022] PUT /identity/v3/projects/68e028bb78b943eb800803b819a8c2db/users/a011bacc08934bbabac408f47632a16d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:55.437539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.453230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1df42-3ccd-44e6-848e-db5c8c2f38b0 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.541018 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:55.552107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87fabe-544a-47be-b11b-195a22369901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.552107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87fabe-544a-47be-b11b-195a22369901 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.552107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87fabe-544a-47be-b11b-195a22369901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.552601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87fabe-544a-47be-b11b-195a22369901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.553566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87fabe-544a-47be-b11b-195a22369901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.555223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87fabe-544a-47be-b11b-195a22369901 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.573076 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2136/4291] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:55.577140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.592788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008960b8-148c-41fc-b0a0-90e7dfdb7917 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.606479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.607778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.608138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.608494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] PATH_INFO: `/v3/projects/68e028bb78b943eb800803b819a8c2db/users/a011bacc08934bbabac408f47632a16d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.616000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e028bb78b943eb800803b819a8c2db, user_id=a011bacc08934bbabac408f47632a16d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.620836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.642206 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2156/4292] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:55 2022] PUT /identity/v3/projects/68e028bb78b943eb800803b819a8c2db/users/a011bacc08934bbabac408f47632a16d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:55.644434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.644739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.645026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.674144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] MFA Rules not processed for user `a011bacc08934bbabac408f47632a16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:55.675423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:55.778027 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2137/4293] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:55.783858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.798623 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:55.803851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6942d-9ce6-4c8b-a71e-d634c7e0e67f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.810243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.811247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.812471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.812877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.814048 n-d-master-1 devstack@keystone.service[80989]: WARNING oslo_log.versionutils [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:55.814695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.816186 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:55.816186 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:55.816186 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:55.817312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.842594 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2157/4294] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:02:55 2022] POST /identity/v3/policies => generated 229 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:55.846391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.859860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48d21c-584a-4e7a-9c17-68b5e50c3fc8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.882017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.883000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.883287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.883910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies/24b07900eb1c4543b5fb73e97d8ccfce` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.884914 n-d-master-1 devstack@keystone.service[80990]: WARNING oslo_log.versionutils [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:55.885449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=24b07900eb1c4543b5fb73e97d8ccfce)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.901671 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:55.901671 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:55.901671 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:55.902646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.974848 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2138/4295] 10.222.0.77 () {60 vars in 1251 bytes} [Mon Jul 11 15:02:55 2022] PATCH /identity/v3/policies/24b07900eb1c4543b5fb73e97d8ccfce => generated 236 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:55.977572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.992929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de848-8a1d-4487-b70f-e443d16ce878 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.003207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.004222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.004660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.004993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies/24b07900eb1c4543b5fb73e97d8ccfce` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.006747 n-d-master-1 devstack@keystone.service[80989]: WARNING oslo_log.versionutils [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:56.007658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=24b07900eb1c4543b5fb73e97d8ccfce)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.010262 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:56.010262 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:56.010262 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:56.011453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.029179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2158/4296] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:02:55 2022] GET /identity/v3/policies/24b07900eb1c4543b5fb73e97d8ccfce => generated 236 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:56.033483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.062696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54081f-f932-4143-975f-dd3212500ee4 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.075271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.076147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.076433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.076719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies/24b07900eb1c4543b5fb73e97d8ccfce` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.077526 n-d-master-1 devstack@keystone.service[80990]: WARNING oslo_log.versionutils [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:56.078158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=24b07900eb1c4543b5fb73e97d8ccfce)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.079467 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:56.079467 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:56.079467 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:56.085738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.118765 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2139/4297] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:56 2022] DELETE /identity/v3/policies/24b07900eb1c4543b5fb73e97d8ccfce => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:56.126313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.139975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2a702-f283-4a73-8570-686d91f86bcd tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.145594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.147345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.147880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.148410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.149877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.152084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.175196 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2159/4298] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:02:56 2022] POST /identity/v3/policies => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:56.179617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.213700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14148b-badf-454e-be99-81dc6007310e tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.220809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.221590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.221882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.224923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.224923 n-d-master-1 devstack@keystone.service[80990]: WARNING oslo_log.versionutils [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:56.224923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.225240 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:56.225240 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:56.225240 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:56.226261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.251250 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2140/4299] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:02:56 2022] POST /identity/v3/policies => generated 228 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:56.253679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.265959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13ef1-b649-48a8-9165-916365c49f53 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.272207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.272882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.273173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.273456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.274855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.276970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.297843 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2160/4300] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:02:56 2022] POST /identity/v3/policies => generated 229 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:56.301682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.313931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c943-5db8-4e5d-b2bc-f82e4378f23f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.319447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.320273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.320570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.320855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.321984 n-d-master-1 devstack@keystone.service[80990]: WARNING oslo_log.versionutils [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:56.322247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.323519 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:56.323519 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:02:56.323519 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:02:56.324661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.335934 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2141/4301] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:02:56 2022] GET /identity/v3/policies => generated 762 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:02:56.339938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.354698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553851-050a-48b3-a02a-f44f8385e031 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.371795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.373339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.373339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.373629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies/d35310bca74243e994de6dc158c0672e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.374614 n-d-master-1 devstack@keystone.service[80989]: WARNING oslo_log.versionutils [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 11 15:02:56.376240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d35310bca74243e994de6dc158c0672e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.376771 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:02:56.376771 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:02:56.376771 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:02:56.378786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.410097 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2161/4302] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:56 2022] DELETE /identity/v3/policies/d35310bca74243e994de6dc158c0672e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:56.415381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.431448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6725439-f5d7-41ce-8950-4856382d782f tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.438133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.439380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.439898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.440362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies/01eabc10e88b4331bae510d314b064c2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.441867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=01eabc10e88b4331bae510d314b064c2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.444985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.477861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2142/4303] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:56 2022] DELETE /identity/v3/policies/01eabc10e88b4331bae510d314b064c2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:56.479617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.499865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a05847-2785-4e72-90f2-2678d3238662 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.505674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9450-f64e-4600-a953-19c52220db20 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a011bacc08934bbabac408f47632a16d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e028bb78b943eb800803b819a8c2db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.506634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9450-f64e-4600-a953-19c52220db20 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.506924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9450-f64e-4600-a953-19c52220db20 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.507201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9450-f64e-4600-a953-19c52220db20 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] PATH_INFO: `/v3/policies/b2741dde93b04e5ebc17e8b58f0bb44b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.508660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab9450-f64e-4600-a953-19c52220db20 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b2741dde93b04e5ebc17e8b58f0bb44b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.511837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab9450-f64e-4600-a953-19c52220db20 tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.538351 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2162/4304] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:56 2022] DELETE /identity/v3/policies/b2741dde93b04e5ebc17e8b58f0bb44b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:56.544420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.633330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b644-456f-42ff-8505-8aece89abbda tempest-PoliciesTestJSON-1295302135 tempest-PoliciesTestJSON-1295302135-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.640608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.641496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.641784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.642066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] PATH_INFO: `/v3/users/ab50898a209e4dc2a581cdfee927cb10` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.644014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab50898a209e4dc2a581cdfee927cb10)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.646938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.665078 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:56.726386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab50898a209e4dc2a581cdfee927cb10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:56.741478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab50898a209e4dc2a581cdfee927cb10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:56.749993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab50898a209e4dc2a581cdfee927cb10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:56.760547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab50898a209e4dc2a581cdfee927cb10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:56.761810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab50898a209e4dc2a581cdfee927cb10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:56.777715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2143/4305] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:56 2022] DELETE /identity/v3/users/ab50898a209e4dc2a581cdfee927cb10 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:56.781090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.782019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.783153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.806716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:56.808543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:56.810849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.814042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:56.920533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f698cf7-7195-4b3d-8208-fba461b1ff32 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:56.932454 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2163/4306] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:56.934474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:56.935627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:56.935944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:56.936227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] PATH_INFO: `/v3/users/237e35e1f9fc4ea78e5f0787d3bda31f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:56.937476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237e35e1f9fc4ea78e5f0787d3bda31f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:56.939467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:56.941853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:56.944515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.029685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237e35e1f9fc4ea78e5f0787d3bda31f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.040083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d58b4-281e-41b0-8404-29df2da01a95 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:57.045096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237e35e1f9fc4ea78e5f0787d3bda31f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.045868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:57.046911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.047692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.048179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.053533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237e35e1f9fc4ea78e5f0787d3bda31f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.062893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237e35e1f9fc4ea78e5f0787d3bda31f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.063064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:57.063665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31c2ff13-8195-4e41-84a3-fd72339ff2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237e35e1f9fc4ea78e5f0787d3bda31f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.066734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:57.074941 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2144/4307] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:56 2022] DELETE /identity/v3/users/237e35e1f9fc4ea78e5f0787d3bda31f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:57.076743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.077130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.077470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.082797 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2164/4308] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:57.095340 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:57.102909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:57.104921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.183026 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2145/4309] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:02:57.195968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:57.197854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.210864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a4d0-1acc-4779-ade0-a6a33c46d3fb service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:57.252581 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:57.301194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:57.301996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.302432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.303429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.318509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:57.320268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:57.331851 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2165/4310] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:57.612731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:57.614943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.656408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea4f4f-cfdb-4e45-ac90-fd2be2c25fdf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:57.663236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:57.664167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.665262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.665550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] PATH_INFO: `/v3/projects/36960750ab1147e9b24f7b0facb6a46c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.666890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36960750ab1147e9b24f7b0facb6a46c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:57.669303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:57.752044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36960750ab1147e9b24f7b0facb6a46c', 'request_id': 'req-8cd306c4-2cbb-4b43-b89f-92341c7f1281'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.759365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:57.760943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.761090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36960750ab1147e9b24f7b0facb6a46c', 'request_id': 'req-8cd306c4-2cbb-4b43-b89f-92341c7f1281'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.782218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc19d59-2103-4088-bf54-c098b8d4db7f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:57.785506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36960750ab1147e9b24f7b0facb6a46c', 'request_id': 'req-8cd306c4-2cbb-4b43-b89f-92341c7f1281'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.819178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] The token cache is being invalidate because project 36960750ab1147e9b24f7b0facb6a46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:57.819521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.820248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8cd306c4-2cbb-4b43-b89f-92341c7f1281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.822684 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2146/4311] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:57 2022] DELETE /identity/v3/projects/36960750ab1147e9b24f7b0facb6a46c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:57.827905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ab84d-4c5c-463a-be6e-8c27f422fe81 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.828405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ab84d-4c5c-463a-be6e-8c27f422fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.828755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ab84d-4c5c-463a-be6e-8c27f422fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.855852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6b0ab84d-4c5c-463a-be6e-8c27f422fe81 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:57.858780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b0ab84d-4c5c-463a-be6e-8c27f422fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.908103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:57.909312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.909704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.910130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] PATH_INFO: `/v3/projects/7c86bf7fa8fe44c2a7a1f165bde7679e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.911769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c86bf7fa8fe44c2a7a1f165bde7679e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:57.914365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:57.961585 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2147/4312] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:57.970912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.971214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.971501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.989622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c86bf7fa8fe44c2a7a1f165bde7679e', 'request_id': 'req-af32122b-4127-43a5-b54f-2f2a9e29c32c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:57.998021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:57.999396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.000774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c86bf7fa8fe44c2a7a1f165bde7679e', 'request_id': 'req-af32122b-4127-43a5-b54f-2f2a9e29c32c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.020102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c86bf7fa8fe44c2a7a1f165bde7679e', 'request_id': 'req-af32122b-4127-43a5-b54f-2f2a9e29c32c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.030736 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:58.042052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] The token cache is being invalidate because project 7c86bf7fa8fe44c2a7a1f165bde7679e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:58.042673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.044236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.048530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2166/4313] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:57 2022] DELETE /identity/v3/projects/7c86bf7fa8fe44c2a7a1f165bde7679e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:58.057339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.062949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.082315 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2148/4314] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:02:58.087314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.101019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec4786-6ba8-4ed8-81d8-ed287d27a122 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.109689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.110201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.110545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.118444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.119368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:58.119688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.121349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.136601 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2149/4315] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:58.141181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.152131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611276-37b1-40b8-aef5-30acb211df63 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.157547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.158290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.158721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.159009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.159702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.161809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.168436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32122b-4127-43a5-b54f-2f2a9e29c32c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.173404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.174905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.175196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.175483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] PATH_INFO: `/v3/users/a011bacc08934bbabac408f47632a16d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.177289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a011bacc08934bbabac408f47632a16d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.179462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.183423 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:58.203858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2150/4316] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:58 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:02:58.204657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.237777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a011bacc08934bbabac408f47632a16d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.238547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a011bacc08934bbabac408f47632a16d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.257171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a011bacc08934bbabac408f47632a16d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.258283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a011bacc08934bbabac408f47632a16d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.266119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a011bacc08934bbabac408f47632a16d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.286515 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2167/4317] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:02:58 2022] DELETE /identity/v3/users/a011bacc08934bbabac408f47632a16d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:58.286751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2328c-8740-4d85-9811-7b1c641634af admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.364458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.365339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.365784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.365993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.366921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.368972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.395160 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2151/4318] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:58 2022] POST /identity/v3/users => generated 282 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:58.397265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.399719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.425278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252afd7-e8a1-4697-b253-13bf2173ca71 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.432627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.433679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.434057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.435615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.437028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.439757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.473300 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2168/4319] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:58.474672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.489835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ab2ea-13df-49f1-bb5b-3ab5d9bf7f29 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.503029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ae5f8-d6d4-43fb-9493-3f12fb6334dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.504085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ae5f8-d6d4-43fb-9493-3f12fb6334dc admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.504473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ae5f8-d6d4-43fb-9493-3f12fb6334dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.504853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ae5f8-d6d4-43fb-9493-3f12fb6334dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.507468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ae5f8-d6d4-43fb-9493-3f12fb6334dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.514190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ae5f8-d6d4-43fb-9493-3f12fb6334dc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.534031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2152/4320] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:58.538054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.555670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33c494-8a31-4fb7-b96e-2c058f89f178 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.566470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.567740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.568155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.569109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] PATH_INFO: `/v3/projects/e9e6ec390a0342c7b3e2aacbf73a7021/users/b41b55f344804dcea0d8cb04c650f659/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.588387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e6ec390a0342c7b3e2aacbf73a7021, user_id=b41b55f344804dcea0d8cb04c650f659, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.591089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.610853 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2169/4321] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:58 2022] PUT /identity/v3/projects/e9e6ec390a0342c7b3e2aacbf73a7021/users/b41b55f344804dcea0d8cb04c650f659/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:02:58.622308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077645-b63e-4092-b4de-513841099a5d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.623174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077645-b63e-4092-b4de-513841099a5d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.623471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077645-b63e-4092-b4de-513841099a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.666667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.667659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-56077645-b63e-4092-b4de-513841099a5d None None] MFA Rules not processed for user `b41b55f344804dcea0d8cb04c650f659`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:58.668572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.669741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-56077645-b63e-4092-b4de-513841099a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.687125 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:58.779992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483d9cb-29b2-4e86-abc8-e4619178de95 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.785314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.785725 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2153/4322] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:58.786293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.786622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.786931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] PATH_INFO: `/v3/projects/68e028bb78b943eb800803b819a8c2db` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.787508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.787791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.788135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.788259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e028bb78b943eb800803b819a8c2db)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.792718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.811010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] MFA Rules not processed for user `2498f2b4e9bb4e4baedc83e1462867b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:58.812298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.873848 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:58.875614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e028bb78b943eb800803b819a8c2db', 'request_id': 'req-6dd839f8-2e2e-4081-ab7d-38455604245e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.894576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e028bb78b943eb800803b819a8c2db', 'request_id': 'req-6dd839f8-2e2e-4081-ab7d-38455604245e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.899880 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2154/4323] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:58.899880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.909154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e028bb78b943eb800803b819a8c2db', 'request_id': 'req-6dd839f8-2e2e-4081-ab7d-38455604245e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.910123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.944865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] The token cache is being invalidate because project 68e028bb78b943eb800803b819a8c2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:02:58.945733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.948161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dd839f8-2e2e-4081-ab7d-38455604245e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:02:58.957307 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2170/4324] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:02:58 2022] DELETE /identity/v3/projects/68e028bb78b943eb800803b819a8c2db => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:58.958801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040018f-914a-4986-b9e6-a56278a6f932 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.959098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040018f-914a-4986-b9e6-a56278a6f932 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.959380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040018f-914a-4986-b9e6-a56278a6f932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.988276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8040018f-914a-4986-b9e6-a56278a6f932 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:58.989504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8040018f-914a-4986-b9e6-a56278a6f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:59.045104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419490-93c0-4e6b-8594-c264ca38ddf8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.105875 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2171/4325] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:59.113873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.114438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.117893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.151589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.152590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.153056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.154230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.156937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:59.170995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:59.177117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:59.198383 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:59.200542 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2172/4326] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:59.205884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:59.221825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14663ce-23be-49d7-92a7-f354a8e709cb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.229317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.230010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.230469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.230863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.231618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:02:59.232046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.233699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.263902 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2173/4327] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:02:59.265088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:59.281690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05c2d-dfff-4c5f-8da6-f160c117657d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.293146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.293570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.294665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.295202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.295634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.295832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.296718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.298903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.310157 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2155/4328] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:59.344996 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2174/4329] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:59 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:59.349309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:59.369690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1509b0-13a5-45d3-8594-10d7e677929f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.493420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.494121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.494411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.494718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.495446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.497422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.562077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:59.563335 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2156/4330] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:02:59 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:02:59.578432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63e262-0664-4b5f-b47d-ec38324060f3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.587341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.589084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.589484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.590010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.591212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.593779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.614645 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2175/4331] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:59.616801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:59.633956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01a52e-8bbd-4c58-a920-3020712281aa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.640077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc99aa-eb9f-46a5-83a0-ceb8610bd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.640911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc99aa-eb9f-46a5-83a0-ceb8610bd370 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.641209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc99aa-eb9f-46a5-83a0-ceb8610bd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.641491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc99aa-eb9f-46a5-83a0-ceb8610bd370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.642232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc99aa-eb9f-46a5-83a0-ceb8610bd370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.643911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc99aa-eb9f-46a5-83a0-ceb8610bd370 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.660723 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2157/4332] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:02:59.666423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:59.680399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c926a-4304-4dc8-86b0-d2b238699268 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:59.685986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:59.687142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.687439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.688761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] PATH_INFO: `/v3/projects/ff9f7b3fe95048f7a6c6d172e072d238/users/598c2a3fdb014ebda74c20795b2ea0c5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.716452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9f7b3fe95048f7a6c6d172e072d238, user_id=598c2a3fdb014ebda74c20795b2ea0c5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:59.723392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:59.740882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2176/4333] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:02:59 2022] PUT /identity/v3/projects/ff9f7b3fe95048f7a6c6d172e072d238/users/598c2a3fdb014ebda74c20795b2ea0c5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:02:59.752956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:59.753334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:59.753547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:59.796291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] MFA Rules not processed for user `598c2a3fdb014ebda74c20795b2ea0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:02:59.797619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:59.966550 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2158/4334] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:02:59.967784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.082129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182aac2-8f36-4433-b70a-331a17bf43f4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.091955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.092794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.092946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.093191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.093905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.095858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.100491 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:00.139934 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2177/4335] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:02:59 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:00.149423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.175807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368fb39-8c50-4fa8-9fc1-8d7ff01b9c39 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.224014 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:00.275296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.276561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.277015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.277462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.278646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.281999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.305548 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2159/4336] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:00 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:00.309614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.322731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8fb7-7d61-4b70-82e8-305a21480100 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.335419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.336432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.336891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.337368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.338539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.340516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.363465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.368453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:00.369234 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2178/4337] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:03:00.370109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.385897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771820e7-3df4-49b7-911c-c39406bc7a02 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.386147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a736b39-04f1-467a-b509-6b56815312ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.400557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.402553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.403010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.403166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.403636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] PATH_INFO: `/v3/projects/32a8b45dbfa94d87b2bb3a480ef633c8/users/bb536ff552fa4fc89385a973ec341475/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.405195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.405495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.406621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] PATH_INFO: `/v3/users/bbca12357748486ebcd038c9b56b5bd5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.408549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbca12357748486ebcd038c9b56b5bd5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.411400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.433409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8b45dbfa94d87b2bb3a480ef633c8, user_id=bb536ff552fa4fc89385a973ec341475, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.438527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.456349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2179/4338] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:00 2022] PUT /identity/v3/projects/32a8b45dbfa94d87b2bb3a480ef633c8/users/bb536ff552fa4fc89385a973ec341475/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:00.460172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.498486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbca12357748486ebcd038c9b56b5bd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.514467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbca12357748486ebcd038c9b56b5bd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.522728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbca12357748486ebcd038c9b56b5bd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.531713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbca12357748486ebcd038c9b56b5bd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.532487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbca12357748486ebcd038c9b56b5bd5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.560336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2160/4339] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:00 2022] DELETE /identity/v3/users/bbca12357748486ebcd038c9b56b5bd5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:00.625315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e545-df72-41f5-8db5-a40a2fd5db91 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.750749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.751595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.751787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.752067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.752812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.754544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.772010 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2180/4340] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:00.776893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.778531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:00.794581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc505d2-5b9f-4cb5-a1fa-ba0b514a8904 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.801740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:00.804491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:00.805035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e164-3070-4779-90fa-0417df3deb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.806024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e164-3070-4779-90fa-0417df3deb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.806441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e164-3070-4779-90fa-0417df3deb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.807042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e164-3070-4779-90fa-0417df3deb18 admin admin] PATH_INFO: `/v3/projects/32a8b45dbfa94d87b2bb3a480ef633c8/users/bb536ff552fa4fc89385a973ec341475/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.809461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862e164-3070-4779-90fa-0417df3deb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8b45dbfa94d87b2bb3a480ef633c8, user_id=bb536ff552fa4fc89385a973ec341475, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.812926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862e164-3070-4779-90fa-0417df3deb18 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.830334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b477-aa57-4eb4-b06c-968e0c527c55 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:00.843951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:00.845593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.846705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.847403 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2161/4341] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:00 2022] PUT /identity/v3/projects/32a8b45dbfa94d87b2bb3a480ef633c8/users/bb536ff552fa4fc89385a973ec341475/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:00.847580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] PATH_INFO: `/v3/projects/e6f0b063995347d4ac931b993d656020` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.852864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f0b063995347d4ac931b993d656020)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:00.857801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:00.857945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.858235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.858544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.902080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] MFA Rules not processed for user `bb536ff552fa4fc89385a973ec341475`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:00.903446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:00.919707 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:00.922273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f0b063995347d4ac931b993d656020', 'request_id': 'req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.934703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f0b063995347d4ac931b993d656020', 'request_id': 'req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.943431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f0b063995347d4ac931b993d656020', 'request_id': 'req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.962345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] The token cache is being invalidate because project e6f0b063995347d4ac931b993d656020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:00.963842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.965436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c33a7733-e07d-4d5d-b8a0-57d5b0d61a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:00.970433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2181/4342] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:00 2022] DELETE /identity/v3/projects/e6f0b063995347d4ac931b993d656020 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:00.976639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3240e-714f-44e6-8c8f-f9ec3275a537 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:00.977082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3240e-714f-44e6-8c8f-f9ec3275a537 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:00.977458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3240e-714f-44e6-8c8f-f9ec3275a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:00.998144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-17b3240e-714f-44e6-8c8f-f9ec3275a537 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:00.999408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17b3240e-714f-44e6-8c8f-f9ec3275a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:01.023142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2162/4343] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:01.030068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.045020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111c4ee-0c11-4edb-b52a-da6c278ef2f5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.053924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.054840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.055238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.055644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.056602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.060807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.067827 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:01.105458 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2182/4344] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:01.107563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.107962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.108318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.115556 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2163/4345] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/projects => generated 360 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:01.122559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.145406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:01.147123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:01.284526 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2183/4346] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:01.284820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f88061-da7e-434a-ba16-b60de1f0ce9b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.286084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.300784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.312940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214ab4-3d34-48e1-8e2f-813825f46f1d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.313298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.313298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.313298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.313298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.314042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.314042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.314042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.314042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.314433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.314563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:01.314563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.314563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.332449 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2184/4347] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:03:01.334016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.350352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c695-3307-45e8-a7ff-e08b15852403 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.351223 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2164/4348] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/users => generated 371 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:01.355221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.356193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.357109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.357560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.358020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.359275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.361736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.368398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1266f-f83f-4ac0-9ca1-43f3b3eb58d1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.373713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.374833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.375195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.375496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/3ccc23d0d26a4ba0a0f0f099d668aebb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.395018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:get_user(user_id=3ccc23d0d26a4ba0a0f0f099d668aebb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.398108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.402528 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2165/4349] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:03:01 2022] GET /identity/v3/users/3ccc23d0d26a4ba0a0f0f099d668aebb => generated 371 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:01.402788 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2185/4350] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:01.404135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.405464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.419682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a38c2d-ea11-4afd-a1aa-25cf317d70ad tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.465927 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:01.501178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405664c9-5908-41c8-987a-20248ee348da admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.506545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.507621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.508011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.508388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/3ccc23d0d26a4ba0a0f0f099d668aebb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.510182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3ccc23d0d26a4ba0a0f0f099d668aebb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.512315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.513148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.515430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.515949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.516435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.517611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.519895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.551627 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2166/4351] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:03:01.557738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.571887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd95bee-a84b-4575-86c2-e26be999bcb8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.577643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.578393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.578838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.579132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.579954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.581716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.596729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2167/4352] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:01.598607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.613613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21130330-5a9f-4d7f-b730-6b5ffe1f761c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.614921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ccc23d0d26a4ba0a0f0f099d668aebb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.615682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ccc23d0d26a4ba0a0f0f099d668aebb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.627282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.628298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.628591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.628874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.629615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.634083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.639511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ccc23d0d26a4ba0a0f0f099d668aebb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.640904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ccc23d0d26a4ba0a0f0f099d668aebb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.650307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ccc23d0d26a4ba0a0f0f099d668aebb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.658758 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2168/4353] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:03:01.663053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.667855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:01.686547 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2186/4354] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:01 2022] DELETE /identity/v3/users/3ccc23d0d26a4ba0a0f0f099d668aebb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:01.688235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.689917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:01.709622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38071c-54be-4fd5-84a1-216b397d81d8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.752623 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:01.797411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9656cea-0786-48de-8e56-d1ea0908fb17 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:01.802860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca19ac8-8f14-42e2-8dbe-9e78851e4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.803032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:01.803931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca19ac8-8f14-42e2-8dbe-9e78851e4fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.804095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.804288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca19ac8-8f14-42e2-8dbe-9e78851e4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.804510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.804630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca19ac8-8f14-42e2-8dbe-9e78851e4fc1 admin admin] PATH_INFO: `/v3/projects/4dd89698401b4c6e92acfbdf600733cb/users/72be490a451b45eaa4879340a06b51f5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.804814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/68c3bed53dc4485da7b5025455c4a3df` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.806164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68c3bed53dc4485da7b5025455c4a3df)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.808451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.828415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca19ac8-8f14-42e2-8dbe-9e78851e4fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd89698401b4c6e92acfbdf600733cb, user_id=72be490a451b45eaa4879340a06b51f5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:01.831330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca19ac8-8f14-42e2-8dbe-9e78851e4fc1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:01.851879 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2169/4355] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:01 2022] PUT /identity/v3/projects/4dd89698401b4c6e92acfbdf600733cb/users/72be490a451b45eaa4879340a06b51f5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:01.858837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:01.859175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:01.859415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:01.881053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:01.882634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:01.897785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c3bed53dc4485da7b5025455c4a3df', 'request_id': 'req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.909236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c3bed53dc4485da7b5025455c4a3df', 'request_id': 'req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.916254 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:01.919293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c3bed53dc4485da7b5025455c4a3df', 'request_id': 'req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.940164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] The token cache is being invalidate because project 68c3bed53dc4485da7b5025455c4a3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:01.940434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.941141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:01.943508 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2187/4356] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:01 2022] DELETE /identity/v3/projects/68c3bed53dc4485da7b5025455c4a3df => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:01.950529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.952352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:01.977131 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2170/4357] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:01.987310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:01.988939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:02.045491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ef7bc-25ae-465b-89eb-ef77b819e8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.058037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.059928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.060238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.062880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.063675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.065906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.076410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860149-bba1-4b33-8e26-4724333f31f1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.081946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.082852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.083398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.084534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.096690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.097996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.109608 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2171/4358] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:03:02.114833 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2188/4359] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:01 2022] POST /identity/v3/projects => generated 358 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:03:02.119200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.131314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f83ea-d5cc-446c-88fa-df652b52e1a7 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.191576 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:02.200930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.201832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.202314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.202654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.203384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.205897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.236610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2172/4360] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:02 2022] POST /identity/v3/users => generated 417 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:02.241033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.254147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5210e2-509a-428c-b916-fa57b4d7942d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.260383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.261003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.261640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.262060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.266886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.268620 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:03:02.268620 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:03:02.268620 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:03:02.270030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.290536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2189/4361] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:03:02 2022] POST /identity/v3/roles => generated 240 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:03:02.294650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.309979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde59ae2-63f7-4273-8afb-e7d9c44ff3af tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.315101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.316126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.316544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.317208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/d8e2a911d15e4064ab25b7695e56e943` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.353682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:get_user(user_id=d8e2a911d15e4064ab25b7695e56e943)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.357249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.365641 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2173/4362] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:03:02 2022] GET /identity/v3/users/d8e2a911d15e4064ab25b7695e56e943 => generated 417 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:02.366881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.379429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc517f-3a9e-440e-ba35-7384168496cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.390178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.391437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.391776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.392066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/roles/eef9dc91175240ddab345589be5010ea` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.394027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:get_role(role_id=eef9dc91175240ddab345589be5010ea)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.395235 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:03:02.395235 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:03:02.395235 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:03:02.396218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.398425 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2190/4363] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:03:02 2022] GET /identity/v3/roles/eef9dc91175240ddab345589be5010ea => generated 240 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:03:02.402224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.417482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537887d7-123b-4f0a-a6b5-f2f3f9908ac1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.423715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.424694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.425052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.425440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.426232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.428933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.471309 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2174/4364] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:02 2022] POST /identity/v3/projects => generated 360 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:02.475247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.489416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893292-b691-4da1-b221-66f0d1b6f57d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.560535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.561470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.561763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.562040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/12d43c9c701b45a89cdb17dc6b968d2a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.563559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:get_project(project_id=12d43c9c701b45a89cdb17dc6b968d2a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.565715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.570831 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2191/4365] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:03:02 2022] GET /identity/v3/projects/12d43c9c701b45a89cdb17dc6b968d2a => generated 360 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:02.572432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.584517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb8c3-59ca-45ac-82dd-173f03f731f8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.595097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.596298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.596747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.597215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/12d43c9c701b45a89cdb17dc6b968d2a/users/d8e2a911d15e4064ab25b7695e56e943/roles/eef9dc91175240ddab345589be5010ea` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.600420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_grant(project_id=12d43c9c701b45a89cdb17dc6b968d2a, user_id=d8e2a911d15e4064ab25b7695e56e943, role_id=eef9dc91175240ddab345589be5010ea)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.603743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.625471 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2175/4366] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:02 2022] PUT /identity/v3/projects/12d43c9c701b45a89cdb17dc6b968d2a/users/d8e2a911d15e4064ab25b7695e56e943/roles/eef9dc91175240ddab345589be5010ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:02.626936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.646730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aaa3-629d-47c0-8e06-0464d3b4f63e tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.726817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.727430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.727741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.728033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.728866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.730852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.738572 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:02.814984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2192/4367] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:02 2022] POST /identity/v3/projects => generated 359 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:02.816116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.831946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ebe15-bbb8-49ad-b192-dbe0b5cf8539 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.917274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.918773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.919313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.919902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/67bc0cc67d1a4bbf84a303bbb0f190d3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.921553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:get_project(project_id=67bc0cc67d1a4bbf84a303bbb0f190d3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.926389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.933158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.948140 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2176/4368] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:03:02 2022] GET /identity/v3/projects/67bc0cc67d1a4bbf84a303bbb0f190d3 => generated 359 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:03:02.953844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ee21-adb4-4201-b11d-e7f14b3fb08d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.961715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.963473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.963989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.964936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/67bc0cc67d1a4bbf84a303bbb0f190d3/users/d8e2a911d15e4064ab25b7695e56e943/roles/eef9dc91175240ddab345589be5010ea` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.968260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_grant(project_id=67bc0cc67d1a4bbf84a303bbb0f190d3, user_id=d8e2a911d15e4064ab25b7695e56e943, role_id=eef9dc91175240ddab345589be5010ea)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.972310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.995137 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2193/4369] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:02 2022] PUT /identity/v3/projects/67bc0cc67d1a4bbf84a303bbb0f190d3/users/d8e2a911d15e4064ab25b7695e56e943/roles/eef9dc91175240ddab345589be5010ea => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:03.000125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:03.012170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836e9a-3950-4c1d-8084-1736a3ab83cf tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:03.106803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:03.107739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:03.108032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:03.108360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/d8e2a911d15e4064ab25b7695e56e943/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:03.109661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=d8e2a911d15e4064ab25b7695e56e943)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:03.111924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:03.180981 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2177/4370] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:03:02 2022] GET /identity/v3/users/d8e2a911d15e4064ab25b7695e56e943/projects => generated 843 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:03.184809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:03.196810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640366fc-71cf-4b7d-ad7e-be78fd312c8b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:03.202680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:03.203561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:03.205773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:03.205773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/67bc0cc67d1a4bbf84a303bbb0f190d3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:03.205773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=67bc0cc67d1a4bbf84a303bbb0f190d3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:03.207271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:03.293399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bc0cc67d1a4bbf84a303bbb0f190d3', 'request_id': 'req-e9f1b248-0c06-4ffd-b770-568809c33441'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.307292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bc0cc67d1a4bbf84a303bbb0f190d3', 'request_id': 'req-e9f1b248-0c06-4ffd-b770-568809c33441'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.314820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bc0cc67d1a4bbf84a303bbb0f190d3', 'request_id': 'req-e9f1b248-0c06-4ffd-b770-568809c33441'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.335304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] The token cache is being invalidate because project 67bc0cc67d1a4bbf84a303bbb0f190d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:03.335607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.338924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.342129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2194/4371] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:03 2022] DELETE /identity/v3/projects/67bc0cc67d1a4bbf84a303bbb0f190d3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:03.345924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:03.348070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:03.380587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76493-cff7-4409-b06e-1fbcfb6aa01b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:03.390067 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:03.537840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:03.538775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:03.539065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:03.539344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/12d43c9c701b45a89cdb17dc6b968d2a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:03.541256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=12d43c9c701b45a89cdb17dc6b968d2a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:03.543238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:03.675085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d43c9c701b45a89cdb17dc6b968d2a', 'request_id': 'req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.705562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d43c9c701b45a89cdb17dc6b968d2a', 'request_id': 'req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.727472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d43c9c701b45a89cdb17dc6b968d2a', 'request_id': 'req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.757408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] The token cache is being invalidate because project 12d43c9c701b45a89cdb17dc6b968d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:03.757746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.760315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:03.762639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2178/4372] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:03 2022] DELETE /identity/v3/projects/12d43c9c701b45a89cdb17dc6b968d2a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:03.766681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:03.784470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b248-0c06-4ffd-b770-568809c33441 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:03.931627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:03.932668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:03.932979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:03.933259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/roles/eef9dc91175240ddab345589be5010ea` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:03.935523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eef9dc91175240ddab345589be5010ea)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:03.943680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:04.008983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invalidating the token cache because role eef9dc91175240ddab345589be5010ea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:04.009326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.010863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.019427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2195/4373] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:03 2022] DELETE /identity/v3/roles/eef9dc91175240ddab345589be5010ea => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:04.019830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:04.021521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:04.049838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7559c-f7e1-454b-9942-4e6857d4a8d9 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:04.178065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:04.179285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:04.179788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:04.180308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/d8e2a911d15e4064ab25b7695e56e943` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:04.182827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d8e2a911d15e4064ab25b7695e56e943)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:04.185080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:04.243680 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:04.253644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e2a911d15e4064ab25b7695e56e943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.273416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e2a911d15e4064ab25b7695e56e943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.282515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e2a911d15e4064ab25b7695e56e943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.293703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e2a911d15e4064ab25b7695e56e943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.294844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e2a911d15e4064ab25b7695e56e943'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.308451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2179/4374] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:04 2022] DELETE /identity/v3/users/d8e2a911d15e4064ab25b7695e56e943 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:04.312646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:04.314529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:04.341259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad80f28-e384-4e06-9b8d-50f48b81a4b1 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:04.391703 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:04.510107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:04.512199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:04.513967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:04.515187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/d3ba2748018c47aa9e36305de9788a0d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:04.517023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d3ba2748018c47aa9e36305de9788a0d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:04.519766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:04.595412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ba2748018c47aa9e36305de9788a0d', 'request_id': 'req-40b543c1-e762-4c57-9429-356ddc75d275'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.612317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ba2748018c47aa9e36305de9788a0d', 'request_id': 'req-40b543c1-e762-4c57-9429-356ddc75d275'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.621499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ba2748018c47aa9e36305de9788a0d', 'request_id': 'req-40b543c1-e762-4c57-9429-356ddc75d275'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.640352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] The token cache is being invalidate because project d3ba2748018c47aa9e36305de9788a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:04.640678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.641410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40b543c1-e762-4c57-9429-356ddc75d275 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.652515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:04.656549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:04.658401 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2196/4375] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:04 2022] DELETE /identity/v3/projects/d3ba2748018c47aa9e36305de9788a0d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:04.675619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9b37-43a4-40a8-a744-94bb50d5fc2a tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:04.832427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:04.833639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:04.833934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:04.834215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/598c2a3fdb014ebda74c20795b2ea0c5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:04.835678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:update_user(user_id=598c2a3fdb014ebda74c20795b2ea0c5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:04.836829 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:03:04.836829 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:03:04.836829 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:03:04.838225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:04.912415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.926179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invalidating the token cache because user 598c2a3fdb014ebda74c20795b2ea0c5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:04.926712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.929019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:04.937664 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2180/4376] 10.222.0.77 () {60 vars in 1242 bytes} [Mon Jul 11 15:03:04 2022] PATCH /identity/v3/users/598c2a3fdb014ebda74c20795b2ea0c5 => generated 296 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:04.939505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:04.939928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:04.940278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.003922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] MFA Rules not processed for user `598c2a3fdb014ebda74c20795b2ea0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:05.005279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:05.016961 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2197/4377] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:04 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:03:05.021831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:05.034263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:05.091510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d21f73-0aa9-4a39-90a1-23b30badb9a8 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:05.100961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:05.101875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.102169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.102453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/598c2a3fdb014ebda74c20795b2ea0c5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.103851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:update_user(user_id=598c2a3fdb014ebda74c20795b2ea0c5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:05.105823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:05.154059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.168315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invalidating the token cache because user 598c2a3fdb014ebda74c20795b2ea0c5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:05.170198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.171337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-98d2cf2d-4828-4b4d-8d35-120c626cb2e6 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.174272 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2181/4378] 10.222.0.77 () {60 vars in 1242 bytes} [Mon Jul 11 15:03:05 2022] PATCH /identity/v3/users/598c2a3fdb014ebda74c20795b2ea0c5 => generated 296 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:05.178126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:05.191814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c446f89-b3f5-4d75-a24b-3b1ffedda927 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:05.197187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:05.198079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.198373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.198690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/598c2a3fdb014ebda74c20795b2ea0c5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.217315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:update_user(user_id=598c2a3fdb014ebda74c20795b2ea0c5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:05.218391 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:03:05.218391 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:03:05.218391 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:03:05.219654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:05.258177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.270358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invalidating the token cache because user 598c2a3fdb014ebda74c20795b2ea0c5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:05.270747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.271651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.274391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2198/4379] 10.222.0.77 () {60 vars in 1242 bytes} [Mon Jul 11 15:03:05 2022] PATCH /identity/v3/users/598c2a3fdb014ebda74c20795b2ea0c5 => generated 296 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:05.278893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.280204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.281662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.322145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] MFA Rules not processed for user `598c2a3fdb014ebda74c20795b2ea0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:05.323678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:05.327563 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2182/4380] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:05 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:03:05.332243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:05.335544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:05.360279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce142a-8ef6-41e0-b830-6462b677a341 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:05.369609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:05.370797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.371501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.371501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/598c2a3fdb014ebda74c20795b2ea0c5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.373077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:update_user(user_id=598c2a3fdb014ebda74c20795b2ea0c5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:05.375480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:05.420618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.428731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invalidating the token cache because user 598c2a3fdb014ebda74c20795b2ea0c5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:05.429151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.430283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.432461 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2199/4381] 10.222.0.77 () {60 vars in 1242 bytes} [Mon Jul 11 15:03:05 2022] PATCH /identity/v3/users/598c2a3fdb014ebda74c20795b2ea0c5 => generated 296 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:05.437484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:05.455383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5c63-188d-4a2f-854e-72625048d59d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:05.465394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968d0c9-b028-4434-99d5-9fb7ab1ed48d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:05.465821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968d0c9-b028-4434-99d5-9fb7ab1ed48d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.466114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968d0c9-b028-4434-99d5-9fb7ab1ed48d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.466393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968d0c9-b028-4434-99d5-9fb7ab1ed48d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.468561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968d0c9-b028-4434-99d5-9fb7ab1ed48d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:05.470282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968d0c9-b028-4434-99d5-9fb7ab1ed48d tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:05.510155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2183/4382] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:03:05 2022] POST /identity/v3/users => generated 264 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:05.513631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:05.515093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:05.532565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd94e8-0904-4375-992f-db3b876e809c tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:05.539290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:05.540173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.540471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.540759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/0d01c9bcd04946f5a8edbabeb7b56780/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.563316 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=11,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:05.635747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0d01c9bcd04946f5a8edbabeb7b56780'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:05.648036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2200/4383] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:03:05 2022] POST /identity/v3/users/0d01c9bcd04946f5a8edbabeb7b56780/password => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:06.655027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:06.656048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:06.657999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:06.714045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] MFA Rules not processed for user `0d01c9bcd04946f5a8edbabeb7b56780`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:06.715704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:06.733725 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2184/4384] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:06 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:03:06.734977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:06.753450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3d0e-2ecd-4231-b846-02e5aea2cd18 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:06.772682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:06.773371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:06.773672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:06.773960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:06.789859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:06.793954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:06.811522 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2201/4385] 10.222.0.77 () {56 vars in 1262 bytes} [Mon Jul 11 15:03:06 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:03:06.815446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:06.838312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87975b2-431b-421b-8982-f80ed1575b57 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:06.848633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:06.849568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:06.849859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:06.850143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/0d01c9bcd04946f5a8edbabeb7b56780` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:06.855237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0d01c9bcd04946f5a8edbabeb7b56780)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:06.857404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:06.892077 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=8,keystone:SELECT=82,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:06.969504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d01c9bcd04946f5a8edbabeb7b56780'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:06.993350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d01c9bcd04946f5a8edbabeb7b56780'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.006873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d01c9bcd04946f5a8edbabeb7b56780'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.018187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d01c9bcd04946f5a8edbabeb7b56780'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.019226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d01c9bcd04946f5a8edbabeb7b56780'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.035298 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2185/4386] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:06 2022] DELETE /identity/v3/users/0d01c9bcd04946f5a8edbabeb7b56780 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:07.036582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:07.068904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80185d7-91ce-41b1-b749-5230d8611a3b tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:07.251476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:07.252197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:07.253309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:07.253609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:07.254354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:07.257697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:07.345796 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2202/4387] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:07 2022] POST /identity/v3/users => generated 367 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:03:07.348790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:07.352542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:07.380083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1d52-2811-4bce-8503-b0fe6ae7e7db tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:07.386199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:07.387883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:07.388821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:07.389369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:07.390407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:07.392923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:07.446630 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2186/4388] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:07 2022] POST /identity/v3/projects => generated 360 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:07.452765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:07.471398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03550795-b4da-4b22-b89f-e9dd2c81dd10 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:07.563694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:07.569844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:07.570434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:07.570986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/790b189fb57d4044a4d9aa806a8a0562` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:07.590064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:update_user(user_id=790b189fb57d4044a4d9aa806a8a0562)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:07.592768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:07.643496 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2203/4389] 10.222.0.77 () {60 vars in 1243 bytes} [Mon Jul 11 15:03:07 2022] PATCH /identity/v3/users/790b189fb57d4044a4d9aa806a8a0562 => generated 523 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:07.643822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:07.657161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dcbff-d04a-43fe-8845-1cd3fa9a1b90 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:07.670627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:07.673944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:07.674587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:07.675154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/790b189fb57d4044a4d9aa806a8a0562` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:07.698115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:get_user(user_id=790b189fb57d4044a4d9aa806a8a0562)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:07.701475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:07.704053 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2187/4390] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:03:07 2022] GET /identity/v3/users/790b189fb57d4044a4d9aa806a8a0562 => generated 389 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:03:07.708447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:07.727914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400711-67ce-426f-8766-be0fae68f410 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:07.744226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:07.745980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:07.746693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:07.747535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/projects/3d2872dc943e4a2a9a180a1ec42017a6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:07.749537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d2872dc943e4a2a9a180a1ec42017a6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:07.752220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:07.776968 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:07.836758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2872dc943e4a2a9a180a1ec42017a6', 'request_id': 'req-107d34e5-61be-4f72-bfe4-e172db46b750'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.860584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2872dc943e4a2a9a180a1ec42017a6', 'request_id': 'req-107d34e5-61be-4f72-bfe4-e172db46b750'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.877234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2872dc943e4a2a9a180a1ec42017a6', 'request_id': 'req-107d34e5-61be-4f72-bfe4-e172db46b750'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.903302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] The token cache is being invalidate because project 3d2872dc943e4a2a9a180a1ec42017a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:07.903739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.904685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:07.909667 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2204/4391] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:07 2022] DELETE /identity/v3/projects/3d2872dc943e4a2a9a180a1ec42017a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:07.910959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:07.913678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:07.940470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862218a-5f84-44ee-b9ad-673bd717c8e0 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:08.152700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb536ff552fa4fc89385a973ec341475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a8b45dbfa94d87b2bb3a480ef633c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:08.155123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:08.155696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:08.156270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] PATH_INFO: `/v3/users/790b189fb57d4044a4d9aa806a8a0562` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:08.173434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=790b189fb57d4044a4d9aa806a8a0562)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:08.179009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:08.297553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790b189fb57d4044a4d9aa806a8a0562'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.317164 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:08.332048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790b189fb57d4044a4d9aa806a8a0562'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.351567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790b189fb57d4044a4d9aa806a8a0562'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.368672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790b189fb57d4044a4d9aa806a8a0562'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.370258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e1e0fe72-6f56-4975-b480-3a7a868eb171 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790b189fb57d4044a4d9aa806a8a0562'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.392567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2188/4392] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:07 2022] DELETE /identity/v3/users/790b189fb57d4044a4d9aa806a8a0562 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:08.393868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:08.398381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:08.582247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d34e5-61be-4f72-bfe4-e172db46b750 tempest-UsersV3TestJSON-196357654 tempest-UsersV3TestJSON-196357654-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:08.689963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:08.691598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:08.691897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:08.692182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] PATH_INFO: `/v3/users/598c2a3fdb014ebda74c20795b2ea0c5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:08.723185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598c2a3fdb014ebda74c20795b2ea0c5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:08.725412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:08.803843 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:08.819879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.820498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.862333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.863989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.873698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598c2a3fdb014ebda74c20795b2ea0c5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.893233 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2205/4393] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:08 2022] DELETE /identity/v3/users/598c2a3fdb014ebda74c20795b2ea0c5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:08.899893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:08.900507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:08.900507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:08.925946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:08.927806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.030278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2189/4394] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:09.059704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.062602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.066016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.067567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.186200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d149-7723-4857-8548-05dc9dfc5349 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.199589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84034b-e999-4248-9f6c-87723e8e6888 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.200699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.201570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.202919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.203400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.205726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.210545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.211332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.211696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.212385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.226153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.228206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bba9f-27ee-45f4-9f1a-560db95341f2 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.232466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.233940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.248610 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2206/4395] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:09.249885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.250189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.250476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.257467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2190/4396] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:03:09.326833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] MFA Rules not processed for user `72be490a451b45eaa4879340a06b51f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:09.328100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.461245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2207/4397] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:09.466006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.467491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.487367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff66070-e418-4fac-8cc8-f9afc29e12e8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.507027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.508921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.509231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.509527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.510254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.512225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.563836 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2191/4398] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:09 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:09.565604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.581437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9c5a-7e4a-45ff-bfa4-c2735fc3d727 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.639441 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:09.709496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.710589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.711117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.711614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.712548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.714814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.751577 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2208/4399] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:09 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:09.757123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.779033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f81df-8964-413e-9681-6e39315478b7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.788067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.789257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.789556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.790675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.791460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.794218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.808582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2192/4400] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:09.813943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.829850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845692-8447-4293-841b-9d8094e07a37 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.844752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.848362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.849569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.850081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] PATH_INFO: `/v3/projects/a13cbd01fad94de3a41f0f1176cc8fb2/users/1df08e1a2bce4873a2df8b676f4290b4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.897219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13cbd01fad94de3a41f0f1176cc8fb2, user_id=1df08e1a2bce4873a2df8b676f4290b4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.900369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.928604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2209/4401] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:09 2022] PUT /identity/v3/projects/a13cbd01fad94de3a41f0f1176cc8fb2/users/1df08e1a2bce4873a2df8b676f4290b4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:09.934234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.963252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ab0d-bc99-4e28-ad28-21782c44424a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.975792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:09.979691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:10.047844 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:10.078309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:10.079212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:10.079575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:10.080030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:10.081101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:10.083425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:10.107981 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2193/4402] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:10.108891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:10.140680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197c35-f1a0-4862-bdbe-deaf30089dd8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:10.154575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:10.155654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:10.155793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cbb87-fee9-4bd9-ba82-ac0cb3551f99 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:10.157379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:10.157673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] PATH_INFO: `/v3/projects/a13cbd01fad94de3a41f0f1176cc8fb2/users/1df08e1a2bce4873a2df8b676f4290b4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:10.162954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13cbd01fad94de3a41f0f1176cc8fb2, user_id=1df08e1a2bce4873a2df8b676f4290b4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:10.165663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:10.168741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:10.170251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:10.170816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:10.171355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] PATH_INFO: `/v3/projects/ff9f7b3fe95048f7a6c6d172e072d238` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:10.172866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9f7b3fe95048f7a6c6d172e072d238)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:10.175807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:10.192198 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2194/4403] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:10 2022] PUT /identity/v3/projects/a13cbd01fad94de3a41f0f1176cc8fb2/users/1df08e1a2bce4873a2df8b676f4290b4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:10.324872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9f7b3fe95048f7a6c6d172e072d238', 'request_id': 'req-4088aa4b-0498-46df-8763-4664e6af9401'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.349467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9f7b3fe95048f7a6c6d172e072d238', 'request_id': 'req-4088aa4b-0498-46df-8763-4664e6af9401'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.366467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9f7b3fe95048f7a6c6d172e072d238', 'request_id': 'req-4088aa4b-0498-46df-8763-4664e6af9401'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.396840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] The token cache is being invalidate because project ff9f7b3fe95048f7a6c6d172e072d238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:10.397143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.399033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.405930 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2210/4404] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:09 2022] DELETE /identity/v3/projects/ff9f7b3fe95048f7a6c6d172e072d238 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:10.409793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:10.412321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:10.612145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b36c-08da-401e-a511-1f60d8d2b9b2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:10.805063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:10.810683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:10.811243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:10.811745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] PATH_INFO: `/v3/users/bb536ff552fa4fc89385a973ec341475` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:10.819498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb536ff552fa4fc89385a973ec341475)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:10.822482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:10.931465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb536ff552fa4fc89385a973ec341475'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.962155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb536ff552fa4fc89385a973ec341475'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.986058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb536ff552fa4fc89385a973ec341475'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:10.996218 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:11.011367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb536ff552fa4fc89385a973ec341475'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:11.012450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ec2782e6-273d-480b-a2e8-6a5c76470586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb536ff552fa4fc89385a973ec341475'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:11.029659 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2195/4405] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:10 2022] DELETE /identity/v3/users/bb536ff552fa4fc89385a973ec341475 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:11.817510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:11.832770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088aa4b-0498-46df-8763-4664e6af9401 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:11.939829 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:12.092661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:12.094326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:12.095288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:12.095673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] PATH_INFO: `/v3/projects/32a8b45dbfa94d87b2bb3a480ef633c8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:12.101506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a8b45dbfa94d87b2bb3a480ef633c8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:12.103729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:12.251926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a8b45dbfa94d87b2bb3a480ef633c8', 'request_id': 'req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:12.273016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a8b45dbfa94d87b2bb3a480ef633c8', 'request_id': 'req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:12.294052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a8b45dbfa94d87b2bb3a480ef633c8', 'request_id': 'req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:12.333057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] The token cache is being invalidate because project 32a8b45dbfa94d87b2bb3a480ef633c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:12.334732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:12.335061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fba3ff9b-47cc-4dc6-a3e5-775a7d8c24c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:12.357240 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2211/4406] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:11 2022] DELETE /identity/v3/projects/32a8b45dbfa94d87b2bb3a480ef633c8 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:12.358824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:12.359313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:12.359428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:12.402624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:12.404145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:12.567317 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2196/4407] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:12.576735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:12.576735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:12.577099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:12.623112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:12.624982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:12.642968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:12.664262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2212/4408] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:12.665491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d8cd6-d973-4556-8b8b-7a6ce62e988a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:12.672211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:12.675978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:12.676769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:12.677280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:12.678226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:12.678729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:12.680727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:12.701378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2197/4409] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:12.703176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:12.717250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e02fd-7719-469c-8c77-e56eed4bf440 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:12.722488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:12.723493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:12.724302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:12.724765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:12.726895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:12.730088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:12.786088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:12.786722 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2213/4410] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:12 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:12.806048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda79b2-4ebb-4a79-bdfb-63fa73f05653 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.040436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.041277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.041668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.042032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.042869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.047166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:13.117544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2198/4411] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:12 2022] POST /identity/v3/users => generated 286 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:13.118430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:13.140032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6492-2d59-41e6-8f9d-1f64bb17bbec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.153980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.154860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.155214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.156463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.157791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.159630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:13.177676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2214/4412] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:13.179714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:13.201057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b9666-2552-40c3-a546-dee51b757150 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.206464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd8b40-4efa-455b-a390-764952139105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.207314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8b40-4efa-455b-a390-764952139105 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.207666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8b40-4efa-455b-a390-764952139105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.208701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8b40-4efa-455b-a390-764952139105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.212311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd8b40-4efa-455b-a390-764952139105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.214137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd8b40-4efa-455b-a390-764952139105 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:13.234540 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2199/4413] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:13.236421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:13.255063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323849-1500-4ff6-b074-5e1638ee0035 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.262238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.263960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.264325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.264889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] PATH_INFO: `/v3/projects/a4bd247b71e64ba48bb70ee185a3cd2a/users/09548a538d8e490a840442141e9ff2ec/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.315405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bd247b71e64ba48bb70ee185a3cd2a, user_id=09548a538d8e490a840442141e9ff2ec, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.318359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:13.369656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2215/4414] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:13 2022] PUT /identity/v3/projects/a4bd247b71e64ba48bb70ee185a3cd2a/users/09548a538d8e490a840442141e9ff2ec/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:13.386131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.386789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.386789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.475379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] MFA Rules not processed for user `09548a538d8e490a840442141e9ff2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:13.476847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:13.563588 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:13.622586 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2200/4415] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:13.625846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:13.657632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d520b-c578-40fb-a9ab-d42c42e453b7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.663726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.666588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.667784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.668180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.679066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:create_application_credential(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.680609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:13.785459 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:13.834538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:13.841060 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2216/4416] 10.222.0.77 () {60 vars in 1314 bytes} [Mon Jul 11 15:03:13 2022] POST /identity/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials => generated 920 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:13.848461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309528f-b8dd-4836-adf9-2666bd88d82c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.858307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.859308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.859600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.859885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules/a8d397e031ee4d97a36277ff061ee2e1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.862337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:delete_access_rule(user_id=09548a538d8e490a840442141e9ff2ec, access_rule_id=a8d397e031ee4d97a36277ff061ee2e1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.865330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application session.delete(ref) Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application yield resource Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:03:13.932855 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise self.value Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application session.commit() Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:03:13.934161 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._synchronize( Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise AssertionError( Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 11 15:03:13.935793 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:13.937041 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:03:13.939428 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2201/4417] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Jul 11 15:03:13 2022] DELETE /identity/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules/a8d397e031ee4d97a36277ff061ee2e1 => generated 89 bytes in 101 msecs (HTTP/1.1 403) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:03:13.943929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:13.961792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6953-75fc-4eae-9e78-ad4cd0bd38e0 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:13.974087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:13.975294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:13.979731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:13.979731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials/2308bedfe907458288ca51b402444182` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:13.994210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:delete_application_credential(user_id=09548a538d8e490a840442141e9ff2ec, application_credential_id=2308bedfe907458288ca51b402444182)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:13.996049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.040216 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2217/4418] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:13 2022] DELETE /identity/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials/2308bedfe907458288ca51b402444182 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:14.043493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.058833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd8b98-19f4-4307-bfcd-34b872821a11 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.075716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.076839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.077302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.077754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.079638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:list_access_rules(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.082037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.089651 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2202/4419] 10.222.0.77 () {58 vars in 1259 bytes} [Mon Jul 11 15:03:14 2022] GET /identity/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:03:14.093300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.112875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667b76-9182-4c68-b712-4465e84067bc tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.129572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.133760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.134641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.134933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules/a8d397e031ee4d97a36277ff061ee2e1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.137004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:delete_access_rule(user_id=09548a538d8e490a840442141e9ff2ec, access_rule_id=a8d397e031ee4d97a36277ff061ee2e1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.148261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.200329 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2218/4420] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Jul 11 15:03:14 2022] DELETE /identity/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules/a8d397e031ee4d97a36277ff061ee2e1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:14.204055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.221558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e060e-73a2-4023-864d-3289b3d32f34 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.236983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.237958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.238260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.240121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.242593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:list_access_rules(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.244109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.259780 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2203/4421] 10.222.0.77 () {58 vars in 1259 bytes} [Mon Jul 11 15:03:14 2022] GET /identity/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules => generated 158 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:14.267726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.280464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cf23-df21-4469-b442-3522a88637a1 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.288088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.289181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.289561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.289925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.290829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:create_application_credential(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.292952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.476129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.487793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2219/4422] 10.222.0.77 () {60 vars in 1314 bytes} [Mon Jul 11 15:03:14 2022] POST /identity/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials => generated 921 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:14.497015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980a6e-b5e0-4ac7-a744-6e39162a9321 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.507201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.508394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.510899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.511829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.515500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:list_access_rules(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.517200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.524175 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2204/4423] 10.222.0.77 () {58 vars in 1259 bytes} [Mon Jul 11 15:03:14 2022] GET /identity/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:14.529796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.541266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7333a5f-7260-4fea-86d4-e7fceec7a8e9 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.546636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.547961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.548355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.548740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.549838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:create_application_credential(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.551272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.677457 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=11,keystone:SELECT=85,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:14.691384 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2220/4424] 10.222.0.77 () {60 vars in 1314 bytes} [Mon Jul 11 15:03:14 2022] POST /identity/v3/users/09548a538d8e490a840442141e9ff2ec/application_credentials => generated 921 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:14.694572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.705451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b51e8-90f4-4869-bae6-d08b84bf706e tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.710692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655477b5-e52f-4c4e-a15f-c500d3016edb tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09548a538d8e490a840442141e9ff2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.718884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655477b5-e52f-4c4e-a15f-c500d3016edb tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.720162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655477b5-e52f-4c4e-a15f-c500d3016edb tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.720688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655477b5-e52f-4c4e-a15f-c500d3016edb tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules/33d33f7c961d4b8897ce38efc68e752e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.726240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655477b5-e52f-4c4e-a15f-c500d3016edb tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorizing `identity:get_access_rule(user_id=09548a538d8e490a840442141e9ff2ec, access_rule_id=33d33f7c961d4b8897ce38efc68e752e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.729952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655477b5-e52f-4c4e-a15f-c500d3016edb tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:14.750792 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2205/4425] 10.222.0.77 () {58 vars in 1358 bytes} [Mon Jul 11 15:03:14 2022] GET /identity/v3/users/09548a538d8e490a840442141e9ff2ec/access_rules/33d33f7c961d4b8897ce38efc68e752e => generated 229 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:14.755816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:14.920113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746ff3-2329-4cf1-bb52-0633c9d26ea4 tempest-AccessRulesV3Test-1761646097 tempest-AccessRulesV3Test-1761646097-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:14.931134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:14.932128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:14.932324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:14.932611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] PATH_INFO: `/v3/users/09548a538d8e490a840442141e9ff2ec` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:14.934455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=09548a538d8e490a840442141e9ff2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:14.936428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:15.072725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09548a538d8e490a840442141e9ff2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:15.073428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09548a538d8e490a840442141e9ff2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:15.139714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09548a538d8e490a840442141e9ff2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:15.139714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09548a538d8e490a840442141e9ff2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:15.152204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09548a538d8e490a840442141e9ff2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:15.186568 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2221/4426] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:14 2022] DELETE /identity/v3/users/09548a538d8e490a840442141e9ff2ec => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:15.189954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:15.190251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:15.190615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:15.217392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:15.219769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:15.365871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2206/4427] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:15.379178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:15.381246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:15.516559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbd9b9-b892-4514-ae65-4c52170ddaab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:15.520863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7a2ee-5ad6-4e16-8d4b-eb27a819f2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:15.521812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7a2ee-5ad6-4e16-8d4b-eb27a819f2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:15.522096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7a2ee-5ad6-4e16-8d4b-eb27a819f2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:15.522382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7a2ee-5ad6-4e16-8d4b-eb27a819f2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:15.537943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7a2ee-5ad6-4e16-8d4b-eb27a819f2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:15.540022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7a2ee-5ad6-4e16-8d4b-eb27a819f2e8 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:15.545184 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:15.554966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2222/4428] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:16.405549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:16.407181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:16.442237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4448-3d24-4549-bb31-8ac0331acca8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:16.455591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:16.457947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:16.459218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:16.459514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] PATH_INFO: `/v3/projects/a4bd247b71e64ba48bb70ee185a3cd2a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:16.464098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bd247b71e64ba48bb70ee185a3cd2a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:16.469344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:16.567501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'request_id': 'req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:16.577687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'request_id': 'req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:16.588420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bd247b71e64ba48bb70ee185a3cd2a', 'request_id': 'req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:16.625671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] The token cache is being invalidate because project a4bd247b71e64ba48bb70ee185a3cd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:16.626127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:16.627398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c1bddbf1-83f0-4291-bca5-a43d1be0d0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:16.629384 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2207/4429] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:16 2022] DELETE /identity/v3/projects/a4bd247b71e64ba48bb70ee185a3cd2a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:16.634457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:16.635014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:16.635014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:16.671574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:16.673616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:16.784781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2223/4430] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:16.785449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:16.785757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:16.786054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:16.823852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:16.825397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:16.866625 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2208/4431] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:16.871870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:16.886316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f718c92-4e0e-4a38-bea5-75f5086903f1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:16.898477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:16.899302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:16.899744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:16.900034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:16.900774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:16.901203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:16.902852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:16.935680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2224/4432] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:16.936745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:16.949073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a084-1267-465c-875e-941c67e81ee2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:16.973958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:16.974679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:16.974968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:16.975246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:16.975960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:16.977885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.023687 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:17.033701 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2209/4433] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:16 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:17.037750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:17.072094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303518d-8c2f-47a7-8c83-7d02ad5076e8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:17.273171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:17.274321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.274321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.274618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.275135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:17.277044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.313599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:17.326063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2225/4434] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:17 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:17.329065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff57a3-e2b6-4144-a886-4ad8274d7355 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:17.335237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:17.336602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.336899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.337182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.337924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:17.341514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.369734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:17.370140 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2210/4435] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:03:17.382632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ede4-d3ee-450f-9d6a-00033834fbca admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:17.389542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d591-60ef-461c-9f5f-73628199b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:17.390220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d591-60ef-461c-9f5f-73628199b89b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.390586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d591-60ef-461c-9f5f-73628199b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.390931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d591-60ef-461c-9f5f-73628199b89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.392290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d591-60ef-461c-9f5f-73628199b89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:17.395170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d591-60ef-461c-9f5f-73628199b89b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.416324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:17.428479 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2226/4436] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:17.432518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaacbf-f158-4e89-b0e9-2c2d4c61e43b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:17.440073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:17.441259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.441727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.442178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] PATH_INFO: `/v3/projects/fc6ee7b43ba5455195be2bd9305f74a9/users/36fd12ba452a484199c8d71babefc73f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.462218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6ee7b43ba5455195be2bd9305f74a9, user_id=36fd12ba452a484199c8d71babefc73f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:17.465784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.486127 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2211/4437] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:17 2022] PUT /identity/v3/projects/fc6ee7b43ba5455195be2bd9305f74a9/users/36fd12ba452a484199c8d71babefc73f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:17.498772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.499547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.499547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.551566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] MFA Rules not processed for user `36fd12ba452a484199c8d71babefc73f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:17.554326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:17.668608 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:17.704117 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2227/4438] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:17.704717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:17.719685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dba330-b24f-47d1-a496-08c038a87170 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:17.731746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5fb61-51d9-4558-87b4-939f030cc671 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:17.732592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5fb61-51d9-4558-87b4-939f030cc671 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.732780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5fb61-51d9-4558-87b4-939f030cc671 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.733068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5fb61-51d9-4558-87b4-939f030cc671 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.733834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5fb61-51d9-4558-87b4-939f030cc671 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:17.735143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5fb61-51d9-4558-87b4-939f030cc671 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.904643 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2212/4439] 10.222.0.77 () {60 vars in 1313 bytes} [Mon Jul 11 15:03:17 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 788 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:17.907626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:17.921033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678f64e-3682-49fa-a82f-45f45fcef9e0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:17.927682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:17.929130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.929657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.930183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/7048817096e94d96b77827a544ef8912` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.941895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:get_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=7048817096e94d96b77827a544ef8912)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:17.944851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:17.951456 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2228/4440] 10.222.0.77 () {58 vars in 1391 bytes} [Mon Jul 11 15:03:17 2022] GET /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/7048817096e94d96b77827a544ef8912 => generated 688 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:17.952813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:17.953118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:17.953474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:17.969382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] MFA Rules not processed for user `36fd12ba452a484199c8d71babefc73f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:17.970767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:18.224317 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2213/4441] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:17 2022] POST /identity/v3/auth/tokens => generated 3414 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 11 15:03:18.229270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:18.257993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049739-8bb2-4db4-a402-09a6bf875ef7 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:18.269593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:18.272209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:18.272209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:18.272509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/7048817096e94d96b77827a544ef8912` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:18.276764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=7048817096e94d96b77827a544ef8912)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:18.292190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:18.358742 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2229/4442] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:18 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/7048817096e94d96b77827a544ef8912 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:18.359320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:18.373033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc38f16-41f1-43a3-93f9-a7949863b783 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:18.384790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:18.385787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:18.386144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:18.386500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:18.387367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:18.389823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:18.419977 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:18.644193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:18.655252 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2214/4443] 10.222.0.77 () {60 vars in 1314 bytes} [Mon Jul 11 15:03:18 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 920 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:18.658015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f7d6-9dbf-4e5c-b858-46f353589957 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:18.669113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:18.671306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:18.671603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:18.671889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/4f30794235c246ea901b3e7933ee423e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:18.698444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=4f30794235c246ea901b3e7933ee423e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:18.704632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:18.749363 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2230/4444] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:18 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/4f30794235c246ea901b3e7933ee423e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:18.754449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:18.770163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3eba-2c44-4de7-8bc4-37fdbfb4f17d tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:18.785671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:18.786649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:18.786950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:18.787224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:18.787988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:18.789195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:18.935328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2215/4445] 10.222.0.77 () {60 vars in 1314 bytes} [Mon Jul 11 15:03:18 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 813 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:18.938647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:18.954818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0c1a0-5842-4e3d-bc21-6fb320b80375 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:18.973302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:18.974340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:18.974650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:18.974933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/58f7a7ebe6de4eeb820faecbfd0defeb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:18.990150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=58f7a7ebe6de4eeb820faecbfd0defeb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:18.991769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.037523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2231/4446] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:18 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/58f7a7ebe6de4eeb820faecbfd0defeb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:19.042614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.078423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462b3d9-2d20-435a-9b65-b9323362bbef tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.084159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.085440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.085837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.086256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.087314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.089555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.224865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.229911 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2216/4447] 10.222.0.77 () {60 vars in 1313 bytes} [Mon Jul 11 15:03:19 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 788 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:19.236401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0527-3e67-4e73-8496-6635a0b8ec88 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.248844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.249790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.250139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.250400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.251209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.252455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.406128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.407180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2232/4448] 10.222.0.77 () {60 vars in 1313 bytes} [Mon Jul 11 15:03:19 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 789 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:19.417805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31462a-8502-4d2e-b282-cd636fc311fc tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.422777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.423752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.424105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.424448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.425269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:list_application_credentials(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.427587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.447855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.459507 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2217/4449] 10.222.0.77 () {58 vars in 1292 bytes} [Mon Jul 11 15:03:19 2022] GET /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 1501 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:19.461321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a27d1-8530-4bae-a1c6-023579ce1b8f tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.470668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.471804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.472161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.472553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/8c38e38f2bbe4eac9ab244894c2f1888` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.484258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=8c38e38f2bbe4eac9ab244894c2f1888)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.486228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.517285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.527965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2233/4450] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:19 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/8c38e38f2bbe4eac9ab244894c2f1888 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:19.529422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02846c-0e54-4c2a-ab7a-0f5fa31082d4 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.538095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.540278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.540830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.541998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/fd5ca542a6e74072b4de73227596ff5f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.551269 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:19.558290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=fd5ca542a6e74072b4de73227596ff5f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.562173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.592262 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2218/4451] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:19 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/fd5ca542a6e74072b4de73227596ff5f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:19.593551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.605058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1c93d-9b86-48b3-bd47-3dcef3c2cc13 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.611654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.613402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.613700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.613985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.615750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.617486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.636118 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:19.739569 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2234/4452] 10.222.0.77 () {60 vars in 1313 bytes} [Mon Jul 11 15:03:19 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 788 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:19.741555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.752853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f27bf6-8df2-4646-b994-f43434ec340e tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.759223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.760974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.761340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.761699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.762579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:create_application_credential(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.763828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.890917 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2219/4453] 10.222.0.77 () {60 vars in 1313 bytes} [Mon Jul 11 15:03:19 2022] POST /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials => generated 789 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:19.895090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.913344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d841404-a537-4578-9ef8-0f26aedf0b7b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.918145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.919176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.919467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.919754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.920545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Adding query filter params (name=tempest-application_credential-1539701693) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:19.920909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:list_application_credentials(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.922718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:19.938065 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2235/4454] 10.222.0.77 () {58 vars in 1385 bytes} [Mon Jul 11 15:03:19 2022] GET /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials?name=tempest-application_credential-1539701693 => generated 887 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:19.942057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:19.961558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b7f0c-1fdc-4840-9289-3d7832dd5cb3 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:19.972920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:19.974407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:19.974996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:19.975510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/3f7187a7a6d842ddab66da8531e10bbe` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:19.993635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=3f7187a7a6d842ddab66da8531e10bbe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:19.995825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:20.035105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2220/4455] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:19 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/3f7187a7a6d842ddab66da8531e10bbe => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:20.038313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:20.082959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d47d14-0f5a-4f80-bf86-958fdb1ba2b8 tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:20.099441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117329-9b1b-42b8-adaa-71364cb021ba tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fd12ba452a484199c8d71babefc73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6ee7b43ba5455195be2bd9305f74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:20.100541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117329-9b1b-42b8-adaa-71364cb021ba tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:20.100906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117329-9b1b-42b8-adaa-71364cb021ba tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:20.101287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117329-9b1b-42b8-adaa-71364cb021ba tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/4e8aa715ff7e4c74a7a77eca5ace5218` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:20.112758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae117329-9b1b-42b8-adaa-71364cb021ba tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorizing `identity:delete_application_credential(user_id=36fd12ba452a484199c8d71babefc73f, application_credential_id=4e8aa715ff7e4c74a7a77eca5ace5218)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:20.114606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae117329-9b1b-42b8-adaa-71364cb021ba tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:20.147475 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2236/4456] 10.222.0.77 () {58 vars in 1394 bytes} [Mon Jul 11 15:03:20 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f/application_credentials/4e8aa715ff7e4c74a7a77eca5ace5218 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:20.148882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:20.251440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae04310-f1eb-4922-9696-426fd70b440b tempest-ApplicationCredentialsV3Test-767418791 tempest-ApplicationCredentialsV3Test-767418791-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:20.260524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:20.263640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:20.265257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:20.265601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] PATH_INFO: `/v3/users/36fd12ba452a484199c8d71babefc73f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:20.267226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fd12ba452a484199c8d71babefc73f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:20.276653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:20.402753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fd12ba452a484199c8d71babefc73f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:20.405546 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:20.453382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fd12ba452a484199c8d71babefc73f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:20.490288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fd12ba452a484199c8d71babefc73f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:20.522856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fd12ba452a484199c8d71babefc73f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:20.524817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fd12ba452a484199c8d71babefc73f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:20.533993 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2221/4457] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:20 2022] DELETE /identity/v3/users/36fd12ba452a484199c8d71babefc73f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:20.538724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e50e0-5826-4686-a5a7-4bb613a51589 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:20.539089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e50e0-5826-4686-a5a7-4bb613a51589 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:20.539437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e50e0-5826-4686-a5a7-4bb613a51589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:20.584226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-288e50e0-5826-4686-a5a7-4bb613a51589 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:20.590314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-288e50e0-5826-4686-a5a7-4bb613a51589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:20.764744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2237/4458] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:20.796851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:20.799756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:20.857152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:20.858018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:20.859025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:20.923432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] MFA Rules not processed for user `1df08e1a2bce4873a2df8b676f4290b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:20.925174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:20.926611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d1550-77b3-4af8-a7d4-16e85f162e41 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:20.954332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:20.954332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:20.954332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:20.954332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:20.996403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:21.002482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:21.034801 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:21.042191 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2222/4459] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:21.100448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:21.102220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:21.110314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2238/4460] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:21.205765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66e04-3129-4687-b71e-eae7104d965e service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:21.211125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:21.211787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:21.212076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:21.212356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:21.214437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:21.291947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:21.293672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236363f-42cf-4684-b040-26ca6a914ebb service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:21.309553 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2223/4461] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:03:21.511411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:21.513084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:21.546829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75dd52-6bf1-4219-adeb-6e69b947f93c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:21.552986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:21.555126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:21.555515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:21.555908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] PATH_INFO: `/v3/projects/fc6ee7b43ba5455195be2bd9305f74a9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:21.561198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6ee7b43ba5455195be2bd9305f74a9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:21.567937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:21.700194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6ee7b43ba5455195be2bd9305f74a9', 'request_id': 'req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:21.726803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6ee7b43ba5455195be2bd9305f74a9', 'request_id': 'req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:21.740316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6ee7b43ba5455195be2bd9305f74a9', 'request_id': 'req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:21.774869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] The token cache is being invalidate because project fc6ee7b43ba5455195be2bd9305f74a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:21.775393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:21.776631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0d0a4b8-9b72-4253-81ac-deabc00ff4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:21.779379 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2239/4462] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:21 2022] DELETE /identity/v3/projects/fc6ee7b43ba5455195be2bd9305f74a9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:21.783987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:21.784486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:21.784620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:21.819577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:21.820833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:21.854585 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:21.990539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2224/4463] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:21.999111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:21.999512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:21.999813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.037284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:22.039574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:22.068923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2240/4464] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:22.073192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:22.092209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29600-d1c3-49d7-b7cb-2ed3d5630b4e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:22.103740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:22.104627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.104942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.105259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.106306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:22.106706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:22.108444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:22.130819 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2225/4465] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:22.132657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:22.168485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944ec5-351a-4102-9b46-8a26c74a0b61 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:22.203160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:22.203852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.204142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.204427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.205155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:22.208331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:22.311411 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2241/4466] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:22 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:22.316066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:22.352690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8ec90-2fd6-416a-91e8-4203739cab39 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:22.446977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:22.447673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.448004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.448284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.449050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:22.451778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:22.480616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2226/4467] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:22 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:22.484608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:22.507683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35203b-5fd4-48da-b1f2-66b49681ea78 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:22.519357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:22.523076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.524210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.524741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.526682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:22.531897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:22.593514 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2242/4468] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:22.593738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:22.606939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4395f9b-4e54-48bc-a81c-01a6c5625b60 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:22.622830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d4549-4e6e-43f5-ba62-c236b98430d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:22.625014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d4549-4e6e-43f5-ba62-c236b98430d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.626618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d4549-4e6e-43f5-ba62-c236b98430d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.626985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d4549-4e6e-43f5-ba62-c236b98430d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.628680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d4549-4e6e-43f5-ba62-c236b98430d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:22.633670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d4549-4e6e-43f5-ba62-c236b98430d3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:22.666073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2227/4469] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:03:22.667258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:22.682486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2db555-4ab9-41d0-a2f9-b093c8ce5614 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:22.690357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:22.691555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.692021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.692495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] PATH_INFO: `/v3/projects/813b6b20384848d98ed2572f646d4527/users/1a3dd36a000b405699800b3ab67433da/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.734736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813b6b20384848d98ed2572f646d4527, user_id=1a3dd36a000b405699800b3ab67433da, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:22.765152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:22.796539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2243/4470] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:22 2022] PUT /identity/v3/projects/813b6b20384848d98ed2572f646d4527/users/1a3dd36a000b405699800b3ab67433da/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:22.806873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:22.807338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:22.807624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:22.838025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] MFA Rules not processed for user `1a3dd36a000b405699800b3ab67433da`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:22.839890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:22.980057 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2228/4471] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:22.987923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:23.132378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec0d1b-f8d9-4ac8-881e-dedda3702850 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:23.137770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:23.138455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:23.138923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:23.139206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:23.140192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:23.142297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:23.166055 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:23.188928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:23.197211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2244/4472] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:22 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:23.202118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0389-1b7b-4041-ae1a-0091a756d703 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:23.221565 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:23.321068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:23.323402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:23.323908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:23.324941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:23.325857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:23.328460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:23.359323 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2229/4473] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:23 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:23.363253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:23.403590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650c00-0c18-4692-9b13-4b99f9e8b416 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:23.419753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:23.423065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:23.424724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:23.425065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:23.430167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:23.431872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:23.475346 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2245/4474] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:23.477657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:23.499442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56d824-8e65-4184-8e52-e685b71d34ce admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:23.510647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298870e2-9ddc-4198-8470-c66994cafd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:23.511331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298870e2-9ddc-4198-8470-c66994cafd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:23.511623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298870e2-9ddc-4198-8470-c66994cafd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:23.511901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298870e2-9ddc-4198-8470-c66994cafd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:23.512643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298870e2-9ddc-4198-8470-c66994cafd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:23.514243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298870e2-9ddc-4198-8470-c66994cafd80 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:23.554700 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2230/4475] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:23.558911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:23.574958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae932-ce36-408c-bf7b-ddbd52432406 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:23.598085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:23.600931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:23.607425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:23.607926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] PATH_INFO: `/v3/projects/5f5def0c4eb245e4897a5292a57487ac/users/9b5f371a56a04798bdd4f82401b6290f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:23.662000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5def0c4eb245e4897a5292a57487ac, user_id=9b5f371a56a04798bdd4f82401b6290f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:23.680447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:23.711913 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2246/4476] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:23 2022] PUT /identity/v3/projects/5f5def0c4eb245e4897a5292a57487ac/users/9b5f371a56a04798bdd4f82401b6290f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:23.722748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9312bef-6268-4764-b366-fe5cc566bad1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:23.723063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9312bef-6268-4764-b366-fe5cc566bad1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:23.723860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9312bef-6268-4764-b366-fe5cc566bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:23.782020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c9312bef-6268-4764-b366-fe5cc566bad1 None None] MFA Rules not processed for user `9b5f371a56a04798bdd4f82401b6290f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:23.783301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c9312bef-6268-4764-b366-fe5cc566bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:23.907468 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2231/4477] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:23.908762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:24.142806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418c1f-d444-47ae-9a40-3972b4a7923e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:24.158896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb93179-a5b2-400d-9751-50c224b86ef8 tempest-IdentityV3ProjectsTest-507409329 tempest-IdentityV3ProjectsTest-507409329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3dd36a000b405699800b3ab67433da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813b6b20384848d98ed2572f646d4527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:24.159776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93179-a5b2-400d-9751-50c224b86ef8 tempest-IdentityV3ProjectsTest-507409329 tempest-IdentityV3ProjectsTest-507409329-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:24.160007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93179-a5b2-400d-9751-50c224b86ef8 tempest-IdentityV3ProjectsTest-507409329 tempest-IdentityV3ProjectsTest-507409329-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:24.160290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93179-a5b2-400d-9751-50c224b86ef8 tempest-IdentityV3ProjectsTest-507409329 tempest-IdentityV3ProjectsTest-507409329-project] PATH_INFO: `/v3/users/1a3dd36a000b405699800b3ab67433da/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:24.162146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb93179-a5b2-400d-9751-50c224b86ef8 tempest-IdentityV3ProjectsTest-507409329 tempest-IdentityV3ProjectsTest-507409329-project] RBAC: Authorizing `identity:list_user_projects(user_id=1a3dd36a000b405699800b3ab67433da)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:24.164075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb93179-a5b2-400d-9751-50c224b86ef8 tempest-IdentityV3ProjectsTest-507409329 tempest-IdentityV3ProjectsTest-507409329-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:24.334027 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2247/4478] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:03:23 2022] GET /identity/v3/users/1a3dd36a000b405699800b3ab67433da/projects => generated 515 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:24.337848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:24.338425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:24.338735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:24.462972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] MFA Rules not processed for user `1a3dd36a000b405699800b3ab67433da`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:24.467058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:24.503730 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2232/4479] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:24.505530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:24.506118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:24.506527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:24.574932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] MFA Rules not processed for user `1a3dd36a000b405699800b3ab67433da`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:24.578072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:24.720506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.models.token_model [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] User 1a3dd36a000b405699800b3ab67433da has no access to project 5f5def0c4eb245e4897a5292a57487ac {{(pid=80989) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 11 15:03:24.732587 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.application [None req-aed4f794-7506-4abf-9efd-2869826a63ca None None] Authorization failed. The request you have made requires authentication. from 10.222.0.77: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 11 15:03:24.743140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2248/4480] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:24 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 239 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 11 15:03:24.744679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:24.880196 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:24.929095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7e62-c5bb-4882-8f34-ca251fecaa8e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:24.939170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:24.940077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:24.940368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:24.940647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] PATH_INFO: `/v3/users/1a3dd36a000b405699800b3ab67433da` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:24.947404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3dd36a000b405699800b3ab67433da)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:24.949689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:25.079552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3dd36a000b405699800b3ab67433da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:25.116890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3dd36a000b405699800b3ab67433da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:25.133309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3dd36a000b405699800b3ab67433da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:25.148444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3dd36a000b405699800b3ab67433da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:25.149359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3dd36a000b405699800b3ab67433da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:25.166813 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2233/4481] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:24 2022] DELETE /identity/v3/users/1a3dd36a000b405699800b3ab67433da => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:25.168631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:25.169185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:25.169185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:25.220097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:25.221275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:25.297827 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:25.385910 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2249/4482] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:25.396159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:25.397873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:25.677837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c176d4-07c2-4d48-80db-3e57d95ba287 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:25.702146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:25.704917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:25.704917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:25.706171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:25.771992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:25.776731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:25.818682 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2234/4483] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:26.615008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:26.617066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:26.682186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f382a3-5bb2-45aa-8c2b-bdb777da6511 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:26.711453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:26.714897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:26.715444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:26.715989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] PATH_INFO: `/v3/projects/813b6b20384848d98ed2572f646d4527` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:26.723971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813b6b20384848d98ed2572f646d4527)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:26.727456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:26.994416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813b6b20384848d98ed2572f646d4527', 'request_id': 'req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.010711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813b6b20384848d98ed2572f646d4527', 'request_id': 'req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.034290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813b6b20384848d98ed2572f646d4527', 'request_id': 'req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.078143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] The token cache is being invalidate because project 813b6b20384848d98ed2572f646d4527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:27.080637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.094679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.098857 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2250/4484] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:26 2022] DELETE /identity/v3/projects/813b6b20384848d98ed2572f646d4527 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:27.103183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:27.131988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301777-8dc6-4b55-bb43-c9de7924c99e service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:27.409051 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:27.426071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:27.428284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:27.429191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:27.429538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] PATH_INFO: `/v3/users/9b5f371a56a04798bdd4f82401b6290f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:27.431905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5f371a56a04798bdd4f82401b6290f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:27.435192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:27.541197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5f371a56a04798bdd4f82401b6290f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.588548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5f371a56a04798bdd4f82401b6290f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.608674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5f371a56a04798bdd4f82401b6290f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.633271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5f371a56a04798bdd4f82401b6290f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.634479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-792424e6-9f15-4c9c-ade0-3fef068123bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5f371a56a04798bdd4f82401b6290f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:27.653028 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2235/4485] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:27 2022] DELETE /identity/v3/users/9b5f371a56a04798bdd4f82401b6290f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:28.744891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:28.747044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:28.782990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b6ab4-aeed-4a39-8720-1b19c2dd1d92 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:29.013446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:29.015667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:29.018843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:29.023435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] PATH_INFO: `/v3/projects/5f5def0c4eb245e4897a5292a57487ac` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:29.026292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5def0c4eb245e4897a5292a57487ac)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:29.035675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:29.158309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5def0c4eb245e4897a5292a57487ac', 'request_id': 'req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:29.185394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5def0c4eb245e4897a5292a57487ac', 'request_id': 'req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:29.190798 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:29.194577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5def0c4eb245e4897a5292a57487ac', 'request_id': 'req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:29.228425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] The token cache is being invalidate because project 5f5def0c4eb245e4897a5292a57487ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:29.228804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:29.231364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fe98ad5-24f3-4095-9bbd-cc876b9c13ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:29.236457 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2251/4486] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:28 2022] DELETE /identity/v3/projects/5f5def0c4eb245e4897a5292a57487ac => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:29.238672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:29.239216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:29.239338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:29.328719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:29.331808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:29.604174 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2236/4487] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:29.609206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:29.609497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:29.609774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:29.643561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:29.644814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:29.669511 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2252/4488] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:29.673484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:29.694254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5c729-ac21-4059-971f-1970433187a1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:29.704940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:29.705945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:29.707816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:29.708287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:29.709278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:29.709771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:29.717247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:29.754066 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2237/4489] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:29.755562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:29.770861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b9fd-0727-407b-a165-01a90c30b6fc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:29.783446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:29.784524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:29.785061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:29.785574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:29.787082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:29.789234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:29.854223 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2253/4490] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:29 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:29.858075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:29.880309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2088d-c597-46a9-b2e0-61df71ee1be0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.004218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.005459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.006084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.008654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.009462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.016005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.036982 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:30.062960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.070406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2238/4491] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:29 2022] POST /identity/v3/users => generated 281 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:30.077049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376332e-55e4-48e3-971e-bf43c903a2cb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.091144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.093024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.093316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.093600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.094336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.095983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.132580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.138420 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2254/4492] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:30.148281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e4bf-f605-498a-b4d5-34824df39046 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.154070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edfad8-66fe-4045-96e5-43e66a63326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.154887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfad8-66fe-4045-96e5-43e66a63326c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.155326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfad8-66fe-4045-96e5-43e66a63326c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.155589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfad8-66fe-4045-96e5-43e66a63326c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.156410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edfad8-66fe-4045-96e5-43e66a63326c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.158386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edfad8-66fe-4045-96e5-43e66a63326c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.175697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.183927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2239/4493] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:30.188211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d914f-4d1c-4cd8-9d86-c3136163850c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.193745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b2604-8dae-4f90-a2e4-c8415833f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.194749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2604-8dae-4f90-a2e4-c8415833f330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.195107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2604-8dae-4f90-a2e4-c8415833f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.195455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2604-8dae-4f90-a2e4-c8415833f330 admin admin] PATH_INFO: `/v3/projects/a288b2f07a01430bb9deba305cf2273e/users/fb5d943900d84df499a3414b22c750f9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.233359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b2604-8dae-4f90-a2e4-c8415833f330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a288b2f07a01430bb9deba305cf2273e, user_id=fb5d943900d84df499a3414b22c750f9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.236593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b2604-8dae-4f90-a2e4-c8415833f330 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.269868 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2255/4494] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:30 2022] PUT /identity/v3/projects/a288b2f07a01430bb9deba305cf2273e/users/fb5d943900d84df499a3414b22c750f9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:30.270864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3b2f-58d2-4e47-998d-f8cfd9f55b8b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.271641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3b2f-58d2-4e47-998d-f8cfd9f55b8b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.272123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3b2f-58d2-4e47-998d-f8cfd9f55b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.381061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c83e3b2f-58d2-4e47-998d-f8cfd9f55b8b None None] MFA Rules not processed for user `fb5d943900d84df499a3414b22c750f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:30.382334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c83e3b2f-58d2-4e47-998d-f8cfd9f55b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:30.562696 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2240/4495] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:30.568560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.569206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.569603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.634375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] MFA Rules not processed for user `fb5d943900d84df499a3414b22c750f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:30.636062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:30.651515 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2256/4496] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:03:30.652246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d5d6a-c785-490e-852e-787222e94aed None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.652549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d5d6a-c785-490e-852e-787222e94aed None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.652831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d5d6a-c785-490e-852e-787222e94aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.693798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-762d5d6a-c785-490e-852e-787222e94aed None None] MFA Rules not processed for user `fb5d943900d84df499a3414b22c750f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:30.695135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-762d5d6a-c785-490e-852e-787222e94aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:30.698560 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2241/4497] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:03:30.702989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.725910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2374-c7e7-4bc3-a776-6c68bc07685a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.739399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.740623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.741168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.741682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.751595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorizing `identity:check_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.756544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.770342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d5d6a-c785-490e-852e-787222e94aed None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.770740 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2257/4498] 10.222.0.77 () {56 vars in 1263 bytes} [Mon Jul 11 15:03:30 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 11 15:03:30.787830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d5d6a-c785-490e-852e-787222e94aed None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.809683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.811285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.811842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.812689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.826247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.828408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.878194 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2242/4499] 10.222.0.77 () {56 vars in 1262 bytes} [Mon Jul 11 15:03:30 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:03:30.878551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.888851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3115e3c-9dae-4b74-8ce0-3763a1b2b198 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.905118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019201fe-cce1-440b-9068-7dfa6c372330 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.905807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019201fe-cce1-440b-9068-7dfa6c372330 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.910216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019201fe-cce1-440b-9068-7dfa6c372330 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.911251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019201fe-cce1-440b-9068-7dfa6c372330 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:30.926039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019201fe-cce1-440b-9068-7dfa6c372330 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:30.927623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019201fe-cce1-440b-9068-7dfa6c372330 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:30.956034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2258/4500] 10.222.0.77 () {56 vars in 1265 bytes} [Mon Jul 11 15:03:30 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:30.960596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:30.987931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb2d87-3304-4e6f-a164-f92d0d9996e6 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:30.995057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:30.996191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:30.996676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:30.997156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.011171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 11 15:03:31.086923 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 11 15:03:31.088179 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 11 15:03:31.089571 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.089571 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.089571 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 11 15:03:31.089571 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 11 15:03:31.089571 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 11 15:03:31.089571 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:03:31.090862 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2243/4501] 10.222.0.77 () {56 vars in 1263 bytes} [Mon Jul 11 15:03:30 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 11 15:03:31.095416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:31.095716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:31.096003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.130190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] MFA Rules not processed for user `fb5d943900d84df499a3414b22c750f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:31.135485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:31.143680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2259/4502] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:03:31.148080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:31.160105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5ecef-72a6-4478-b26f-b2c7db76731e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:31.170357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:31.171410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:31.172684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:31.173843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.188580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:31.191314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:31.206549 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2244/4503] 10.222.0.77 () {56 vars in 1262 bytes} [Mon Jul 11 15:03:31 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:03:31.209941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:31.226724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7e5e4-a487-4f9d-923d-75bc4632023c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:31.232124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:31.233110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:31.233557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:31.234038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.242039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:31.243910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:31.283911 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2260/4504] 10.222.0.77 () {56 vars in 1265 bytes} [Mon Jul 11 15:03:31 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:31.288465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:31.303623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78559fa-d7ce-4b7a-922e-dddbd6b35b9f tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:31.309542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2bc75-bd14-4db6-a76e-9f7b4e3ba35e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5d943900d84df499a3414b22c750f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288b2f07a01430bb9deba305cf2273e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:31.310726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bc75-bd14-4db6-a76e-9f7b4e3ba35e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:31.311421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bc75-bd14-4db6-a76e-9f7b4e3ba35e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:31.312077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bc75-bd14-4db6-a76e-9f7b4e3ba35e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.315378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-78d2bc75-bd14-4db6-a76e-9f7b4e3ba35e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-78d2bc75-bd14-4db6-a76e-9f7b4e3ba35e tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 11 15:03:31.336873 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 11 15:03:31.338377 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 11 15:03:31.340224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:03:31.340224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:03:31.340224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 11 15:03:31.340224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 11 15:03:31.340224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 11 15:03:31.340224 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:03:31.351917 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2245/4505] 10.222.0.77 () {56 vars in 1262 bytes} [Mon Jul 11 15:03:31 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:03:31.353250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:31.594433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7fac-1e1b-4556-9f05-ccec4fb89cf0 tempest-TokensV3Test-1498258908 tempest-TokensV3Test-1498258908-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:31.603048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:31.604495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:31.606287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:31.606746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] PATH_INFO: `/v3/users/fb5d943900d84df499a3414b22c750f9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.609045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5d943900d84df499a3414b22c750f9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:31.616273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:31.647838 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:31.738566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5d943900d84df499a3414b22c750f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:31.744384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5d943900d84df499a3414b22c750f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:31.765610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5d943900d84df499a3414b22c750f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:31.769152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5d943900d84df499a3414b22c750f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:31.799541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5d943900d84df499a3414b22c750f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:31.821989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2261/4506] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:31 2022] DELETE /identity/v3/users/fb5d943900d84df499a3414b22c750f9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:31.829858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:31.830155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:31.830658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:31.860312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:31.861553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:32.038151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2246/4507] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:32.051223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:32.055394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:32.209036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf552184-2329-4838-912f-75a06cbd4b95 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:32.222133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:32.222891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:32.223716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:32.224003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:32.248221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:32.249878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:32.273958 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2262/4508] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:32.975531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:32.977955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:33.045936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232d72-b41c-45f3-9bd5-4477b50754e1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:33.090001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:33.102993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:33.103373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:33.103584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:33.115762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:33.188266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:33.189751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825551b1-fb32-4954-9b79-d3308bb5ef3b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:33.223788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2247/4509] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:33.675886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:33.678181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:33.701556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ac29-eb5a-46ad-bf27-2d14ba8f9ef5 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:33.721827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:33.724041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:33.724376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:33.724688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] PATH_INFO: `/v3/projects/a288b2f07a01430bb9deba305cf2273e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:33.728714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a288b2f07a01430bb9deba305cf2273e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:33.732273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:33.866567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a288b2f07a01430bb9deba305cf2273e', 'request_id': 'req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:33.895827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a288b2f07a01430bb9deba305cf2273e', 'request_id': 'req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:33.906642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a288b2f07a01430bb9deba305cf2273e', 'request_id': 'req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:33.937447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] The token cache is being invalidate because project a288b2f07a01430bb9deba305cf2273e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:33.937687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:33.939081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-867aa9f6-b04a-40a4-b8a9-c549b10d99d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:33.943985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2263/4510] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:33 2022] DELETE /identity/v3/projects/a288b2f07a01430bb9deba305cf2273e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:33.949583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:33.949863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:33.951285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.007109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:34.017497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:34.032580 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:34.350784 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2248/4511] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:34.356377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68427947-5193-4173-bcbb-d550cb47633d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:34.356692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68427947-5193-4173-bcbb-d550cb47633d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:34.356970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68427947-5193-4173-bcbb-d550cb47633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.384117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68427947-5193-4173-bcbb-d550cb47633d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:34.386210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68427947-5193-4173-bcbb-d550cb47633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:34.405241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:34.420747 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2264/4512] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:34.426861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5631-50fd-4793-835a-e52453fcb28d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:34.444915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:34.446001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:34.446564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:34.447072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.448064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:34.448984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:34.451600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:34.467300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2249/4513] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:34.473054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68427947-5193-4173-bcbb-d550cb47633d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:34.485700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68427947-5193-4173-bcbb-d550cb47633d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:34.498801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:34.499953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:34.501692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:34.502724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.506155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:34.508356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:34.559043 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:34.597485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:34.609280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2265/4514] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:34 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:34.620343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca21e7-fe62-481b-bed5-84b874c2b8a6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:34.804338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:34.812687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:34.813544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:34.813845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.815187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:34.817990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:34.860431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2250/4515] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:34 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:03:34.865098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:34.881352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca059cd-34a4-4984-b6c9-1d276255fe40 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:34.900803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:34.901498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:34.903989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:34.904509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.908391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:34.914597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:34.948966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2266/4516] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:34.950231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:34.965268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302c4d5-8b6d-413d-8789-14d259203b15 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:34.978077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa6a9-1050-417b-8f40-65abce60319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:34.981149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa6a9-1050-417b-8f40-65abce60319c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:34.981457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa6a9-1050-417b-8f40-65abce60319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:34.981737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa6a9-1050-417b-8f40-65abce60319c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:34.982511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa6a9-1050-417b-8f40-65abce60319c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:34.999497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa6a9-1050-417b-8f40-65abce60319c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:35.036995 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2251/4517] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:35.041972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:35.060651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eddaf-133c-47d6-ab93-923eb0ccdaff admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:35.078790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812934e-f882-4508-9443-710905b559eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:35.080054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812934e-f882-4508-9443-710905b559eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:35.080347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812934e-f882-4508-9443-710905b559eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:35.080633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812934e-f882-4508-9443-710905b559eb admin admin] PATH_INFO: `/v3/projects/049973304fbf467a8f28b3ffcbc3b7f8/users/134382582037432096c6622bc5aec42c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:35.116927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812934e-f882-4508-9443-710905b559eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=049973304fbf467a8f28b3ffcbc3b7f8, user_id=134382582037432096c6622bc5aec42c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:35.120289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812934e-f882-4508-9443-710905b559eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:35.142015 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2267/4518] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:35 2022] PUT /identity/v3/projects/049973304fbf467a8f28b3ffcbc3b7f8/users/134382582037432096c6622bc5aec42c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:35.243309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e481-de86-4366-88d2-4fd8d6439b56 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:35.243810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e481-de86-4366-88d2-4fd8d6439b56 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:35.244282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e481-de86-4366-88d2-4fd8d6439b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:35.301812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3a77e481-de86-4366-88d2-4fd8d6439b56 None None] MFA Rules not processed for user `134382582037432096c6622bc5aec42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:35.305804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3a77e481-de86-4366-88d2-4fd8d6439b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:35.461800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2252/4519] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:35.480328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812934e-f882-4508-9443-710905b559eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:35.482666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a812934e-f882-4508-9443-710905b559eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:35.602520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812934e-f882-4508-9443-710905b559eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:35.612311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:35.612991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:35.614271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:35.617122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:35.637715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:35.641208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:35.659385 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2268/4520] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:35.859961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7457ab-6abe-4465-967c-cea41a971ba6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:35.860264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7457ab-6abe-4465-967c-cea41a971ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:35.860547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7457ab-6abe-4465-967c-cea41a971ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:35.866156 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:35.920939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ff7457ab-6abe-4465-967c-cea41a971ba6 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:35.922200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ff7457ab-6abe-4465-967c-cea41a971ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:36.063567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2253/4521] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:36.097603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:36.099985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:36.223839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd24c-7b43-49e5-abc6-bda5956bfad2 service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:36.231444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:36.232596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:36.233121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:36.233629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:36.252934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:36.255334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:36.290481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2269/4522] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:36.655576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:36.656556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:36.657251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:36.683097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:36.684500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:36.694434 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2254/4523] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:03:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:36.709026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:36.724263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1fd42-3ba8-4251-acf2-09ddb4f78065 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:36.736495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c976c9-c8e7-48a1-9dfe-0ca8711649cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:36.737164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c976c9-c8e7-48a1-9dfe-0ca8711649cb service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:36.737451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c976c9-c8e7-48a1-9dfe-0ca8711649cb service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:36.737735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c976c9-c8e7-48a1-9dfe-0ca8711649cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:36.762073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c976c9-c8e7-48a1-9dfe-0ca8711649cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:36.763100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c976c9-c8e7-48a1-9dfe-0ca8711649cb service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:36.763887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:36.765376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:36.785106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2270/4524] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:36.898108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ced24-7de6-4b34-b154-5858d4133ed0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:36.928452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:36.937025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:36.939309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:36.939867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] PATH_INFO: `/v3/users/0d365ffbdaf744f696e393b21b077d3c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:36.953966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d365ffbdaf744f696e393b21b077d3c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:36.956358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:37.117063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d365ffbdaf744f696e393b21b077d3c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:37.147133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d365ffbdaf744f696e393b21b077d3c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:37.161691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d365ffbdaf744f696e393b21b077d3c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:37.177576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d365ffbdaf744f696e393b21b077d3c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:37.178434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c5a9994-186d-4038-a5d0-675782b4708e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d365ffbdaf744f696e393b21b077d3c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:37.187721 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2255/4525] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:36 2022] DELETE /identity/v3/users/0d365ffbdaf744f696e393b21b077d3c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:37.194088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:37.195355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:37.196967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:37.240809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:37.249078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:37.285068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:37.286163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:37.286659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:37.321607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:37.322897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:37.341980 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:37.344635 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:37.407193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2271/4526] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:37.438935 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2256/4527] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:37.456752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:37.458716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:37.460918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:37.463586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:37.603556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8630d9d-ed0c-425a-a99c-d04fca606fb9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:37.612976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8797-5034-428a-b375-b4b83b51cfa8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:37.614174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4f81a-b604-48f2-a2ef-0a813f11cef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:37.614879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f81a-b604-48f2-a2ef-0a813f11cef6 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:37.615168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f81a-b604-48f2-a2ef-0a813f11cef6 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:37.615450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f81a-b604-48f2-a2ef-0a813f11cef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:37.623828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:37.624599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:37.624889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:37.627153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:37.639231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f81a-b604-48f2-a2ef-0a813f11cef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:37.644401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f81a-b604-48f2-a2ef-0a813f11cef6 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:37.650397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:37.653957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:37.668144 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2272/4528] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:37.679069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2257/4529] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:38.165248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e19a8b-0210-4611-b8af-a8286ad48c7e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:38.165540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e19a8b-0210-4611-b8af-a8286ad48c7e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:38.165823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e19a8b-0210-4611-b8af-a8286ad48c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:38.204381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-74e19a8b-0210-4611-b8af-a8286ad48c7e None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:38.205656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-74e19a8b-0210-4611-b8af-a8286ad48c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:38.228168 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2273/4530] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:38.241599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:38.256782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc0e7-0a3a-4474-b8ad-447a4b3b7f16 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:38.263596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:38.264502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:38.264952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:38.265406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:38.282090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:38.284321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:38.310430 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2258/4531] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:38.724796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:38.725087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:38.726267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:38.784974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:38.789871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:38.811964 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2274/4532] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:38.827885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:38.844596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae70187-b05d-4e20-a002-6cbd00a2799d service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:38.857108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d0047-bdc7-4bf8-8b20-6748ed7a732e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:38.857773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d0047-bdc7-4bf8-8b20-6748ed7a732e service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:38.858054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d0047-bdc7-4bf8-8b20-6748ed7a732e service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:38.858330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d0047-bdc7-4bf8-8b20-6748ed7a732e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:38.877925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d0047-bdc7-4bf8-8b20-6748ed7a732e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:38.880172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d0047-bdc7-4bf8-8b20-6748ed7a732e service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:38.900750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2259/4533] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:39.094295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:39.095770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:39.128861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15029d-6c19-41c6-88f8-293a5490da03 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:39.146677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:39.147705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.147996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.148276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] PATH_INFO: `/v3/projects/4597b6a38f07454dadb707fa171ffc98` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.161680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4597b6a38f07454dadb707fa171ffc98)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:39.164547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:39.297675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2fe5-3f3d-4bbc-afab-3c55a52ee4eb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.298204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2fe5-3f3d-4bbc-afab-3c55a52ee4eb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.298313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2fe5-3f3d-4bbc-afab-3c55a52ee4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.322111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4597b6a38f07454dadb707fa171ffc98', 'request_id': 'req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:39.336647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-58bd2fe5-3f3d-4bbc-afab-3c55a52ee4eb None None] MFA Rules not processed for user `292c78c8b8484e748687b637d6ca62fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:39.337932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58bd2fe5-3f3d-4bbc-afab-3c55a52ee4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:39.345617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4597b6a38f07454dadb707fa171ffc98', 'request_id': 'req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:39.354006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4597b6a38f07454dadb707fa171ffc98', 'request_id': 'req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:39.390131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] The token cache is being invalidate because project 4597b6a38f07454dadb707fa171ffc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:39.390717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:39.391434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1a9b0d1-db8b-4273-9c97-0c4414b8e1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:39.393472 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2275/4534] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:39 2022] DELETE /identity/v3/projects/4597b6a38f07454dadb707fa171ffc98 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:39.398906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359916-7652-44b3-b534-4a1eb71b128b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.399594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359916-7652-44b3-b534-4a1eb71b128b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.400049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359916-7652-44b3-b534-4a1eb71b128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.456972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cf359916-7652-44b3-b534-4a1eb71b128b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:39.458562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cf359916-7652-44b3-b534-4a1eb71b128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:39.470527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2260/4535] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:39.473576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.474041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.474619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.529639 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:39.548242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:39.549790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:39.594605 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2276/4536] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:39.602514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.604276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.604566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.657823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:39.663225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:39.688984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2277/4537] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:39.689965 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:39.695074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:39.717163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0bba4-72f6-46ea-b31d-01ac6a4515a2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:39.739020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:39.740157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.740671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.741188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.742718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:39.743690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:39.745838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:39.759250 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2261/4538] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:39.774075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:39.776429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:39.778678 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2278/4539] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:03:39.790026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:39.821527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3232-b99c-4631-8e86-5de777cd64fc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:39.843665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:39.845232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:39.845754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:39.846265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:39.852627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:39.855484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:39.917459 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2279/4540] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:39 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:39.919034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:40.041444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543484-0bc1-4332-b512-1eb0c5f7830b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.172701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf99b-237b-42f6-91a5-eed77dde59b5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.201993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.205710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.212656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.213354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.214302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.225057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.225632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:40.225792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.226007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.226288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.303342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2280/4541] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:39 2022] POST /identity/v3/users => generated 283 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:03:40.305804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:40.348416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac463-8f12-4faa-9ddb-459327548606 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.381177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.385048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.385334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.395422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.398086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.400435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.400597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:40.408717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:40.424093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2262/4542] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:03:40.446849 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2281/4543] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:40.452220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:40.474911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76e77e-979c-4755-83ca-dcf16467fcb4 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.486913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1732f45-4943-49a6-85b5-c233ad81f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.487818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1732f45-4943-49a6-85b5-c233ad81f33f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.488295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1732f45-4943-49a6-85b5-c233ad81f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.488660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1732f45-4943-49a6-85b5-c233ad81f33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.489465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1732f45-4943-49a6-85b5-c233ad81f33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.491247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1732f45-4943-49a6-85b5-c233ad81f33f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:40.518930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2263/4544] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:40.522751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:40.547423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781807f-7ec7-49c5-a9d2-1c1b58aa51db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.561297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.562638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.563211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.564138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] PATH_INFO: `/v3/projects/74c7fc64ffd44ad287216c942e74bae0/users/ee9654eea6394375bb289b3a63c34733/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.600190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c7fc64ffd44ad287216c942e74bae0, user_id=ee9654eea6394375bb289b3a63c34733, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.603514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:40.636621 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2282/4545] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:40 2022] PUT /identity/v3/projects/74c7fc64ffd44ad287216c942e74bae0/users/ee9654eea6394375bb289b3a63c34733/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:40.641801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.643296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.643833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.667797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:40.670603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:40.704364 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:40.781938 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2264/4546] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:40.799179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:40.801675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:40.932934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8389-f657-42e6-b311-cdcf3a45f8b8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:40.956435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea9d3-8a3b-4bfa-9760-0ba76eb68437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:40.958723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea9d3-8a3b-4bfa-9760-0ba76eb68437 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:40.959014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea9d3-8a3b-4bfa-9760-0ba76eb68437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:40.960811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea9d3-8a3b-4bfa-9760-0ba76eb68437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:40.974414 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:40.984398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bea9d3-8a3b-4bfa-9760-0ba76eb68437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:40.987123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bea9d3-8a3b-4bfa-9760-0ba76eb68437 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:41.011185 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2283/4547] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:42.391123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:42.405064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:42.405623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:42.406454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:42.418448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fe5a2-725d-4de2-9e7c-c9e5f2b8e5df None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:42.445543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:42.446069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:42.447354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:42.447856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:42.448905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:42.450111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:42.459458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:42.688578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:42.690309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d1c53-bbd9-46cd-a6a9-e51c6eacef44 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:42.707111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2284/4548] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:42.714778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:42.715374 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2265/4549] 10.222.0.77 () {60 vars in 1396 bytes} [Mon Jul 11 15:03:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3236 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:42.939845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe4bb4-5018-42c2-9b66-04c75c3fe7c7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:42.955843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:42.956852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:42.957341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:42.957785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:42.977607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:42.979782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:43.003311 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2285/4550] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:43.384235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ad9e-a119-4bc5-9bdb-3da03a54fac6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:43.384772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ad9e-a119-4bc5-9bdb-3da03a54fac6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:43.385187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ad9e-a119-4bc5-9bdb-3da03a54fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:43.407183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3b40ad9e-a119-4bc5-9bdb-3da03a54fac6 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:43.409286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3b40ad9e-a119-4bc5-9bdb-3da03a54fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:43.427574 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2266/4551] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:43.435527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:43.451793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673d9da-64d2-4e1e-b5bc-58343efad5ed service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:43.463707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:43.465066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:43.466237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:43.467466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:43.495414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:43.497309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:43.508636 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2286/4552] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:43.873817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31a25-3c38-4037-9cec-135152f334fc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:43.874259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31a25-3c38-4037-9cec-135152f334fc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:43.874678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31a25-3c38-4037-9cec-135152f334fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:43.924329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-07d31a25-3c38-4037-9cec-135152f334fc None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:43.926088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-07d31a25-3c38-4037-9cec-135152f334fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:43.944736 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2267/4553] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:43.958758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:43.978340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43eb9-7568-4c89-9b75-8590b9f28bfe service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:44.024439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:44.026825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:44.028232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:44.035973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:44.087313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:44.092196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:44.120799 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2287/4554] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:44.473692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3759-35fc-401f-919b-6c763d7b591e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:44.474189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3759-35fc-401f-919b-6c763d7b591e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:44.474414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3759-35fc-401f-919b-6c763d7b591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:44.508428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-140b3759-35fc-401f-919b-6c763d7b591e None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:44.509669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-140b3759-35fc-401f-919b-6c763d7b591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:44.519335 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2268/4555] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:03:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:44.534227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:44.557873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7b7c4-bce5-4dd8-8f31-f176ad546165 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:44.595238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:44.600414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:44.602579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:44.602988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:44.627222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:44.633959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:44.671580 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2288/4556] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:44.994149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83d96-c5e0-48de-9783-6b7eb34757ab None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:44.994932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83d96-c5e0-48de-9783-6b7eb34757ab None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:44.995521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83d96-c5e0-48de-9783-6b7eb34757ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:45.036750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1fa83d96-c5e0-48de-9783-6b7eb34757ab None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:45.042029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1fa83d96-c5e0-48de-9783-6b7eb34757ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:45.086720 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2269/4557] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:03:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:45.100546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:45.119713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e8cd-abbe-4bb0-b975-9ed820a2b46a service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:45.147212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:45.148610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:45.149769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:45.150889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:45.174714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:45.179490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:45.202400 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2289/4558] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:03:45.496397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:45.496921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:45.497049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:45.555149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:45.558331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:45.573775 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2270/4559] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:45.597722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:45.622135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60191b37-a8de-4c66-ab95-02b371549c71 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:45.638936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb9016-0568-4505-bc8e-f149fe75d8a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:45.645522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9016-0568-4505-bc8e-f149fe75d8a5 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:45.645824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9016-0568-4505-bc8e-f149fe75d8a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:45.646114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9016-0568-4505-bc8e-f149fe75d8a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:45.675324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb9016-0568-4505-bc8e-f149fe75d8a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:45.681891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb9016-0568-4505-bc8e-f149fe75d8a5 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:45.711362 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2290/4560] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:03:46.014600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:46.016695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:46.043189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b03d13-112d-49c1-968e-d9582a3ff668 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:46.061675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:46.063183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:46.064061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:46.065076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] PATH_INFO: `/v3/users/134382582037432096c6622bc5aec42c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:46.067475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134382582037432096c6622bc5aec42c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:46.070953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:46.157343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134382582037432096c6622bc5aec42c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:46.176252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134382582037432096c6622bc5aec42c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:46.188728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134382582037432096c6622bc5aec42c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:46.195947 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:46.206258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134382582037432096c6622bc5aec42c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:46.210018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134382582037432096c6622bc5aec42c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:46.221862 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2271/4561] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:46 2022] DELETE /identity/v3/users/134382582037432096c6622bc5aec42c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:46.226270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:46.226583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:46.227074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:46.298622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:46.299842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:46.335104 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:46.429153 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2291/4562] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:46.488716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:46.490225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:46.610852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c3512-3bc0-48b4-87f2-531be896fe81 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:46.622027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b14a9-ebab-41e0-a412-586a6ea0268b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:46.623683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b14a9-ebab-41e0-a412-586a6ea0268b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:46.624236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b14a9-ebab-41e0-a412-586a6ea0268b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:46.624725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b14a9-ebab-41e0-a412-586a6ea0268b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:46.672373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b14a9-ebab-41e0-a412-586a6ea0268b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:46.680030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b14a9-ebab-41e0-a412-586a6ea0268b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:46.720015 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2272/4563] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:49.024298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:49.027227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:49.082575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd47a9-d2fa-489a-9ce9-f07587faa84f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:49.116878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:49.123117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:49.123474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:49.123765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] PATH_INFO: `/v3/projects/049973304fbf467a8f28b3ffcbc3b7f8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:49.134984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] RBAC: Authorizing `identity:delete_project(project_id=049973304fbf467a8f28b3ffcbc3b7f8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:49.143918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:49.330629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049973304fbf467a8f28b3ffcbc3b7f8', 'request_id': 'req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:49.348708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049973304fbf467a8f28b3ffcbc3b7f8', 'request_id': 'req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:49.364697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049973304fbf467a8f28b3ffcbc3b7f8', 'request_id': 'req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:49.389506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] The token cache is being invalidate because project 049973304fbf467a8f28b3ffcbc3b7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:49.389907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:49.391941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1318a1f-c51d-48f0-95bf-b0edb2f8808d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:49.396192 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2292/4564] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:49 2022] DELETE /identity/v3/projects/049973304fbf467a8f28b3ffcbc3b7f8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:49.401698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:49.402637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:49.403125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:49.445144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:49.450469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:49.576008 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2273/4565] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:49.578084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:49.578381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:49.578698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:49.616654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:49.619600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:49.643574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2293/4566] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:49.648093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:49.661081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1ac0-0986-4379-8f18-a968fac1d03b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:49.673375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:49.674124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:49.674409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:49.676012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:49.678089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:49.678435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:49.681245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:49.729530 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2274/4567] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:49.734117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:49.748582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104914e-4d7c-4c24-9857-bb1ad53069a3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:49.762885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:49.763593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:49.763880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:49.764156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:49.765125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:49.767637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:49.823811 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2294/4568] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:49 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:49.828368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:49.840497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3ecb6-11b7-4579-b117-96ed94b58990 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:49.955259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:49.956058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:49.956294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:49.956624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:49.957456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:49.959499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.009501 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2275/4569] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:49 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:50.016554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.047933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b717-da39-4cfd-b618-06f5bfe05864 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:50.060666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:50.061905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.063011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.063484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.065701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:50.067600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.116145 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2295/4570] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:50.120653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.135286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26cbf-7ab3-4a79-be2b-d211cfed0c70 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:50.162976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bd9f8-649b-4c33-b0ab-b7dab9182a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:50.163684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bd9f8-649b-4c33-b0ab-b7dab9182a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.163974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bd9f8-649b-4c33-b0ab-b7dab9182a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.164366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bd9f8-649b-4c33-b0ab-b7dab9182a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.165159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bd9f8-649b-4c33-b0ab-b7dab9182a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:50.166857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bd9f8-649b-4c33-b0ab-b7dab9182a78 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.185773 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2276/4571] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:50.190722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.211077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a619c-d099-4f8b-9421-4f97a728fc5f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:50.229447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:50.230412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.230698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.231494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] PATH_INFO: `/v3/projects/21be6864711b40bd9204de4f554596c8/users/a260d47cce014d2ea27a8084a75535ea/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.285687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21be6864711b40bd9204de4f554596c8, user_id=a260d47cce014d2ea27a8084a75535ea, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:50.291675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.372723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2296/4572] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:50 2022] PUT /identity/v3/projects/21be6864711b40bd9204de4f554596c8/users/a260d47cce014d2ea27a8084a75535ea/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:50.373595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.373595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.373595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.373595 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:50.424196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] MFA Rules not processed for user `a260d47cce014d2ea27a8084a75535ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:50.426532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:50.543067 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2277/4573] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:50.543490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.611842 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:50.640995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff666d-72b3-4ca0-845a-92d656e48c3b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:50.655604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:50.656527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.657050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.657472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.658472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:50.663317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.751469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.765054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2297/4574] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:50 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:50.774115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11985dc-4d60-4f32-b584-45fe06b23e20 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:50.871957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:50.872980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.873895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.874415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.875425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:50.879518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.924717 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2278/4575] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:03:50 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:50.928409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.943095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30ca6-4986-48fd-a2ed-a3ec2ffa0bc3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:50.953487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:50.954984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:50.954984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:50.959905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:50.960781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:50.962423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:50.981180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2298/4576] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:03:50.982087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:50.996864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a603a1-5bfa-444c-a6bc-b1f74917e126 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:51.002943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:51.005003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:51.005404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:51.005793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] PATH_INFO: `/v3/projects/167cd0dcb02d4a54a023696fc0c888b3/users/112eda20415a4ac9a22dc8fd49a0b03b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:51.027455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167cd0dcb02d4a54a023696fc0c888b3, user_id=112eda20415a4ac9a22dc8fd49a0b03b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:51.030901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:51.057189 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2279/4577] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:50 2022] PUT /identity/v3/projects/167cd0dcb02d4a54a023696fc0c888b3/users/112eda20415a4ac9a22dc8fd49a0b03b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:03:51.058476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:51.073758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1a5e-9009-4f1b-8457-ae7713b7bb02 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:51.163492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dcc87-673c-4dce-b4dc-226262d3960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:51.164562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dcc87-673c-4dce-b4dc-226262d3960f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:51.165075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dcc87-673c-4dce-b4dc-226262d3960f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:51.166167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dcc87-673c-4dce-b4dc-226262d3960f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:51.167536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dcc87-673c-4dce-b4dc-226262d3960f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:51.170999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dcc87-673c-4dce-b4dc-226262d3960f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:51.187003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2299/4578] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:03:51.190818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:51.229945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64d89-418a-40b7-8992-b6766bf3c1d4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:51.247996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:51.248951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:51.249236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:51.249514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] PATH_INFO: `/v3/projects/167cd0dcb02d4a54a023696fc0c888b3/users/112eda20415a4ac9a22dc8fd49a0b03b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:51.253078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167cd0dcb02d4a54a023696fc0c888b3, user_id=112eda20415a4ac9a22dc8fd49a0b03b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:51.256538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:51.271716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2280/4579] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:03:51 2022] PUT /identity/v3/projects/167cd0dcb02d4a54a023696fc0c888b3/users/112eda20415a4ac9a22dc8fd49a0b03b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:51.282625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:51.283604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:51.283998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:51.361263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] MFA Rules not processed for user `112eda20415a4ac9a22dc8fd49a0b03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:51.366386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:51.594001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:51.603369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2300/4580] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:51.624746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477ce-adba-49a6-a16b-f0d982544f42 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:51.635390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112eda20415a4ac9a22dc8fd49a0b03b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167cd0dcb02d4a54a023696fc0c888b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:51.635969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:51.638869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:51.639303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:51.640222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:51.642445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:51.648039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:51.677583 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2281/4581] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:51.679046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:51.700790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269747e-122b-46a4-9a31-d33ada7ebd86 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:51.721320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112eda20415a4ac9a22dc8fd49a0b03b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167cd0dcb02d4a54a023696fc0c888b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:51.722724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:51.724310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:51.730898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:51.733378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:51.737338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:51.815744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2301/4582] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:03:51 2022] POST /identity/v3/projects => generated 350 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:03:51.819329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:51.836667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6adc71-fb51-44a7-b39d-4f48ccbf4282 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:51.937933 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:52.030266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112eda20415a4ac9a22dc8fd49a0b03b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167cd0dcb02d4a54a023696fc0c888b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:52.030856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:52.031161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:52.032070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:52.032206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:03:52.032523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:52.034184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4e54e-658f-40df-a6e8-dc5a287fd1cb tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:52.065256 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2282/4583] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:03:52.084080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:52.087251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:52.132226 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:52.187620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314f59-4599-4dc9-b075-88dc4b92aa3f tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:52.197330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:52.198202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:52.198674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:52.199330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:52.219716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:52.225325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:52.267086 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2302/4584] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:53.537903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:53.538466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:53.538707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:53.575372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] MFA Rules not processed for user `3b0551622c74490abc17d4e0c34d5528`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:53.577454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:53.731739 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2283/4585] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:54.747699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:54.777425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30e732-2f78-42b7-9324-2ea6e7306394 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:54.818810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:54.822056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:54.826304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:54.828416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:54.831945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:54.859664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:54.862151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bacf66-0fb9-427e-a400-baf2c618656e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:54.894478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2303/4586] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:03:56.573787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:56.575658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:56.769764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09189-9435-4b3b-8a12-e0f5cbeaff75 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:56.777436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:56.778872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:56.779711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:56.780251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:56.783967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:56.807662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:56.810439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08890db-da01-4a5b-b348-936f614b528e service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:56.820963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:56.821458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:56.821527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:56.850920 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2284/4587] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:56.889427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:56.891995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:57.055830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:57.056255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:57.056803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:57.079308 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2304/4588] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:03:57.110977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:57.117042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:57.142708 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2285/4589] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:57.309557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:57.311326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:57.558532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831924d-7555-45ed-9e27-a02161e2ba2e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:57.582688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:57.584983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:57.585814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:57.595228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:57.617332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:57.630935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:57.686726 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2305/4590] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:58.132028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:58.153241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc72297-deca-408b-9c71-e415d5a3d5f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:58.167141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112eda20415a4ac9a22dc8fd49a0b03b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167cd0dcb02d4a54a023696fc0c888b3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:58.169171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:58.170671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:58.171132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] PATH_INFO: `/v3/projects/fbff514549fe402987c43acc235bd1d1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:58.173982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fbff514549fe402987c43acc235bd1d1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:58.182324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:58.261042 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:58.272114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbff514549fe402987c43acc235bd1d1', 'request_id': 'req-8eaafab5-0342-4c47-8d48-5e1c25a33f41'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.279754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbff514549fe402987c43acc235bd1d1', 'request_id': 'req-8eaafab5-0342-4c47-8d48-5e1c25a33f41'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.289120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbff514549fe402987c43acc235bd1d1', 'request_id': 'req-8eaafab5-0342-4c47-8d48-5e1c25a33f41'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.319446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] The token cache is being invalidate because project fbff514549fe402987c43acc235bd1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:58.319966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.321379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8eaafab5-0342-4c47-8d48-5e1c25a33f41 tempest-QuotasNegativeTest-422733788 tempest-QuotasNegativeTest-422733788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.333833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:58.339793 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2286/4591] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:58 2022] DELETE /identity/v3/projects/fbff514549fe402987c43acc235bd1d1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:58.379390 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:58.523186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c9af2-0f44-43aa-abb0-dd0d1820f983 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:58.633331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:58.634534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:58.634833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:58.635114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] PATH_INFO: `/v3/users/a260d47cce014d2ea27a8084a75535ea` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:58.638488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a260d47cce014d2ea27a8084a75535ea)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:58.640724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:58.755219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a260d47cce014d2ea27a8084a75535ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.756520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a260d47cce014d2ea27a8084a75535ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.843927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a260d47cce014d2ea27a8084a75535ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.844701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a260d47cce014d2ea27a8084a75535ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.864290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a260d47cce014d2ea27a8084a75535ea'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:58.928352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2306/4592] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:58 2022] DELETE /identity/v3/users/a260d47cce014d2ea27a8084a75535ea => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:58.933861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:58.934947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:58.935454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:59.076109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:03:59.087846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:59.207732 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2287/4593] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:03:59.223768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:59.225618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:59.305675 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:59.361842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317345-e47a-4005-b237-aec1d4ebb847 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:59.381695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:59.381993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:59.382294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:59.382607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:59.408345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:59.414453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:59.454404 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2307/4594] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:01.786374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:01.789702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:01.809095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c160-bcea-44a6-8918-ffa4d93836ac None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:01.825366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:01.826306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:01.826621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:01.826904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] PATH_INFO: `/v3/projects/21be6864711b40bd9204de4f554596c8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:01.828478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21be6864711b40bd9204de4f554596c8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:01.833571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:01.966460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21be6864711b40bd9204de4f554596c8', 'request_id': 'req-fa64c1fc-4f2b-4301-98a7-aebe23312465'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:01.982691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21be6864711b40bd9204de4f554596c8', 'request_id': 'req-fa64c1fc-4f2b-4301-98a7-aebe23312465'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.001179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21be6864711b40bd9204de4f554596c8', 'request_id': 'req-fa64c1fc-4f2b-4301-98a7-aebe23312465'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.036394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] The token cache is being invalidate because project 21be6864711b40bd9204de4f554596c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:04:02.036759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.037678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.074576 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2288/4595] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:04:01 2022] DELETE /identity/v3/projects/21be6864711b40bd9204de4f554596c8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:02.078550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:02.094784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ddb69-54f5-49e0-b0d4-c8ae172719f4 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:02.278025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:02.279144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:02.279532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:02.279909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] PATH_INFO: `/v3/users/112eda20415a4ac9a22dc8fd49a0b03b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:02.293514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] RBAC: Authorizing `identity:delete_user(user_id=112eda20415a4ac9a22dc8fd49a0b03b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:02.296083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:02.400826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112eda20415a4ac9a22dc8fd49a0b03b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.401633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112eda20415a4ac9a22dc8fd49a0b03b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.428992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112eda20415a4ac9a22dc8fd49a0b03b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.430282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112eda20415a4ac9a22dc8fd49a0b03b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.446348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f3e9871-b050-4b79-9ae9-b240fa9cecde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112eda20415a4ac9a22dc8fd49a0b03b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:02.470596 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2308/4596] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:04:02 2022] DELETE /identity/v3/users/112eda20415a4ac9a22dc8fd49a0b03b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:04.019842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:04.021389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:04.040511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64c1fc-4f2b-4301-98a7-aebe23312465 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:04.103357 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:04.178544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:04.180779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.181440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.183895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] PATH_INFO: `/v3/projects/167cd0dcb02d4a54a023696fc0c888b3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.186451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167cd0dcb02d4a54a023696fc0c888b3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:04.188911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:04.346933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167cd0dcb02d4a54a023696fc0c888b3', 'request_id': 'req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:04.358837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167cd0dcb02d4a54a023696fc0c888b3', 'request_id': 'req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:04.381779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167cd0dcb02d4a54a023696fc0c888b3', 'request_id': 'req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:04.408015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] The token cache is being invalidate because project 167cd0dcb02d4a54a023696fc0c888b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:04:04.408834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:04.409682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e52cf81e-70fa-4c59-bcf8-7a6da23331b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:04.412642 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2289/4597] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:04:04 2022] DELETE /identity/v3/projects/167cd0dcb02d4a54a023696fc0c888b3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:04.417423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.417920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.418002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.495657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:04.497805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:04.544844 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:04.585211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2309/4598] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:04:04.593092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.593587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.593957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.631195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:04.632522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:04.658405 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2290/4599] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:04.662341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:04.676759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263d9d1-f998-4b1a-8e44-394f6ee934ac None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:04.682726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:04.683582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.684007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.684451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.685321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:04:04.685766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:04.687530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:04.705777 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2310/4600] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:04:04.709827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:04.720194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c3ad-2715-4ecc-8dd6-a15ee8f1b5d8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:04.730287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:04.731307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.738486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.738833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.739835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:04.741908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:04.788356 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2291/4601] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:04:04 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:04.792468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:04.807082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aedd4-8313-42e0-9ddc-372336aa80a2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:04.892445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:04.893432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.894654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.895562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.895828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:04.897882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:04.924463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2311/4602] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:04:04 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:04.929152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:04.941054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eab7d2-c670-45fb-9312-20aebf5486c7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:04.947047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:04.947936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.949410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.949410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.949692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:04.951421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:04.965281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2292/4603] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:04.969422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:04.982663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c576b0-e013-4df8-befd-3241b580ebe0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:04.988148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf582-804a-4d72-80a5-8e8844325700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:04.989080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf582-804a-4d72-80a5-8e8844325700 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:04.989191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf582-804a-4d72-80a5-8e8844325700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:04.989409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf582-804a-4d72-80a5-8e8844325700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:04.990158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf582-804a-4d72-80a5-8e8844325700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:04.991939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf582-804a-4d72-80a5-8e8844325700 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.008212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2312/4604] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:05.013281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.028272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b65c-b197-4138-9801-483b8801c027 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.033159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.034203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.034486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.034790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] PATH_INFO: `/v3/projects/2c3a865b6ab24d60ad7d278570867035/users/df072ac2cb8f4983916a7fe8a125ddf9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.052813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3a865b6ab24d60ad7d278570867035, user_id=df072ac2cb8f4983916a7fe8a125ddf9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.056986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.072042 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2293/4605] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:04:05 2022] PUT /identity/v3/projects/2c3a865b6ab24d60ad7d278570867035/users/df072ac2cb8f4983916a7fe8a125ddf9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:05.084562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.084851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.085131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.115073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] MFA Rules not processed for user `df072ac2cb8f4983916a7fe8a125ddf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:05.116350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:05.205691 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2313/4606] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:05.210475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.288762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d213e-5c9e-487e-9e4c-46697bf8e191 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.294784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.295728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.296087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.296438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.297259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.299319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.304875 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:05.349864 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2294/4607] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:04:05 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:05.352073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.372082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c1f8-3269-4c26-8384-55f757181a96 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.416719 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:05.465869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.466707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.467024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.467401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.468287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.470552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.498358 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2314/4608] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:04:05 2022] POST /identity/v3/users => generated 302 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:04:05.502551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.520618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953401-a559-43b5-ad0c-d8188676f76d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.526271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.527144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.527786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.528170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.529024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.530805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.546349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2295/4609] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:05.547626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.566438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6559f-e3b4-430f-80d3-74c2ea9168e8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.576576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.577655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.578080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.578512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] PATH_INFO: `/v3/projects/36c1dcd10f5949b6ad69c4c96e12a7b4/users/0833996f14f44edebf1e0bc368fd744c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.598897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c1dcd10f5949b6ad69c4c96e12a7b4, user_id=0833996f14f44edebf1e0bc368fd744c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.601870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.620840 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2315/4610] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:04:05 2022] PUT /identity/v3/projects/36c1dcd10f5949b6ad69c4c96e12a7b4/users/0833996f14f44edebf1e0bc368fd744c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:05.625000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.635935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadef374-1021-4a40-bbb1-aebf8344ece0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.720094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a615d-b6cf-44f2-be0b-c883ad699890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.721050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a615d-b6cf-44f2-be0b-c883ad699890 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.721493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a615d-b6cf-44f2-be0b-c883ad699890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.721820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a615d-b6cf-44f2-be0b-c883ad699890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.722617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a615d-b6cf-44f2-be0b-c883ad699890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.725355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a615d-b6cf-44f2-be0b-c883ad699890 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.738591 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2296/4611] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:05.742803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.774792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef24b8-54af-4a35-858c-313697def4a7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:05.791354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:05.792359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.792792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.794749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] PATH_INFO: `/v3/projects/36c1dcd10f5949b6ad69c4c96e12a7b4/users/0833996f14f44edebf1e0bc368fd744c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.799318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c1dcd10f5949b6ad69c4c96e12a7b4, user_id=0833996f14f44edebf1e0bc368fd744c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:05.802263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:05.821837 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2316/4612] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:04:05 2022] PUT /identity/v3/projects/36c1dcd10f5949b6ad69c4c96e12a7b4/users/0833996f14f44edebf1e0bc368fd744c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:05.833594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f218d7d-80a3-4705-bc52-91510ca70196 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:05.834120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f218d7d-80a3-4705-bc52-91510ca70196 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:05.834404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f218d7d-80a3-4705-bc52-91510ca70196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:05.870642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1f218d7d-80a3-4705-bc52-91510ca70196 None None] MFA Rules not processed for user `0833996f14f44edebf1e0bc368fd744c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:05.871878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1f218d7d-80a3-4705-bc52-91510ca70196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:05.983664 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2297/4613] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:05.995972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:05.997797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:06.096149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba2fb1-7430-407c-8653-89556f6c969c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:06.100643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ea988-dfd0-4d16-9aca-82cabc79cb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:06.101346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea988-dfd0-4d16-9aca-82cabc79cb8d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:06.101633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea988-dfd0-4d16-9aca-82cabc79cb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:06.102068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea988-dfd0-4d16-9aca-82cabc79cb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:06.113715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ea988-dfd0-4d16-9aca-82cabc79cb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:06.115298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ea988-dfd0-4d16-9aca-82cabc79cb8d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:06.127230 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2317/4614] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:07.943391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168227-0ffb-4c01-890b-10c56b2db309 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:07.943876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168227-0ffb-4c01-890b-10c56b2db309 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:07.943986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168227-0ffb-4c01-890b-10c56b2db309 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:07.945672 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2298/4615] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:04:07.951158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:07.952146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:07.952608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:08.011269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:08.013015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:08.116865 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:08.136787 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2318/4616] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:08.154646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168227-0ffb-4c01-890b-10c56b2db309 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:08.156443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-97168227-0ffb-4c01-890b-10c56b2db309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:08.196433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168227-0ffb-4c01-890b-10c56b2db309 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:08.205772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:08.206508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:08.206803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:08.207078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:08.232333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:08.234153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:08.267699 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2299/4617] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:10.079877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:10.081420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:10.096299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b316e-5fb7-439a-84ac-1ff28b25384c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:10.101267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:10.102536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:10.103603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:10.104118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:10.106403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:10.197837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:10.201612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:10.214472 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2319/4618] 10.222.0.77 () {60 vars in 1396 bytes} [Mon Jul 11 15:04:10 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3305 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:13.801718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:13.803997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:13.823679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d710-d608-4e29-a657-41f6d1549d2c service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:13.830450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:13.831521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:13.831994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:13.832275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:13.834183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:13.848536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:13.850819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6bae-7c2a-4869-bf05-baf1ef6af7e8 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:13.862947 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2300/4619] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:14.211679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:14.317487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5b72-018f-44d4-97d0-cd8ba7f514ce service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:14.324708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:14.325949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:14.326453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:14.327259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] PATH_INFO: `/v3/users/df072ac2cb8f4983916a7fe8a125ddf9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:14.329614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df072ac2cb8f4983916a7fe8a125ddf9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:14.333595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:14.424958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df072ac2cb8f4983916a7fe8a125ddf9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:14.426468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df072ac2cb8f4983916a7fe8a125ddf9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:14.442800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df072ac2cb8f4983916a7fe8a125ddf9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:14.444031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df072ac2cb8f4983916a7fe8a125ddf9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:14.454353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df072ac2cb8f4983916a7fe8a125ddf9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:14.475168 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2320/4620] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:04:14 2022] DELETE /identity/v3/users/df072ac2cb8f4983916a7fe8a125ddf9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:14.480340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:14.480633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:14.480915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:14.510465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:14.511701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:14.567539 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:14.657947 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2301/4621] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:14.682310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:14.687343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:14.742641 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:14.841962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05834-e2eb-4dc2-9b25-f7b64e30b541 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:14.848830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:14.850251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:14.850806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:14.851203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:14.862540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:14.864074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:14.875778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2321/4622] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:15.738496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:15.740196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:15.766620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72aa03-4b01-49fd-a9d1-1d7f0dcbe610 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:15.773829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:15.774743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:15.775211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:15.775621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] PATH_INFO: `/v3/projects/2c3a865b6ab24d60ad7d278570867035` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:15.776984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3a865b6ab24d60ad7d278570867035)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:15.779300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:15.892935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3a865b6ab24d60ad7d278570867035', 'request_id': 'req-13c72dc1-065c-4e0c-8a14-9590434bbc87'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:15.925057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3a865b6ab24d60ad7d278570867035', 'request_id': 'req-13c72dc1-065c-4e0c-8a14-9590434bbc87'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:15.944998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3a865b6ab24d60ad7d278570867035', 'request_id': 'req-13c72dc1-065c-4e0c-8a14-9590434bbc87'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:15.967001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] The token cache is being invalidate because project 2c3a865b6ab24d60ad7d278570867035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:04:15.967633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:15.968627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:15.971137 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2302/4623] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:04:15 2022] DELETE /identity/v3/projects/2c3a865b6ab24d60ad7d278570867035 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:15.975362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:15.989182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb5dee-b88b-41dd-a344-cdf97e7aa0f1 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:16.111315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:16.112976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:16.113363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:16.113741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] PATH_INFO: `/v3/users/0833996f14f44edebf1e0bc368fd744c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:16.115228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0833996f14f44edebf1e0bc368fd744c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:16.117677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:16.215128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0833996f14f44edebf1e0bc368fd744c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.218954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0833996f14f44edebf1e0bc368fd744c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.247401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0833996f14f44edebf1e0bc368fd744c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.250660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0833996f14f44edebf1e0bc368fd744c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.272822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c1e9400c-6bd6-4aeb-946a-961daaddde86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0833996f14f44edebf1e0bc368fd744c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.294764 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2322/4624] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:04:15 2022] DELETE /identity/v3/users/0833996f14f44edebf1e0bc368fd744c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:16.745975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:16.748436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:16.787503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c72dc1-065c-4e0c-8a14-9590434bbc87 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:16.872473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:16.873507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:16.873912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:16.874243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] PATH_INFO: `/v3/projects/36c1dcd10f5949b6ad69c4c96e12a7b4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:16.876021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c1dcd10f5949b6ad69c4c96e12a7b4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:16.878334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:16.943971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c1dcd10f5949b6ad69c4c96e12a7b4', 'request_id': 'req-2ccce784-b741-45fb-9ec9-3e161a434e2b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.948146 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:16.952792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c1dcd10f5949b6ad69c4c96e12a7b4', 'request_id': 'req-2ccce784-b741-45fb-9ec9-3e161a434e2b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.966454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c1dcd10f5949b6ad69c4c96e12a7b4', 'request_id': 'req-2ccce784-b741-45fb-9ec9-3e161a434e2b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.982284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] The token cache is being invalidate because project 36c1dcd10f5949b6ad69c4c96e12a7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:04:16.982730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.983575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2ccce784-b741-45fb-9ec9-3e161a434e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:16.985450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2303/4625] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:04:16 2022] DELETE /identity/v3/projects/36c1dcd10f5949b6ad69c4c96e12a7b4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:16.990333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:16.991418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:16.991894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.017686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:17.020449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.063219 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:17.126552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2323/4626] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:17.133434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.133712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.134079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.153732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:17.154659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.168279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.175676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2304/4627] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:17.180360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40265926-f04b-4e64-8228-35fe473a9b9c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.185718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.186545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.186849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.187128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.188127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:04:17.188247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.190474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.207002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2324/4628] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:04:17.212058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.223544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274cc75-a497-4ba3-a9d5-d86b326fcd89 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.231593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.232464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.232755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.236057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.236057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.247800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.298366 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2305/4629] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:04:17 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:17.300650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.316589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa8a4-1d33-429f-8367-a3281ccd6fd1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.424741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.425721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.426195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.426652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.427666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.429793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.459983 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2325/4630] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:04:17 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:17.461184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.489776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c8bd5-96c0-4e97-99ec-57c2a12320d8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.497648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.498405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.498722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.499179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.500073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.506805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.544924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2306/4631] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:17.546565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.566749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e93a0-56ec-43bc-846a-5ac7eb5d3453 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.572552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94797f-17c9-4d62-9574-e0193b008414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.573237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94797f-17c9-4d62-9574-e0193b008414 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.573522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94797f-17c9-4d62-9574-e0193b008414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.573802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94797f-17c9-4d62-9574-e0193b008414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.575379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94797f-17c9-4d62-9574-e0193b008414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.577371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94797f-17c9-4d62-9574-e0193b008414 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.605916 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2326/4632] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:17.607038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.627848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e84e5-7ca0-46e9-95f0-bc4a0714bfd8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.642179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.643665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.643952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.644233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] PATH_INFO: `/v3/projects/cb4a0e8b96ef4ebc943af0e8f13041a3/users/c5a7f54ac1a342c5888132f76e9b8136/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.675677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4a0e8b96ef4ebc943af0e8f13041a3, user_id=c5a7f54ac1a342c5888132f76e9b8136, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.678723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.698222 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2307/4633] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:04:17 2022] PUT /identity/v3/projects/cb4a0e8b96ef4ebc943af0e8f13041a3/users/c5a7f54ac1a342c5888132f76e9b8136/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:17.710581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208926c-e6a9-4b56-b345-d44617828f59 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.710875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208926c-e6a9-4b56-b345-d44617828f59 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.711158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208926c-e6a9-4b56-b345-d44617828f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.743577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3208926c-e6a9-4b56-b345-d44617828f59 None None] MFA Rules not processed for user `c5a7f54ac1a342c5888132f76e9b8136`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:17.744792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3208926c-e6a9-4b56-b345-d44617828f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.902460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2327/4634] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:17.914226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.916399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:18.025449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4439-cda7-4c27-bd34-310d92a00077 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:18.031796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:18.033754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:18.034417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:18.035628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:18.047836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:18.050432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:18.061995 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2308/4635] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:19.070801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1ea80-26bb-4bd8-8db9-c8efc223b9cf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:19.071412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1ea80-26bb-4bd8-8db9-c8efc223b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:19.071412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1ea80-26bb-4bd8-8db9-c8efc223b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:19.091467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-18c1ea80-26bb-4bd8-8db9-c8efc223b9cf None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:19.093313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18c1ea80-26bb-4bd8-8db9-c8efc223b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:19.133673 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:19.177321 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2328/4636] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:20.886992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:20.889124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:20.962715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c1c8-9328-4e02-8985-a886b7051674 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:20.963735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c1c8-9328-4e02-8985-a886b7051674 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:20.964147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c1c8-9328-4e02-8985-a886b7051674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:21.009624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eb71c1c8-9328-4e02-8985-a886b7051674 None None] MFA Rules not processed for user `72be490a451b45eaa4879340a06b51f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:21.013281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb71c1c8-9328-4e02-8985-a886b7051674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:21.163442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899153-ee71-4392-912a-ff46e7aca005 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:21.172297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:21.173330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:21.173818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:21.175011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:21.177401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:21.198349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:21.200614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706634-b7af-48ad-832c-6d4787ff619d service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:21.232821 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2309/4637] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:21.255957 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2329/4638] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:04:21.268301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:21.269910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:21.270596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:21.316948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] MFA Rules not processed for user `72be490a451b45eaa4879340a06b51f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:21.320080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:21.355282 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2310/4639] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:21.378440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:21.379726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:21.380560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:21.427814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:21.429462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:21.456656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2330/4640] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:25.767457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:25.770767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:25.781429 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:25.952771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a6c7-2f4e-48ad-a11e-f3044c452934 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:25.962286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:25.963476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:25.964073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:25.964464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:25.967794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:26.078989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:26.081792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:26.094433 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2311/4641] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:29.074138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:29.089777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:29.164546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44e634-9370-4846-823c-8af4966a8f72 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:29.185733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:29.187863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:29.187863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:29.187863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:29.193258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:29.223231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:29.240232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287192e3-c39e-4d3c-a4df-f6f2ef4692f9 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:29.262123 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2331/4642] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:36.088226 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=62 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:39.248446 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=45 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:40.782919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:40.815296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df939d0-f58d-4c92-8e40-aeaf107451f6 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:40.841542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:40.842676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:40.843232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:40.843602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:40.848390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:40.976466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:40.978249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:40.998431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2312/4643] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:48.564850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:48.565853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:48.566365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:48.596017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:48.597540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:48.606372 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2332/4644] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:50.656527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:50.677244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11953c8-b03c-4dc2-8ce2-1e9efc73c764 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:50.705398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:50.708293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:50.710450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:50.713307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:50.718855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:50.879994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:50.882674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e53277-7a18-46a7-9b3f-c0c1f08c079b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:50.917648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2313/4645] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:55.011512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:55.164818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251551-e6d3-465b-8198-825b9c2032c0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:55.170391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:55.171373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:55.171660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:55.171939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] PATH_INFO: `/v3/users/c5a7f54ac1a342c5888132f76e9b8136` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:55.173212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a7f54ac1a342c5888132f76e9b8136)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:55.176487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:55.251954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a7f54ac1a342c5888132f76e9b8136'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:55.253163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a7f54ac1a342c5888132f76e9b8136'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:55.272564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a7f54ac1a342c5888132f76e9b8136'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:55.274129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a7f54ac1a342c5888132f76e9b8136'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:55.285719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a7f54ac1a342c5888132f76e9b8136'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:55.309825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2333/4646] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:04:55 2022] DELETE /identity/v3/users/c5a7f54ac1a342c5888132f76e9b8136 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:55.314907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:55.315837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:55.316338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:55.337739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:55.339716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:55.441402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2314/4647] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:55.469309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:55.471285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:55.614797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901188-ddf3-43c2-98fc-a138cbec8f28 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:55.635692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ac3e-12b1-45a6-88f2-f30079ab9cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:55.636699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ac3e-12b1-45a6-88f2-f30079ab9cae service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:55.637140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ac3e-12b1-45a6-88f2-f30079ab9cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:55.637703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ac3e-12b1-45a6-88f2-f30079ab9cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:55.656977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ac3e-12b1-45a6-88f2-f30079ab9cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:55.673472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ac3e-12b1-45a6-88f2-f30079ab9cae service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:55.687373 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2334/4648] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:56.326048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:56.327819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:56.348643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9eb8-2f55-4f8b-a208-90a62540f755 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:56.364206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:56.366609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:56.366609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:56.367035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] PATH_INFO: `/v3/projects/cb4a0e8b96ef4ebc943af0e8f13041a3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:56.368736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4a0e8b96ef4ebc943af0e8f13041a3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:56.375080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:56.488376 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:56.533518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4a0e8b96ef4ebc943af0e8f13041a3', 'request_id': 'req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:56.564260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4a0e8b96ef4ebc943af0e8f13041a3', 'request_id': 'req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:56.580422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4a0e8b96ef4ebc943af0e8f13041a3', 'request_id': 'req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:56.607166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] The token cache is being invalidate because project cb4a0e8b96ef4ebc943af0e8f13041a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:04:56.607814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:56.612347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a90ad1aa-8c50-4a7e-82f4-167dbcfd268e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:04:56.614719 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2315/4649] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:04:56 2022] DELETE /identity/v3/projects/cb4a0e8b96ef4ebc943af0e8f13041a3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:56.619376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:56.619876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:56.619962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:56.655899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:56.657724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:56.685076 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:56.813041 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2335/4650] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:56.821119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:56.821831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:56.822330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:56.845589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:56.847453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:56.859532 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2316/4651] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:56.863795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:56.880214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a5828-67de-4d92-87aa-f6b0f938cf6f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:56.896088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:56.896765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:56.897552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:56.897552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:56.898035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:04:56.898346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:56.900001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:56.923992 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2336/4652] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:04:56.929796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:56.942397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf51e5-9aa3-4b9b-9473-5b4a22815d6d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:56.964046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:56.965672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:56.968704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:56.971199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:56.974141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:56.980542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:57.031192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2317/4653] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:04:56 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:57.035604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:57.061548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d050-6b15-4f6e-acc2-6fa0c71a1d38 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:57.197939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:57.198671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:57.199230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:57.199792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:57.200568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:57.202553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:57.239268 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2337/4654] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:04:57 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:04:57.240543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:57.256410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa85ee-e63d-455f-928b-401ffa22db15 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:57.269504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:57.270464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:57.270787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:57.271069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:57.271986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:57.274770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:57.294208 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2318/4655] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:57.296605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:57.318678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9132445-3787-4259-a45b-f3f5c0bca4ab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:57.326715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1ec04-8061-40f5-a766-ad6e6388879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:57.327564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ec04-8061-40f5-a766-ad6e6388879a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:57.327978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ec04-8061-40f5-a766-ad6e6388879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:57.328339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ec04-8061-40f5-a766-ad6e6388879a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:57.329204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1ec04-8061-40f5-a766-ad6e6388879a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:57.331913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1ec04-8061-40f5-a766-ad6e6388879a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:57.352781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2338/4656] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:04:57.356779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:57.385687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460580-5112-471b-9efd-b4178001d030 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:57.400162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:57.401542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:57.402034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:57.402614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] PATH_INFO: `/v3/projects/d63a3d5be2934710a4d74c716879a249/users/da144bb86ad34ec6805fb6f8b19be960/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:57.428284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63a3d5be2934710a4d74c716879a249, user_id=da144bb86ad34ec6805fb6f8b19be960, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:57.432040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:57.487041 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2319/4657] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:04:57 2022] PUT /identity/v3/projects/d63a3d5be2934710a4d74c716879a249/users/da144bb86ad34ec6805fb6f8b19be960/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:04:57.490654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:57.492192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:57.493544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:57.587085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] MFA Rules not processed for user `da144bb86ad34ec6805fb6f8b19be960`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:04:57.591356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:57.731229 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2339/4658] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:04:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:04:57.759249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:57.762088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:57.912803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8655578-4720-43dc-b5e4-85bc53457d18 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:57.916866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bc6ee-a36b-4339-8962-1de31b1d7eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:57.917830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bc6ee-a36b-4339-8962-1de31b1d7eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:57.918329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bc6ee-a36b-4339-8962-1de31b1d7eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:57.918797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bc6ee-a36b-4339-8962-1de31b1d7eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:57.949676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bc6ee-a36b-4339-8962-1de31b1d7eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:57.952128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bc6ee-a36b-4339-8962-1de31b1d7eb3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:57.974701 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2320/4659] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:06.872481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:06.873935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:06.899669 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:07.013583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad72-e55f-4c25-8e5d-8eb4f26e5b72 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:07.024719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:07.036117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:07.036414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:07.036746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] PATH_INFO: `/v3/users/b41b55f344804dcea0d8cb04c650f659` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:07.039531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41b55f344804dcea0d8cb04c650f659)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:07.041467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:07.166079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41b55f344804dcea0d8cb04c650f659'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:07.166793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41b55f344804dcea0d8cb04c650f659'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:07.201761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41b55f344804dcea0d8cb04c650f659'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:07.202595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41b55f344804dcea0d8cb04c650f659'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:07.211654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41b55f344804dcea0d8cb04c650f659'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:07.236051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2340/4660] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:05:06 2022] DELETE /identity/v3/users/b41b55f344804dcea0d8cb04c650f659 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:07.240999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:07.241457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:07.241563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:07.271747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:07.273318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:07.382463 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:07.403740 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2321/4661] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:07.420692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:07.422368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:07.617293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5315e-a42b-46e3-a06b-e042c046b347 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:07.621983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df46ba9-7ed8-4c9b-b877-96d421dbf07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:07.622853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46ba9-7ed8-4c9b-b877-96d421dbf07e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:07.623283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46ba9-7ed8-4c9b-b877-96d421dbf07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:07.623727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46ba9-7ed8-4c9b-b877-96d421dbf07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:07.640438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df46ba9-7ed8-4c9b-b877-96d421dbf07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:07.641926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df46ba9-7ed8-4c9b-b877-96d421dbf07e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:07.666561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2341/4662] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:08.187043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:08.188549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:08.224845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290aeed-8725-4289-be3f-6f4fb570b55e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:08.243992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:08.246166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:08.246682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:08.247246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] PATH_INFO: `/v3/projects/e9e6ec390a0342c7b3e2aacbf73a7021` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:08.248743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e6ec390a0342c7b3e2aacbf73a7021)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:08.251525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:08.377918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e6ec390a0342c7b3e2aacbf73a7021', 'request_id': 'req-87787aba-8690-460d-b5cd-79135114c33a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:08.387663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e6ec390a0342c7b3e2aacbf73a7021', 'request_id': 'req-87787aba-8690-460d-b5cd-79135114c33a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:08.404557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e6ec390a0342c7b3e2aacbf73a7021', 'request_id': 'req-87787aba-8690-460d-b5cd-79135114c33a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:08.419417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] The token cache is being invalidate because project e9e6ec390a0342c7b3e2aacbf73a7021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:05:08.419866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:08.420532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87787aba-8690-460d-b5cd-79135114c33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:08.427291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:08.427802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:08.427898 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2322/4663] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:05:08 2022] DELETE /identity/v3/projects/e9e6ec390a0342c7b3e2aacbf73a7021 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:08.428018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:08.460502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:08.461801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:08.528116 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:08.613381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2342/4664] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:05:08.621051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:08.621350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:08.621634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:08.654850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:08.656098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:08.681130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2323/4665] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:05:08.686590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:08.707031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59f564-915b-4331-9997-f0af58492d9c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:08.738106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:08.741082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:08.741904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:08.742828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:08.745060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:05:08.745811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:08.752224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:08.779831 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2343/4666] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:05:08.785625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:08.806588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13425f92-34d4-4517-99e2-20bbb4fa4a15 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:08.827633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:08.831689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:08.832010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:08.832210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:08.832881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:08.834853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:08.907324 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2324/4667] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:05:08 2022] POST /identity/v3/projects => generated 351 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:05:08.919535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:08.936885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c59fb4-2d88-497c-bb50-4351381a3392 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:09.067250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:09.068214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:09.069172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:09.069946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:09.072383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:09.074911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:09.101534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2344/4668] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:05:08 2022] POST /identity/v3/users => generated 276 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:09.102884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:09.116162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb34441-1ce7-4d60-a8e6-a0a965dbe435 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:09.123143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:09.124117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:09.124759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:09.125307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:09.127029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:09.131809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:09.148691 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2325/4669] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:09.153196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:09.168154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16011092-4241-488c-a6d3-27b967418534 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:09.175121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683f781-dd65-4623-b6c6-10d0037aa7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:09.175905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683f781-dd65-4623-b6c6-10d0037aa7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:09.176415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683f781-dd65-4623-b6c6-10d0037aa7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:09.176799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683f781-dd65-4623-b6c6-10d0037aa7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:09.177962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683f781-dd65-4623-b6c6-10d0037aa7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:09.181985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683f781-dd65-4623-b6c6-10d0037aa7b7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:09.196376 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2345/4670] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:09.201308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:09.222367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabe72-0103-4aa9-9a35-89085608ad0b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:09.232566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:09.233653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:09.234043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:09.234471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] PATH_INFO: `/v3/projects/c0031c529e0145b087f026ab9ed34400/users/54e8dff0da104889b6bec86619aa672a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:09.272601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0031c529e0145b087f026ab9ed34400, user_id=54e8dff0da104889b6bec86619aa672a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:09.275628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:09.306880 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2326/4671] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:09 2022] PUT /identity/v3/projects/c0031c529e0145b087f026ab9ed34400/users/54e8dff0da104889b6bec86619aa672a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:09.317380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:09.317874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:09.318236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:09.369957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] MFA Rules not processed for user `54e8dff0da104889b6bec86619aa672a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:09.371385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:09.542158 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2346/4672] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:09.559185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:09.561024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:09.658551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565edbd-f81a-496a-a37b-ca4b9ce6a502 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:09.664075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87494c-6f45-4f73-86af-4aeba31658db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:09.664864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87494c-6f45-4f73-86af-4aeba31658db service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:09.665282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87494c-6f45-4f73-86af-4aeba31658db service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:09.665670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87494c-6f45-4f73-86af-4aeba31658db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:09.678406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87494c-6f45-4f73-86af-4aeba31658db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:09.680158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87494c-6f45-4f73-86af-4aeba31658db service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:09.703002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2327/4673] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:09 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:13.518960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:13.573624 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:13.620431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef22c12-890f-4eaa-9395-ad34b021479f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:13.626667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:13.627753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:13.628220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:13.628651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] PATH_INFO: `/v3/users/54e8dff0da104889b6bec86619aa672a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:13.643264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e8dff0da104889b6bec86619aa672a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:13.645350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:13.764712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e8dff0da104889b6bec86619aa672a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:13.765719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e8dff0da104889b6bec86619aa672a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:13.780724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e8dff0da104889b6bec86619aa672a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:13.781779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e8dff0da104889b6bec86619aa672a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:13.793687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e8dff0da104889b6bec86619aa672a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:13.835228 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2347/4674] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:05:13 2022] DELETE /identity/v3/users/54e8dff0da104889b6bec86619aa672a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:13.839528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:13.840041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:13.840134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:13.868178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:13.869440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:13.938196 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:14.072991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2328/4675] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:14.159002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:14.160594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:14.278033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89dd0-aea4-4988-8c72-16ac9f1aafb1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:14.289986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d164e1-9611-4f0e-95ea-32bfe713d353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:14.292557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d164e1-9611-4f0e-95ea-32bfe713d353 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:14.293152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d164e1-9611-4f0e-95ea-32bfe713d353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:14.293624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d164e1-9611-4f0e-95ea-32bfe713d353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:14.318105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d164e1-9611-4f0e-95ea-32bfe713d353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:14.347505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d164e1-9611-4f0e-95ea-32bfe713d353 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:14.376214 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2348/4676] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:14.961172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:14.963307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:14.980784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f471a-f1a5-4363-aa84-acb23d304d86 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:14.987227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:14.988478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:14.988946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:14.989368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] PATH_INFO: `/v3/projects/c0031c529e0145b087f026ab9ed34400` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:14.990871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0031c529e0145b087f026ab9ed34400)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:14.993926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.094139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0031c529e0145b087f026ab9ed34400', 'request_id': 'req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:15.111830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0031c529e0145b087f026ab9ed34400', 'request_id': 'req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:15.122771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0031c529e0145b087f026ab9ed34400', 'request_id': 'req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:15.141310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] The token cache is being invalidate because project c0031c529e0145b087f026ab9ed34400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:05:15.142065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:15.143262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c01a2c42-4ebf-4d5f-9049-8d46a41a9012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:15.148717 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2329/4677] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:05:14 2022] DELETE /identity/v3/projects/c0031c529e0145b087f026ab9ed34400 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:15.153549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.154046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.154412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.192579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:15.193817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:15.259492 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:15.280246 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2349/4678] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:15.289135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.290120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.290577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.317169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:15.319302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:15.330172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2330/4679] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:05:15.334081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:15.348837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c4031-cd78-4979-a1c8-f552a706b44b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:15.380031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:15.382084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.382840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.383333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.384403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:05:15.387047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:15.394192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.414264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2350/4680] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:05:15.418699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:15.436249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e5c8-abd2-434f-8b8e-ca1b2c74ee3b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:15.444234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375574e-e4df-4985-a4ab-b6793608d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:15.445800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375574e-e4df-4985-a4ab-b6793608d27d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.446334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375574e-e4df-4985-a4ab-b6793608d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.447027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375574e-e4df-4985-a4ab-b6793608d27d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.447891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375574e-e4df-4985-a4ab-b6793608d27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:15.450392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375574e-e4df-4985-a4ab-b6793608d27d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.492163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2331/4681] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:05:15 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:15.496001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:15.515723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f24a7-4683-4621-a737-9fcee5641975 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:15.528157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.528558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.528908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.572006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:15.576639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:15.686294 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2332/4682] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:15.691749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:15.692587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.692882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.693165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.693866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:15.695832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.726090 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2351/4683] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:05:15 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:15.730172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:15.746163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c848a2-5603-4b61-b205-65ecc383f9b0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:15.753270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:15.754153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.754517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.754807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.755787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:15.757575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.775310 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2333/4684] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:05:15.777912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:15.799019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04763-d47c-4fcf-a3c3-df3628862628 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:15.805675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23722a-1c64-4ebf-bea1-f83701748f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:15.805812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23722a-1c64-4ebf-bea1-f83701748f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.805987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23722a-1c64-4ebf-bea1-f83701748f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.806266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23722a-1c64-4ebf-bea1-f83701748f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.807100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23722a-1c64-4ebf-bea1-f83701748f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:15.809177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23722a-1c64-4ebf-bea1-f83701748f96 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.825326 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2352/4685] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:15.829631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:15.842777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d071d-9f23-4647-b743-d6631fff4cb7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:15.848532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:15.849817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.849817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.850013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] PATH_INFO: `/v3/projects/9777c1a80acf4fa2815c26a7f9e3fd8f/users/bbf37be384b148bb9de191c3d4c637c7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.860315 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:15.881851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9777c1a80acf4fa2815c26a7f9e3fd8f, user_id=bbf37be384b148bb9de191c3d4c637c7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:15.891744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:15.919506 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2334/4686] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:15 2022] PUT /identity/v3/projects/9777c1a80acf4fa2815c26a7f9e3fd8f/users/bbf37be384b148bb9de191c3d4c637c7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:15.929438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:15.929901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:15.930189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:15.988777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] MFA Rules not processed for user `bbf37be384b148bb9de191c3d4c637c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:15.990077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:16.153376 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2353/4687] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:16.158218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:16.306116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772eb07-ab7b-4133-a67e-bbe9f7bab609 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:16.322567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:16.323362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.323483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.323995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.324720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:16.326695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:16.363248 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2335/4688] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:05:16 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:16.363932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:16.382808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4cd04-2ad3-4b92-bb5c-4c6ea21c7822 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:16.434409 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:16.453876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:16.454585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.454930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.455338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.456127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:16.458210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:16.492450 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2354/4689] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:05:16 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:05:16.496772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:16.512169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a58cf4-0471-48b8-949f-db67e27e76be admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:16.522347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:16.529443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.529721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.530008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.530793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:16.534359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:16.556802 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2336/4690] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:16.561213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:16.579852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83893a1-04bc-4ece-a4b4-ce8e364f4f4d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:16.593863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:16.595221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.597278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.597797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] PATH_INFO: `/v3/projects/b314913debf64bc4bb607ea287719160/users/e7a621d3a589468790487250147fda4d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.638788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b314913debf64bc4bb607ea287719160, user_id=e7a621d3a589468790487250147fda4d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:16.643420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:16.673490 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2355/4691] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:16 2022] PUT /identity/v3/projects/b314913debf64bc4bb607ea287719160/users/e7a621d3a589468790487250147fda4d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:16.676337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:16.691347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bb953-2fa7-4233-8bf6-a3420988fbcf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:16.832530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093fd8-e3ac-43c0-b431-b6e47e29949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:16.833375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093fd8-e3ac-43c0-b431-b6e47e29949b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.833672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093fd8-e3ac-43c0-b431-b6e47e29949b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.833950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093fd8-e3ac-43c0-b431-b6e47e29949b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.834717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf093fd8-e3ac-43c0-b431-b6e47e29949b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:16.836339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf093fd8-e3ac-43c0-b431-b6e47e29949b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:16.856489 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2337/4692] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:16.857681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:16.871338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6086f1-da04-44ff-97a7-5380dbbafb2b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:16.888016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:16.889113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.889402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.889681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] PATH_INFO: `/v3/projects/b314913debf64bc4bb607ea287719160/users/e7a621d3a589468790487250147fda4d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.898825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b314913debf64bc4bb607ea287719160, user_id=e7a621d3a589468790487250147fda4d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:16.901335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:16.928932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2356/4693] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:16 2022] PUT /identity/v3/projects/b314913debf64bc4bb607ea287719160/users/e7a621d3a589468790487250147fda4d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:16.940413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9388-b000-49b8-b7d9-76ef837047f9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:16.941861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9388-b000-49b8-b7d9-76ef837047f9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:16.942153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9388-b000-49b8-b7d9-76ef837047f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:16.992291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-87da9388-b000-49b8-b7d9-76ef837047f9 None None] MFA Rules not processed for user `e7a621d3a589468790487250147fda4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:16.993518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-87da9388-b000-49b8-b7d9-76ef837047f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:17.126692 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:17.186628 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2338/4694] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:05:18.063818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:18.065689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:18.260079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8a828-4aa7-40bc-a712-49fa9ea514cf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:18.273894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:18.274634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:18.274928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:18.275207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:18.291859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:18.293324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:18.308119 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2357/4695] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:24.334364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:24.335317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:24.335616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:24.364173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:24.365457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:24.446872 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2339/4696] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:24.513109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:24.515169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:24.622960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56f30-a306-4ecc-a827-722298eff4aa service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:24.629752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d27f0-08a8-45e5-87b3-d5929bd0653f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:24.630879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d27f0-08a8-45e5-87b3-d5929bd0653f service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:24.631249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d27f0-08a8-45e5-87b3-d5929bd0653f service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:24.631601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d27f0-08a8-45e5-87b3-d5929bd0653f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:24.642704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d27f0-08a8-45e5-87b3-d5929bd0653f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:24.645364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d27f0-08a8-45e5-87b3-d5929bd0653f service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:24.676167 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2358/4697] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:05:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:05:27.500750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:27.511972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6adcd8-e1d4-4560-8d88-0396bb941358 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:27.517944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:27.518962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:27.519427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:27.519865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:27.645738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:27.647213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:27.681961 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2340/4698] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:33.766310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba6ad-07b6-4f86-bc6d-6ff912b7ad96 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:33.766851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba6ad-07b6-4f86-bc6d-6ff912b7ad96 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:33.767297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba6ad-07b6-4f86-bc6d-6ff912b7ad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:33.805546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ba3ba6ad-07b6-4f86-bc6d-6ff912b7ad96 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:33.816010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ba3ba6ad-07b6-4f86-bc6d-6ff912b7ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:33.863503 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:34.025103 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2359/4699] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:36.753707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:36.961941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e266a7-2669-4e04-9935-029d0e91d6e2 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:36.969062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:36.973748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:36.974051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:36.974363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] PATH_INFO: `/v3/users/bbf37be384b148bb9de191c3d4c637c7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:36.979197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf37be384b148bb9de191c3d4c637c7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:36.984053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:37.101660 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:37.135888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf37be384b148bb9de191c3d4c637c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:37.163613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf37be384b148bb9de191c3d4c637c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:37.181507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf37be384b148bb9de191c3d4c637c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:37.194886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf37be384b148bb9de191c3d4c637c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:37.195769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf37be384b148bb9de191c3d4c637c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:37.207594 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2341/4700] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:05:36 2022] DELETE /identity/v3/users/bbf37be384b148bb9de191c3d4c637c7 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:37.216480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:37.216953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:37.217058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:37.263846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:37.265905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:37.395076 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2360/4701] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:37.545825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:37.549764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:37.726822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183ff3-d44f-447c-8646-28263b299de4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:37.747637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:37.748328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:37.748612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:37.748983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:37.764144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:37.766174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:37.786655 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2342/4702] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:40.780963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:40.783199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:40.817685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42cdcf-ba84-46c9-8a17-5d91e34fa0a9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:40.826737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:40.827956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:40.828404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:40.828852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] PATH_INFO: `/v3/projects/9777c1a80acf4fa2815c26a7f9e3fd8f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:40.831056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9777c1a80acf4fa2815c26a7f9e3fd8f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:40.833339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:40.946633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9777c1a80acf4fa2815c26a7f9e3fd8f', 'request_id': 'req-469f5616-4515-4810-9b93-0a358e682f5f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:40.966752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9777c1a80acf4fa2815c26a7f9e3fd8f', 'request_id': 'req-469f5616-4515-4810-9b93-0a358e682f5f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:40.977544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9777c1a80acf4fa2815c26a7f9e3fd8f', 'request_id': 'req-469f5616-4515-4810-9b93-0a358e682f5f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.006695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] The token cache is being invalidate because project 9777c1a80acf4fa2815c26a7f9e3fd8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:05:41.007230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.009865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.013960 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2361/4703] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:05:40 2022] DELETE /identity/v3/projects/9777c1a80acf4fa2815c26a7f9e3fd8f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:41.018121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:41.030910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5752bdc-66f3-44dd-9ed6-3a7a40a35993 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:41.289784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:41.290723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:41.291080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:41.291367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] PATH_INFO: `/v3/users/e7a621d3a589468790487250147fda4d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:41.292640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a621d3a589468790487250147fda4d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:41.295630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:41.412409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a621d3a589468790487250147fda4d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.418118 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:41.475060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a621d3a589468790487250147fda4d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.493354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a621d3a589468790487250147fda4d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.508829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a621d3a589468790487250147fda4d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.509829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a82a49e0-f415-457e-bac5-1ede53ebda90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a621d3a589468790487250147fda4d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:41.525124 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2343/4704] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:05:41 2022] DELETE /identity/v3/users/e7a621d3a589468790487250147fda4d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:42.820617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:42.822094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:42.848972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f5616-4515-4810-9b93-0a358e682f5f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:42.992795 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:43.040126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:43.041029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:43.041316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:43.041596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] PATH_INFO: `/v3/projects/b314913debf64bc4bb607ea287719160` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:43.043396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b314913debf64bc4bb607ea287719160)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:43.046943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:43.213843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b314913debf64bc4bb607ea287719160', 'request_id': 'req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:43.236283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b314913debf64bc4bb607ea287719160', 'request_id': 'req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:43.243409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b314913debf64bc4bb607ea287719160', 'request_id': 'req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:43.264133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] The token cache is being invalidate because project b314913debf64bc4bb607ea287719160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:05:43.264471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:43.267309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-af73cc3c-e67d-44fe-a264-4a451e3b4b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:05:43.271355 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2362/4705] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:05:42 2022] DELETE /identity/v3/projects/b314913debf64bc4bb607ea287719160 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:43.277592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:43.278950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:43.279447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:43.320535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:43.339374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:43.564135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2344/4706] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:43.650740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:43.651145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:43.651549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:43.677817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:43.679227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:43.698365 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2363/4707] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:43.699154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:43.721405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1724-5d14-4fe5-91e7-1e4660eee29a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:43.749006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:43.751071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:43.751826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:43.752210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:43.753122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:05:43.755234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:43.757716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:43.801564 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2345/4708] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:05:43.804177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:43.822024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e0d34-31a7-4146-ac44-9c0982d306e1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:43.841449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:43.842406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:43.843499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:43.846252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:43.848664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:43.855364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:43.923686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2364/4709] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:05:43 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:43.924947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:43.939232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364dfff-0a76-49cb-b344-cad9d08cb01a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:44.171614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:44.172561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:44.172854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:44.173134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:44.173901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:44.175881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:44.220664 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2346/4710] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:05:43 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:05:44.221979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:44.232897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d44ae-5913-42ba-826b-278e8ce5145a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:44.267384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:44.268107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:44.268399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:44.268679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:44.269913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:44.280768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:44.310727 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2365/4711] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:44.314481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:44.331228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2b920-18dd-488f-aaaf-0441f4fb5cc9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:44.342191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628b6e7-c56c-48a5-9672-17101b145736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:44.343688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628b6e7-c56c-48a5-9672-17101b145736 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:44.343970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628b6e7-c56c-48a5-9672-17101b145736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:44.370046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628b6e7-c56c-48a5-9672-17101b145736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:44.373697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628b6e7-c56c-48a5-9672-17101b145736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:44.375643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628b6e7-c56c-48a5-9672-17101b145736 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:44.432132 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2347/4712] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:44.436437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:44.453307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4abe-c8a7-4b19-b61d-79c879f1c74c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:44.472043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:44.473190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:44.475360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:44.476029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] PATH_INFO: `/v3/projects/c1464c61768249b2bb71ddbcb2fe48a5/users/ea97c07e0bdc41988dbaec3578f53cf4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:44.525995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1464c61768249b2bb71ddbcb2fe48a5, user_id=ea97c07e0bdc41988dbaec3578f53cf4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:44.528801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:44.557249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2366/4713] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:44 2022] PUT /identity/v3/projects/c1464c61768249b2bb71ddbcb2fe48a5/users/ea97c07e0bdc41988dbaec3578f53cf4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:05:44.568009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:44.568444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:44.568797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:44.624395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] MFA Rules not processed for user `ea97c07e0bdc41988dbaec3578f53cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:44.626136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:44.676474 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:44.782750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2348/4714] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:05:44.786652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:45.034731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f355836-7a1e-43f0-a565-a8e0aea1ffb9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:45.067462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:45.070882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:45.071365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:45.074740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:45.077687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:45.080441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:45.159184 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:45.184199 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2367/4715] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:05:44 2022] POST /identity/v3/projects => generated 379 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:45.188542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:45.205422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea353e6d-4d1e-4507-9342-dcf0bab986e0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:45.415768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:45.416445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:45.416742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:45.417080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:45.417727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:45.423924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:45.472002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2349/4716] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:05:45 2022] POST /identity/v3/users => generated 296 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:05:45.475745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:45.489521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c3637-0290-4dbf-b9ad-76319405b602 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:45.516166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:45.516886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:45.517179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:45.517469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:45.518218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:45.544754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:45.577643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:45.580992 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2368/4717] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:45.593071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee647-d4bd-40ae-98ed-103f0501905a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:45.615409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:45.629128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:45.629440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:45.629714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] PATH_INFO: `/v3/projects/618bed2a967a475b87287aca519c9d5a/users/37d146ce410e45b386fa7db67053738a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:45.678734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618bed2a967a475b87287aca519c9d5a, user_id=37d146ce410e45b386fa7db67053738a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:45.684798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:45.746197 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2350/4718] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:45 2022] PUT /identity/v3/projects/618bed2a967a475b87287aca519c9d5a/users/37d146ce410e45b386fa7db67053738a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:05:45.749980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:45.766921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bef2c-86b5-493e-b53e-3f6082381c5d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:45.920253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abedcd-8eba-40c9-9c12-95e64f86452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:45.923440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abedcd-8eba-40c9-9c12-95e64f86452d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:45.924099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abedcd-8eba-40c9-9c12-95e64f86452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:45.925332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abedcd-8eba-40c9-9c12-95e64f86452d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:45.931163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abedcd-8eba-40c9-9c12-95e64f86452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:45.940851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abedcd-8eba-40c9-9c12-95e64f86452d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:45.968997 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2369/4719] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:05:45.973306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:45.993853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd36571-4f79-4733-a924-bf5a5b30c018 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:46.011549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:46.013779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:46.015939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:46.016549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] PATH_INFO: `/v3/projects/618bed2a967a475b87287aca519c9d5a/users/37d146ce410e45b386fa7db67053738a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:46.024549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=618bed2a967a475b87287aca519c9d5a, user_id=37d146ce410e45b386fa7db67053738a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:46.034044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:46.116074 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2351/4720] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:05:45 2022] PUT /identity/v3/projects/618bed2a967a475b87287aca519c9d5a/users/37d146ce410e45b386fa7db67053738a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:05:46.126552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:46.127469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:46.128083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:46.175559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] MFA Rules not processed for user `37d146ce410e45b386fa7db67053738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:05:46.177242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:46.380941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2370/4721] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:05:46.420599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:46.423009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:46.580258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68318-a286-45c6-bc10-7a3c28e98e2a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:46.594597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:46.595478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:46.595948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:46.597514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:46.685461 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:46.777328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:46.779633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:46.807451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2352/4722] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:51.107289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:51.110389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:51.175134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba7ada-f90d-4971-8864-6561124b8b8a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:51.189738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:51.191023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:51.191023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:51.210766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:51.252018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:51.262993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:51.289241 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2371/4723] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:52.014853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:52.017075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:52.287805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c59e-d57e-494b-8382-f7ca5cbfcd44 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:52.308516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:52.315078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:52.318140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:52.318478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:52.328652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:52.572782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:52.575301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:52.628765 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2353/4724] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:57.718086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:57.721513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:57.754802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7e08-7732-4305-8515-6522fb0d7231 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:57.781059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:57.782643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:57.784964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:57.785575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:57.791704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:57.943969 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:05:57.973158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:57.975500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:58.012806 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2372/4725] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:05:58.420523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:05:58.431746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac50b5-e85b-4097-83bf-7b5e5d67bb69 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:05:58.443730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:05:58.446819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:05:58.447274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:05:58.447776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:05:58.452770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:05:58.487261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:05:58.489111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacf8ed-a82e-4619-885d-90053f4aaf8f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:05:58.516522 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2354/4726] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:04.781411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:04.783930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:04.813639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379485ec-7641-4acd-9f23-e7486d98f99e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:04.839974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:04.844735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:04.844963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:04.852022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] PATH_INFO: `/v3/users/da144bb86ad34ec6805fb6f8b19be960` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:04.855352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da144bb86ad34ec6805fb6f8b19be960)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:04.859196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:04.994318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da144bb86ad34ec6805fb6f8b19be960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:04.995882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da144bb86ad34ec6805fb6f8b19be960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:05.027742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da144bb86ad34ec6805fb6f8b19be960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:05.028674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da144bb86ad34ec6805fb6f8b19be960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:05.037833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da144bb86ad34ec6805fb6f8b19be960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:05.075516 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2373/4727] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:04 2022] DELETE /identity/v3/users/da144bb86ad34ec6805fb6f8b19be960 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:05.082940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:05.092328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:05.092328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:05.134099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:05.139473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:05.266574 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:05.285538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2355/4728] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:05.298015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:05.299837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:05.520150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cd446-f53e-4165-a4af-11ac359770c8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:05.538188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e64daf-8d0d-4a9c-9096-789431665cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:05.540442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e64daf-8d0d-4a9c-9096-789431665cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:05.541072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e64daf-8d0d-4a9c-9096-789431665cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:05.541982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e64daf-8d0d-4a9c-9096-789431665cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:05.559766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e64daf-8d0d-4a9c-9096-789431665cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:05.561437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e64daf-8d0d-4a9c-9096-789431665cdc service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:05.590738 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2374/4729] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:06.164381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:06.165893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:06.199881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a67b6-af8b-4578-be8b-6c4c252ce7fb None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:06.219946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:06.221584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:06.223164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:06.223627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] PATH_INFO: `/v3/projects/d63a3d5be2934710a4d74c716879a249` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:06.227124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63a3d5be2934710a4d74c716879a249)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:06.230629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:06.373277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63a3d5be2934710a4d74c716879a249', 'request_id': 'req-7566cc6a-21a7-4271-aa0c-cab4e07a8557'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.409120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63a3d5be2934710a4d74c716879a249', 'request_id': 'req-7566cc6a-21a7-4271-aa0c-cab4e07a8557'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.433438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63a3d5be2934710a4d74c716879a249', 'request_id': 'req-7566cc6a-21a7-4271-aa0c-cab4e07a8557'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.452587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] The token cache is being invalidate because project d63a3d5be2934710a4d74c716879a249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:06.453010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.456493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7566cc6a-21a7-4271-aa0c-cab4e07a8557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.465892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:06.466433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:06.466881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:06.468345 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2356/4730] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:06 2022] DELETE /identity/v3/projects/d63a3d5be2934710a4d74c716879a249 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:06.489460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:06.491235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:06.695052 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2375/4731] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:06.695180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:06.695345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:06.695857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:06.710810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:06.712456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:06.754632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7169d77-5db3-4c24-b7ec-bfda4e44b3ce None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:06.761645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:06.766460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:06.771721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:06.776572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:06.780065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:06.784937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] PATH_INFO: `/v3/users/ea97c07e0bdc41988dbaec3578f53cf4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:06.790579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea97c07e0bdc41988dbaec3578f53cf4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:06.803486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2357/4732] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:06.813352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:06.814557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:06.821084 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:06.846251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576c7a3-2c48-49e6-908e-172f3f720f8e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:06.880459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:06.881144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:06.881431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:06.881710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:06.882456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:06.882842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:06.894352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:06.938526 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2358/4733] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:06.943266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:06.947411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea97c07e0bdc41988dbaec3578f53cf4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.959426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea97c07e0bdc41988dbaec3578f53cf4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.974635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45756ef-0090-4315-8fe5-2f30c697a1f9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:06.986143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea97c07e0bdc41988dbaec3578f53cf4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.987744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea97c07e0bdc41988dbaec3578f53cf4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:06.988137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:06.988855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:06.989172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:06.989452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:06.990157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:06.995296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:07.008559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b79a1a7-1132-4ec8-8e1b-febba7060fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea97c07e0bdc41988dbaec3578f53cf4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:07.033899 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2376/4734] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:06 2022] DELETE /identity/v3/users/ea97c07e0bdc41988dbaec3578f53cf4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:07.040807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.041162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.041868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.071352 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2359/4735] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:06 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:07.075403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:07.081116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:07.094382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:07.098515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:07.247180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d63e7-e5c4-4f88-81fb-417728ba5e29 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:07.263099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:07.264377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.264664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.264929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.265831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:07.267966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:07.318573 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2360/4736] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:07 2022] POST /identity/v3/users => generated 281 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:07.326912 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2377/4737] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:07.327946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:07.328935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:07.335516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:07.361108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443b35f-a5df-4da1-8c33-f2426d2bc3c3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:07.402483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:07.410173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.411227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.411762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.413205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:07.416466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:07.477708 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2361/4738] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:07.482010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:07.506067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9600745-e2d1-4244-ac2c-d27f5b3d2e63 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:07.525428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a5402-b956-41c4-aee7-e4b3b084b3f4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:07.536337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:07.537317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.540400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.540964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.541948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:07.543421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c94673-66ed-4b2d-a4de-e09e782fac99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:07.545663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:07.546472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c94673-66ed-4b2d-a4de-e09e782fac99 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.547509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c94673-66ed-4b2d-a4de-e09e782fac99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.547967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c94673-66ed-4b2d-a4de-e09e782fac99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.548965 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:07.574447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2362/4739] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:07.578465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:07.579635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c94673-66ed-4b2d-a4de-e09e782fac99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:07.582527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c94673-66ed-4b2d-a4de-e09e782fac99 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:07.599804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56ba8e-74dd-49b6-ad50-89fc9275444d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:07.614444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:07.617945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.618357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.618806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] PATH_INFO: `/v3/projects/9cbbc33fbb5f498d807aa32c89248de6/users/ef0d4295dbbd42d2b82e1f5cafe79ad9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.636832 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2378/4740] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:07.669231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbbc33fbb5f498d807aa32c89248de6, user_id=ef0d4295dbbd42d2b82e1f5cafe79ad9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:07.675294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:07.710071 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2363/4741] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:07 2022] PUT /identity/v3/projects/9cbbc33fbb5f498d807aa32c89248de6/users/ef0d4295dbbd42d2b82e1f5cafe79ad9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:07.720655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:07.721065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:07.721447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:07.848321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] MFA Rules not processed for user `ef0d4295dbbd42d2b82e1f5cafe79ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:07.849644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:07.872065 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:08.032752 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2379/4742] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:08.074053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:08.310452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851cfa-2d86-44ad-bd61-f0aee7c19562 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:08.325491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:08.326926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:08.327320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:08.327775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:08.348362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:08.350115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:08.371608 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2364/4743] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:08.808211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:08.809833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:08.996918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2fcb-b31e-4e00-a461-1333849f3b33 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:09.003143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:09.004139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:09.004535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:09.004917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] PATH_INFO: `/v3/projects/c1464c61768249b2bb71ddbcb2fe48a5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:09.006861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1464c61768249b2bb71ddbcb2fe48a5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:09.011075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:09.128874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1464c61768249b2bb71ddbcb2fe48a5', 'request_id': 'req-8397d713-6e9b-4f43-9e88-e028d5fe24a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.146958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1464c61768249b2bb71ddbcb2fe48a5', 'request_id': 'req-8397d713-6e9b-4f43-9e88-e028d5fe24a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.184979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1464c61768249b2bb71ddbcb2fe48a5', 'request_id': 'req-8397d713-6e9b-4f43-9e88-e028d5fe24a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.205815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] The token cache is being invalidate because project c1464c61768249b2bb71ddbcb2fe48a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:09.206125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.208891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8397d713-6e9b-4f43-9e88-e028d5fe24a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.213551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2380/4744] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:08 2022] DELETE /identity/v3/projects/c1464c61768249b2bb71ddbcb2fe48a5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:09.214771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:09.235290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea7a5-09d4-4ffe-b461-fb58f8aeb17d service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:09.359738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:09.361543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:09.362060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:09.362721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] PATH_INFO: `/v3/users/37d146ce410e45b386fa7db67053738a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:09.364215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d146ce410e45b386fa7db67053738a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:09.366562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:09.436923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d146ce410e45b386fa7db67053738a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.454935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d146ce410e45b386fa7db67053738a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.465150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d146ce410e45b386fa7db67053738a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.470229 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:09.477672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d146ce410e45b386fa7db67053738a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.478884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d146ce410e45b386fa7db67053738a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:09.490044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2365/4745] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:09 2022] DELETE /identity/v3/users/37d146ce410e45b386fa7db67053738a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:09.683095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f84038-ebe7-40a8-a3a9-93199134adc5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:09.684435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f84038-ebe7-40a8-a3a9-93199134adc5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:09.684958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f84038-ebe7-40a8-a3a9-93199134adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:09.769310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-38f84038-ebe7-40a8-a3a9-93199134adc5 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:09.776009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38f84038-ebe7-40a8-a3a9-93199134adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:09.903684 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:09.941344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2381/4746] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:10.205332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:10.208123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:10.295868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f7847-90d1-4f1c-a2d6-6b6549152d2f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:10.321746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:10.322887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:10.324856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:10.324856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] PATH_INFO: `/v3/projects/618bed2a967a475b87287aca519c9d5a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:10.326844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618bed2a967a475b87287aca519c9d5a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:10.329155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:10.390016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618bed2a967a475b87287aca519c9d5a', 'request_id': 'req-587efb10-3e66-4e2d-ae21-107ad8702750'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:10.401616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618bed2a967a475b87287aca519c9d5a', 'request_id': 'req-587efb10-3e66-4e2d-ae21-107ad8702750'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:10.413234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618bed2a967a475b87287aca519c9d5a', 'request_id': 'req-587efb10-3e66-4e2d-ae21-107ad8702750'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:10.449501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] The token cache is being invalidate because project 618bed2a967a475b87287aca519c9d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:10.450488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:10.452223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-587efb10-3e66-4e2d-ae21-107ad8702750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:10.460431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2366/4747] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:10 2022] DELETE /identity/v3/projects/618bed2a967a475b87287aca519c9d5a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:10.465140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:10.465630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:10.466054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:10.502750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:10.515992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:10.667142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:10.667434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:10.667719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:10.669111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2382/4748] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:10.700323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:10.702258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:10.715063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:10.730348 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2367/4749] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:10.732933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11415-a974-45ad-9958-823fa7e83dbb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:10.745870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:10.746595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:10.747738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:10.748024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:10.748781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:10.749092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:10.751135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:10.770518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:10.777306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2383/4750] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:10.781589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd1c1-7be7-4dee-b6d1-ea2c452809cd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:10.788070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:10.788888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:10.789240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:10.789589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:10.790374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:10.792574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:10.837856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:10.849468 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2368/4751] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:10 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:10.850616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb66684-57ce-46ba-9528-51510cc2800a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:10.941287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:10.942528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:10.942528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:10.942969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:10.943858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:10.949437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:11.005211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:11.015065 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2384/4752] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:10 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:11.021218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf585b3-5437-4a96-b919-fc62dcc11c63 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:11.034848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:11.035752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.036107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.036454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.039526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:11.044935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:11.069050 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2369/4753] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:11.073201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:11.088316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2ad9-5732-489e-a67b-0634ee60d38c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:11.101322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee3fa4-7d32-4a3d-8224-3f020fb854bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:11.102031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3fa4-7d32-4a3d-8224-3f020fb854bb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.102451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3fa4-7d32-4a3d-8224-3f020fb854bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.102865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3fa4-7d32-4a3d-8224-3f020fb854bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.107350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee3fa4-7d32-4a3d-8224-3f020fb854bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:11.109130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee3fa4-7d32-4a3d-8224-3f020fb854bb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:11.139969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:11.146728 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2385/4754] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:11.155511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c733-60f8-432a-a7cb-27cfde4081ed admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:11.169684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dde40-1585-41da-9a4f-9ba524332bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:11.172691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dde40-1585-41da-9a4f-9ba524332bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.172691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dde40-1585-41da-9a4f-9ba524332bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.172691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dde40-1585-41da-9a4f-9ba524332bed admin admin] PATH_INFO: `/v3/projects/b7a98ece964e4fb7b6b22462d4cc0a43/users/d482f39484534e1ab2844465583bdad2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.243746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dde40-1585-41da-9a4f-9ba524332bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a98ece964e4fb7b6b22462d4cc0a43, user_id=d482f39484534e1ab2844465583bdad2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:11.247202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dde40-1585-41da-9a4f-9ba524332bed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:11.276958 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2370/4755] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:11 2022] PUT /identity/v3/projects/b7a98ece964e4fb7b6b22462d4cc0a43/users/d482f39484534e1ab2844465583bdad2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:11.287561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.288001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.288396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.364994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] MFA Rules not processed for user `d482f39484534e1ab2844465583bdad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:11.366608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:11.446010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.446472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.446819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.476523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:11.477943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:11.480725 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:11.515493 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2386/4756] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:11.517176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:11.526737 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:11.591236 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2371/4757] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:11.608018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:11.610041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:11.643396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fa909-c82f-4bc8-b49d-0905d7d690eb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:11.658361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:11.659142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.659716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.660054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.660714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:11.664650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:11.723678 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2387/4758] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:11 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:11.725043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:11.766561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5c298-acb1-49d2-926a-2940dd1f1b93 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:11.848942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:11.849819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.850374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.851108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.891886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8bed-fb52-4797-a81b-bb4a0373096c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:11.905065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:11.906133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:11.906630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:11.907059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:11.907907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:11.912960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:11.978601 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2388/4759] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:11 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:11.983262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:12.023910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf16b-6a80-45cd-b1f5-703bff78a258 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:12.038749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.040479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:12.041272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.041817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.042106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.043135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.049582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.053252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.078823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2372/4760] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:06:12.080684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:12.083900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:12.090813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2389/4761] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:12.090813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:12.094479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:12.116838 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:12.263729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5ff34-ee35-4240-a2f2-e4a1034aa6a2 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:12.271434 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:12.280461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:12.281143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.281434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.281713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.288742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9493f4-827b-4040-b70b-ed71f35dff3c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:12.291422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:12.306952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:12.307777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.308112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.308526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.313371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:12.335253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.336725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.338385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.340147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.370893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2390/4762] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:12.371879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:12.376844 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2373/4763] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:12.402315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c882-af92-49ec-bcd7-a3fbc3c142a4 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:12.423356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:12.424252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.424539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.424816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] PATH_INFO: `/v3/projects/e8a4cda8c4b64568b87f6dce89ad1be1/users/b3c1f948548a4b40a8957d5dedadabca/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.504749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a4cda8c4b64568b87f6dce89ad1be1, user_id=b3c1f948548a4b40a8957d5dedadabca, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.507485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.551147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2391/4764] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:12 2022] PUT /identity/v3/projects/e8a4cda8c4b64568b87f6dce89ad1be1/users/b3c1f948548a4b40a8957d5dedadabca/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:12.555470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:12.571949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac336-eb78-4a25-b6b8-cd4052dea742 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:12.745984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcece59c-0df3-428d-8016-1935d470b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:12.746701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcece59c-0df3-428d-8016-1935d470b05f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.746990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcece59c-0df3-428d-8016-1935d470b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.747268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcece59c-0df3-428d-8016-1935d470b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.748566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcece59c-0df3-428d-8016-1935d470b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.754549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcece59c-0df3-428d-8016-1935d470b05f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.785671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2374/4765] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:12.789993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:12.816962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aff67-70ec-4665-b829-9002e36c6e33 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:12.830135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:12.831221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.831582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.831929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] PATH_INFO: `/v3/projects/e8a4cda8c4b64568b87f6dce89ad1be1/users/b3c1f948548a4b40a8957d5dedadabca/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.834023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a4cda8c4b64568b87f6dce89ad1be1, user_id=b3c1f948548a4b40a8957d5dedadabca, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:12.839101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:12.887389 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2392/4766] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:12 2022] PUT /identity/v3/projects/e8a4cda8c4b64568b87f6dce89ad1be1/users/b3c1f948548a4b40a8957d5dedadabca/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:12.889780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:12.891307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:12.892134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:12.946263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] MFA Rules not processed for user `b3c1f948548a4b40a8957d5dedadabca`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:12.952918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:13.336820 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2375/4767] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:13.345945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:13.348479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:13.512957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb99068-274b-4a33-9417-d8d7a847cef0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:13.520097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:13.520856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:13.521074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:13.521333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:13.555379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:13.556840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:13.615377 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2393/4768] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:14.437945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:14.448683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ab1f-5c34-458b-8f75-29abafa441e4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:14.471315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3c1f948548a4b40a8957d5dedadabca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:14.472024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:14.472317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:14.472606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:14.473366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:14.473732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:14.488693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:14.551073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2376/4769] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:14.554139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:14.565879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09568b4-f2fd-41ed-8f78-4c6a38ec8485 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:14.582796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3c1f948548a4b40a8957d5dedadabca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:14.583537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:14.583811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:14.584095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:14.584812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:14.586768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:14.652296 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2394/4770] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:14 2022] POST /identity/v3/projects => generated 354 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:14.656314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:14.679030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd574d-ee19-4f33-9d6a-17e4c94e11ed tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:14.754812 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:14.896703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3c1f948548a4b40a8957d5dedadabca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:14.897502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:14.897793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:14.898084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:14.898883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:14.899203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:14.907464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:14.961764 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2377/4771] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:15.069057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:15.087662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1d4b-6be2-4411-921b-5cbd73d82b9d tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:15.093119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3c1f948548a4b40a8957d5dedadabca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:15.094062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:15.094358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:15.094676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] PATH_INFO: `/v3/projects/c1de26b1ee0e475bb5418bdfd289188a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:15.095911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1de26b1ee0e475bb5418bdfd289188a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:15.098051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:15.185632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1de26b1ee0e475bb5418bdfd289188a', 'request_id': 'req-9010010f-1c38-45f2-b99c-72ff75c23c92'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:15.213064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1de26b1ee0e475bb5418bdfd289188a', 'request_id': 'req-9010010f-1c38-45f2-b99c-72ff75c23c92'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:15.223224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1de26b1ee0e475bb5418bdfd289188a', 'request_id': 'req-9010010f-1c38-45f2-b99c-72ff75c23c92'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:15.249634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] The token cache is being invalidate because project c1de26b1ee0e475bb5418bdfd289188a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:15.249923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:15.250766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9010010f-1c38-45f2-b99c-72ff75c23c92 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:15.255636 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2395/4772] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:15 2022] DELETE /identity/v3/projects/c1de26b1ee0e475bb5418bdfd289188a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:15.811592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:15.818826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:15.999701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0625a-fc4e-445a-8b63-f352b23c57d9 tempest-VolumeQuotaClassesTest-327504813 tempest-VolumeQuotaClassesTest-327504813-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:16.174426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:16.175509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:16.175909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:16.176319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] PATH_INFO: `/v3/users/d482f39484534e1ab2844465583bdad2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:16.177698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d482f39484534e1ab2844465583bdad2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:16.179859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:16.334279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd482f39484534e1ab2844465583bdad2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:16.355046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd482f39484534e1ab2844465583bdad2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:16.356677 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:16.374971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd482f39484534e1ab2844465583bdad2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:16.391371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd482f39484534e1ab2844465583bdad2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:16.392136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd482f39484534e1ab2844465583bdad2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:16.409162 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2378/4773] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:15 2022] DELETE /identity/v3/users/d482f39484534e1ab2844465583bdad2 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:16.413756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:16.414271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:16.414458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:16.467494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:16.471432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:16.520442 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:16.705968 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2396/4774] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:16.831048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:16.833045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:16.995695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f3eb7-9819-410e-bed2-621bfb528bd7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:17.012107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:17.012798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:17.013124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:17.013410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:17.048977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:17.050468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:17.079964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2379/4775] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:20.186039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:20.188692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:20.213219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190ca51-da8c-45b3-afbe-76b1ace85e2b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:20.230381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:20.231506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:20.232496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:20.233414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] PATH_INFO: `/v3/projects/b7a98ece964e4fb7b6b22462d4cc0a43` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:20.235583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a98ece964e4fb7b6b22462d4cc0a43)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:20.237538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:20.322870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a98ece964e4fb7b6b22462d4cc0a43', 'request_id': 'req-bb432a84-770f-4798-9cba-8c7057cc8eb8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.333065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a98ece964e4fb7b6b22462d4cc0a43', 'request_id': 'req-bb432a84-770f-4798-9cba-8c7057cc8eb8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.340723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a98ece964e4fb7b6b22462d4cc0a43', 'request_id': 'req-bb432a84-770f-4798-9cba-8c7057cc8eb8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.355909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] The token cache is being invalidate because project b7a98ece964e4fb7b6b22462d4cc0a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:20.356282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.357101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.359044 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2397/4776] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:20 2022] DELETE /identity/v3/projects/b7a98ece964e4fb7b6b22462d4cc0a43 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:20.363840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:20.374805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522da2a-1d98-4e17-a288-c4a47b8f3ec0 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:20.467657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:20.469150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:20.469678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:20.470180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] PATH_INFO: `/v3/users/b3c1f948548a4b40a8957d5dedadabca` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:20.471841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c1f948548a4b40a8957d5dedadabca)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:20.474547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:20.548586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c1f948548a4b40a8957d5dedadabca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.567947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c1f948548a4b40a8957d5dedadabca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.578043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c1f948548a4b40a8957d5dedadabca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.600865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c1f948548a4b40a8957d5dedadabca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.602374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c1f948548a4b40a8957d5dedadabca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:20.611871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2380/4777] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:20 2022] DELETE /identity/v3/users/b3c1f948548a4b40a8957d5dedadabca => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:21.802894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:21.804451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:21.861449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432a84-770f-4798-9cba-8c7057cc8eb8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:22.042070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:22.069149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:22.071097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:22.071620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] PATH_INFO: `/v3/projects/e8a4cda8c4b64568b87f6dce89ad1be1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:22.078787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a4cda8c4b64568b87f6dce89ad1be1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:22.082886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:22.149301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:22.151509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:22.166473 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:22.238851 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:22.263210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'request_id': 'req-6c4267c7-d935-4f13-ab58-7907348782e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:22.296147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'request_id': 'req-6c4267c7-d935-4f13-ab58-7907348782e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:22.317102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a4cda8c4b64568b87f6dce89ad1be1', 'request_id': 'req-6c4267c7-d935-4f13-ab58-7907348782e2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:22.356536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] The token cache is being invalidate because project e8a4cda8c4b64568b87f6dce89ad1be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:22.360038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:22.360845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c4267c7-d935-4f13-ab58-7907348782e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:22.368563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2398/4778] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:21 2022] DELETE /identity/v3/projects/e8a4cda8c4b64568b87f6dce89ad1be1 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:22.373083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16d8e5-9b92-4717-813d-72cbf9553e05 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:22.373455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16d8e5-9b92-4717-813d-72cbf9553e05 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:22.373806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16d8e5-9b92-4717-813d-72cbf9553e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:22.376385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52533-87f0-43d1-8006-2232239acfc0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:22.401712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9f16d8e5-9b92-4717-813d-72cbf9553e05 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:22.404053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f16d8e5-9b92-4717-813d-72cbf9553e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:22.561100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:22.562240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:22.562465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2399/4779] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:22.562601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:22.564168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:22.565814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:22.566266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:22.566703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:22.569551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:22.601080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:22.603938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:22.631622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2381/4780] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:22.635758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:22.645301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:22.691608 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2400/4781] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:22.697001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:22.721548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd814ac-b820-4fab-8fda-0d4229b92d6e service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:22.737086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:22.739261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:22.739682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:22.739971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:22.740745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:22.741042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:22.748920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:22.788202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:22.792361 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2382/4782] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:22.813212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf975-a7c6-4a91-9aec-8dabfaedf0bb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:22.827287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:22.828369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:22.828872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:22.829357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:22.830281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:22.832467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:22.901388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2401/4783] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:22 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:22.902207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:22.947191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c150e1b-b206-4c0d-9588-d3957843cd1f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:23.024679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:23.027254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:23.058174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:23.059095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.059556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.060524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.061399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:23.063559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:23.115909 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2383/4784] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:22 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:23.121673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:23.145464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a403-be01-45ba-9fd3-34007aece3cc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:23.159038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:23.159781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.160835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.160835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.161038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:23.162721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:23.194201 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2384/4785] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:23.197902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:23.224548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab0ff-7928-4d07-a8db-5075117128c4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:23.232763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:23.233501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.233827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.234732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.235002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:23.236832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:23.244882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff89f-c93a-48a2-9b02-4127823cfdf4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:23.258717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:23.259325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.259615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.259897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.261994 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2385/4786] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:23.265801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:23.275797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:23.295508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:23.296989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf1bd-14a4-4a4e-9c29-9ad552d56468 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:23.298234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6146-c651-4b74-be36-c4d0897fdb75 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:23.305183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:23.306085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.306472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.306716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] PATH_INFO: `/v3/projects/b7fede130ce84cd39928f1c6ab54c305/users/c482fcdd7477440784553770059526b5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.333288 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2402/4787] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:06:23.342640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fede130ce84cd39928f1c6ab54c305, user_id=c482fcdd7477440784553770059526b5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:23.345645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:23.359452 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:23.379671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2386/4788] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:23 2022] PUT /identity/v3/projects/b7fede130ce84cd39928f1c6ab54c305/users/c482fcdd7477440784553770059526b5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:23.391015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.391573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.392071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.430163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] MFA Rules not processed for user `c482fcdd7477440784553770059526b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:23.431652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:23.493713 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:23.676936 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2403/4789] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:23.681597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:23.828060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e231f-500b-42d4-b15b-88debb2a53b6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:23.841780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:23.845788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:23.846223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:23.846638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:23.847682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:23.851453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:23.886868 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2387/4790] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:23 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:23.891161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:23.916842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5ebae-ab4d-4a60-a219-2111a55c19a4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:24.077926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:24.081554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:24.085038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:24.085635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:24.087437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:24.091821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:24.167537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:24.169638 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2404/4791] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:23 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:24.181151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fd3a3-330c-425d-8193-4a3ad9cf5d0d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:24.203245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:24.204085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:24.204959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:24.204959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:24.205501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:24.207040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:24.235230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:24.236626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2388/4792] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:24.248250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa068a8d-e783-4aed-b034-06cadb3d924b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:24.283973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70548-9ba9-4dff-aec6-910c4f30e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:24.284680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70548-9ba9-4dff-aec6-910c4f30e284 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:24.284969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70548-9ba9-4dff-aec6-910c4f30e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:24.285251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70548-9ba9-4dff-aec6-910c4f30e284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:24.286666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70548-9ba9-4dff-aec6-910c4f30e284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:24.288370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70548-9ba9-4dff-aec6-910c4f30e284 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:24.321630 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2405/4793] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:24.326648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:24.340015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800a34-e6a0-4990-bdae-aa14dffa1053 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:24.360029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:24.360956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:24.361245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:24.361528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] PATH_INFO: `/v3/projects/fb2f041b7b8241ecb00b071665fa89f0/users/4d03fae5964a42ccac956a9f1cfc4a18/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:24.400793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2f041b7b8241ecb00b071665fa89f0, user_id=4d03fae5964a42ccac956a9f1cfc4a18, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:24.406281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:24.441461 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2389/4794] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:24 2022] PUT /identity/v3/projects/fb2f041b7b8241ecb00b071665fa89f0/users/4d03fae5964a42ccac956a9f1cfc4a18/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:24.455839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:24.456665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:24.456968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:24.569324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] MFA Rules not processed for user `4d03fae5964a42ccac956a9f1cfc4a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:24.573979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:24.782807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2406/4795] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:24.784631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:24.951683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c102ee-6339-4afe-a389-bcc53107319e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:24.959214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:24.961708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:24.963521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:24.963934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:24.964872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:24.967843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:25.019271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:25.020330 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2390/4796] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:24 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:25.049444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cc02f-c711-47a9-abaa-0aa401e72ceb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:25.102869 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:25.176704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:25.182184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:25.182681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:25.183074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:25.188869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:25.191331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:25.244662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2407/4797] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:25 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:25.250050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:25.274061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764f94-888a-4204-ba1e-f711d85bc0d4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:25.286096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:25.288830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:25.289556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:25.290286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:25.291621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:25.294303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:25.308734 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2391/4798] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:25.313906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:25.329681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd410b-cce4-46da-a59a-0d7031d9a158 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:25.349190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:25.350096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:25.350387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:25.350698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] PATH_INFO: `/v3/projects/1f9ea4a608d8412b907a4c94870f7913/users/49b8ee8dca1f489aa35599a2b407e414/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:25.389630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9ea4a608d8412b907a4c94870f7913, user_id=49b8ee8dca1f489aa35599a2b407e414, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:25.395567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:25.422484 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2408/4799] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:25 2022] PUT /identity/v3/projects/1f9ea4a608d8412b907a4c94870f7913/users/49b8ee8dca1f489aa35599a2b407e414/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:25.425465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:25.442973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466550c8-d369-4c6b-9fb5-8ced90f00bc7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:25.491805 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:25.667802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ff7a3-37a1-425e-9665-8fbb263395ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:25.669533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ff7a3-37a1-425e-9665-8fbb263395ae admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:25.669533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ff7a3-37a1-425e-9665-8fbb263395ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:25.669782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ff7a3-37a1-425e-9665-8fbb263395ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:25.670666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ff7a3-37a1-425e-9665-8fbb263395ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:25.675518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ff7a3-37a1-425e-9665-8fbb263395ae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:25.712291 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2392/4800] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:06:25.713987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:25.761634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb27428-7a06-40d1-b29f-7eb9cd4bc636 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:25.777692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:25.783725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:25.784063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:25.784478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] PATH_INFO: `/v3/projects/1f9ea4a608d8412b907a4c94870f7913/users/49b8ee8dca1f489aa35599a2b407e414/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:25.788558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9ea4a608d8412b907a4c94870f7913, user_id=49b8ee8dca1f489aa35599a2b407e414, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:25.792963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:25.844744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2409/4801] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:25 2022] PUT /identity/v3/projects/1f9ea4a608d8412b907a4c94870f7913/users/49b8ee8dca1f489aa35599a2b407e414/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:25.845444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:25.845825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:25.846145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:25.903404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] MFA Rules not processed for user `49b8ee8dca1f489aa35599a2b407e414`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:25.904663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:26.069521 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2393/4802] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:26.082826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:26.086596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:26.247094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7ee6-f205-4d1b-9c7c-88a1b2cbc08a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:26.259493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:26.260393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:26.260996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:26.261521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:26.281323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:26.283104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:26.307530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2410/4803] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:27.300949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:27.302958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:27.315961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbca4e-da3f-40e1-8a1a-cc188bc6c238 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:27.320800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:27.322358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:27.323714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:27.323714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:27.458806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:27.460416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:27.488626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2394/4804] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:29.818047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:29.819827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:29.989534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd9e9-7aae-4e62-9740-b93c82ea659b service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:29.995896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:29.997784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:29.998968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:29.999481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] PATH_INFO: `/v3/users/2498f2b4e9bb4e4baedc83e1462867b4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:30.003527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2498f2b4e9bb4e4baedc83e1462867b4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:30.006015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:30.040155 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:30.088776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2498f2b4e9bb4e4baedc83e1462867b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:30.089630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2498f2b4e9bb4e4baedc83e1462867b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:30.116842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2498f2b4e9bb4e4baedc83e1462867b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:30.118699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2498f2b4e9bb4e4baedc83e1462867b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:30.145915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2498f2b4e9bb4e4baedc83e1462867b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:30.180907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2411/4805] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:29 2022] DELETE /identity/v3/users/2498f2b4e9bb4e4baedc83e1462867b4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:30.813728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:30.815848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:30.839725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:30.841764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:30.916876 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:30.984553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512632b-8368-43d7-bfc8-79134bd19faf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:30.992729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:30.994385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:30.995486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:30.996171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] PATH_INFO: `/v3/projects/0c52196f02cb471eb30487e1664f0adf` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:31.001447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c52196f02cb471eb30487e1664f0adf)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:31.004359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:31.008375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262b2f-ed27-4c3b-ba78-9f2caedb96fb service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:31.120018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c52196f02cb471eb30487e1664f0adf', 'request_id': 'req-82c5c683-7b8f-45b6-bb61-9a52914f459f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.139253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c52196f02cb471eb30487e1664f0adf', 'request_id': 'req-82c5c683-7b8f-45b6-bb61-9a52914f459f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.152807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c52196f02cb471eb30487e1664f0adf', 'request_id': 'req-82c5c683-7b8f-45b6-bb61-9a52914f459f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.156763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:31.157111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:31.157396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:31.162067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:31.168196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:31.171430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] The token cache is being invalidate because project 0c52196f02cb471eb30487e1664f0adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:31.172425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.173319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.176058 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2412/4806] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:30 2022] DELETE /identity/v3/projects/0c52196f02cb471eb30487e1664f0adf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:31.182029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:31.184114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:31.206990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:31.209045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:31.238579 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2395/4807] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:31.272743 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:31.340374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5c683-7b8f-45b6-bb61-9a52914f459f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:31.349546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:31.351012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:31.351572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:31.352280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] PATH_INFO: `/v3/users/add4037503cf4a86af4777047f854e6e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:31.353749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add4037503cf4a86af4777047f854e6e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:31.355946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:31.466678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add4037503cf4a86af4777047f854e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.467516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add4037503cf4a86af4777047f854e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.503915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add4037503cf4a86af4777047f854e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.507106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add4037503cf4a86af4777047f854e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.522717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee110abe-eef7-4c10-8e19-8ff25e26ee27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add4037503cf4a86af4777047f854e6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:31.543321 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2413/4808] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:31 2022] DELETE /identity/v3/users/add4037503cf4a86af4777047f854e6e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:32.317767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:32.333458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863a6c-9bda-4bbe-a828-51669fc30dc0 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:32.529468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:32.530357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:32.530848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:32.531133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] PATH_INFO: `/v3/projects/a23b3445ae7644aebcb89b0e354520e2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:32.535311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23b3445ae7644aebcb89b0e354520e2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:32.537478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:32.630055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23b3445ae7644aebcb89b0e354520e2', 'request_id': 'req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:32.641243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23b3445ae7644aebcb89b0e354520e2', 'request_id': 'req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:32.663737 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:32.673786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23b3445ae7644aebcb89b0e354520e2', 'request_id': 'req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:32.709531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] The token cache is being invalidate because project a23b3445ae7644aebcb89b0e354520e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:32.709862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:32.710717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5d827ea-4fa4-4f6d-9518-72eaaef627f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:32.717158 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2396/4809] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:32 2022] DELETE /identity/v3/projects/a23b3445ae7644aebcb89b0e354520e2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:32.726888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:32.727405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:32.727497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:32.748509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:32.750006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:32.848502 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2414/4810] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:32.857579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:32.857907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:32.858154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:32.892737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:32.893979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:32.919151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2397/4811] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:32.920839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:32.938297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d34ebd-2cf3-41df-9696-520760d77a9f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:32.949622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:32.950919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:32.951208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:32.951491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:32.954362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:32.955279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:32.960243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:32.990317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:32.991710 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2415/4812] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:33.004769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d9458-512d-472b-b90a-56ed6f6c89b0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:33.015317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:33.016158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:33.016408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:33.016735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:33.017454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:33.019470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:33.111543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2398/4813] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:32 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:33.115792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:33.131556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cd8c-d586-42da-973d-34eeaf20fa61 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:33.274247 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:33.343924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:33.345931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:33.346990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:33.347489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:33.348571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:33.351147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:33.395240 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2416/4814] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:33 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:33.400541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:33.416085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38b1f4-1219-451e-8db8-479e5d54e4be admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:33.424344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:33.425295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:33.425812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:33.426202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:33.427558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:33.429826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:33.447217 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2399/4815] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:06:33.451209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:33.467566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82aea-320e-419e-bd0c-d6bf48f925e0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:33.488961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b278d6-0cea-4bff-b869-bb5dca2a4b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:33.489734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b278d6-0cea-4bff-b869-bb5dca2a4b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:33.490025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b278d6-0cea-4bff-b869-bb5dca2a4b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:33.490305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b278d6-0cea-4bff-b869-bb5dca2a4b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:33.491081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b278d6-0cea-4bff-b869-bb5dca2a4b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:33.502809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b278d6-0cea-4bff-b869-bb5dca2a4b16 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:33.528954 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2417/4816] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:33.529738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:33.557381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714e03-a4f8-4a77-83f7-3073dfc8e626 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:33.614729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:33.614729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:33.617609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:33.617996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] PATH_INFO: `/v3/projects/cdec27979ca2489a87029c5015bb0697/users/711b17bd9ba1479484982f6b2a7aef1b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:33.650855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdec27979ca2489a87029c5015bb0697, user_id=711b17bd9ba1479484982f6b2a7aef1b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:33.654922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:33.680445 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2400/4817] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:33 2022] PUT /identity/v3/projects/cdec27979ca2489a87029c5015bb0697/users/711b17bd9ba1479484982f6b2a7aef1b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:33.696227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:33.696573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:33.697299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:33.769477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] MFA Rules not processed for user `711b17bd9ba1479484982f6b2a7aef1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:33.770994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:33.975529 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2418/4818] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:33.976690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:34.140753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ca1a-1c3f-40bc-b787-03740e69c061 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:34.152683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:34.153919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.154267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.154620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:34.156200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:34.159844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:34.208187 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2401/4819] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:33 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:34.209576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:34.233882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0a87-64fa-4f27-851f-27534ffa46e6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:34.374351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:34.375809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.376171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.377463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:34.379279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:34.384700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:34.441894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2419/4820] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:34 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:34.446049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:34.466815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ea1f-3bf0-49d3-940c-8ea9d35ebbe5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:34.476496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:34.477900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.478557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.478993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:34.480189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:34.483689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:34.528732 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2402/4821] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:06:34.532916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:34.550279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ee389-c19a-42f2-b81e-33818c4e96a2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:34.562038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:34.564381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.564683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.564970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] PATH_INFO: `/v3/projects/2561784b19c9439f8fe648301ab4f60a/users/7679f4df8e6f42fa971a99dce0494834/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:34.588796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2561784b19c9439f8fe648301ab4f60a, user_id=7679f4df8e6f42fa971a99dce0494834, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:34.602812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:34.645543 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2420/4822] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:34 2022] PUT /identity/v3/projects/2561784b19c9439f8fe648301ab4f60a/users/7679f4df8e6f42fa971a99dce0494834/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:34.645738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:34.662074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d542a-0982-40bf-822e-ab902160a7ea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:34.848033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb429-8ee1-41ca-a1e6-b2792757f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:34.848727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb429-8ee1-41ca-a1e6-b2792757f256 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.849010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb429-8ee1-41ca-a1e6-b2792757f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.849288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb429-8ee1-41ca-a1e6-b2792757f256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:34.850014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb429-8ee1-41ca-a1e6-b2792757f256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:34.851686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb429-8ee1-41ca-a1e6-b2792757f256 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:34.855396 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:34.878160 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2403/4823] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:06:34.882413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:34.900182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116bfc0-99b2-443e-ba44-4f8c30c9ae7a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:34.914888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:34.917221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.921141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.921650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] PATH_INFO: `/v3/projects/2561784b19c9439f8fe648301ab4f60a/users/7679f4df8e6f42fa971a99dce0494834/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:34.925376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2561784b19c9439f8fe648301ab4f60a, user_id=7679f4df8e6f42fa971a99dce0494834, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:34.928268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:34.947615 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:34.960212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2421/4824] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:34 2022] PUT /identity/v3/projects/2561784b19c9439f8fe648301ab4f60a/users/7679f4df8e6f42fa971a99dce0494834/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:34.971323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a13e-3889-4e9c-81d7-c76e0f3f8452 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:34.971619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a13e-3889-4e9c-81d7-c76e0f3f8452 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:34.971903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a13e-3889-4e9c-81d7-c76e0f3f8452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:35.032209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3112a13e-3889-4e9c-81d7-c76e0f3f8452 None None] MFA Rules not processed for user `7679f4df8e6f42fa971a99dce0494834`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:35.033733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3112a13e-3889-4e9c-81d7-c76e0f3f8452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:35.194518 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2404/4825] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:35.208528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:35.212013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:35.340338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56fbab-a66f-4a16-950a-4eb48e77cbea admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:35.347326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:35.348117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:35.348629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:35.349250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:35.389648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:35.396520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:35.441021 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2422/4826] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:06:36.199544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:36.200087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:36.200087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:36.334549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:36.335832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:36.405904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:36.422486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2405/4827] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:06:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:36.438151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:36.439671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:36.567359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afa24b-a36b-4816-bacd-3b15be501b56 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:36.591586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:36.592490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:36.592775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:36.593050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] PATH_INFO: `/v3/users/711b17bd9ba1479484982f6b2a7aef1b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:36.596383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=711b17bd9ba1479484982f6b2a7aef1b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:36.600131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:36.636485 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:36.720458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7741206-07f6-4ffe-969c-6917942d9b02 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:36.734355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdbebb-c1d7-4d51-8803-f4da0c5ccc18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:36.746806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdbebb-c1d7-4d51-8803-f4da0c5ccc18 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:36.746806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdbebb-c1d7-4d51-8803-f4da0c5ccc18 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:36.746806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdbebb-c1d7-4d51-8803-f4da0c5ccc18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:36.777105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711b17bd9ba1479484982f6b2a7aef1b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:36.778692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711b17bd9ba1479484982f6b2a7aef1b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:36.781681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdbebb-c1d7-4d51-8803-f4da0c5ccc18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:36.783339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdbebb-c1d7-4d51-8803-f4da0c5ccc18 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:36.807396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711b17bd9ba1479484982f6b2a7aef1b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:36.810113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711b17bd9ba1479484982f6b2a7aef1b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:36.812716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2406/4828] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:06:36.826985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711b17bd9ba1479484982f6b2a7aef1b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:36.853577 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:36.882129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2423/4829] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:36 2022] DELETE /identity/v3/users/711b17bd9ba1479484982f6b2a7aef1b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:36.883080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:36.883523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:36.884618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:36.923440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:36.924890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:37.104623 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2407/4830] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:37.166977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:37.169108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:37.421653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a4abe-3558-4f81-9c84-6117f3f04eed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:37.437610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:37.438848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:37.439377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:37.439981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:37.456585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:37.459286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:37.474357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2424/4831] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:37.794272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:37.795785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:37.825652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd3f2a-4d98-4fab-a607-f1f84294d929 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:37.838823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:37.839763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:37.840047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:37.840972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] PATH_INFO: `/v3/users/1d550d0bfe3d49c3b34d8a2b27dd0909` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:37.845312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d550d0bfe3d49c3b34d8a2b27dd0909)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:37.858114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:37.981510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d550d0bfe3d49c3b34d8a2b27dd0909'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:38.024902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d550d0bfe3d49c3b34d8a2b27dd0909'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:38.059528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d550d0bfe3d49c3b34d8a2b27dd0909'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:38.073957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d550d0bfe3d49c3b34d8a2b27dd0909'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:38.075346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d550d0bfe3d49c3b34d8a2b27dd0909'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:38.085205 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2408/4832] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:37 2022] DELETE /identity/v3/users/1d550d0bfe3d49c3b34d8a2b27dd0909 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:38.255541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:38.257091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:38.425153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb453c6-55a0-43d3-83e1-fd306fe7eb4e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:38.524462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:38.525626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:38.526113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:38.526619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:38.539289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:38.666556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:38.668138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:38.681005 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2425/4833] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:38.773512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:38.775388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:38.937060 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:38.951819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb50df-16b1-47e3-b687-87d78707ddf8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:38.960888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:38.962606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:38.963125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:38.963564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] PATH_INFO: `/v3/projects/1a3851928bfa4adf9d8b8a06da0f6a67` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:38.966349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3851928bfa4adf9d8b8a06da0f6a67)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:38.969469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:39.075935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3851928bfa4adf9d8b8a06da0f6a67', 'request_id': 'req-951e9781-dbcd-4240-9771-07fe7db3cca6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.084850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3851928bfa4adf9d8b8a06da0f6a67', 'request_id': 'req-951e9781-dbcd-4240-9771-07fe7db3cca6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.098994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3851928bfa4adf9d8b8a06da0f6a67', 'request_id': 'req-951e9781-dbcd-4240-9771-07fe7db3cca6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.140712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] The token cache is being invalidate because project 1a3851928bfa4adf9d8b8a06da0f6a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:39.141434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.143171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.161703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2409/4834] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:38 2022] DELETE /identity/v3/projects/1a3851928bfa4adf9d8b8a06da0f6a67 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:39.164328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:39.180091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25defab-b43c-4ab3-bfe2-155d9b882637 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:39.205493 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:39.315780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:39.317434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:39.319578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:39.327274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:39.330943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:39.331377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] PATH_INFO: `/v3/users/1a17808ef78f4d3882b96a2146ceb20b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:39.336130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a17808ef78f4d3882b96a2146ceb20b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:39.342186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:39.355653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9781-dbcd-4240-9771-07fe7db3cca6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:39.372519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:39.373498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:39.374446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:39.375613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] PATH_INFO: `/v3/projects/cdec27979ca2489a87029c5015bb0697` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:39.379750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdec27979ca2489a87029c5015bb0697)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:39.387793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:39.488394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a17808ef78f4d3882b96a2146ceb20b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.490197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a17808ef78f4d3882b96a2146ceb20b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.593985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a17808ef78f4d3882b96a2146ceb20b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.602925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a17808ef78f4d3882b96a2146ceb20b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.642780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdec27979ca2489a87029c5015bb0697', 'request_id': 'req-fa4b204e-710c-4570-99c9-d661711e623b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.664587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdec27979ca2489a87029c5015bb0697', 'request_id': 'req-fa4b204e-710c-4570-99c9-d661711e623b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.670446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a17808ef78f4d3882b96a2146ceb20b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.676709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdec27979ca2489a87029c5015bb0697', 'request_id': 'req-fa4b204e-710c-4570-99c9-d661711e623b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.704035 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2426/4835] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:39 2022] DELETE /identity/v3/users/1a17808ef78f4d3882b96a2146ceb20b => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:39.707860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] The token cache is being invalidate because project cdec27979ca2489a87029c5015bb0697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:39.708190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.709753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:39.712700 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2410/4836] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:39 2022] DELETE /identity/v3/projects/cdec27979ca2489a87029c5015bb0697 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:39.717246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:39.719199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:39.941080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d119fd-11fa-442d-873d-b43660856fcc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:39.955780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:39.975145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:39.975552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:39.975793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] PATH_INFO: `/v3/users/7679f4df8e6f42fa971a99dce0494834` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:39.978613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7679f4df8e6f42fa971a99dce0494834)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:39.982902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:40.088598 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:40.140684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7679f4df8e6f42fa971a99dce0494834'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.141533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7679f4df8e6f42fa971a99dce0494834'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.159277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7679f4df8e6f42fa971a99dce0494834'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.159968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7679f4df8e6f42fa971a99dce0494834'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.171831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff4b7bc7-de22-4306-b678-c49e12ccb181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7679f4df8e6f42fa971a99dce0494834'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.193639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2427/4837] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:39 2022] DELETE /identity/v3/users/7679f4df8e6f42fa971a99dce0494834 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:40.564429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:40.566449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:40.716778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b204e-710c-4570-99c9-d661711e623b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:40.765187 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:40.859603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:40.860494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:40.860785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:40.861826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] PATH_INFO: `/v3/projects/2980ab146ce8405aa64423e00d0375c5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:40.863661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2980ab146ce8405aa64423e00d0375c5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:40.866420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:40.937685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2980ab146ce8405aa64423e00d0375c5', 'request_id': 'req-5ba75fb2-6345-4460-b3c0-1f722455d13a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.947530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2980ab146ce8405aa64423e00d0375c5', 'request_id': 'req-5ba75fb2-6345-4460-b3c0-1f722455d13a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.961490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2980ab146ce8405aa64423e00d0375c5', 'request_id': 'req-5ba75fb2-6345-4460-b3c0-1f722455d13a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.980893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] The token cache is being invalidate because project 2980ab146ce8405aa64423e00d0375c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:40.982101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.983289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:40.985753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2411/4838] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:40 2022] DELETE /identity/v3/projects/2980ab146ce8405aa64423e00d0375c5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:40.991922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e869-ff8e-4763-b799-cf9c0fe825dc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:40.992556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e869-ff8e-4763-b799-cf9c0fe825dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:40.992762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e869-ff8e-4763-b799-cf9c0fe825dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.006676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.008149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:41.018214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-17a6e869-ff8e-4763-b799-cf9c0fe825dc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:41.019731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17a6e869-ff8e-4763-b799-cf9c0fe825dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:41.181015 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2428/4839] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:41.183450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.183753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.184573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.219135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:41.220394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:41.245018 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2429/4840] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:41.249320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba75fb2-6345-4460-b3c0-1f722455d13a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.252565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.263846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.264950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.265483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.265980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] PATH_INFO: `/v3/projects/2561784b19c9439f8fe648301ab4f60a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.267464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2561784b19c9439f8fe648301ab4f60a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.268298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a1eb-6186-4254-b0af-1d3e3d2e358a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.269784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.283828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.284659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.284844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.285084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.285828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:41.286134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.292158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.322763 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2430/4841] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:41.323793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.342688 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:41.344778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2561784b19c9439f8fe648301ab4f60a', 'request_id': 'req-c3f02178-704b-411c-8c5b-14572f9e174a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:41.345142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0e21-42f9-4579-99ca-dc871e01bb4d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.356599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2561784b19c9439f8fe648301ab4f60a', 'request_id': 'req-c3f02178-704b-411c-8c5b-14572f9e174a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:41.385327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2561784b19c9439f8fe648301ab4f60a', 'request_id': 'req-c3f02178-704b-411c-8c5b-14572f9e174a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:41.394735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] The token cache is being invalidate because project 2561784b19c9439f8fe648301ab4f60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:41.394735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:41.396503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3f02178-704b-411c-8c5b-14572f9e174a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:41.401314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2412/4842] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:41 2022] DELETE /identity/v3/projects/2561784b19c9439f8fe648301ab4f60a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:41.403202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961209-1160-4552-ba74-dcaaa7cdf01d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.403491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961209-1160-4552-ba74-dcaaa7cdf01d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.403768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961209-1160-4552-ba74-dcaaa7cdf01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.435221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0c961209-1160-4552-ba74-dcaaa7cdf01d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:41.436441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0c961209-1160-4552-ba74-dcaaa7cdf01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:41.463294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.463975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.464263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.464542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.465371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.467204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.550996 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2431/4843] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:41.555154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.557116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:41.594091 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:41.597313 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2413/4844] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:41.606703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.607007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.607284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.643682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:41.645548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:41.688887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04661fa-50c8-402c-ad03-964f51029078 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.706881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.707586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.707870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.708150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.708849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.712787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.763435 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2432/4845] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:41.764804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.780624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e3b9e-f02d-463e-b4d3-c57b11684b79 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.787148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.788058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.788192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2414/4846] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:41.788872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.789596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.790879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.792626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.794217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.812774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2433/4847] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:41.814005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.818414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c11a9-d0a7-44da-81c3-d71c3f21f4e9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.828932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.829615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.830741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.831188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.831851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:41.832166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.833807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.835940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad5dc8-cd51-4d97-a342-b50a9074b28a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.859297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.861541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.862651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.864663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.866062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.870152 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2415/4848] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:06:41.871232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.872169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.893659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be02df-5910-4c04-85b9-eb0af5792054 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:41.902312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:41.903711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:41.903977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:41.904255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:41.904960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:41.906922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:41.917093 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2434/4849] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:41.920069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.962720 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2416/4850] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:41.964095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:41.968961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df6b9-06c0-4329-b10c-98206eb9911b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.070068 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:42.111973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38c752-88d4-4221-a84c-33cf90f2b59a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.121309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.122385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.122385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.122608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.123302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:42.125297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:42.165596 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2417/4851] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:41 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:42.169704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:42.192196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d05f-137c-4019-b94b-9b1684acbd16 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.201810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.202520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.202826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.203097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.203837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:42.205470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:42.210256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d885-4030-4314-80f3-d40eda708d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.211572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d885-4030-4314-80f3-d40eda708d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.212257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d885-4030-4314-80f3-d40eda708d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.218887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d885-4030-4314-80f3-d40eda708d15 admin admin] PATH_INFO: `/v3/projects/1c1544cf38cc455a923bb68928439743/users/87be873dd7d6441d84380b227ec4f034/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.237618 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2418/4852] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:42.238046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:42.245444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d885-4030-4314-80f3-d40eda708d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1544cf38cc455a923bb68928439743, user_id=87be873dd7d6441d84380b227ec4f034, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:42.253023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d885-4030-4314-80f3-d40eda708d15 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:42.255522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb299-69e1-43fe-b92d-2c252178e2e4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.267320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.267320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.267320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.267320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.267760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:42.269268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:42.290261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2419/4853] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:06:42.294256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:42.316919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c550-c503-468d-94d8-46b3150cd2b9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.323629 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2435/4854] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:41 2022] PUT /identity/v3/projects/1c1544cf38cc455a923bb68928439743/users/87be873dd7d6441d84380b227ec4f034/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:42.329241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.330751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.332183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.399630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:42.405996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:42.432513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18938807-f433-41f9-949d-2db424d114ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.433425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18938807-f433-41f9-949d-2db424d114ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.433742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18938807-f433-41f9-949d-2db424d114ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.434565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18938807-f433-41f9-949d-2db424d114ed admin admin] PATH_INFO: `/v3/projects/1f20e0402b09444396e786d8227b6fdd/users/5c5b1815e933482db73e7c4d2c6d5526/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.467519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18938807-f433-41f9-949d-2db424d114ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f20e0402b09444396e786d8227b6fdd, user_id=5c5b1815e933482db73e7c4d2c6d5526, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:42.470247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18938807-f433-41f9-949d-2db424d114ed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:42.505695 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2420/4855] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:42 2022] PUT /identity/v3/projects/1f20e0402b09444396e786d8227b6fdd/users/5c5b1815e933482db73e7c4d2c6d5526/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:42.516615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.517011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.517175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.547428 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2436/4856] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:42.561443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:42.563996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:42.568091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] MFA Rules not processed for user `5c5b1815e933482db73e7c4d2c6d5526`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:42.569449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:42.583153 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:42.723677 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2421/4857] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:42.724637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:42.756266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96400-df3e-4b86-8a62-aa81409e7d76 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.779680 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:42.855208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.857458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.858064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.858547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.891841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4411e-5f6b-4e2e-8ffd-f934dd66c581 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:42.897015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:42.897760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:42.898051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:42.898335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:42.899084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:42.901027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:42.960762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2422/4858] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:42 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:42.961668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.039101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.042308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.075333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2437/4859] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:43.107166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abd3ee-2593-4f1b-8ab1-189a8409aa3e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.127519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.128311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.128619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.128973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.129696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.131738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.167314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2423/4860] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:42 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:43.172301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.186375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f3bb-d461-474f-b1be-dcaaf77e31ea service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.196970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.197762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.199085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.199434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.201176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.207169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.230036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2438/4861] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:43.234937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.249612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ae2d-8da7-4623-8873-cc985c856ca1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.265591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.266642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.267734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.267734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] PATH_INFO: `/v3/projects/5a6121926fc74e8ba6e8abbfbd3442a6/users/9b07a1b27429472c8f5a7fb4890ad66c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.297627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6121926fc74e8ba6e8abbfbd3442a6, user_id=9b07a1b27429472c8f5a7fb4890ad66c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.303087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.332252 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2424/4862] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:43 2022] PUT /identity/v3/projects/5a6121926fc74e8ba6e8abbfbd3442a6/users/9b07a1b27429472c8f5a7fb4890ad66c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:43.333529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.348436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab0f1d-a97e-40c6-991e-944242997ff7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.478886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384890a1-019b-41ae-a1a6-275687d28dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.479932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384890a1-019b-41ae-a1a6-275687d28dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.480506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384890a1-019b-41ae-a1a6-275687d28dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.481620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384890a1-019b-41ae-a1a6-275687d28dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.482592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384890a1-019b-41ae-a1a6-275687d28dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.486968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384890a1-019b-41ae-a1a6-275687d28dd3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.497034 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:43.507149 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2439/4863] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:43.516824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.532608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d1a6-e2ea-4636-b65d-0a89dfc3d149 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.540441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.542257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.542981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.544172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] PATH_INFO: `/v3/projects/5a6121926fc74e8ba6e8abbfbd3442a6/users/9b07a1b27429472c8f5a7fb4890ad66c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.546962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6121926fc74e8ba6e8abbfbd3442a6, user_id=9b07a1b27429472c8f5a7fb4890ad66c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.551515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.567630 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2425/4864] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:43 2022] PUT /identity/v3/projects/5a6121926fc74e8ba6e8abbfbd3442a6/users/9b07a1b27429472c8f5a7fb4890ad66c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:43.586235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.586813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.587323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.628184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] MFA Rules not processed for user `9b07a1b27429472c8f5a7fb4890ad66c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:43.630749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:43.789310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.805288 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2440/4865] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:43.807459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016d185-8728-45c8-9288-ce6f47a434f2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.824912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.825530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.825827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.826118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.826904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:43.828376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.830998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.869193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.877007 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2426/4866] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:43.886766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6dbd4-8c4a-453c-bf59-61124fe4fb0d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:43.901195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:43.903224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:43.906676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:43.907160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:43.908593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:43.913463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:43.977655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:43.989615 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2441/4867] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:43 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:43.993006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59073-4657-41fe-b51f-23e3a1fcf7ca tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:44.077966 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:44.097891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:44.098945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:44.099429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:44.099899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:44.101140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:44.101762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:44.103824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2693b-9862-4cd2-9b1d-3dabbfd7d455 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:44.123955 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2427/4868] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:44.130088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:44.132551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:44.374864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fffdd-a680-4324-9fb2-afeccc61f6a3 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:44.387715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:44.389135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:44.389618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:44.390087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:44.417107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:44.420237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:44.441028 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2442/4869] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:44.456849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee89a-94ef-4859-94ab-76b36d98a8c5 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:44.457146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee89a-94ef-4859-94ab-76b36d98a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:44.457430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee89a-94ef-4859-94ab-76b36d98a8c5 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:44.458851 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2428/4870] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:06:44.477128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:06:44.506191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:44.528805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4a9a-2d61-4b1a-a60c-1333fc93b65c service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:44.544105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:44.545276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:44.545869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:44.546807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/projects/37f11795bbd34dce92b5f9dc34867918` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:44.549038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f11795bbd34dce92b5f9dc34867918)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:44.556699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:44.569352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2443/4871] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:06:44 2022] GET /identity/v3/projects/37f11795bbd34dce92b5f9dc34867918 => generated 369 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:44.776838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eef16-4d68-48cf-98da-5c9850898a51 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:44.778232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eef16-4d68-48cf-98da-5c9850898a51 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:44.778758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eef16-4d68-48cf-98da-5c9850898a51 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:44.784859 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2429/4872] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:06:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:06:44.804327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:06:44.828660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:44.871205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11237da-2dbd-4ae4-a9a2-7b3d240443cb tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:44.894171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:44.895669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:44.898391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:44.898699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/projects/37f11795bbd34dce92b5f9dc34867918` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:44.909325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f11795bbd34dce92b5f9dc34867918)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:44.915945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:44.924869 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2444/4873] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:06:44 2022] GET /identity/v3/projects/37f11795bbd34dce92b5f9dc34867918 => generated 369 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:45.062552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61eef16-4d68-48cf-98da-5c9850898a51 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.095312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61eef16-4d68-48cf-98da-5c9850898a51 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.110137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.113038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.113532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.113831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.121574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:45.121905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.125782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.174569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.182486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2430/4874] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:45.187835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489cd2a-1925-4c80-957b-0aa8983159f2 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.194064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ecad-7d69-43c8-bbd5-f5f4946278e1 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.194799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ecad-7d69-43c8-bbd5-f5f4946278e1 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.195147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ecad-7d69-43c8-bbd5-f5f4946278e1 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.195438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ecad-7d69-43c8-bbd5-f5f4946278e1 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.196671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9ecad-7d69-43c8-bbd5-f5f4946278e1 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.199216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9ecad-7d69-43c8-bbd5-f5f4946278e1 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.232185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.244412 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2445/4875] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:45 2022] POST /identity/v3/users => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:45.247333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c40f-9260-40c2-a8d6-2cf9e93bf556 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.255186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.256527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.257291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.257806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.258914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:45.259605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.261712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.282587 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2431/4876] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:45.307458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff04d7-43b8-4fbe-a364-ba5bec081821 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.308062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff04d7-43b8-4fbe-a364-ba5bec081821 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.308743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff04d7-43b8-4fbe-a364-ba5bec081821 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.311368 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2446/4877] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:06:45.324111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:06:45.352090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.372962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3648-e407-4217-97ac-be25f782e578 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.380939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341db1a-a44e-4c06-9bfb-02ee0a0181db tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.382444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341db1a-a44e-4c06-9bfb-02ee0a0181db tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.382918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341db1a-a44e-4c06-9bfb-02ee0a0181db tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.383402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341db1a-a44e-4c06-9bfb-02ee0a0181db tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/projects/37f11795bbd34dce92b5f9dc34867918` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.388658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341db1a-a44e-4c06-9bfb-02ee0a0181db tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f11795bbd34dce92b5f9dc34867918)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.395834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341db1a-a44e-4c06-9bfb-02ee0a0181db tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.401498 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2432/4878] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:06:45 2022] GET /identity/v3/projects/37f11795bbd34dce92b5f9dc34867918 => generated 369 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:45.483965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff04d7-43b8-4fbe-a364-ba5bec081821 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.487104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17ff04d7-43b8-4fbe-a364-ba5bec081821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:45.521774 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:45.652102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff04d7-43b8-4fbe-a364-ba5bec081821 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.658181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.659347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.659789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.660284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] PATH_INFO: `/v3/users/c482fcdd7477440784553770059526b5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.661846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c482fcdd7477440784553770059526b5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.666175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.702817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.703163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.703457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.705068 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2433/4879] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:06:45.719342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] Authenticating service token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:06:45.721500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:45.764666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.798172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c1cc-7cff-49fc-8912-ad0f8a07eb11 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.813724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.815937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.816217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.816513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/projects/37f11795bbd34dce92b5f9dc34867918` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.820867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:get_project(project_id=37f11795bbd34dce92b5f9dc34867918)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.827465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.828159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c482fcdd7477440784553770059526b5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:45.829227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c482fcdd7477440784553770059526b5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:45.846300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2434/4880] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:06:45 2022] GET /identity/v3/projects/37f11795bbd34dce92b5f9dc34867918 => generated 369 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:06:45.877146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c482fcdd7477440784553770059526b5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:45.878682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c482fcdd7477440784553770059526b5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:45.899029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:45.901355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:45.913770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-856f77a7-edd2-4f95-8fbf-395ca8f54a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c482fcdd7477440784553770059526b5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:45.923032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6145a8-a526-40fa-8668-bbaec6ddb891 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:45.928866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:45.930061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.930361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.930942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/users/af9ccb9ffb57420da1188806b84e8f95` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.946565 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2447/4881] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:45 2022] DELETE /identity/v3/users/c482fcdd7477440784553770059526b5 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:45.948659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:45.952015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:delete_user(user_id=af9ccb9ffb57420da1188806b84e8f95)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:45.952170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:45.952600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:45.954881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:45.991909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:45.994388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:46.044581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9ccb9ffb57420da1188806b84e8f95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.077675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9ccb9ffb57420da1188806b84e8f95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.104605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9ccb9ffb57420da1188806b84e8f95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.125906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9ccb9ffb57420da1188806b84e8f95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.126838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9ccb9ffb57420da1188806b84e8f95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.152552 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2435/4882] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:45 2022] DELETE /identity/v3/users/af9ccb9ffb57420da1188806b84e8f95 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:46.157012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:46.161613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:46.183037 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2448/4883] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:46.246675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:46.248293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:46.398461 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:46.425800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549cd0-836c-4439-a44f-9b2e1da6b053 tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:46.427763 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:46.446464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b07a1b27429472c8f5a7fb4890ad66c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6121926fc74e8ba6e8abbfbd3442a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:46.447634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:46.447998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:46.448554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] PATH_INFO: `/v3/projects/37f11795bbd34dce92b5f9dc34867918` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:46.451267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37f11795bbd34dce92b5f9dc34867918)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:46.457373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:46.528040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae854d8d-84fb-4eb0-a161-b67597104305 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:46.634365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f11795bbd34dce92b5f9dc34867918', 'request_id': 'req-cd7ef555-d58f-47b0-9053-0ff89acbe86f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.651253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f11795bbd34dce92b5f9dc34867918', 'request_id': 'req-cd7ef555-d58f-47b0-9053-0ff89acbe86f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.676742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f11795bbd34dce92b5f9dc34867918', 'request_id': 'req-cd7ef555-d58f-47b0-9053-0ff89acbe86f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.688271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5561e4-5a5e-4b13-a210-1fee89e442be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:46.689309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5561e4-5a5e-4b13-a210-1fee89e442be service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:46.689610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5561e4-5a5e-4b13-a210-1fee89e442be service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:46.689961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5561e4-5a5e-4b13-a210-1fee89e442be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:46.738058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] The token cache is being invalidate because project 37f11795bbd34dce92b5f9dc34867918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:46.738767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.740348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:46.748377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2436/4884] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:46 2022] DELETE /identity/v3/projects/37f11795bbd34dce92b5f9dc34867918 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:46.787172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:46.790177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:46.903088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5561e4-5a5e-4b13-a210-1fee89e442be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:46.905885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5561e4-5a5e-4b13-a210-1fee89e442be service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:46.934381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2449/4885] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:47.002575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef555-d58f-47b0-9053-0ff89acbe86f tempest-QuotasAdminTestV257-211473809 tempest-QuotasAdminTestV257-211473809-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:47.014034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:47.016295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:47.018146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:47.019254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] PATH_INFO: `/v3/users/5c5b1815e933482db73e7c4d2c6d5526` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:47.022676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5b1815e933482db73e7c4d2c6d5526)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:47.026082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:47.129612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5b1815e933482db73e7c4d2c6d5526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:47.146145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5b1815e933482db73e7c4d2c6d5526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:47.156701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5b1815e933482db73e7c4d2c6d5526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:47.167624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5b1815e933482db73e7c4d2c6d5526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:47.168642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5b1815e933482db73e7c4d2c6d5526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:47.176958 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2437/4886] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:46 2022] DELETE /identity/v3/users/5c5b1815e933482db73e7c4d2c6d5526 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:47.181332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6283-5663-49e6-b652-bd90e5d47867 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:47.181630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6283-5663-49e6-b652-bd90e5d47867 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:47.181917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6283-5663-49e6-b652-bd90e5d47867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:47.205032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d82b6283-5663-49e6-b652-bd90e5d47867 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:47.206752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d82b6283-5663-49e6-b652-bd90e5d47867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:47.349823 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2450/4887] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:47.424042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:47.425610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:47.456878 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:47.627781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec84481-c648-4c0b-8855-063ca41d8bc4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:47.633898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:47.635772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:47.636108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:47.636393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:47.653068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:47.656033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:47.677641 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2438/4888] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:47.754910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:47.755478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:47.755586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:47.773576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:47.775735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:47.816558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572a41-290b-42b9-9171-b0af5e471085 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:47.835598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] MFA Rules not processed for user `ee9654eea6394375bb289b3a63c34733`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:47.839228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:47.839429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:47.840813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:47.841228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:47.841629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] PATH_INFO: `/v3/projects/b7fede130ce84cd39928f1c6ab54c305` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:47.843083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fede130ce84cd39928f1c6ab54c305)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:47.845294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:47.962228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fede130ce84cd39928f1c6ab54c305', 'request_id': 'req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:47.982856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fede130ce84cd39928f1c6ab54c305', 'request_id': 'req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.001318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fede130ce84cd39928f1c6ab54c305', 'request_id': 'req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.010693 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:48.021583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] The token cache is being invalidate because project b7fede130ce84cd39928f1c6ab54c305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:48.021998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.022818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.027999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2439/4889] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:47 2022] DELETE /identity/v3/projects/b7fede130ce84cd39928f1c6ab54c305 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:48.029003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:48.032286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:48.093378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2451/4890] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:48.228994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d38d3-a6af-4b53-a7a7-7b9827ef0ac3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:48.240766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:48.242330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:48.242785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:48.243161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] PATH_INFO: `/v3/users/4d03fae5964a42ccac956a9f1cfc4a18` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:48.244587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d03fae5964a42ccac956a9f1cfc4a18)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:48.247034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:48.309089 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:48.323872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d03fae5964a42ccac956a9f1cfc4a18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.341793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d03fae5964a42ccac956a9f1cfc4a18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.350820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d03fae5964a42ccac956a9f1cfc4a18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.360987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d03fae5964a42ccac956a9f1cfc4a18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.362143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d03fae5964a42ccac956a9f1cfc4a18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:48.375687 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2440/4891] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:48 2022] DELETE /identity/v3/users/4d03fae5964a42ccac956a9f1cfc4a18 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:49.181919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:49.184126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:49.208281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1fb1d-dd31-4b23-b3c3-3f0174efad82 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:49.396460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:49.397356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:49.397638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:49.397915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] PATH_INFO: `/v3/projects/1f20e0402b09444396e786d8227b6fdd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:49.407000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f20e0402b09444396e786d8227b6fdd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:49.413986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:49.442719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:49.445440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:49.529040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f20e0402b09444396e786d8227b6fdd', 'request_id': 'req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.545469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f20e0402b09444396e786d8227b6fdd', 'request_id': 'req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.555558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f20e0402b09444396e786d8227b6fdd', 'request_id': 'req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.598882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] The token cache is being invalidate because project 1f20e0402b09444396e786d8227b6fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:49.599187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.600886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.606754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2452/4892] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:49 2022] DELETE /identity/v3/projects/1f20e0402b09444396e786d8227b6fdd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:49.607287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:49.609315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:49.626022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db3f9-4170-4c43-b4b2-f2a35ccff2ad admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:49.758440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee1e8d-6ad8-4247-8818-4b1dda8c44dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:49.764464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:49.765974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:49.767344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:49.768291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:49.768786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] PATH_INFO: `/v3/users/9b07a1b27429472c8f5a7fb4890ad66c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:49.770154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:49.770440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:49.770757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:49.772358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b07a1b27429472c8f5a7fb4890ad66c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:49.775457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:49.779004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:49.808117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:49.813421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:49.816693 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:49.837018 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2441/4893] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:49.883967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b07a1b27429472c8f5a7fb4890ad66c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.884807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b07a1b27429472c8f5a7fb4890ad66c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.913131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b07a1b27429472c8f5a7fb4890ad66c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.916257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b07a1b27429472c8f5a7fb4890ad66c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.944908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b07a1b27429472c8f5a7fb4890ad66c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:49.982380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2453/4894] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:49 2022] DELETE /identity/v3/users/9b07a1b27429472c8f5a7fb4890ad66c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:50.188978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:50.198000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:50.263899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33909-b2f9-4998-8802-3d649a859832 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:50.358174 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:50.387936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:50.389094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:50.390317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:50.390755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] PATH_INFO: `/v3/projects/fb2f041b7b8241ecb00b071665fa89f0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:50.392405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2f041b7b8241ecb00b071665fa89f0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:50.395908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:50.486412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2f041b7b8241ecb00b071665fa89f0', 'request_id': 'req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.499932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2f041b7b8241ecb00b071665fa89f0', 'request_id': 'req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.518719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2f041b7b8241ecb00b071665fa89f0', 'request_id': 'req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.549154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] The token cache is being invalidate because project fb2f041b7b8241ecb00b071665fa89f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:50.550468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.551300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.558018 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2442/4895] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:50 2022] DELETE /identity/v3/projects/fb2f041b7b8241ecb00b071665fa89f0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:50.562769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:50.564789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:50.591436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d48f9-ab3e-4aae-a377-a29f027acf48 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:50.760468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:50.763755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:50.789275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:50.791927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:50.792824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:50.793112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] PATH_INFO: `/v3/users/49b8ee8dca1f489aa35599a2b407e414` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:50.796852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b8ee8dca1f489aa35599a2b407e414)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:50.802529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:50.956721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b8ee8dca1f489aa35599a2b407e414'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.959386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b8ee8dca1f489aa35599a2b407e414'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.965892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd3197-c0c6-4c88-ab8d-baeccebf0bc7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:50.973194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:50.974452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:50.975128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:50.976266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:50.979543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:50.984211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b8ee8dca1f489aa35599a2b407e414'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:50.985190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b8ee8dca1f489aa35599a2b407e414'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:51.000496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:51.009017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b8ee8dca1f489aa35599a2b407e414'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:51.040467 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2454/4896] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:50 2022] DELETE /identity/v3/users/49b8ee8dca1f489aa35599a2b407e414 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:51.042095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e3be-301d-4271-b664-5f41be677439 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:51.055979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2443/4897] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:06:52.049170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:52.050889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:52.069140 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:52.141778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efd261-9a1e-4203-b157-03f5df5fdbd8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:52.148662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:52.149589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.149945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:52.150297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] PATH_INFO: `/v3/projects/5a6121926fc74e8ba6e8abbfbd3442a6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:52.152030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6121926fc74e8ba6e8abbfbd3442a6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:52.171066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:52.243844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6121926fc74e8ba6e8abbfbd3442a6', 'request_id': 'req-d5d27e97-dab3-4209-a687-6c749c6dcae0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:52.255284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6121926fc74e8ba6e8abbfbd3442a6', 'request_id': 'req-d5d27e97-dab3-4209-a687-6c749c6dcae0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:52.267583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6121926fc74e8ba6e8abbfbd3442a6', 'request_id': 'req-d5d27e97-dab3-4209-a687-6c749c6dcae0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:52.288678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] The token cache is being invalidate because project 5a6121926fc74e8ba6e8abbfbd3442a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:52.289271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:52.290769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5d27e97-dab3-4209-a687-6c749c6dcae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:52.294606 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2455/4898] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:52 2022] DELETE /identity/v3/projects/5a6121926fc74e8ba6e8abbfbd3442a6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:06:52.303238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99391304-8160-4526-b38c-4266e408dd6d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.303887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99391304-8160-4526-b38c-4266e408dd6d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:52.304099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99391304-8160-4526-b38c-4266e408dd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:52.342482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-99391304-8160-4526-b38c-4266e408dd6d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:52.344513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-99391304-8160-4526-b38c-4266e408dd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:52.485033 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2444/4899] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:52.493314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.493738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:52.494123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:52.519450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:52.522230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:52.537994 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2456/4900] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:52.539335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99391304-8160-4526-b38c-4266e408dd6d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:52.566073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99391304-8160-4526-b38c-4266e408dd6d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:52.584506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:52.585394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.585691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:52.586067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:52.586896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:52.587402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:52.592663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:52.630254 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2445/4901] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:52.634764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:52.651341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cac049-8cb8-4c0b-b5a6-cee42d7572cb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:52.673612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:52.678034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.678545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:52.678980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:52.679868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:52.685243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:52.740355 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2457/4902] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:52 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:52.744278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:52.752269 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:52.756816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e4be9-d1f3-415a-b851-c5f6b4afa084 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:52.909887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:52.911522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.911522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:52.911522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:52.912576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:52.915381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:52.957891 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2446/4903] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:52 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:52.961464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:52.979897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176169c8-c419-4d9c-a1cc-6c631a46ac78 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:52.991058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:52.993238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:52.998835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:52.999538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:52.999824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.000105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.001118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.002775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.013060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb75aeb-e184-4baf-8547-9843d9589365 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:53.019655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:53.020827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.022015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.022471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] PATH_INFO: `/v3/projects/1f9ea4a608d8412b907a4c94870f7913` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.024127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9ea4a608d8412b907a4c94870f7913)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.026658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.035313 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2458/4904] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:53.062326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:53.074999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e55fc-a687-4371-b9a8-e237b89fb01e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:53.081798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:53.082885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.083320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.084057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.084999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.087739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.110473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2459/4905] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:53.114994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:53.138354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9ea4a608d8412b907a4c94870f7913', 'request_id': 'req-0038cd71-21bc-4947-a296-0f840750da9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:53.140708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab733e-b581-431f-9465-6c3a2678e25e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:53.155693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9ea4a608d8412b907a4c94870f7913', 'request_id': 'req-0038cd71-21bc-4947-a296-0f840750da9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:53.171550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9ea4a608d8412b907a4c94870f7913', 'request_id': 'req-0038cd71-21bc-4947-a296-0f840750da9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:53.195595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] The token cache is being invalidate because project 1f9ea4a608d8412b907a4c94870f7913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:53.196132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:53.197189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0038cd71-21bc-4947-a296-0f840750da9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:53.201941 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2447/4906] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:52 2022] DELETE /identity/v3/projects/1f9ea4a608d8412b907a4c94870f7913 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:53.208246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256146e-87be-479f-bbb3-58e83f80ff25 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.208743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256146e-87be-479f-bbb3-58e83f80ff25 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.209169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256146e-87be-479f-bbb3-58e83f80ff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.248887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6256146e-87be-479f-bbb3-58e83f80ff25 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:53.252616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6256146e-87be-479f-bbb3-58e83f80ff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:53.271740 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:53.300436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f86ec-715c-4049-b361-efb3312e51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:53.301351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f86ec-715c-4049-b361-efb3312e51a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.302443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f86ec-715c-4049-b361-efb3312e51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.302753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f86ec-715c-4049-b361-efb3312e51a1 admin admin] PATH_INFO: `/v3/projects/fe781cd8395448e8a703bdfb16a1aad7/users/0775a166e56e4d299afc541eada3480f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.338993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f86ec-715c-4049-b361-efb3312e51a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe781cd8395448e8a703bdfb16a1aad7, user_id=0775a166e56e4d299afc541eada3480f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.343579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f86ec-715c-4049-b361-efb3312e51a1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.378609 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2460/4907] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:53 2022] PUT /identity/v3/projects/fe781cd8395448e8a703bdfb16a1aad7/users/0775a166e56e4d299afc541eada3480f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:53.383774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.384616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.385102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.430142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2448/4908] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:53.440902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.441394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.441609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.454335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] MFA Rules not processed for user `0775a166e56e4d299afc541eada3480f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:53.456173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:53.471628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:53.476277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:53.507847 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:53.559352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2461/4909] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:06:53.563979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:53.565954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:53.645082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2449/4910] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:53.646311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:53.672820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608347f-0a03-4b93-881f-d2b4e0a0afca None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:53.688704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:53.690020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.691266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.691266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.692075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:06:53.694930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.696627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.725164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7bc5e-8629-4ec1-b9f4-e8e1afb77b9a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:53.732844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:53.734091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2450/4911] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:06:53.735612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.736056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.736570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.737663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:53.738866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.741372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.772241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8e3a5-b2ff-4832-ac6b-d68f2d14a675 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:53.795425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:53.796224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:53.796400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:53.796693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:53.797386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:53.811961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:53.871732 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2462/4912] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:53.875797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:53.928122 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2451/4913] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:53.929505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.028720 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:54.070051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561715b4-8e65-4971-8802-3c57a4f708a9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.107814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3a1c-f1ed-4e18-bcf6-74f7d727963f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.115677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.116383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.116733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.117017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.117765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.119901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.184873 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2452/4914] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:54.188524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.213873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa56b9-2071-45ea-a5e7-2cd087f563c7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.222708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.223564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.226375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.226844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.228060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.230741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.248079 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2453/4915] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:54.252058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.258433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.260975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.262574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.263533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.264373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.269384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.275302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658916-e478-4a48-9cde-635bbce34b20 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.286380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.287796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.288264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.289049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.290246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.293257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.311441 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2463/4916] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:53 2022] POST /identity/v3/users => generated 294 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:06:54.317554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2454/4917] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:54.318997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.321443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.332072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608eb95-b95b-4def-97d1-c8339b3792be admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.337036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a98a-4583-4b25-b188-56dfeedbf388 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.338629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.339315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.339700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.340144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.341417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.343495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.346181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12b31a-e915-4fba-bf63-fb5e1cf7e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.347386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12b31a-e915-4fba-bf63-fb5e1cf7e3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.347843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12b31a-e915-4fba-bf63-fb5e1cf7e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.348420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12b31a-e915-4fba-bf63-fb5e1cf7e3ca admin admin] PATH_INFO: `/v3/projects/fa774f518e094424b3c7c6d6b29f71f7/users/f3949c121ec948bd9a8eda3dc2164a95/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.370066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2464/4918] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:54.375745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.377094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12b31a-e915-4fba-bf63-fb5e1cf7e3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa774f518e094424b3c7c6d6b29f71f7, user_id=f3949c121ec948bd9a8eda3dc2164a95, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.380716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12b31a-e915-4fba-bf63-fb5e1cf7e3ca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.404848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ee18b-9db4-46f7-a0ad-182cc0b48fa1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.418226 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2455/4919] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:54 2022] PUT /identity/v3/projects/fa774f518e094424b3c7c6d6b29f71f7/users/f3949c121ec948bd9a8eda3dc2164a95/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:54.420611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.420970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.421317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.472420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] MFA Rules not processed for user `f3949c121ec948bd9a8eda3dc2164a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:54.473926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:54.502477 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:54.575326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.576401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.576776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.577251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] PATH_INFO: `/v3/projects/4c1bdbb9bda5423d85af31acc5775439/users/a831f8428a4e489fa062db712c15dc63/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.597755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1bdbb9bda5423d85af31acc5775439, user_id=a831f8428a4e489fa062db712c15dc63, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.600954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.623903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2465/4920] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:54 2022] PUT /identity/v3/projects/4c1bdbb9bda5423d85af31acc5775439/users/a831f8428a4e489fa062db712c15dc63/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:54.628235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.663417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2456/4921] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:54.666880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.688246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454287f-93a3-45e0-9b22-36e88fd998c8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.742984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0d98d-beba-4a9d-8cb1-1c631c27968f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.783293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2a6a-2bc4-4d16-a1b4-adec5e8ed10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.784101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2a6a-2bc4-4d16-a1b4-adec5e8ed10b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.784402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2a6a-2bc4-4d16-a1b4-adec5e8ed10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.784682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2a6a-2bc4-4d16-a1b4-adec5e8ed10b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.785454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2a6a-2bc4-4d16-a1b4-adec5e8ed10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.787306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2a6a-2bc4-4d16-a1b4-adec5e8ed10b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.788882 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:54.793316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.794445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.795252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.795702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.796623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.798834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.802921 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2466/4922] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:54.804341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.804654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.804915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.850595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2457/4923] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:06:54 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:54.851970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.855394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] MFA Rules not processed for user `87be873dd7d6441d84380b227ec4f034`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:54.856672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:54.945870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2467/4924] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:54.949430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.954149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a29a1-4fd1-4890-9901-5ead19cb7c01 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.960016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:54.960984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:54.961281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:54.961561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] PATH_INFO: `/v3/projects/4c1bdbb9bda5423d85af31acc5775439/users/a831f8428a4e489fa062db712c15dc63/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:54.967018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1bdbb9bda5423d85af31acc5775439, user_id=a831f8428a4e489fa062db712c15dc63, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:54.970402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:54.978003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e6a4-fece-4b39-8631-d36ba8f19111 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:54.984964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2458/4925] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:54 2022] PUT /identity/v3/projects/4c1bdbb9bda5423d85af31acc5775439/users/a831f8428a4e489fa062db712c15dc63/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:54.986118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:54.994694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:55.103935 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:55.116117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eaa95-81fb-4044-b745-79922fd20b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.117336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eaa95-81fb-4044-b745-79922fd20b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.117935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eaa95-81fb-4044-b745-79922fd20b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.118445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eaa95-81fb-4044-b745-79922fd20b00 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.120096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eaa95-81fb-4044-b745-79922fd20b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:55.124468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eaa95-81fb-4044-b745-79922fd20b00 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:55.153878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3f35-10af-4c51-9903-edf92be7f744 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:55.160390 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2468/4926] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:06:54 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:06:55.163397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa636fd-450d-4ed3-8116-a6e0fc944891 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.163397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa636fd-450d-4ed3-8116-a6e0fc944891 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.163397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa636fd-450d-4ed3-8116-a6e0fc944891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.168986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.169661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.169952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.170238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.203395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cfa636fd-450d-4ed3-8116-a6e0fc944891 None None] MFA Rules not processed for user `a831f8428a4e489fa062db712c15dc63`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:55.206035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cfa636fd-450d-4ed3-8116-a6e0fc944891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:55.284845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:55.288733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:55.307782 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2459/4927] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:55.310004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:55.331041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218977c7-2ed9-4a8f-bee3-0f9dd78d6575 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:55.344604 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:55.348867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.350040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.350610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.351132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.352505 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2469/4928] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:55.359192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:55.361141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:55.374744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.375184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.375472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.395744 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2460/4929] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:06:55.397474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:55.418802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] MFA Rules not processed for user `0775a166e56e4d299afc541eada3480f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:55.421856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:55.424875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1310acc-48ca-456b-a2be-3244a6db3709 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:55.444963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.446119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.447082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.447578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] PATH_INFO: `/v3/projects/e0fb2d41b3234bed84c758c8bde52317/users/f68145b43e4d4483a3fe18c91d193f10/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.474441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fb2d41b3234bed84c758c8bde52317, user_id=f68145b43e4d4483a3fe18c91d193f10, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:55.479361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:55.504489 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2461/4930] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:55 2022] PUT /identity/v3/projects/e0fb2d41b3234bed84c758c8bde52317/users/f68145b43e4d4483a3fe18c91d193f10/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:55.510420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:55.614036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2470/4931] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:55.631483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:55.634657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:55.687340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86501c-d7a4-4a90-99d1-92b632ef45ec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:55.696173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd967e4-6b8a-4cfd-afe3-57e27a907e1c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:55.706929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.710281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.711480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.711772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.715579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:55.722692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:55.765178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2462/4932] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:06:55.766050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:55.798712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5103-4634-4cec-9a6d-5f258983f422 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:55.809981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbd4c-9f1d-41fb-ae5d-c3b2373250aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.810973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbd4c-9f1d-41fb-ae5d-c3b2373250aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.811265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbd4c-9f1d-41fb-ae5d-c3b2373250aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.811551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbd4c-9f1d-41fb-ae5d-c3b2373250aa admin admin] PATH_INFO: `/v3/projects/e0fb2d41b3234bed84c758c8bde52317/users/f68145b43e4d4483a3fe18c91d193f10/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.817516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cbd4c-9f1d-41fb-ae5d-c3b2373250aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fb2d41b3234bed84c758c8bde52317, user_id=f68145b43e4d4483a3fe18c91d193f10, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:55.824146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cbd4c-9f1d-41fb-ae5d-c3b2373250aa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:55.871853 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2463/4933] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:06:55 2022] PUT /identity/v3/projects/e0fb2d41b3234bed84c758c8bde52317/users/f68145b43e4d4483a3fe18c91d193f10/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:55.882877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.883215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.883457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.934344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:55.935046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:55.935335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:55.935626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:55.953593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] MFA Rules not processed for user `f68145b43e4d4483a3fe18c91d193f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:55.955205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:55.966892 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:56.048844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:56.051887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:56.062549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2471/4934] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:56.066820 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2464/4935] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:56.078364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:56.082629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:56.150711 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:56.166755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe0d1-7256-43a3-8751-1b9f35b906a1 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:56.239892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfa67-9b8a-49b9-8588-456bc7a68239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:56.241114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfa67-9b8a-49b9-8588-456bc7a68239 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:56.241236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfa67-9b8a-49b9-8588-456bc7a68239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:56.241568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfa67-9b8a-49b9-8588-456bc7a68239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:56.264008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfa67-9b8a-49b9-8588-456bc7a68239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:56.265487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfa67-9b8a-49b9-8588-456bc7a68239 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:56.278046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2472/4936] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:57.591210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:57.782631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411f0a-a6d4-4dbd-97a8-a6646cbd6aa4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:57.787741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:57.789342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:57.789638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:57.789925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] PATH_INFO: `/v3/users/f3949c121ec948bd9a8eda3dc2164a95` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:57.794074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3949c121ec948bd9a8eda3dc2164a95)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:57.799093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:57.925493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3949c121ec948bd9a8eda3dc2164a95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:57.952413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3949c121ec948bd9a8eda3dc2164a95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:57.971086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3949c121ec948bd9a8eda3dc2164a95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:57.989102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3949c121ec948bd9a8eda3dc2164a95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:57.990311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3949c121ec948bd9a8eda3dc2164a95'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:58.008561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622865d1-3753-4a39-987b-7b79a89851af None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:58.009585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622865d1-3753-4a39-987b-7b79a89851af None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:58.010205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622865d1-3753-4a39-987b-7b79a89851af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:58.012192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2465/4937] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:57 2022] DELETE /identity/v3/users/f3949c121ec948bd9a8eda3dc2164a95 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:58.037512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-622865d1-3753-4a39-987b-7b79a89851af None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:06:58.039632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-622865d1-3753-4a39-987b-7b79a89851af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:58.190102 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2473/4938] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:06:58.279954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:58.281465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:58.355295 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:06:58.432922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff0a5-6290-4d80-bf78-2868ccd2fa86 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:58.450954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:58.451644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:58.452139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:58.452337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:58.470261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:58.471651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:58.493797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2466/4939] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:06:59.368813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622865d1-3753-4a39-987b-7b79a89851af None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:59.372422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-622865d1-3753-4a39-987b-7b79a89851af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:06:59.390143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622865d1-3753-4a39-987b-7b79a89851af None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:59.406134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:59.407556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:59.408066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:59.408556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] PATH_INFO: `/v3/projects/fa774f518e094424b3c7c6d6b29f71f7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:59.410218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa774f518e094424b3c7c6d6b29f71f7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:59.412721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:59.527477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa774f518e094424b3c7c6d6b29f71f7', 'request_id': 'req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.565480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa774f518e094424b3c7c6d6b29f71f7', 'request_id': 'req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.574409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa774f518e094424b3c7c6d6b29f71f7', 'request_id': 'req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.589374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] The token cache is being invalidate because project fa774f518e094424b3c7c6d6b29f71f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:06:59.589708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.592426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.598762 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2474/4940] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:06:59 2022] DELETE /identity/v3/projects/fa774f518e094424b3c7c6d6b29f71f7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:06:59.601075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:06:59.629203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b59b-a44f-42c4-b202-674cbc7a6b86 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:06:59.738427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:06:59.739370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:06:59.739658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:06:59.740022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] PATH_INFO: `/v3/users/f68145b43e4d4483a3fe18c91d193f10` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:06:59.741729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68145b43e4d4483a3fe18c91d193f10)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:06:59.743767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:06:59.841071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68145b43e4d4483a3fe18c91d193f10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.865551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68145b43e4d4483a3fe18c91d193f10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.874014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68145b43e4d4483a3fe18c91d193f10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.888589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68145b43e4d4483a3fe18c91d193f10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.890142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07dcf440-1bc1-4599-b9d9-b6ee89f8d1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68145b43e4d4483a3fe18c91d193f10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:06:59.906538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2467/4941] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:06:59 2022] DELETE /identity/v3/users/f68145b43e4d4483a3fe18c91d193f10 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:01.055704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:01.057260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:01.072693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91f9dc-1502-4e03-8b5e-54bcb4f2d58b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:01.123751 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:01.223246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:01.226579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.227473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.228336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] PATH_INFO: `/v3/projects/e0fb2d41b3234bed84c758c8bde52317` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.231927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fb2d41b3234bed84c758c8bde52317)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:01.233969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:01.298020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fb2d41b3234bed84c758c8bde52317', 'request_id': 'req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:01.307653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fb2d41b3234bed84c758c8bde52317', 'request_id': 'req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:01.316083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fb2d41b3234bed84c758c8bde52317', 'request_id': 'req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:01.331975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] The token cache is being invalidate because project e0fb2d41b3234bed84c758c8bde52317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:01.332273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:01.332961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4df2cb8c-4ce0-4e81-8317-1e4ac37100dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:01.335188 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2475/4942] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:01 2022] DELETE /identity/v3/projects/e0fb2d41b3234bed84c758c8bde52317 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:01.341410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.342448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.342988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.372351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:01.382199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:01.439499 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:01.468314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2468/4943] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:01.475876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.476176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.476466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.497852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:01.502439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:01.526108 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2476/4944] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:01.530346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:01.546909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe252-0643-47d5-84fa-b0fecc4169c4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:01.555086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:01.555823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.556292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.556661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.557327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:01.557641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:01.559745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:01.578742 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2469/4945] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:01.580585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:01.593125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d759d0-c6d3-4ac0-ace9-9393725c0356 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:01.619578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e44a1-dac0-4e6e-9754-b8c7dcdbb190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:01.621544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e44a1-dac0-4e6e-9754-b8c7dcdbb190 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.621903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e44a1-dac0-4e6e-9754-b8c7dcdbb190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.622186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e44a1-dac0-4e6e-9754-b8c7dcdbb190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.623191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e44a1-dac0-4e6e-9754-b8c7dcdbb190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:01.626167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e44a1-dac0-4e6e-9754-b8c7dcdbb190 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:01.684649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2477/4946] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:01 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:01.688710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:01.703331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053f55a-a400-425a-bd93-2578859e3932 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:01.804091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.804091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.804353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.809713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:01.810825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.811115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.811396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.812104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:01.815163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:01.828603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] MFA Rules not processed for user `87be873dd7d6441d84380b227ec4f034`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:01.829899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:01.861153 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2470/4947] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:01 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:01.864723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:01.883078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea9d9-f083-437f-b35b-60208a835d1c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:01.898880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:01.900216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.900611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.900992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.902452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:01.909528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:01.931882 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2471/4948] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:01.936187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:01.943907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2478/4949] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:01.947539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adbbc-a775-4dfd-be3e-24c20422f157 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:01.974568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfaff0-948d-4e53-b7c8-6a07b2dfd51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:01.975351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfaff0-948d-4e53-b7c8-6a07b2dfd51f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:01.975721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfaff0-948d-4e53-b7c8-6a07b2dfd51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:01.976433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfaff0-948d-4e53-b7c8-6a07b2dfd51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:01.976793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfaff0-948d-4e53-b7c8-6a07b2dfd51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:01.978918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfaff0-948d-4e53-b7c8-6a07b2dfd51f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:02.025235 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2472/4950] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:02.026037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:02.042115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bb377-a56d-4484-b4d5-7c1d6cd55193 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:02.062854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:02.064599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:02.065214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:02.066404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] PATH_INFO: `/v3/projects/4da11e26f0054b18a3b2fc83a26132cd/users/609f2117ee7e4a728779281e4912166a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:02.117491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da11e26f0054b18a3b2fc83a26132cd, user_id=609f2117ee7e4a728779281e4912166a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:02.121956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:02.150477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2479/4951] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:02 2022] PUT /identity/v3/projects/4da11e26f0054b18a3b2fc83a26132cd/users/609f2117ee7e4a728779281e4912166a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:02.164739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e571706-8879-4602-823a-ef564cd7229f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:02.165334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e571706-8879-4602-823a-ef564cd7229f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:02.166049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e571706-8879-4602-823a-ef564cd7229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:02.240434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6e571706-8879-4602-823a-ef564cd7229f None None] MFA Rules not processed for user `609f2117ee7e4a728779281e4912166a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:02.242531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e571706-8879-4602-823a-ef564cd7229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:02.394763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2473/4952] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:02.406890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:02.410591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:02.432052 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:02.610175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda3e4-7abe-4057-8a11-40fb919d4735 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:02.614912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:02.615982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:02.616281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:02.616597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:02.634948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:02.636942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:02.656624 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2480/4953] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:03.077644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e571706-8879-4602-823a-ef564cd7229f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:03.080355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e571706-8879-4602-823a-ef564cd7229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:03.184493 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:03.289913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e571706-8879-4602-823a-ef564cd7229f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:03.304796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:03.305654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:03.305951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:03.306219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] PATH_INFO: `/v3/users/292c78c8b8484e748687b637d6ca62fa` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:03.308247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=292c78c8b8484e748687b637d6ca62fa)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:03.310210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:03.391190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292c78c8b8484e748687b637d6ca62fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:03.408421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292c78c8b8484e748687b637d6ca62fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:03.419326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292c78c8b8484e748687b637d6ca62fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:03.434142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292c78c8b8484e748687b637d6ca62fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:03.434893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1a6abfbe-38a0-437b-83e7-c37f577fc96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292c78c8b8484e748687b637d6ca62fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:03.443982 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2474/4954] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:03 2022] DELETE /identity/v3/users/292c78c8b8484e748687b637d6ca62fa => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:03.772624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:03.787628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce269d-1c4a-48c2-b501-7e42b5c00791 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:03.865423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:03.867146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:03.867684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:03.868227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] PATH_INFO: `/v3/projects/1899713e76a441fca0f9eeb6601366fc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:03.873057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1899713e76a441fca0f9eeb6601366fc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:03.876474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:03.987339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1899713e76a441fca0f9eeb6601366fc', 'request_id': 'req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:04.006149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1899713e76a441fca0f9eeb6601366fc', 'request_id': 'req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:04.020875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1899713e76a441fca0f9eeb6601366fc', 'request_id': 'req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:04.054574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] The token cache is being invalidate because project 1899713e76a441fca0f9eeb6601366fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:04.055706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:04.058003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0e27cb75-024a-456c-aa2e-19e6ec6ad8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:04.067360 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2481/4955] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:03 2022] DELETE /identity/v3/projects/1899713e76a441fca0f9eeb6601366fc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:04.068698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.069145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.069489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.122381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:04.123681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:04.332350 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2475/4956] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:04.346539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.347192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.348812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.405043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.406607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:04.420430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:04.422720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:04.442517 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2482/4957] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:04.447890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.458172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383c9ce-36bd-4431-b605-220ea796f646 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.463990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.465348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.465713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.466071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.467104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:04.467489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:04.469624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:04.486572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2483/4958] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:04.489316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.509503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf4ea-a721-47f6-9a25-1c704f2d71d3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.520355 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:04.528211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.528908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.531307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.531711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.534023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:04.538696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:04.587083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77299f3-9d7e-45f5-a3f0-56cce9217079 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.599733 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:04.606850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.607532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.607836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.611946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.617954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:04.620534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2484/4959] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:04 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:04.633856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.659051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:04.660948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:04.731915 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2476/4960] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:07:04.745648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07a57-cb51-4a62-9fae-084be90f7e1d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.751642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.752344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.752635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.752917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.753925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:04.759785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:04.811694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2485/4961] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:04 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:04.813444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.840083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936fcc-ac15-4d25-9ba3-7318faba6509 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.851293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.852229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.853917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.854374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.856323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:04.864441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:04.903632 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2477/4962] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:04.904921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.922040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f107e-f711-4f44-840d-01d72c29e498 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.936101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88795400-cde7-4b58-ab9a-052d60ba4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.938543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88795400-cde7-4b58-ab9a-052d60ba4aff admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.938543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88795400-cde7-4b58-ab9a-052d60ba4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.938543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88795400-cde7-4b58-ab9a-052d60ba4aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:04.938543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88795400-cde7-4b58-ab9a-052d60ba4aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:04.940293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88795400-cde7-4b58-ab9a-052d60ba4aff admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:04.958299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2486/4963] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:04.962594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:04.982286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac06e5-0197-4317-9cd5-62c137742ec8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:04.989185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:04.990165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:04.990374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:04.990710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] PATH_INFO: `/v3/projects/01ef0938b5f746aa978f7b840050e37e/users/4d2cf91aa7e54eb58c7a6c51e3e12cbb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.018318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ef0938b5f746aa978f7b840050e37e, user_id=4d2cf91aa7e54eb58c7a6c51e3e12cbb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:05.021144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:05.060983 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2478/4964] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:04 2022] PUT /identity/v3/projects/01ef0938b5f746aa978f7b840050e37e/users/4d2cf91aa7e54eb58c7a6c51e3e12cbb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:05.065882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:05.066392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:05.066822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.119669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] MFA Rules not processed for user `4d2cf91aa7e54eb58c7a6c51e3e12cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:05.122488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:05.271792 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2487/4965] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:05.277090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:05.393490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9135c-9a64-48c1-aecb-d12d3850944a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:05.399733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:05.400586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:05.400872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:05.401150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.402111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:05.409146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:05.470106 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2479/4966] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:05 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:05.470252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:05.485777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4290-45cb-4600-a753-1c86735ef074 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:05.580556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:05.581601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:05.582246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:05.582785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.583709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:05.586219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:05.609619 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:05.640244 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2488/4967] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:05 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:05.643568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:05.660386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e6be3-e01d-4132-86e7-d8e5aa8494f0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:05.669887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:05.671039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:05.671615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:05.672527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.673783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:05.676760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:05.694632 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2480/4968] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:05.700567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:05.719253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1e51-af63-47f9-aeb5-b48e7c3409fe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:05.744006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:05.747161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:05.747556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:05.748006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] PATH_INFO: `/v3/projects/947bb4e1687b4b08adaf6962f6b819a6/users/e429cbb420d44dd1bc22113d916b3410/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.800115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947bb4e1687b4b08adaf6962f6b819a6, user_id=e429cbb420d44dd1bc22113d916b3410, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:05.814455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:05.850479 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2489/4969] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:05 2022] PUT /identity/v3/projects/947bb4e1687b4b08adaf6962f6b819a6/users/e429cbb420d44dd1bc22113d916b3410/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:05.854020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:05.873554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c575cf-977b-4c1b-b949-f8a99c49fb94 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:05.975074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941178b-54f7-4dc5-bb92-3fcd26bff8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:05.976251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941178b-54f7-4dc5-bb92-3fcd26bff8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:05.976510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941178b-54f7-4dc5-bb92-3fcd26bff8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:05.976792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941178b-54f7-4dc5-bb92-3fcd26bff8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:05.977847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941178b-54f7-4dc5-bb92-3fcd26bff8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:05.979475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941178b-54f7-4dc5-bb92-3fcd26bff8ae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:05.993950 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2481/4970] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:05.998416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.014019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4847bc-d238-4c9f-ad36-bcb4fe0ed5a2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.025438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:06.027718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.028184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.028571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] PATH_INFO: `/v3/projects/947bb4e1687b4b08adaf6962f6b819a6/users/e429cbb420d44dd1bc22113d916b3410/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.034950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947bb4e1687b4b08adaf6962f6b819a6, user_id=e429cbb420d44dd1bc22113d916b3410, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:06.039113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:06.079639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2490/4971] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:05 2022] PUT /identity/v3/projects/947bb4e1687b4b08adaf6962f6b819a6/users/e429cbb420d44dd1bc22113d916b3410/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:06.091689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.091689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.091900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.123571 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:06.145663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] MFA Rules not processed for user `e429cbb420d44dd1bc22113d916b3410`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:06.147237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:06.388665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2482/4972] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:06.388770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.403133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782b33-a509-4414-9080-516955be0b14 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.417843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:06.419046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.419743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.420614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.421616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:06.426089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:06.485227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.494517 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2491/4973] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:06 2022] POST /identity/v3/services => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:06.518938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0d102-9ae5-4550-8aef-455b10148ef4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.561890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:06.563111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.563585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.564235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.565707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:06.567084 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:06.567084 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:06.567084 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:06.567997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:06.629831 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1156569997. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:06.629831 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:06.629831 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:06.711200 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2483/4974] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 15:07:06 2022] POST /identity/v3/endpoints => generated 360 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:06.712938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.731417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751688ef-f447-4b18-bda8-260ef2d95a88 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.772926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:06.774531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.775046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.775612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1156569997` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.776761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1156569997)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:06.778102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:06.780804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2492/4975] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 15:07:06 2022] GET /identity/v3/regions/tempest-region-1156569997 => generated 180 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:06.785376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.801322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580fc1-39e6-4d84-a319-34da832068e4 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.810281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:06.811347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.813107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.813409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.814223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:06.815904 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:06.815904 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:06.815904 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:06.816906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:06.839159 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2484/4976] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:06 2022] POST /identity/v3/services => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:06.840376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.851757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b20b-cc44-4ed7-b7a1-f959a55381fe tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.874155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:06.875823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:06.876198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:06.876570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:06.877553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:06.879801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:06.904406 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-625331999. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:06.904406 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:06.904406 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:06.940820 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2493/4977] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 15:07:06 2022] POST /identity/v3/endpoints => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:06.945478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:06.962595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c59a0e-f9d5-47c4-aa4d-3aff7af98d38 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:06.990126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.002987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.003487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.007280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-625331999` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.008216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-625331999)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.009624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.016896 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2485/4978] 10.222.0.77 () {58 vars in 1202 bytes} [Mon Jul 11 15:07:06 2022] GET /identity/v3/regions/tempest-region-625331999 => generated 178 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:07.018108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.031147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef034-cdc6-4a57-b34d-b4df4abdcf92 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.041762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.044455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.044980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.045373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.046390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.048307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.084637 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1176442015. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:07.084637 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:07.084637 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:07.144652 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2494/4979] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 15:07:07 2022] POST /identity/v3/endpoints => generated 360 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:07.146124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.164918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364be69-18f4-4f9a-881e-0005074e22d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.221427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.222295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.222635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.223627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1176442015` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.224310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1176442015)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.225538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.240129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.240582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2486/4980] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/regions/tempest-region-1176442015 => generated 180 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:07.268951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73e58a-6fea-4964-878c-2e6676bdf9cb tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.280901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.282568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.282921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.285344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.285717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.286949 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:07.286949 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:07.286949 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:07.287864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.311037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.326999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2495/4981] 10.222.0.77 () {58 vars in 1133 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints => generated 4385 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:07.353500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70aa84-cfba-4102-b958-0ffbf5ab08e0 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.365344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.366247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.367292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.367593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/d602270574bf4681aaffbd372fb6aef3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.380187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=d602270574bf4681aaffbd372fb6aef3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.381344 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:07.381344 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:07.381344 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:07.382245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.391177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2487/4982] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints/d602270574bf4681aaffbd372fb6aef3 => generated 360 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:07.392384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.409085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865df98-5725-40f2-b803-51005eb588d8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.422984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.424149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.424593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.425036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/d602270574bf4681aaffbd372fb6aef3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.431466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d602270574bf4681aaffbd372fb6aef3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.433896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.458038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd602270574bf4681aaffbd372fb6aef3', 'request_id': 'req-537f664c-aa25-4d51-bec1-de3b2e6a67e8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:07.482683 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2496/4983] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 15:07:07 2022] DELETE /identity/v3/endpoints/d602270574bf4681aaffbd372fb6aef3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:07.490074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.520785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8aee-58dc-4edf-b7d8-75cb6d1a05c5 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.561309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.561985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.562544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.562644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.563315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.564338 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:07.564338 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:07.564338 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:07.565241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.584422 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2488/4984] 10.222.0.77 () {58 vars in 1133 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints => generated 4038 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:07.589230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.601011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f664c-aa25-4d51-bec1-de3b2e6a67e8 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.607057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.607953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.608392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.608681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/d602270574bf4681aaffbd372fb6aef3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.614861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Could not find endpoint: d602270574bf4681aaffbd372fb6aef3.: keystone.exception.EndpointNotFound: Could not find endpoint: d602270574bf4681aaffbd372fb6aef3. Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._iter().one() Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._only_one_row( Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:07.629929 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: d602270574bf4681aaffbd372fb6aef3. Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:07.631277 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:07.632557 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: d602270574bf4681aaffbd372fb6aef3. Jul 11 15:07:07.633666 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:07.635850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.637265 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2497/4985] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 15:07:07 2022] DELETE /identity/v3/endpoints/d602270574bf4681aaffbd372fb6aef3 => generated 114 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:07.650138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27aeb0-3808-4f80-92f0-169947d41a44 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.655608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.656762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.657063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.657348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1176442015` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.658023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1176442015)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.659109 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:07.659109 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:07.659109 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:07.660020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.679260 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1176442015. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:07.679260 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:07.679260 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:07.694388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2489/4986] 10.222.0.77 () {58 vars in 1208 bytes} [Mon Jul 11 15:07:07 2022] DELETE /identity/v3/regions/tempest-region-1176442015 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:07.696056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.709878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803b54e-76f3-4622-bff4-abac90e7b798 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.727608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.728294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.728579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.728912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.730166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.732669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.747921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.749164 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2498/4987] 10.222.0.77 () {58 vars in 1133 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints => generated 4038 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:07.764587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769cae-5df5-43a1-b794-2a898ec6ac15 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.793625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.794705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.795016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.795365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.796255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Adding query filter params (service_id=202e997bb3af4cf083401fc5547a1ae8) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:07.796548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.801207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.822003 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2490/4988] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints?service_id=202e997bb3af4cf083401fc5547a1ae8 => generated 502 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:07.822905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.839133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dbb30-248b-4e95-b47b-577157d58eac tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.851690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.852367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.852656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.853052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.853731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Adding query filter params (service_id=d4d8aee47cba4f0e80054a23ba0514a3) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:07.854031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.856375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.873185 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2499/4989] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints?service_id=d4d8aee47cba4f0e80054a23ba0514a3 => generated 503 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:07.877725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.889980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934398c2-c349-4070-bded-54d207faa708 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.914715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.915405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.915700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.915990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.916801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:07.917667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.919499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:07.943391 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2491/4990] 10.222.0.77 () {58 vars in 1166 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints?interface=public => generated 3395 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:07.944391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:07.953046 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:07.964735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0df5-769f-4f61-848f-bba5bd4d15a1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:07.977255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:07.978217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:07.978771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:07.979324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:07.981005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:07.981579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:07.984257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.006524 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2500/4991] 10.222.0.77 () {58 vars in 1170 bytes} [Mon Jul 11 15:07:07 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:08.011500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.016827 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:08.025852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642a89-27b0-4cd9-9bb3-427645c000f1 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.039131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76e8e5-6c14-4bc9-92ef-ad036e63c41a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.039826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76e8e5-6c14-4bc9-92ef-ad036e63c41a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.040119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76e8e5-6c14-4bc9-92ef-ad036e63c41a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.040404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76e8e5-6c14-4bc9-92ef-ad036e63c41a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.060098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76e8e5-6c14-4bc9-92ef-ad036e63c41a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.061945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76e8e5-6c14-4bc9-92ef-ad036e63c41a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.093289 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2492/4992] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:08 2022] POST /identity/v3/services => generated 289 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:08.094607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.108159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f611d-cb60-496c-b1b2-06c689f979d6 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.148840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.149995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.150435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.150890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.153150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.155053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.187509 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1798956980. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:08.187509 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:08.187509 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:08.234159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a47f7-f177-433d-a870-e858ee33f5ae None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.234463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a47f7-f177-433d-a870-e858ee33f5ae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.234777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a47f7-f177-433d-a870-e858ee33f5ae None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.237273 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2493/4993] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:07:08.243262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.243583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.243894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.247141 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2501/4994] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 11 15:07:08 2022] POST /identity/v3/endpoints => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:08.255721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.281605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:08.283750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:08.302957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71610e02-330f-46c2-a826-c76044c07860 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.314523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.315410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.315701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.315983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1798956980` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.316644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1798956980)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.317711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.327818 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2502/4995] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 15:07:08 2022] GET /identity/v3/regions/tempest-region-1798956980 => generated 180 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:08.329124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.345796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8295f8-23eb-480a-8d3d-d58cd254ef4b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.359680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.360338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.360633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.360996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/cdc2fb6be30649bb924dcbabe3054395` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.376602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=cdc2fb6be30649bb924dcbabe3054395)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.387867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.404633 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2494/4996] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:07:08 2022] POST /identity/v3/auth/tokens => generated 4061 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:08.420553 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1922466464. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:08.420553 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:08.420553 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:08.450417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.451997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:08.467922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2492-3edf-44b8-8a2d-829f87ca166d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.492574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2503/4997] 10.222.0.77 () {60 vars in 1255 bytes} [Mon Jul 11 15:07:08 2022] PATCH /identity/v3/endpoints/cdc2fb6be30649bb924dcbabe3054395 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:08.496209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.504772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.505437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.510679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.512036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.533289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.540748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.557392 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2495/4998] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:08 2022] GET /identity/v3/auth/tokens => generated 4061 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:08.559723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95d0a-e7c2-43a5-aa6c-07eafa61122d tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.569866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.570791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.571085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.571356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1922466464` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.572018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1922466464)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.573865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.587343 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2504/4999] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 15:07:08 2022] GET /identity/v3/regions/tempest-region-1922466464 => generated 180 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:08.588837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.635104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d86eb-7d3c-409f-a7be-58cd7ddf08c2 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.651043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.652523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.652879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.653228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/cdc2fb6be30649bb924dcbabe3054395` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.667388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cdc2fb6be30649bb924dcbabe3054395)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.669223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.693901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cdc2fb6be30649bb924dcbabe3054395', 'request_id': 'req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:08.712874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2496/5000] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 15:07:08 2022] DELETE /identity/v3/endpoints/cdc2fb6be30649bb924dcbabe3054395 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:08.715131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.728904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e6d7-40ce-4ae2-bd01-fb8ee69f6025 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.775362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.776286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.777012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.777235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1922466464` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.777943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1922466464)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.779658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.832519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2505/5001] 10.222.0.77 () {58 vars in 1208 bytes} [Mon Jul 11 15:07:08 2022] DELETE /identity/v3/regions/tempest-region-1922466464 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:08.834241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:08.857374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8e8cb-d1ac-4edb-9b49-5a26adc4dae2 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:08.909354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:08.911260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:08.911581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:08.912972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1798956980` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:08.913704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1798956980)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:08.922860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:08.962581 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1798956980. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:07:08.962581 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:07:08.962581 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:08.987996 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2497/5002] 10.222.0.77 () {58 vars in 1208 bytes} [Mon Jul 11 15:07:08 2022] DELETE /identity/v3/regions/tempest-region-1798956980 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:08.992313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.013249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc742-34b1-4d60-a0df-ddec2044a79c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.066692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.067690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.067992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.068291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/services/03a2aaeab0b342fa913426ec1e5a1fdf` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.069503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_service(service_id=03a2aaeab0b342fa913426ec1e5a1fdf)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.076787 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:09.076787 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:09.076787 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:09.077858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.119464 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2506/5003] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:08 2022] DELETE /identity/v3/services/03a2aaeab0b342fa913426ec1e5a1fdf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.125020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.139778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a59d6-8f14-429d-9a5a-76951217e14b tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.171198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.172095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.172393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.172677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/a3d61a887cba4441b2b9234a2e3c3ac0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.185608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a3d61a887cba4441b2b9234a2e3c3ac0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.189659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.202931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a3d61a887cba4441b2b9234a2e3c3ac0', 'request_id': 'req-84390bdc-2018-4f3f-beaf-9361518e4ef9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:09.238670 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2498/5004] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/endpoints/a3d61a887cba4441b2b9234a2e3c3ac0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.242633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.257672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38f43c-20aa-49b5-ace5-455322da186e tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.298365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.299419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.299820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.300219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-625331999` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.301080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-625331999)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.302785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.346843 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2507/5005] 10.222.0.77 () {58 vars in 1205 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/regions/tempest-region-625331999 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.350777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.369234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390bdc-2018-4f3f-beaf-9361518e4ef9 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.398536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.399803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.400177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.400562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/services/d4d8aee47cba4f0e80054a23ba0514a3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.401299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d4d8aee47cba4f0e80054a23ba0514a3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.403067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.440664 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:09.452999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2499/5006] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/services/d4d8aee47cba4f0e80054a23ba0514a3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.457400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.466520 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:09.486629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737c509-9506-47ac-b6a9-3dfd009fed5a tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.527988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.529864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.530561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.531451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/endpoints/b188e21ad3cd4ee2a9edaf5724199600` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.540371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b188e21ad3cd4ee2a9edaf5724199600)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.543576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.555064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b188e21ad3cd4ee2a9edaf5724199600', 'request_id': 'req-4d25681a-ca14-43e0-94b3-c15a7ca728aa'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:09.574665 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2508/5007] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/endpoints/b188e21ad3cd4ee2a9edaf5724199600 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.578449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.593815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280307c-7187-44be-a8f4-22b1014eafa7 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.637502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.638617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.639384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.639770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/regions/tempest-region-1156569997` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.640548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1156569997)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.642580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.697654 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2500/5008] 10.222.0.77 () {58 vars in 1208 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/regions/tempest-region-1156569997 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.701927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.723904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25681a-ca14-43e0-94b3-c15a7ca728aa tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.756034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb676-bb3d-4cbf-ace4-0d606daf3776 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e429cbb420d44dd1bc22113d916b3410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '947bb4e1687b4b08adaf6962f6b819a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.756961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb676-bb3d-4cbf-ace4-0d606daf3776 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.757308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb676-bb3d-4cbf-ace4-0d606daf3776 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.757681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb676-bb3d-4cbf-ace4-0d606daf3776 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] PATH_INFO: `/v3/services/202e997bb3af4cf083401fc5547a1ae8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.758265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb676-bb3d-4cbf-ace4-0d606daf3776 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorizing `identity:delete_service(service_id=202e997bb3af4cf083401fc5547a1ae8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.760119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb676-bb3d-4cbf-ace4-0d606daf3776 tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:09.791822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2509/5009] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/services/202e997bb3af4cf083401fc5547a1ae8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:09.793030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:09.923597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fb9f8-3750-4ec7-88bc-684a7ceb676c tempest-EndPointsTestJSON-5667767 tempest-EndPointsTestJSON-5667767-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:09.944005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:09.945710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:09.946059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:09.946349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] PATH_INFO: `/v3/users/4d2cf91aa7e54eb58c7a6c51e3e12cbb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:09.948036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2cf91aa7e54eb58c7a6c51e3e12cbb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:09.951448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:10.067773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2cf91aa7e54eb58c7a6c51e3e12cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:10.098856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2cf91aa7e54eb58c7a6c51e3e12cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:10.109826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2cf91aa7e54eb58c7a6c51e3e12cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:10.143848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2cf91aa7e54eb58c7a6c51e3e12cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:10.146948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2cf91aa7e54eb58c7a6c51e3e12cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:10.158712 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2501/5010] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:09 2022] DELETE /identity/v3/users/4d2cf91aa7e54eb58c7a6c51e3e12cbb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:10.163588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:10.164129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:10.164129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:10.187651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:10.189341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:10.272094 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2510/5011] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:10.288362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:10.290693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:10.424303 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:10.494761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5106-de49-4de1-8a67-d4c2448829a7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:10.503356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:10.504205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:10.504718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:10.504995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:10.561804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:10.564733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:10.607156 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2502/5012] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:11.169077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:11.171223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:11.193924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8eea4-ed64-4b4a-9629-82bd1e971083 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:11.201618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:11.202874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:11.203357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:11.203827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] PATH_INFO: `/v3/users/609f2117ee7e4a728779281e4912166a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:11.205667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609f2117ee7e4a728779281e4912166a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:11.207858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:11.338032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:11.341982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:11.355931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609f2117ee7e4a728779281e4912166a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.360395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609f2117ee7e4a728779281e4912166a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.391367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1ab0-cbdb-479e-aae1-291b4f34c9bc service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:11.399825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609f2117ee7e4a728779281e4912166a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.400696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609f2117ee7e4a728779281e4912166a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.407881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:11.408781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:11.409072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:11.411492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] PATH_INFO: `/v3/projects/01ef0938b5f746aa978f7b840050e37e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:11.413169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ef0938b5f746aa978f7b840050e37e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:11.419823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4418169f-8e8e-4fe6-ba99-ccc93bfcea38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609f2117ee7e4a728779281e4912166a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.420152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:11.453413 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2511/5013] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:11 2022] DELETE /identity/v3/users/609f2117ee7e4a728779281e4912166a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:11.459880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:11.460307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:11.460824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:11.482111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:11.483755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:11.491014 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:11.547963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ef0938b5f746aa978f7b840050e37e', 'request_id': 'req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.564071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ef0938b5f746aa978f7b840050e37e', 'request_id': 'req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.581090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ef0938b5f746aa978f7b840050e37e', 'request_id': 'req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.597389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] The token cache is being invalidate because project 01ef0938b5f746aa978f7b840050e37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:11.597689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.599365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.604268 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2503/5014] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:11 2022] DELETE /identity/v3/projects/01ef0938b5f746aa978f7b840050e37e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:11.608484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:11.613202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:11.648024 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2512/5015] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:11.658192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:11.664970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:11.722813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796eebf-a5c5-4d2e-929a-32d4d8409a5a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:11.727970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:11.729184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:11.729451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:11.730169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] PATH_INFO: `/v3/users/e429cbb420d44dd1bc22113d916b3410` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:11.731389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e429cbb420d44dd1bc22113d916b3410)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:11.737060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:11.823935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764aa0-4bc5-4639-9ec1-5fce6047254c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:11.830327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e429cbb420d44dd1bc22113d916b3410'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.831580 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:11.855970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e429cbb420d44dd1bc22113d916b3410'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.871409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e429cbb420d44dd1bc22113d916b3410'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.889738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e429cbb420d44dd1bc22113d916b3410'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.890376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e429cbb420d44dd1bc22113d916b3410'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:11.898999 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2504/5016] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:11 2022] DELETE /identity/v3/users/e429cbb420d44dd1bc22113d916b3410 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:11.953257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:11.955270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:11.956952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:11.957251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:11.969077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:12.028259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:12.029387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43638a-5342-4e52-9f7b-fa1435136721 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:12.057679 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2513/5017] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:13.239585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.241351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.327597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e8430-a894-4cf2-af0a-f7a473056c62 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.334671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.338570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.339362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.339952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] PATH_INFO: `/v3/projects/947bb4e1687b4b08adaf6962f6b819a6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.341717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947bb4e1687b4b08adaf6962f6b819a6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.343965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.405016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947bb4e1687b4b08adaf6962f6b819a6', 'request_id': 'req-3bd16f8b-24eb-4615-b7b3-d52993026d89'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.412288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947bb4e1687b4b08adaf6962f6b819a6', 'request_id': 'req-3bd16f8b-24eb-4615-b7b3-d52993026d89'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.422736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947bb4e1687b4b08adaf6962f6b819a6', 'request_id': 'req-3bd16f8b-24eb-4615-b7b3-d52993026d89'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.436715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] The token cache is being invalidate because project 947bb4e1687b4b08adaf6962f6b819a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:13.437290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.438260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3bd16f8b-24eb-4615-b7b3-d52993026d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.440484 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2505/5018] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:13 2022] DELETE /identity/v3/projects/947bb4e1687b4b08adaf6962f6b819a6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:13.445415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.446032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.446032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.469378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:13.470757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.550675 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2514/5019] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:13.558889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.559341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.559833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.583561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:13.585264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.585817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.587613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.597401 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2506/5020] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:13.604070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.617686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058682d-44b8-4309-a43f-5daf780a385a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.622177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b86647-e27b-4888-8534-5ddfec600598 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.626312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.627501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.627792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.628155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.629073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:13.629621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.631729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.637004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.637898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.638183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.638457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] PATH_INFO: `/v3/projects/4da11e26f0054b18a3b2fc83a26132cd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.641182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da11e26f0054b18a3b2fc83a26132cd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.646139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.655840 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:13.659965 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2507/5021] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:13.663285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.683453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c387c-41f6-45de-96b2-8eb0b294806a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.690158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.690863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.691151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.691508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.692243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.694187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.738574 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2508/5022] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:13 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:13.740296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.751361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da11e26f0054b18a3b2fc83a26132cd', 'request_id': 'req-3fd4cea5-d0a4-481e-acbe-f9734d031c54'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.759547 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:13.763815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da11e26f0054b18a3b2fc83a26132cd', 'request_id': 'req-3fd4cea5-d0a4-481e-acbe-f9734d031c54'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.784467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da11e26f0054b18a3b2fc83a26132cd', 'request_id': 'req-3fd4cea5-d0a4-481e-acbe-f9734d031c54'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.820907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] The token cache is being invalidate because project 4da11e26f0054b18a3b2fc83a26132cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:13.821220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.826290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66f6a-801a-43eb-ac76-7e0d3f4bb227 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.834246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.838368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.839510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.840000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.841090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.843755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.854666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fd4cea5-d0a4-481e-acbe-f9734d031c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:13.859961 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2515/5023] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:13 2022] DELETE /identity/v3/projects/4da11e26f0054b18a3b2fc83a26132cd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:13.861313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860c3c-a155-4628-a91d-dcf2bc6509f1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.861595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860c3c-a155-4628-a91d-dcf2bc6509f1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.861882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860c3c-a155-4628-a91d-dcf2bc6509f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.886461 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2509/5024] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:13 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:13.890638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.892621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ae860c3c-a155-4628-a91d-dcf2bc6509f1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:13.893680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.894235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae860c3c-a155-4628-a91d-dcf2bc6509f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.907986 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2516/5025] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:13.909919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f947e-54ea-434c-939a-bdd5aefbf000 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.917059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.917359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.917731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.923049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.923934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.924355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.924732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.926454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.929105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.939288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:13.940530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:13.947012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2510/5026] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:13.951253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.958549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2517/5027] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:13.963362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:13.975011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514535e-fa15-4b8d-bb20-9086e7e7b27c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.978097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e436b-3d69-45f4-a41b-313ce721a784 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:13.988342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.991475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.992068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.992546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:13.993711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:13.994163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:13.994548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:13.994889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:13.997675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:13.998354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:13.998679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.002193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.007633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.030295 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2511/5028] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:14.034200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.041651 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2518/5029] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:14.042855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.061468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edceda-034a-499d-8120-e970aeb12bc6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.070117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581df3-0e24-4800-9e80-cf9889696440 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.074227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247b6b9-f701-436f-851a-edf554fb658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.075168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b6b9-f701-436f-851a-edf554fb658a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.075453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b6b9-f701-436f-851a-edf554fb658a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.075731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b6b9-f701-436f-851a-edf554fb658a admin admin] PATH_INFO: `/v3/projects/60de39bf789b42458cb07f7bf753fd7e/users/adddc7e0689e481c80b767cd20063c31/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.076770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.077491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.077790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.078446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.079221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.081628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.115815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247b6b9-f701-436f-851a-edf554fb658a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60de39bf789b42458cb07f7bf753fd7e, user_id=adddc7e0689e481c80b767cd20063c31, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.123242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247b6b9-f701-436f-851a-edf554fb658a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.128713 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2519/5030] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:14.134582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.152498 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2512/5031] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:14 2022] PUT /identity/v3/projects/60de39bf789b42458cb07f7bf753fd7e/users/adddc7e0689e481c80b767cd20063c31/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:14.163172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.167249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.167911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.223854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] MFA Rules not processed for user `adddc7e0689e481c80b767cd20063c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:14.228084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:14.274633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02090742-6665-4039-905d-bbd11b29d580 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.392584 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2513/5032] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:14.397534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.412864 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:14.480653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.482770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.484485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.484979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.487040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.489257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.528756 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:14.545046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2520/5033] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/users => generated 293 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:14.546360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.570419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa19df-ff47-4412-a937-14381fd1353d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.576654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.577726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.578327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.578850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.579819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.581702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.588300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db00df1-8570-4238-9330-2c59a320b8a4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.599600 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2521/5034] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:14.601214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.618364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.618989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.619125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ae67e-d4af-4c88-99da-a4bb1a996202 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.619270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.619545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.620813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.627082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.627284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.627682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.628157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.628544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.629401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.638587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.657257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2522/5035] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:14.658722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.672211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a904-3ef2-43ab-af9f-9f38302edece admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.687076 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2514/5036] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:14.691713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:14.703787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7665-b475-4171-b5df-230084167fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.704813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7665-b475-4171-b5df-230084167fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.705210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7665-b475-4171-b5df-230084167fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.705598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7665-b475-4171-b5df-230084167fbf admin admin] PATH_INFO: `/v3/projects/25d47e8cb5fa4ed9b1d94b775972d054/users/98d5021920c940aa97940914dcc1d817/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.752071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7665-b475-4171-b5df-230084167fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d47e8cb5fa4ed9b1d94b775972d054, user_id=98d5021920c940aa97940914dcc1d817, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.756387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7665-b475-4171-b5df-230084167fbf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:14.783221 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2523/5037] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:14 2022] PUT /identity/v3/projects/25d47e8cb5fa4ed9b1d94b775972d054/users/98d5021920c940aa97940914dcc1d817/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:14.799041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.799366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.799646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.852069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] MFA Rules not processed for user `98d5021920c940aa97940914dcc1d817`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:14.854105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:14.860047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192742-22d0-452c-97d7-1c03260f4274 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:14.994336 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2524/5038] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:14.994610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:14.994610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:14.994610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:14.994610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:14.995038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:14.995399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.003183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.020210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680989d-8c80-4130-bc70-5e2ec4eda5bc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.028292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.030406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.030930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.031383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.032231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.034275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.048080 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2515/5039] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/users => generated 295 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:15.050570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.076447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653531-b847-420b-a875-a18c20c151bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.091238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.091691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.091882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.092305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.093011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.096066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.104131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2525/5040] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:14 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:15.107392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.129905 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2516/5041] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:15.130820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.150601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1256-3050-4fb9-b157-9c40c65b9fe0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.204377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab783d-fdff-48a1-8e6a-5665be3f250a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.221341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.222435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.223015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.223598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.224458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.230799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.234302 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:15.241186 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:15.251337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.253724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.255558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.255817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] PATH_INFO: `/v3/projects/ef50bc5c15604f499534246bc878667e/users/a57e570e0f084d9496cee79e98444975/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.261757 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2526/5042] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:15 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:15.264575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.290639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af6049-7700-4e95-b564-933233202a6c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.297436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef50bc5c15604f499534246bc878667e, user_id=a57e570e0f084d9496cee79e98444975, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.300835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.306508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.308008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.308415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.308788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.309871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.316195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.336299 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2517/5043] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:15 2022] PUT /identity/v3/projects/ef50bc5c15604f499534246bc878667e/users/a57e570e0f084d9496cee79e98444975/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:15.340608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.351896 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2527/5044] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:15.353167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.372957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c601-e316-4ae9-bf7e-98a8b29bd052 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.483038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ef54a-c0cf-4aa1-a53b-d7215be361bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.493775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.495676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.496507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.497880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.498753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.499679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.501911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.502397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.502799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.503168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.504197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.507705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.530722 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2518/5045] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:15.535009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.536498 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2528/5046] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:15.537479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.555119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953994d-cb14-40f8-b17c-64771d3501ea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.558800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbaae0-b223-45d6-a76f-50cc639d1ff3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.565701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0508e-01ab-48e0-a15d-03442c7e4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.568087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0508e-01ab-48e0-a15d-03442c7e4eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.568927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0508e-01ab-48e0-a15d-03442c7e4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.569636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0508e-01ab-48e0-a15d-03442c7e4eb8 admin admin] PATH_INFO: `/v3/projects/ef50bc5c15604f499534246bc878667e/users/a57e570e0f084d9496cee79e98444975/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.572655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615b794-af64-4863-b743-f43aef60fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.573933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0508e-01ab-48e0-a15d-03442c7e4eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef50bc5c15604f499534246bc878667e, user_id=a57e570e0f084d9496cee79e98444975, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.574985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b794-af64-4863-b743-f43aef60fcb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.575363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b794-af64-4863-b743-f43aef60fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.578124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0508e-01ab-48e0-a15d-03442c7e4eb8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.578565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b794-af64-4863-b743-f43aef60fcb5 admin admin] PATH_INFO: `/v3/projects/9f52365e09184abcb68f7280739fbd84/users/96f7fb4a58bd4d91a7bc27efabb111d4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.605485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2519/5047] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:15 2022] PUT /identity/v3/projects/ef50bc5c15604f499534246bc878667e/users/a57e570e0f084d9496cee79e98444975/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:15.614680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615b794-af64-4863-b743-f43aef60fcb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f52365e09184abcb68f7280739fbd84, user_id=96f7fb4a58bd4d91a7bc27efabb111d4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.617470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615b794-af64-4863-b743-f43aef60fcb5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.625867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.626314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.626804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.650445 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2529/5048] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:15 2022] PUT /identity/v3/projects/9f52365e09184abcb68f7280739fbd84/users/96f7fb4a58bd4d91a7bc27efabb111d4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:15.661843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.662376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.662978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.674145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] MFA Rules not processed for user `a57e570e0f084d9496cee79e98444975`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:15.675554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:15.694534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] MFA Rules not processed for user `96f7fb4a58bd4d91a7bc27efabb111d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:15.696133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:15.815511 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2530/5049] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:15.818772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.821475 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2520/5050] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:15.830259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.849616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80556a81-aa80-4fe2-ae80-9d820afaea38 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.866474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.867600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.867600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.869975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.870716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.871861 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:15.871861 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:15.871861 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:15.874648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.906394 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2521/5051] 10.222.0.77 () {60 vars in 1184 bytes} [Mon Jul 11 15:07:15 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:15.910528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.931170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd09e-a50e-4d95-8c39-d24e441dc11c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.935930 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:15.946096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.949808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:15.950262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:15.951092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e50e6a025ebb483eb2dd0c52a470bc61` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:15.952426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e50e6a025ebb483eb2dd0c52a470bc61)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:15.954531 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:15.954531 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:15.954531 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:15.957800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:15.976627 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2522/5052] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:07:15 2022] GET /identity/v3/OS-OAUTH1/consumers/e50e6a025ebb483eb2dd0c52a470bc61 => generated 221 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:15.979193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:15.987622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881719b-15dc-4224-8603-20469ea91ba9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:15.998634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:15.999477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.000855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.001352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.003909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.004999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7a8d-4eef-42fb-a9e3-b4cb38543830 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.007068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.020518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.021466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.021849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.022224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e50e6a025ebb483eb2dd0c52a470bc61` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.023040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e50e6a025ebb483eb2dd0c52a470bc61)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.024305 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:16.024305 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:16.024305 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:16.025444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.025811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invalidating token cache because consumer e50e6a025ebb483eb2dd0c52a470bc61 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:16.026868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.029954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.067925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e50e6a025ebb483eb2dd0c52a470bc61', 'request_id': 'req-17e49b89-ccc2-4f60-9b84-791fc2c405be'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.072853 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2531/5053] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:15 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:16.077548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.079430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.094820 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:16.110581 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2523/5054] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:07:15 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e50e6a025ebb483eb2dd0c52a470bc61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:16.115537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.117100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.180326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e49b89-ccc2-4f60-9b84-791fc2c405be tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.254800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9738a4-2aa5-4cd8-bba8-8eac4fd47ee2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.261288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.262199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.268581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.269026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.270210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.272659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.324318 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2532/5055] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:16 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:16.330882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.351842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceedb9-a478-4e0f-83cc-54095f37f932 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.358305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.359364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.359771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.360144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.361080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.362767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.374120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.374891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.375187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.375480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.376353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.376932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2533/5056] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:16.378533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.380967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.395452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a1898-8cff-4d11-9145-7db27632dfaa admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.401738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.402775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.403153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.403504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] PATH_INFO: `/v3/projects/e7ef9bbb98b5486d8c161c84196122e9/users/2b73c91f18d84691a590222dd1c9ea09/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.411225 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2524/5057] 10.222.0.77 () {60 vars in 1184 bytes} [Mon Jul 11 15:07:16 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:16.413139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.423804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ef9bbb98b5486d8c161c84196122e9, user_id=2b73c91f18d84691a590222dd1c9ea09, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.427585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.443594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838b7a6-1bc0-41f5-a282-6957b5a77f0d tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.451076 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2534/5058] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:16 2022] PUT /identity/v3/projects/e7ef9bbb98b5486d8c161c84196122e9/users/2b73c91f18d84691a590222dd1c9ea09/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:16.456987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.558624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.559783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.559783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.560042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.561366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=6cca0c06d76e416f9d16cfcf6c6ce4a4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.564629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.574311 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2525/5059] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:07:16 2022] GET /identity/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4 => generated 220 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:16.577054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.595183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa8f2-069d-4a7e-b94b-807865704d2c tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.601108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.602318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.602715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff270ae7-efbd-4309-8566-4851438dd25f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.603548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.603966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.605496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6cca0c06d76e416f9d16cfcf6c6ce4a4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.607246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.607681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invalidating token cache because consumer 6cca0c06d76e416f9d16cfcf6c6ce4a4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:16.608032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.608936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.610943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.612175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.612624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.613091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.613874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.618329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.632703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '6cca0c06d76e416f9d16cfcf6c6ce4a4', 'request_id': 'req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.640957 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2535/5060] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:16.646961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.652696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.653569 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2526/5061] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:07:16 2022] DELETE /identity/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:16.658080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.659883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.671951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5748fb-1755-45ab-8ed5-13c0b394ea4c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.675019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f00bd-aa98-4ee3-906f-f30e8e6a5f1b tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.677515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657f57-d5a5-482c-baa6-a207a830a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.678926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657f57-d5a5-482c-baa6-a207a830a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.679402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657f57-d5a5-482c-baa6-a207a830a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.679758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657f57-d5a5-482c-baa6-a207a830a081 admin admin] PATH_INFO: `/v3/projects/e7ef9bbb98b5486d8c161c84196122e9/users/2b73c91f18d84691a590222dd1c9ea09/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.680462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.681579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.681868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.681981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657f57-d5a5-482c-baa6-a207a830a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ef9bbb98b5486d8c161c84196122e9, user_id=2b73c91f18d84691a590222dd1c9ea09, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.682147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.683423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=6cca0c06d76e416f9d16cfcf6c6ce4a4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.685123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.686276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657f57-d5a5-482c-baa6-a207a830a081 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.706972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2536/5062] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:16 2022] PUT /identity/v3/projects/e7ef9bbb98b5486d8c161c84196122e9/users/2b73c91f18d84691a590222dd1c9ea09/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:16.715763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.716051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.716373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 11 15:07:16.726180 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 11 15:07:16.727190 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:16.730406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2527/5063] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:07:16 2022] GET /identity/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4 => generated 74 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:07:16.735094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.754474 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:16.763090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4e35f-0720-4845-ad89-87b81de2d997 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.795314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] MFA Rules not processed for user `2b73c91f18d84691a590222dd1c9ea09`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:16.799037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.861055 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:16.870579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.871846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.872665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.873064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.874664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6cca0c06d76e416f9d16cfcf6c6ce4a4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.877073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.878140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invalidating token cache because consumer 6cca0c06d76e416f9d16cfcf6c6ce4a4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:16.878839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.880537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:16.903680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2537/5064] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:16.912041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 11 15:07:16.912489 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 11 15:07:16.913482 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:16.915142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2528/5065] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:07:16 2022] DELETE /identity/v3/OS-OAUTH1/consumers/6cca0c06d76e416f9d16cfcf6c6ce4a4 => generated 74 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:07:16.916378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.919896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.921775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:16.943810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820b92-9b40-4d14-ab53-e7f9995ecece tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:16.950289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:16.950979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:16.951715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:16.952013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:16.952738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:16.955316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:16.981089 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2529/5066] 10.222.0.77 () {60 vars in 1184 bytes} [Mon Jul 11 15:07:16 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:16.982563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:16.997902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb35d-e3a7-4586-8979-ddcacf3081fb tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.003416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.004173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.004780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.004899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.005937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.007888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.015304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea654f0-6526-4102-930f-4c32e5db6b2c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.021191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.021944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.022244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.022547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.024512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:17.032760 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2530/5067] 10.222.0.77 () {60 vars in 1184 bytes} [Mon Jul 11 15:07:16 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:17.036231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.054444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31952d-27d9-4c9d-9395-5fd45d8456bf tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.062154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.063033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.063439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.063788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.064515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.065683 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:17.065683 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:17.065683 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:17.067798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.078669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2531/5068] 10.222.0.77 () {58 vars in 1163 bytes} [Mon Jul 11 15:07:17 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:17.083527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.096466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600098-a3bb-41a6-b3e5-9ec811605f20 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.102070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.103022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.103385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.103737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/809f6fe32d384f2c90e63ea13e2e8d35` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.104510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=809f6fe32d384f2c90e63ea13e2e8d35)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.106208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.106660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invalidating token cache because consumer 809f6fe32d384f2c90e63ea13e2e8d35 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:17.107048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.107888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.125043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '809f6fe32d384f2c90e63ea13e2e8d35', 'request_id': 'req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.157711 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2532/5069] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:07:17 2022] DELETE /identity/v3/OS-OAUTH1/consumers/809f6fe32d384f2c90e63ea13e2e8d35 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:17.159066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.161487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:17.170324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.173118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.177834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37ca3-63a2-4f5a-a19c-73a8bfcfa6db tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.184521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.185546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.185935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.186596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e47f0e40fd7541228bdbb8be03cb9f58` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.187396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e47f0e40fd7541228bdbb8be03cb9f58)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.189344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.189719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invalidating token cache because consumer e47f0e40fd7541228bdbb8be03cb9f58 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:17.190121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.191054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.199530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2538/5070] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:07:17.221722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e47f0e40fd7541228bdbb8be03cb9f58', 'request_id': 'req-33def524-1b96-4813-aff7-dfa3cda8da56'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.245713 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2533/5071] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:07:17 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e47f0e40fd7541228bdbb8be03cb9f58 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:17.254090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.277924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92990e-a143-4256-980f-b3f9de75b083 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.291258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.293865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.294996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.295674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.296910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.298185 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:17.298185 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:17.298185 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:17.299468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.334130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.335756 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2539/5072] 10.222.0.77 () {60 vars in 1184 bytes} [Mon Jul 11 15:07:17 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:17.336719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:17.360911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33def524-1b96-4813-aff7-dfa3cda8da56 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.384794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.390634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.391048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.391402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a42314f7fab45f3875536d9fe09e2f3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.393627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=9a42314f7fab45f3875536d9fe09e2f3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.402240 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:17.402240 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:17.402240 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:17.405010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.442551 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2534/5073] 10.222.0.77 () {60 vars in 1284 bytes} [Mon Jul 11 15:07:17 2022] PATCH /identity/v3/OS-OAUTH1/consumers/9a42314f7fab45f3875536d9fe09e2f3 => generated 221 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:17.444270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.461232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d364f-5b04-451e-98c2-5afb0635aca2 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.466682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.467644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.468010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.468421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a42314f7fab45f3875536d9fe09e2f3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.469166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=9a42314f7fab45f3875536d9fe09e2f3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.470424 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:17.470424 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:17.470424 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:17.471499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.483502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.489694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2540/5074] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:07:17 2022] GET /identity/v3/OS-OAUTH1/consumers/9a42314f7fab45f3875536d9fe09e2f3 => generated 221 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:17.497336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c0879-b92f-4060-86e8-7ee91f654b37 tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.512568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e570e0f084d9496cee79e98444975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef50bc5c15604f499534246bc878667e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.513446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.513741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.514026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a42314f7fab45f3875536d9fe09e2f3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.514724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9a42314f7fab45f3875536d9fe09e2f3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.517131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.517410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invalidating token cache because consumer 9a42314f7fab45f3875536d9fe09e2f3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:17.517960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.518714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.543868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef18496f-6673-403c-b0d3-7f378f2e993f tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9a42314f7fab45f3875536d9fe09e2f3', 'request_id': 'req-ef18496f-6673-403c-b0d3-7f378f2e993f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.585544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2535/5075] 10.222.0.77 () {58 vars in 1265 bytes} [Mon Jul 11 15:07:17 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9a42314f7fab45f3875536d9fe09e2f3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:17.591308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:17.596903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:17.641633 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:17.735620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6dd15-43d0-4cc4-96e9-2ed87932236a tempest-OAUTHConsumersV3Test-1806140622 tempest-OAUTHConsumersV3Test-1806140622-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:17.752309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:17.753330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.756813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.757230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] PATH_INFO: `/v3/users/adddc7e0689e481c80b767cd20063c31` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.759833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adddc7e0689e481c80b767cd20063c31)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:17.761939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:17.819856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adddc7e0689e481c80b767cd20063c31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.821279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adddc7e0689e481c80b767cd20063c31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.841004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adddc7e0689e481c80b767cd20063c31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.841940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adddc7e0689e481c80b767cd20063c31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.851377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adddc7e0689e481c80b767cd20063c31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:17.875075 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2541/5076] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:17 2022] DELETE /identity/v3/users/adddc7e0689e481c80b767cd20063c31 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:17.876147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:17.876681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:17.877220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:17.922947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:17.929411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:18.123874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2536/5077] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:18.144496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:18.146308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:18.225734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60cee2-3ae7-4d1f-bba0-7bc387f706a2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:18.239193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:18.240592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:18.244063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:18.244391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:18.257787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:18.259706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:18.277601 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2542/5078] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:19.656987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:19.658844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:19.682028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd72a4-de66-49d9-a4b1-ad89089a4333 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:19.687889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:19.688915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:19.689309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:19.689743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] PATH_INFO: `/v3/projects/60de39bf789b42458cb07f7bf753fd7e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:19.691176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60de39bf789b42458cb07f7bf753fd7e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:19.693527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:19.720259 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:19.773642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60de39bf789b42458cb07f7bf753fd7e', 'request_id': 'req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:19.781712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60de39bf789b42458cb07f7bf753fd7e', 'request_id': 'req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:19.798717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60de39bf789b42458cb07f7bf753fd7e', 'request_id': 'req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:19.814450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] The token cache is being invalidate because project 60de39bf789b42458cb07f7bf753fd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:19.815027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:19.815910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:19.817776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2537/5079] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:19 2022] DELETE /identity/v3/projects/60de39bf789b42458cb07f7bf753fd7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:19.822166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:19.835363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234b734-eb3a-4f8b-836a-0ec225485bf2 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:19.890314 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:19.924849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:19.926087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:19.926758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:19.927331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] PATH_INFO: `/v3/users/a57e570e0f084d9496cee79e98444975` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:19.928788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57e570e0f084d9496cee79e98444975)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:19.931202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:20.000759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57e570e0f084d9496cee79e98444975'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:20.001683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57e570e0f084d9496cee79e98444975'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:20.016970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57e570e0f084d9496cee79e98444975'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:20.018357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57e570e0f084d9496cee79e98444975'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:20.028939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57e570e0f084d9496cee79e98444975'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:20.055951 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2543/5080] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:19 2022] DELETE /identity/v3/users/a57e570e0f084d9496cee79e98444975 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:20.645602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:20.654185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:20.842628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdf2a-7e88-48cc-9fcf-12e5d39b5738 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:20.902779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:20.903676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:20.904075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:20.904449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:20.907129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:20.988537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:20.990118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:21.003799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2538/5081] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:21.218714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:21.220813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:21.363782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19e1c-c5cc-4a10-a065-ad3403db55c5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:21.379268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:21.380444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:21.380959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:21.381442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] PATH_INFO: `/v3/projects/ef50bc5c15604f499534246bc878667e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:21.384017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef50bc5c15604f499534246bc878667e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:21.391769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:21.433964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:21.435593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:21.467719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0e54-dee7-4b78-8bca-4b06f7de0d50 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:21.494514 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:21.495438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef50bc5c15604f499534246bc878667e', 'request_id': 'req-ed455edf-1ac0-41e4-b115-3645e2ff2477'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.513504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef50bc5c15604f499534246bc878667e', 'request_id': 'req-ed455edf-1ac0-41e4-b115-3645e2ff2477'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.517629 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:21.525311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef50bc5c15604f499534246bc878667e', 'request_id': 'req-ed455edf-1ac0-41e4-b115-3645e2ff2477'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.556690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] The token cache is being invalidate because project ef50bc5c15604f499534246bc878667e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:21.556977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.560584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed455edf-1ac0-41e4-b115-3645e2ff2477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.565966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2544/5082] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:21 2022] DELETE /identity/v3/projects/ef50bc5c15604f499534246bc878667e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:21.573610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7204-ef33-4b03-b3df-2c0ece8124ec None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:21.574043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7204-ef33-4b03-b3df-2c0ece8124ec None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:21.574331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7204-ef33-4b03-b3df-2c0ece8124ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:21.603975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e8bd7204-ef33-4b03-b3df-2c0ece8124ec None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:21.604676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:21.605390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e8bd7204-ef33-4b03-b3df-2c0ece8124ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:21.605574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:21.609615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:21.609936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] PATH_INFO: `/v3/users/ef0d4295dbbd42d2b82e1f5cafe79ad9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:21.611370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0d4295dbbd42d2b82e1f5cafe79ad9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:21.616697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:21.620951 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2545/5083] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:21.650180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:21.651057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:21.654245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:21.721629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:21.722358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0d4295dbbd42d2b82e1f5cafe79ad9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.725812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:21.754341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0d4295dbbd42d2b82e1f5cafe79ad9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.755465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2546/5084] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:21.763015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0d4295dbbd42d2b82e1f5cafe79ad9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.763509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:21.773408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0d4295dbbd42d2b82e1f5cafe79ad9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.774205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-978e4df9-ba16-4370-ab9e-e394619debcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0d4295dbbd42d2b82e1f5cafe79ad9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:21.793426 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2539/5085] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:21 2022] DELETE /identity/v3/users/ef0d4295dbbd42d2b82e1f5cafe79ad9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:21.795806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:21.796112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:21.796398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:21.797560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c387c85-4de6-42bb-98ff-f7307857dc3d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:21.867134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:21.871657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:21.949121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:21.949825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:21.950104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:21.950382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:21.951154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:21.951464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:21.953074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:21.993503 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2547/5086] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:21.994273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:21.998880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.023088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c609-bb8e-41ff-a35e-77875b39c4f7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.034382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.035088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.035378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.035666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.036370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.038280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.044142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2540/5087] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:22.054566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.056045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.118342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2548/5088] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:21 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:22.120626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.150439 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:22.192512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8d6c6-b92d-4d19-b8f6-6e098ae63021 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.238162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c03-fd53-4b47-8c43-40380aee5f1f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.246339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.248050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.248343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.248629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.249511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.251513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.274465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.275664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.276533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.276820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.288500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.290303 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2549/5089] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:22 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:22.292097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.295221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.298988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.311398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2541/5090] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:22.312341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.326799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c90c0d-286d-424a-a325-bb68df95f7c4 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.337830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.340028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.340261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.340551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.341358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.343873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.364853 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2542/5091] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:22.368824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.385068 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:22.387307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330f37-c815-4c40-b357-37afd220fb0d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.393216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.393901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.394598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.394893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.395632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.410554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.424216 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2543/5092] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:22.428560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.441719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4bfd9-e8ca-420b-86ea-b59ea78523bb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.447711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ce16-ff28-470a-bf7b-2a2799d6bd2b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.447953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3137aa6-6bd2-40ad-9d28-9eca2388ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.449781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3137aa6-6bd2-40ad-9d28-9eca2388ff0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.450217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3137aa6-6bd2-40ad-9d28-9eca2388ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.450663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3137aa6-6bd2-40ad-9d28-9eca2388ff0d admin admin] PATH_INFO: `/v3/projects/204787d6227541baa38e5eaa57933c9e/users/f240f141262543e2b14d065ee9f4a1e0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.458443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.459518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.460279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.460279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.462058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.491754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3137aa6-6bd2-40ad-9d28-9eca2388ff0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=204787d6227541baa38e5eaa57933c9e, user_id=f240f141262543e2b14d065ee9f4a1e0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.495181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3137aa6-6bd2-40ad-9d28-9eca2388ff0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.526381 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2544/5093] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:22 2022] PUT /identity/v3/projects/204787d6227541baa38e5eaa57933c9e/users/f240f141262543e2b14d065ee9f4a1e0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:22.528552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.528870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.529157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.567495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] MFA Rules not processed for user `f240f141262543e2b14d065ee9f4a1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:22.568936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.615231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.617312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.640583 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2550/5094] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:22.641472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.645227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.673036 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2545/5095] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:22.677671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38fed3-a4f2-45d9-8543-60da42eaceb7 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.679245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.778132 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:22.815010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.816198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.816485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.816919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] PATH_INFO: `/v3/projects/9cbbc33fbb5f498d807aa32c89248de6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.818168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbbc33fbb5f498d807aa32c89248de6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.820218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.820988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b153c5-821b-490d-8f87-cc4ea57eb0b0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.827443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:22.829341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.829737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.830546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.831377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:22.833424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:22.866732 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2546/5096] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:22 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:22.867943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:22.883371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbbc33fbb5f498d807aa32c89248de6', 'request_id': 'req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:22.893976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbbc33fbb5f498d807aa32c89248de6', 'request_id': 'req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:22.902809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbbc33fbb5f498d807aa32c89248de6', 'request_id': 'req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:22.917297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] The token cache is being invalidate because project 9cbbc33fbb5f498d807aa32c89248de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:22.917714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:22.918642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0bba8f87-b9b3-48ac-9f09-18a7caa3ae4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:22.924001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2551/5097] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:22 2022] DELETE /identity/v3/projects/9cbbc33fbb5f498d807aa32c89248de6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:22.927825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacf33c-a3b2-4c63-9b43-a550b71f9d02 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:22.928117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacf33c-a3b2-4c63-9b43-a550b71f9d02 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:22.928435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacf33c-a3b2-4c63-9b43-a550b71f9d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:22.936541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f16d9a-c1d9-4f15-97da-1f3390870207 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:22.962099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ffacf33c-a3b2-4c63-9b43-a550b71f9d02 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:22.963815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ffacf33c-a3b2-4c63-9b43-a550b71f9d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:22.980561 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:23.049244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.050257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.050959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.051769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.052688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.055078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.081025 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2547/5098] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:22 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:23.084710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.099331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:23.112309 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2552/5099] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:23.113779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.114071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.114357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.139946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ac8ff-f119-4f70-9cf5-1ede8885c704 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.146955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.147983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.148634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.150374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:23.151756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:23.153484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.158542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.160760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.165061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2553/5100] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:23.166719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.176330 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2548/5101] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:23.180124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.182706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8b48b-a468-42f9-8265-a106349ee25d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.188479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.190175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.190680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.191269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.192273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:23.192805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.194587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.194834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cd69-e789-4060-adc2-0cc5e842b149 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.201902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.202960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.203255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.203536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] PATH_INFO: `/v3/projects/c65ba6320955461fbfc633cf32eccb57/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.214063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2554/5102] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:23.219643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.232676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65ba6320955461fbfc633cf32eccb57, user_id=8762e11822314fe39feeae1408b27e2d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.238888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.241658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9364-58bc-47a4-84bb-75fcd20059da admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.253100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.254165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.254614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.255231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.256213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.267315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.268493 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2549/5103] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:23 2022] PUT /identity/v3/projects/c65ba6320955461fbfc633cf32eccb57/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:23.272117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.327463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2555/5104] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:23.331770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.336513 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:23.407713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f77d2-fed5-4048-a46b-dfca3f418512 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.413429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.414391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.415548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.415996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.417731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.419740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.420741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1603-8d1d-449a-8571-87b24f1df4a0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.431598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.434632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.434927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.435204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.436228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.450856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.451046 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2550/5105] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:23.451507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.463856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156ab16-58c0-40f9-8294-0d5c762102ed admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.469545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538130ef-2070-4d81-9b6f-0639e983b072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.470836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538130ef-2070-4d81-9b6f-0639e983b072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.471183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538130ef-2070-4d81-9b6f-0639e983b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.471464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538130ef-2070-4d81-9b6f-0639e983b072 admin admin] PATH_INFO: `/v3/projects/c65ba6320955461fbfc633cf32eccb57/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.474160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538130ef-2070-4d81-9b6f-0639e983b072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65ba6320955461fbfc633cf32eccb57, user_id=8762e11822314fe39feeae1408b27e2d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.475558 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2556/5106] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:23.480018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.482720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538130ef-2070-4d81-9b6f-0639e983b072 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.493349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8623ce-92ee-4704-900b-83c4acfeb215 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.501232 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2551/5107] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:23 2022] PUT /identity/v3/projects/c65ba6320955461fbfc633cf32eccb57/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:23.512745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.513471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.513819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.544529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] MFA Rules not processed for user `8762e11822314fe39feeae1408b27e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:23.546133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:23.577055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.577850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.578211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.578530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.579390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.581079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.586347 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:23.594999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2557/5108] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:23.596843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.610013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3ae5-6951-4bf2-bc08-ed9a9fd5e46a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.615985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.616786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.617171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.617525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.618335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.620957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.627301 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2552/5109] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:23.631756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.636154 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2558/5110] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:23.637177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.646960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dda14-8194-4c9a-aa72-ac764e455d1d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.648605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69afff0-29c9-4be1-9105-a3afd526c769 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.652566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.653350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.653743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499c06e-0b02-4ea8-b08a-ac44d27b9ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.653865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.654182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.654841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499c06e-0b02-4ea8-b08a-ac44d27b9ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.654974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.655132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499c06e-0b02-4ea8-b08a-ac44d27b9ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.655541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499c06e-0b02-4ea8-b08a-ac44d27b9ae7 admin admin] PATH_INFO: `/v3/projects/1f0334bd9a524ff2921646e3ddcda9cd/users/156329325d1446c4bf87a40690beaa82/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.657535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.673894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499c06e-0b02-4ea8-b08a-ac44d27b9ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0334bd9a524ff2921646e3ddcda9cd, user_id=156329325d1446c4bf87a40690beaa82, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.677268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499c06e-0b02-4ea8-b08a-ac44d27b9ae7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.698260 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2553/5112] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:23.699284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.702962 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2559/5112] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:23 2022] PUT /identity/v3/projects/1f0334bd9a524ff2921646e3ddcda9cd/users/156329325d1446c4bf87a40690beaa82/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:23.704522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.704877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.705277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.737032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] MFA Rules not processed for user `156329325d1446c4bf87a40690beaa82`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:23.738354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:23.775681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6453-0433-4773-aa52-8cb7b6754db7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.782079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.782897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.783188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.783464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.784157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.786281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.808520 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:23.815498 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2560/5113] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:23.822151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.828715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2554/5114] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:23 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:23.829855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.832055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:23.835218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19347781-a052-4e0c-87d2-50d6a4aeb3d8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.841235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.842060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.842371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.842684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.843430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.845838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.858289 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2561/5115] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:23.863792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.876979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759fdb-ab60-42f6-815f-c4d636d1959d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.896745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.897436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.897736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.898010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.898769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.900531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.915692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2562/5116] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:23.917790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:23.933557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2527f-a51f-42c0-a068-dd0b4c1c98a1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.941052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.941197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2c285-f844-4150-9f36-f1694b1bc2ea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:23.943234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.943865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.944327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] PATH_INFO: `/v3/projects/79a60fe6445847c4b426e3360eb972ff/users/f8070282196740f2b989b2432814ea23/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.945223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a74aa7-e9ef-4bf0-9df2-c4ad0da20756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:23.945971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74aa7-e9ef-4bf0-9df2-c4ad0da20756 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:23.946328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74aa7-e9ef-4bf0-9df2-c4ad0da20756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:23.946947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74aa7-e9ef-4bf0-9df2-c4ad0da20756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:23.958520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a74aa7-e9ef-4bf0-9df2-c4ad0da20756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.960400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a74aa7-e9ef-4bf0-9df2-c4ad0da20756 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.965565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a60fe6445847c4b426e3360eb972ff, user_id=f8070282196740f2b989b2432814ea23, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:23.970351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:23.978789 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2555/5117] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:24.001062 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2563/5118] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:23 2022] PUT /identity/v3/projects/79a60fe6445847c4b426e3360eb972ff/users/f8070282196740f2b989b2432814ea23/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:24.002090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.002586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.003046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.034700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] MFA Rules not processed for user `f8070282196740f2b989b2432814ea23`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:24.035978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:24.120058 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2556/5119] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:24.125251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.208055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4c67-02b1-41d1-80e0-fe4f51ef95d1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.215559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.216693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.217032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.217454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.218245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.221014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.251413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.258252 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2564/5120] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:24 2022] POST /identity/v3/domains => generated 276 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:24.267311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f5006-4f97-4351-9b08-b902e80046d6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.342683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.343491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.344075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.344413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.345284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.347390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.384223 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2557/5121] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:07:24 2022] POST /identity/v3/roles => generated 240 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:24.389030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.395325 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:24.402906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e32f2-9851-40e1-8489-fab190b0f57d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.409987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.411058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.411405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.411803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/ae77e2856ff94ee79ed55e31de73e766/users/f8070282196740f2b989b2432814ea23/roles/785dfdc1509547b5a4ceb2b71984382f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.426057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ae77e2856ff94ee79ed55e31de73e766, user_id=f8070282196740f2b989b2432814ea23, role_id=785dfdc1509547b5a4ceb2b71984382f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.429116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.455985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2565/5122] 10.222.0.77 () {60 vars in 1479 bytes} [Mon Jul 11 15:07:24 2022] PUT /identity/v3/domains/ae77e2856ff94ee79ed55e31de73e766/users/f8070282196740f2b989b2432814ea23/roles/785dfdc1509547b5a4ceb2b71984382f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:24.457081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.468219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c802c4c-d02f-424d-a22e-e2c562077c78 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.501399 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:24.568489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.569219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.569609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.569780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.570580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.574892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.606336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2558/5123] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:24 2022] POST /identity/v3/domains => generated 276 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:24.607380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.621681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f531ba-089e-4a35-b467-00e16f5b1632 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.739566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.740263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.740556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.740843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.742204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.743996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.768888 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2566/5124] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:07:24 2022] POST /identity/v3/roles => generated 239 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:24.771146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.783782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182e87-3ccc-4fa0-9643-1887e979e062 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.789806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.790864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.792110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.792623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.793522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.795816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.832424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.833527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2559/5125] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 15:07:24 2022] POST /identity/v3/groups => generated 326 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:24.846656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828426f-77fd-45f5-9437-e12e39200722 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:24.874346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:24.875198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:24.875491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:24.875780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups/30cf70ebca1a4013ab053dfe1dfd8afa/users/f8070282196740f2b989b2432814ea23` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:24.882173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=30cf70ebca1a4013ab053dfe1dfd8afa, user_id=f8070282196740f2b989b2432814ea23)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:24.883245 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:24.883245 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:24.883245 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:24.884624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:24.928380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:24.937662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2567/5126] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 15:07:24 2022] PUT /identity/v3/groups/30cf70ebca1a4013ab053dfe1dfd8afa/users/f8070282196740f2b989b2432814ea23 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:24.940599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338255-cae0-47c2-974d-093b92374980 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.076578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.077949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.077949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.078163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/e99ad1f0237642cf989a9c855d30ba51/groups/30cf70ebca1a4013ab053dfe1dfd8afa/roles/b1177a8dbb054f2090e7c714498c6ef8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.080442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e99ad1f0237642cf989a9c855d30ba51, group_id=30cf70ebca1a4013ab053dfe1dfd8afa, role_id=b1177a8dbb054f2090e7c714498c6ef8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.083208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.100979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2560/5127] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:24 2022] PUT /identity/v3/domains/e99ad1f0237642cf989a9c855d30ba51/groups/30cf70ebca1a4013ab053dfe1dfd8afa/roles/b1177a8dbb054f2090e7c714498c6ef8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:25.105188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.120470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b336-b7f2-40f2-afe6-380f21d721fa tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.202938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.203882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.204267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.204721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.205960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.207731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.227193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2568/5128] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:25 2022] POST /identity/v3/domains => generated 277 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:25.231997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.245469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a37b4b-80dd-4ea4-b3ed-1a3b87e9f1d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.334329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.335070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.335436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.335722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.336623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.339287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.381234 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2561/5129] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:07:25 2022] POST /identity/v3/roles => generated 240 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:25.385539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.399714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ead76-0fd8-487c-be5e-ed4fb29612c8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.407049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.408041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.408455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.408873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2/users/f8070282196740f2b989b2432814ea23/roles/6077448fde0240f8a44c64ff194c78ab` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.432366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3e36cd6a37ae406fb2216c3b812bf0c2, user_id=f8070282196740f2b989b2432814ea23, role_id=6077448fde0240f8a44c64ff194c78ab)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.436333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.461522 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2569/5130] 10.222.0.77 () {60 vars in 1479 bytes} [Mon Jul 11 15:07:25 2022] PUT /identity/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2/users/f8070282196740f2b989b2432814ea23/roles/6077448fde0240f8a44c64ff194c78ab => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:25.464816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.493170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6153cd-49e4-4bdd-96f1-21d8379cf2d1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.539843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.540875 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:25.583232 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:25.606310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.607352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.607708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.608355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.609093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.611805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.636472 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2562/5131] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:25 2022] POST /identity/v3/domains => generated 276 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:25.637550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.671007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d28861-724d-4799-9599-44fad34a984d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.725687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721242-7dcc-4f3a-b4a6-3fd8d4299b0e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.727991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.729434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.729954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.730465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.731885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.732929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:25.733187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.733543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.734820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.735782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.738001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.760636 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2563/5132] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:07:25 2022] POST /identity/v3/roles => generated 240 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:25.761534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.775445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e9039-897d-4061-aa11-d858def95442 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.782367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.783196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.783497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.784171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.785183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.787612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.807650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.820036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.822243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2564/5133] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 15:07:25 2022] POST /identity/v3/groups => generated 324 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:25.827234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.845861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e82f-adb9-4c70-8bff-32aef62a623e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:25.857551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:25.858870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:25.859951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:25.860459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups/144d9b4eaad3402488b28d56cd90f12c/users/f8070282196740f2b989b2432814ea23` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:25.866545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2570/5134] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:25.871319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=144d9b4eaad3402488b28d56cd90f12c, user_id=f8070282196740f2b989b2432814ea23)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:25.874929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:25.917793 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2565/5135] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 15:07:25 2022] PUT /identity/v3/groups/144d9b4eaad3402488b28d56cd90f12c/users/f8070282196740f2b989b2432814ea23 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:25.919054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:25.953259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc89e4-aa5c-4a2b-950b-b5a7f9639414 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:26.078121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:26.079207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:26.079561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:26.080369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/b764f484aa69401a8d11725cd0b1550c/groups/144d9b4eaad3402488b28d56cd90f12c/roles/928cffc83f7047888d0d26dc49115567` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:26.082901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b764f484aa69401a8d11725cd0b1550c, group_id=144d9b4eaad3402488b28d56cd90f12c, role_id=928cffc83f7047888d0d26dc49115567)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:26.086141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:26.117066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2571/5136] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:25 2022] PUT /identity/v3/domains/b764f484aa69401a8d11725cd0b1550c/groups/144d9b4eaad3402488b28d56cd90f12c/roles/928cffc83f7047888d0d26dc49115567 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:26.121036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:26.229438 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:26.252029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c9d22-3532-49b9-b6dc-a76feb439da1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:26.360861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070282196740f2b989b2432814ea23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79a60fe6445847c4b426e3360eb972ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:26.361775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:26.362301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:26.362836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] PATH_INFO: `/v3/auth/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:26.363695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:26.365822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:26.494608 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2566/5137] 10.222.0.77 () {58 vars in 1142 bytes} [Mon Jul 11 15:07:26 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:26.499244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:26.538574 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:26.647389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba3762-0cc6-4477-ac46-6eb438cc2707 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:26.653229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:26.654155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:26.654444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:26.656592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/b764f484aa69401a8d11725cd0b1550c/groups/144d9b4eaad3402488b28d56cd90f12c/roles/928cffc83f7047888d0d26dc49115567` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:26.662313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b764f484aa69401a8d11725cd0b1550c, group_id=144d9b4eaad3402488b28d56cd90f12c, role_id=928cffc83f7047888d0d26dc49115567)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:26.663361 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:26.663361 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:26.663361 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:26.673526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:26.685276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 928cffc83f7047888d0d26dc49115567 was removed from group 144d9b4eaad3402488b28d56cd90f12c on domain b764f484aa69401a8d11725cd0b1550c. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:26.685707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:26.686976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:26.729174 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2572/5138] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:07:26 2022] DELETE /identity/v3/domains/b764f484aa69401a8d11725cd0b1550c/groups/144d9b4eaad3402488b28d56cd90f12c/roles/928cffc83f7047888d0d26dc49115567 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:26.733405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:26.735754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:26.761444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d9645-7fbf-4785-8508-ee93f3a500df tempest-TokensV3TestJSON-812157240 tempest-TokensV3TestJSON-812157240-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:26.892028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:26.893045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:26.893347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:26.893631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups/144d9b4eaad3402488b28d56cd90f12c/users/f8070282196740f2b989b2432814ea23` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:26.900899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=144d9b4eaad3402488b28d56cd90f12c, user_id=f8070282196740f2b989b2432814ea23)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:26.903075 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:26.903075 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:26.903075 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:26.906700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:26.916201 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:26.927973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:26.950990 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2567/5139] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 15:07:26 2022] DELETE /identity/v3/groups/144d9b4eaad3402488b28d56cd90f12c/users/f8070282196740f2b989b2432814ea23 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:26.955188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:26.970131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed163b-2b79-4e43-ae4d-521120e05a70 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:27.141230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:27.142155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:27.142445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:27.143853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups/144d9b4eaad3402488b28d56cd90f12c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:27.149525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_group(group_id=144d9b4eaad3402488b28d56cd90f12c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:27.151754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:27.287341 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2573/5140] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:07:26 2022] DELETE /identity/v3/groups/144d9b4eaad3402488b28d56cd90f12c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:27.293697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:27.313154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b92e6-78eb-4658-ace1-8161045c8868 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:27.394296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:27.395585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:27.395891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:27.396179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles/928cffc83f7047888d0d26dc49115567` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:27.397947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_role(role_id=928cffc83f7047888d0d26dc49115567)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:27.399027 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:27.399027 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:07:27.399027 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:07:27.399991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:27.447500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 928cffc83f7047888d0d26dc49115567 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:27.448323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.449248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.455143 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2568/5141] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:27 2022] DELETE /identity/v3/roles/928cffc83f7047888d0d26dc49115567 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:27.456172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:27.457984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:27.472047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9860f85-d813-43f4-ba68-bd8f93be503c tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:27.575400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:27.577818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:27.577818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:27.577818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/b764f484aa69401a8d11725cd0b1550c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:27.578473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b764f484aa69401a8d11725cd0b1550c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:27.580719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:27.607956 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:27.621619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.622172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.651882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.652599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.655708 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2574/5142] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:27 2022] PATCH /identity/v3/domains/b764f484aa69401a8d11725cd0b1550c => generated 277 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:27.659482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:27.670555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67afed-4059-4811-ba7e-a4aa9422a6d5 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:27.767781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:27.768646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:27.768940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:27.769221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/b764f484aa69401a8d11725cd0b1550c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:27.806413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b764f484aa69401a8d11725cd0b1550c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:27.807756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:27.844754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.850800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.890572 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:27.919159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c', 'request_id': 'req-540e6408-1d84-49a5-8001-ab51ef59591e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.925114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c', 'request_id': 'req-540e6408-1d84-49a5-8001-ab51ef59591e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.936217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c', 'request_id': 'req-540e6408-1d84-49a5-8001-ab51ef59591e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.955090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] The token cache is being invalidate because project b764f484aa69401a8d11725cd0b1550c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:27.955510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.956606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.968111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c', 'request_id': 'req-540e6408-1d84-49a5-8001-ab51ef59591e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.975167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c', 'request_id': 'req-540e6408-1d84-49a5-8001-ab51ef59591e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:27.976018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b764f484aa69401a8d11725cd0b1550c', 'request_id': 'req-540e6408-1d84-49a5-8001-ab51ef59591e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.000607 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2569/5143] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:27 2022] DELETE /identity/v3/domains/b764f484aa69401a8d11725cd0b1550c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:28.002238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:28.003711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:28.017885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f2d3-c27e-4f05-900a-f6c5942b4cbe tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:28.095260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:28.096422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:28.096707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:28.096997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2/users/f8070282196740f2b989b2432814ea23/roles/6077448fde0240f8a44c64ff194c78ab` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:28.099526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3e36cd6a37ae406fb2216c3b812bf0c2, user_id=f8070282196740f2b989b2432814ea23, role_id=6077448fde0240f8a44c64ff194c78ab)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:28.102301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:28.109066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 6077448fde0240f8a44c64ff194c78ab was removed from user f8070282196740f2b989b2432814ea23 on domain 3e36cd6a37ae406fb2216c3b812bf0c2. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:28.109476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.110537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.129129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2575/5144] 10.222.0.77 () {58 vars in 1463 bytes} [Mon Jul 11 15:07:28 2022] DELETE /identity/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2/users/f8070282196740f2b989b2432814ea23/roles/6077448fde0240f8a44c64ff194c78ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:28.133312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:28.134817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:28.149415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6408-1d84-49a5-8001-ab51ef59591e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:28.237445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:28.238561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:28.238929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:28.239217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles/6077448fde0240f8a44c64ff194c78ab` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:28.241622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6077448fde0240f8a44c64ff194c78ab)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:28.243457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:28.290637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 6077448fde0240f8a44c64ff194c78ab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:28.291432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.292312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.295432 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2570/5145] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:28 2022] DELETE /identity/v3/roles/6077448fde0240f8a44c64ff194c78ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:28.300067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:28.301873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:28.316963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5dfe1-5a9f-43e2-bca6-652f3fdcf461 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:28.402676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:28.403721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:28.404053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:28.404277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:28.405738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3e36cd6a37ae406fb2216c3b812bf0c2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:28.407460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:28.432518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.433635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.468703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.469509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.473275 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2576/5146] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:28 2022] PATCH /identity/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2 => generated 278 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:28.477419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:28.479274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:28.493785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93368a3-1807-4472-b4ee-f011514a9426 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:28.550825 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:28.561410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:28.562298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:28.562974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:28.563520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:28.577151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3e36cd6a37ae406fb2216c3b812bf0c2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:28.579060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:28.604661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.608136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.673591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2', 'request_id': 'req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.687631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2', 'request_id': 'req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.697766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2', 'request_id': 'req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.713313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] The token cache is being invalidate because project 3e36cd6a37ae406fb2216c3b812bf0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:28.713679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.714924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.725765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2', 'request_id': 'req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.732524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2', 'request_id': 'req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.733247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3e36cd6a37ae406fb2216c3b812bf0c2', 'request_id': 'req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.743265 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2571/5147] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:28 2022] DELETE /identity/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:28.744124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:28.746366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:28.765844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fd561-2fec-4f40-8616-e3001a57542f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:28.804304 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:28.859919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:28.861116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:28.861408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:28.861676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/e99ad1f0237642cf989a9c855d30ba51/groups/30cf70ebca1a4013ab053dfe1dfd8afa/roles/b1177a8dbb054f2090e7c714498c6ef8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:28.864122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e99ad1f0237642cf989a9c855d30ba51, group_id=30cf70ebca1a4013ab053dfe1dfd8afa, role_id=b1177a8dbb054f2090e7c714498c6ef8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:28.867415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:28.877358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role b1177a8dbb054f2090e7c714498c6ef8 was removed from group 30cf70ebca1a4013ab053dfe1dfd8afa on domain e99ad1f0237642cf989a9c855d30ba51. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:28.878694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.903851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:28.951891 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2577/5148] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:07:28 2022] DELETE /identity/v3/domains/e99ad1f0237642cf989a9c855d30ba51/groups/30cf70ebca1a4013ab053dfe1dfd8afa/roles/b1177a8dbb054f2090e7c714498c6ef8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:28.952641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:28.954402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:28.972800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecc7b-8d9d-459d-ad29-97d68ee8140a tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:29.143215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:29.144695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:29.144695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:29.144877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups/30cf70ebca1a4013ab053dfe1dfd8afa/users/f8070282196740f2b989b2432814ea23` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:29.148146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=30cf70ebca1a4013ab053dfe1dfd8afa, user_id=f8070282196740f2b989b2432814ea23)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:29.150661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:29.160320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.180800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2572/5149] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 15:07:28 2022] DELETE /identity/v3/groups/30cf70ebca1a4013ab053dfe1dfd8afa/users/f8070282196740f2b989b2432814ea23 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:29.184660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:29.186287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:29.211838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3a4c-4a7f-4cd3-85af-a0b31d9ec30e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:29.315116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:29.316270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:29.316549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:29.317004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/groups/30cf70ebca1a4013ab053dfe1dfd8afa` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:29.318358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_group(group_id=30cf70ebca1a4013ab053dfe1dfd8afa)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:29.320744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:29.383453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2578/5150] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:07:29 2022] DELETE /identity/v3/groups/30cf70ebca1a4013ab053dfe1dfd8afa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:29.387627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:29.402787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d741c31-e35e-4b18-91a8-cad492293420 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:29.428408 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:29.514036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:29.515314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:29.515768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:29.516205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles/b1177a8dbb054f2090e7c714498c6ef8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:29.519211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b1177a8dbb054f2090e7c714498c6ef8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:29.521934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:29.595458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role b1177a8dbb054f2090e7c714498c6ef8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:29.596011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.598354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.602241 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2573/5151] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:29 2022] DELETE /identity/v3/roles/b1177a8dbb054f2090e7c714498c6ef8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:29.606752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:29.609167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:29.629803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042402bd-61dd-43d0-be54-6e657e30d105 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:29.782917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:29.783882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:29.784169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:29.784478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/e99ad1f0237642cf989a9c855d30ba51` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:29.785960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e99ad1f0237642cf989a9c855d30ba51)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:29.787621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:29.811146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.811908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.814248 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:29.850117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.850855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.854280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2579/5152] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:29 2022] PATCH /identity/v3/domains/e99ad1f0237642cf989a9c855d30ba51 => generated 277 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:29.858429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:29.869392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bda1e-f8de-48f2-81e2-a4fccf0809ee tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:29.942884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:29.943905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:29.944345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:29.944731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/e99ad1f0237642cf989a9c855d30ba51` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:29.959280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e99ad1f0237642cf989a9c855d30ba51)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:29.961083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:29.991944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:29.997788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.123688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51', 'request_id': 'req-61269ee5-fb3e-4177-89a7-3817b16a279b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.128684 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:30.132550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51', 'request_id': 'req-61269ee5-fb3e-4177-89a7-3817b16a279b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.145477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51', 'request_id': 'req-61269ee5-fb3e-4177-89a7-3817b16a279b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.167633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] The token cache is being invalidate because project e99ad1f0237642cf989a9c855d30ba51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:30.168078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.168872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.178004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51', 'request_id': 'req-61269ee5-fb3e-4177-89a7-3817b16a279b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.184348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51', 'request_id': 'req-61269ee5-fb3e-4177-89a7-3817b16a279b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.185229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e99ad1f0237642cf989a9c855d30ba51', 'request_id': 'req-61269ee5-fb3e-4177-89a7-3817b16a279b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.198895 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2574/5153] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:29 2022] DELETE /identity/v3/domains/e99ad1f0237642cf989a9c855d30ba51 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:30.202865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:30.204624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:30.220160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea9cbc-5608-4a1a-8b5a-99003e22338d tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:30.334116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:30.339987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:30.340634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:30.341624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/ae77e2856ff94ee79ed55e31de73e766/users/f8070282196740f2b989b2432814ea23/roles/785dfdc1509547b5a4ceb2b71984382f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:30.344620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ae77e2856ff94ee79ed55e31de73e766, user_id=f8070282196740f2b989b2432814ea23, role_id=785dfdc1509547b5a4ceb2b71984382f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:30.348472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:30.356834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 785dfdc1509547b5a4ceb2b71984382f was removed from user f8070282196740f2b989b2432814ea23 on domain ae77e2856ff94ee79ed55e31de73e766. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:30.357363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.358219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.389059 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2580/5154] 10.222.0.77 () {58 vars in 1463 bytes} [Mon Jul 11 15:07:30 2022] DELETE /identity/v3/domains/ae77e2856ff94ee79ed55e31de73e766/users/f8070282196740f2b989b2432814ea23/roles/785dfdc1509547b5a4ceb2b71984382f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:30.390747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:30.392353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:30.410359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269ee5-fb3e-4177-89a7-3817b16a279b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:30.528001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:30.530809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:30.532144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:30.533013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles/785dfdc1509547b5a4ceb2b71984382f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:30.535719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_role(role_id=785dfdc1509547b5a4ceb2b71984382f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:30.537645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:30.588379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 785dfdc1509547b5a4ceb2b71984382f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:30.589068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.589523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.593726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2575/5155] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:30 2022] DELETE /identity/v3/roles/785dfdc1509547b5a4ceb2b71984382f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:30.601119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:30.604540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:30.638804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7424f8a-65c0-41ee-a979-25ebb6b97b72 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:30.754891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:30.757027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:30.757510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:30.757954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/ae77e2856ff94ee79ed55e31de73e766` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:30.759940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ae77e2856ff94ee79ed55e31de73e766)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:30.761798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:30.844255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.846866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.914277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.915275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:30.922964 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2581/5156] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:30 2022] PATCH /identity/v3/domains/ae77e2856ff94ee79ed55e31de73e766 => generated 277 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:30.923372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:30.925234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:30.948414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8b4c3-2857-4684-8b87-a788111322db tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:31.076836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:31.078060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:31.078585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:31.079037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/ae77e2856ff94ee79ed55e31de73e766` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:31.094745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ae77e2856ff94ee79ed55e31de73e766)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:31.097195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:31.158716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.160220 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:31.163391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.308688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766', 'request_id': 'req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.322018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766', 'request_id': 'req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.332726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766', 'request_id': 'req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.364902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] The token cache is being invalidate because project ae77e2856ff94ee79ed55e31de73e766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:31.365201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.365867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.376427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766', 'request_id': 'req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.382477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766', 'request_id': 'req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.384129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ae77e2856ff94ee79ed55e31de73e766', 'request_id': 'req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.403927 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2576/5157] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:30 2022] DELETE /identity/v3/domains/ae77e2856ff94ee79ed55e31de73e766 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:31.415050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:31.419759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:31.434485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfeef9-15e7-4117-a279-9379b82dd757 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:31.478124 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:31.512399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:31.513635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:31.513930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:31.514217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:31.515136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:31.516811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:31.542543 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2582/5158] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:31.546679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:31.549594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:31.575596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b34dd0-a3f0-426b-ad44-ee702df1cbf2 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:31.591887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:31.593084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:31.593455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:31.593738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/204787d6227541baa38e5eaa57933c9e/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:31.596304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(project_id=204787d6227541baa38e5eaa57933c9e, user_id=8762e11822314fe39feeae1408b27e2d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:31.602679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:31.631172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2577/5159] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:31 2022] PUT /identity/v3/projects/204787d6227541baa38e5eaa57933c9e/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:31.633011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:31.656931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde392cf-3a00-46ef-938d-6396bd37f316 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:31.763236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:31.764063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:31.764615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:31.765146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:31.766248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:31.767471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:31.836582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:31.839351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:31.857572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2583/5160] 10.222.0.77 () {58 vars in 1145 bytes} [Mon Jul 11 15:07:31 2022] GET /identity/v3/auth/projects => generated 828 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:31.858872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:31.871812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeda29-4e44-4751-9ddd-fb4e0bb1b6c7 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:31.878907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:31.879913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:31.880198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:31.880484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/204787d6227541baa38e5eaa57933c9e/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:31.883807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=204787d6227541baa38e5eaa57933c9e, user_id=8762e11822314fe39feeae1408b27e2d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:31.887578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:31.896408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role 70eee5d669654151b878064c431c4f7b was removed from user 8762e11822314fe39feeae1408b27e2d on project 204787d6227541baa38e5eaa57933c9e. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:31.896733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.898128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:31.925669 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2584/5161] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:07:31 2022] DELETE /identity/v3/projects/204787d6227541baa38e5eaa57933c9e/users/8762e11822314fe39feeae1408b27e2d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:31.933409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:31.936581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:31.955983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52650c-a0b5-403f-9d97-061a5cd297ea tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.058207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.058795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec318-59c1-4bba-867f-573d6af47d35 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.059577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.060558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.060841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] PATH_INFO: `/v3/users/3b0551622c74490abc17d4e0c34d5528` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.062883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0551622c74490abc17d4e0c34d5528)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.064403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.064819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.065356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.065949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.066764 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:32.068505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.070052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.072884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.136324 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2585/5162] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:31 2022] POST /identity/v3/users => generated 323 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:32.140556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:32.162939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0551622c74490abc17d4e0c34d5528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.167946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d69c8-9e0d-40d9-8572-8b8f7a60f2a1 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.176673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.177350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.177668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.177952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.178695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.180755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.185651 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:32.185989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0551622c74490abc17d4e0c34d5528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.195378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0551622c74490abc17d4e0c34d5528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.208506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0551622c74490abc17d4e0c34d5528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.209827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0551622c74490abc17d4e0c34d5528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.220146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2578/5163] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:31 2022] DELETE /identity/v3/users/3b0551622c74490abc17d4e0c34d5528 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:32.232437 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2586/5164] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:32 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:32.236042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:32.239086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:32.341257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97a1c-a49f-4468-91d4-2141e1c9fbe2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.378753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:32.381233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:32.464302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.464996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.465353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.465570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.467222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.471459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.509007 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2579/5165] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:32 2022] POST /identity/v3/projects => generated 364 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:32.512802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:32.523671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17a63-afda-4544-8808-55b069f2d50b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.529930 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:32.643376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.644501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.644929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.645220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] PATH_INFO: `/v3/users/98d5021920c940aa97940914dcc1d817` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.646954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d5021920c940aa97940914dcc1d817)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.649454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.672075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c903f-c93e-423c-b112-2bda50cfa9a3 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.692968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.693670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.693967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.694315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.695135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.696869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.742010 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2580/5166] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:07:32 2022] POST /identity/v3/roles => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:32.743723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:32.749248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:32.764869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d5021920c940aa97940914dcc1d817'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.765973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d5021920c940aa97940914dcc1d817'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.786127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79973e6-c4b5-4224-920c-4b40b2e693da tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.789774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d5021920c940aa97940914dcc1d817'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.790222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d5021920c940aa97940914dcc1d817'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.793963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:32.795233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.795597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.795941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] PATH_INFO: `/v3/projects/7a25b8d20ee541e7976b54c5cf234dae` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.797391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a25b8d20ee541e7976b54c5cf234dae)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:32.799547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:32.800770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d5021920c940aa97940914dcc1d817'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.827974 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2587/5167] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:32 2022] DELETE /identity/v3/users/98d5021920c940aa97940914dcc1d817 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:32.830173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:32.835455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:32.867105 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:32.886314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a25b8d20ee541e7976b54c5cf234dae', 'request_id': 'req-f35018bb-11ae-452d-9e9c-1087f8eaf87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.902403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a25b8d20ee541e7976b54c5cf234dae', 'request_id': 'req-f35018bb-11ae-452d-9e9c-1087f8eaf87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.913846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a25b8d20ee541e7976b54c5cf234dae', 'request_id': 'req-f35018bb-11ae-452d-9e9c-1087f8eaf87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.953883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856d716-16b6-45f2-b223-55ddb1a12e93 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:32.956890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] The token cache is being invalidate because project 7a25b8d20ee541e7976b54c5cf234dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:32.957381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.958438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f35018bb-11ae-452d-9e9c-1087f8eaf87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:32.960349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2581/5168] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:32 2022] DELETE /identity/v3/projects/7a25b8d20ee541e7976b54c5cf234dae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:32.961807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2794e71-a677-4bc5-8ee6-a193d27678ff None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:32.962249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2794e71-a677-4bc5-8ee6-a193d27678ff None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:32.962756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2794e71-a677-4bc5-8ee6-a193d27678ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:32.994665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c2794e71-a677-4bc5-8ee6-a193d27678ff None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:32.996157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c2794e71-a677-4bc5-8ee6-a193d27678ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.059396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.060608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.061070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.061658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/6f6929ca0f784e5b8b9ae3bbfb59152f/users/341063ffbd73420abc483089f7a26ecc/roles/fbcbcf822d1b4b31ba36b6104dcf2863` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.086450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f6929ca0f784e5b8b9ae3bbfb59152f, user_id=341063ffbd73420abc483089f7a26ecc, role_id=fbcbcf822d1b4b31ba36b6104dcf2863)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.090761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.096702 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2582/5169] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:33.103023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.103369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.103647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.111286 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2588/5170] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:32 2022] PUT /identity/v3/projects/6f6929ca0f784e5b8b9ae3bbfb59152f/users/341063ffbd73420abc483089f7a26ecc/roles/fbcbcf822d1b4b31ba36b6104dcf2863 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:33.112429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.114233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.156208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:33.157988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.196036 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:33.228038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30fd22-1056-430a-90a7-7c161de4fc7e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.237664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.238332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.238651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.238941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.245309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.246295 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2583/5171] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:33.247207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.248527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.297696 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:33.331677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7938c53-a71a-4c8e-abee-9ade24dfae5a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.337755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.338896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.339471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.340326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.347432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.352353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.354061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05840be-a1f4-4b59-9258-57af94ed2b62 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.354711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.367369 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2584/5172] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:33.368199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.370207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.393111 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2589/5173] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:33.394674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.395049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.395247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.458407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:33.459930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.474807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2590/5174] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:33.476842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.489307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb34d78-ffe4-41e0-9185-b3e988361bab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.495796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.496664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.497053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.497868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.498849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:33.499305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.501584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.531686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2591/5175] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:33.533150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.545641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651696c4-1d06-4800-b913-8889856bba72 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.553979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.556223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.556951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.557427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.558334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.560873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.567415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997c0c-19d8-47d2-b3c1-ae6914493638 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.584233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be5749-0684-4ac4-8f97-1646bdb5e6cb tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.585407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5749-0684-4ac4-8f97-1646bdb5e6cb tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.585657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5749-0684-4ac4-8f97-1646bdb5e6cb tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.586204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5749-0684-4ac4-8f97-1646bdb5e6cb tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/c1e294a5e8f749549b7a04cf744d366b/users/341063ffbd73420abc483089f7a26ecc/roles/fbcbcf822d1b4b31ba36b6104dcf2863` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.593268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be5749-0684-4ac4-8f97-1646bdb5e6cb tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c1e294a5e8f749549b7a04cf744d366b, user_id=341063ffbd73420abc483089f7a26ecc, role_id=fbcbcf822d1b4b31ba36b6104dcf2863)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.596583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be5749-0684-4ac4-8f97-1646bdb5e6cb tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.621643 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2592/5176] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:33 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:33.633240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.638671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2585/5177] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:33 2022] PUT /identity/v3/projects/c1e294a5e8f749549b7a04cf744d366b/users/341063ffbd73420abc483089f7a26ecc/roles/fbcbcf822d1b4b31ba36b6104dcf2863 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:33.653563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfda95-d7fd-4834-980b-bdc7f1ad8662 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.657025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfda95-d7fd-4834-980b-bdc7f1ad8662 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.657025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfda95-d7fd-4834-980b-bdc7f1ad8662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.714333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-93cfda95-d7fd-4834-980b-bdc7f1ad8662 None None] MFA Rules not processed for user `341063ffbd73420abc483089f7a26ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:33.734002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-93cfda95-d7fd-4834-980b-bdc7f1ad8662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.739575 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2586/5178] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:33 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:07:33.744626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.746615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.747207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.768055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] MFA Rules not processed for user `341063ffbd73420abc483089f7a26ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:33.769911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:33.807862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b53c6-3117-4d44-892b-f5d32478c226 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.815723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.816568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.816867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.817206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.818059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.820089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.861529 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2593/5179] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:33 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:33.865937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.876376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9a3f-e329-47c0-ab74-b699fccb15bc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.882151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.882875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.883159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.883436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.884492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.887657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.917793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2594/5180] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:33 2022] GET /identity/v3/roles => generated 1651 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:33.924593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.926963 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:33.939514 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2587/5181] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 11 15:07:33.943388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:33.945914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bcf3-ea30-4912-ae23-7fb1e81af8ed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:33.968780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:33.970274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:33.970687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:33.970972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:33.971721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:33.973472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:33.993033 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2595/5182] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:33 2022] GET /identity/v3/roles => generated 1651 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:33.997844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.011377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f00f-919f-44e9-9473-c7f22aa631c8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.016533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.017919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.018239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.018585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] PATH_INFO: `/v3/projects/b4064c53b0654f04937e81b6bd8b6fbe/users/352846763b3048dabdf5d46281cf1388/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.039482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4064c53b0654f04937e81b6bd8b6fbe, user_id=352846763b3048dabdf5d46281cf1388, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.043376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.095067 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2596/5183] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:33 2022] PUT /identity/v3/projects/b4064c53b0654f04937e81b6bd8b6fbe/users/352846763b3048dabdf5d46281cf1388/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:34.097801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.102971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.118024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09fc37-9d96-4388-a1a2-f41fef08d296 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.130255 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:34.202303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121427d-158c-4f62-8616-61481c492a75 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.209500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.211000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.212093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.212386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] PATH_INFO: `/v3/projects/25d47e8cb5fa4ed9b1d94b775972d054` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.213883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d47e8cb5fa4ed9b1d94b775972d054)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.215845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.251633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.252701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.253157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.253492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.279299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d47e8cb5fa4ed9b1d94b775972d054', 'request_id': 'req-524c9dad-f52d-4624-906e-37f57b6ddeb4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.296696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d47e8cb5fa4ed9b1d94b775972d054', 'request_id': 'req-524c9dad-f52d-4624-906e-37f57b6ddeb4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.308086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d47e8cb5fa4ed9b1d94b775972d054', 'request_id': 'req-524c9dad-f52d-4624-906e-37f57b6ddeb4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.321957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] The token cache is being invalidate because project 25d47e8cb5fa4ed9b1d94b775972d054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:34.322316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.324064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-524c9dad-f52d-4624-906e-37f57b6ddeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.336831 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2597/5184] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:34 2022] DELETE /identity/v3/projects/25d47e8cb5fa4ed9b1d94b775972d054 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:34.336831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a075687-e516-48b1-8e10-e20093c4486b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.336831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a075687-e516-48b1-8e10-e20093c4486b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.336831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a075687-e516-48b1-8e10-e20093c4486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.338451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.340321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.362153 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2588/5185] 10.222.0.77 () {56 vars in 1307 bytes} [Mon Jul 11 15:07:33 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:34.363240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.373608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9a075687-e516-48b1-8e10-e20093c4486b None None] MFA Rules not processed for user `352846763b3048dabdf5d46281cf1388`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:34.375762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9a075687-e516-48b1-8e10-e20093c4486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.376961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13956b0-e2c1-4fcd-b936-bf36f01766d8 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.437224 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:34.456839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.459205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.459205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.459205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] PATH_INFO: `/v3/users/96f7fb4a58bd4d91a7bc27efabb111d4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.465714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f7fb4a58bd4d91a7bc27efabb111d4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.465885 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2598/5186] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:34.465885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.465885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.465885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.466234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.467983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.476158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] MFA Rules not processed for user `341063ffbd73420abc483089f7a26ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:34.477286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.520952 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:34.527963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f7fb4a58bd4d91a7bc27efabb111d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.546606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f7fb4a58bd4d91a7bc27efabb111d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.553561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2599/5187] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 11 15:07:34.554438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.555986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.559717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f7fb4a58bd4d91a7bc27efabb111d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.568862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f7fb4a58bd4d91a7bc27efabb111d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.570016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f7fb4a58bd4d91a7bc27efabb111d4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.578386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2589/5188] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:34 2022] DELETE /identity/v3/users/96f7fb4a58bd4d91a7bc27efabb111d4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:34.581982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.583537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.667672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914a788-8e01-4b20-acb0-aea72f13ece4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.671622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356438d6-4ca5-47b4-86ae-de4764ab19de admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.683725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.685428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.685819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.686202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/roles/fbcbcf822d1b4b31ba36b6104dcf2863` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.688257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbcbcf822d1b4b31ba36b6104dcf2863)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.690544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.775417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.776766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.777416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.777416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.779452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.796583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invalidating the token cache because role fbcbcf822d1b4b31ba36b6104dcf2863 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:34.797629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.798877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:34.803128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2590/5189] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:34 2022] DELETE /identity/v3/roles/fbcbcf822d1b4b31ba36b6104dcf2863 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:34.805813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.811648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:34.863806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.867322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.872703 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:34.887701 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2600/5190] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:34.927487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299435b7-5c99-4705-b38a-3707403eeabc tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:34.935203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:34.936453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:34.942338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:34.942338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/c1e294a5e8f749549b7a04cf744d366b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:34.942338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1e294a5e8f749549b7a04cf744d366b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:34.942338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:34.961213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:34.962680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.002016 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:35.017264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e294a5e8f749549b7a04cf744d366b', 'request_id': 'req-b6545849-91cb-4ff5-8f0c-aae975cc3518'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.053677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e294a5e8f749549b7a04cf744d366b', 'request_id': 'req-b6545849-91cb-4ff5-8f0c-aae975cc3518'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.080196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e294a5e8f749549b7a04cf744d366b', 'request_id': 'req-b6545849-91cb-4ff5-8f0c-aae975cc3518'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.081382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eba13-bccd-422a-8645-acd78cb3a507 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:35.100543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] The token cache is being invalidate because project c1e294a5e8f749549b7a04cf744d366b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:35.100843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.101631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.104063 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2591/5191] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:34 2022] DELETE /identity/v3/projects/c1e294a5e8f749549b7a04cf744d366b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:35.108284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.110016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.203387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:35.204337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.204630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.204929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] PATH_INFO: `/v3/projects/9f52365e09184abcb68f7280739fbd84` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.206150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f52365e09184abcb68f7280739fbd84)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:35.208306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:35.222368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545849-91cb-4ff5-8f0c-aae975cc3518 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:35.228006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:35.229155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.229520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.230264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/c1e294a5e8f749549b7a04cf744d366b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.238264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1e294a5e8f749549b7a04cf744d366b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:35.240135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Could not find project: c1e294a5e8f749549b7a04cf744d366b.: keystone.exception.ProjectNotFound: Could not find project: c1e294a5e8f749549b7a04cf744d366b. Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 11 15:07:35.257177 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c1e294a5e8f749549b7a04cf744d366b. Jul 11 15:07:35.258225 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:35.263271 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2592/5192] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:35 2022] DELETE /identity/v3/projects/c1e294a5e8f749549b7a04cf744d366b => generated 113 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:35.263271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.263271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.277967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361f54-d340-4e36-9144-e6fec55b8734 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:35.298852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f52365e09184abcb68f7280739fbd84', 'request_id': 'req-9eadef46-37aa-44df-b16b-4682974ea6bc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.311375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f52365e09184abcb68f7280739fbd84', 'request_id': 'req-9eadef46-37aa-44df-b16b-4682974ea6bc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.329994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f52365e09184abcb68f7280739fbd84', 'request_id': 'req-9eadef46-37aa-44df-b16b-4682974ea6bc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.345489 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:35.362292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] The token cache is being invalidate because project 9f52365e09184abcb68f7280739fbd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:35.364760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.366289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:35.366898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.367415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.367636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.368052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] PATH_INFO: `/v3/users/352846763b3048dabdf5d46281cf1388` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.369984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352846763b3048dabdf5d46281cf1388)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:35.374176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2601/5193] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:34 2022] DELETE /identity/v3/projects/9f52365e09184abcb68f7280739fbd84 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:35.374176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.374754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:35.377415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.456855 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:35.460246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352846763b3048dabdf5d46281cf1388'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.473588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadef46-37aa-44df-b16b-4682974ea6bc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:35.477111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352846763b3048dabdf5d46281cf1388'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.480923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:35.482268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.482584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.482867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/projects/6f6929ca0f784e5b8b9ae3bbfb59152f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.484279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f6929ca0f784e5b8b9ae3bbfb59152f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:35.486101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:35.492553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352846763b3048dabdf5d46281cf1388'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.503658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352846763b3048dabdf5d46281cf1388'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.504893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352846763b3048dabdf5d46281cf1388'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.512454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2593/5194] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:35 2022] DELETE /identity/v3/users/352846763b3048dabdf5d46281cf1388 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:35.513182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.514886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.546533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6929ca0f784e5b8b9ae3bbfb59152f', 'request_id': 'req-6e25c229-1a87-437c-883a-c94f284e9e8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.556171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6929ca0f784e5b8b9ae3bbfb59152f', 'request_id': 'req-6e25c229-1a87-437c-883a-c94f284e9e8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.564006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6929ca0f784e5b8b9ae3bbfb59152f', 'request_id': 'req-6e25c229-1a87-437c-883a-c94f284e9e8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.577955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] The token cache is being invalidate because project 6f6929ca0f784e5b8b9ae3bbfb59152f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:35.578350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.579490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6e25c229-1a87-437c-883a-c94f284e9e8f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.584193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2602/5195] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:35 2022] DELETE /identity/v3/projects/6f6929ca0f784e5b8b9ae3bbfb59152f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:35.584193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.584193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.584193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.603151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:35.604988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.615706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd3e6-dcfb-4094-9a2d-6a23cdccf821 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:35.689154 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2603/5196] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:35.690252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.692139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.702519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:35.704332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.704626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.704910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] PATH_INFO: `/v3/users/2b73c91f18d84691a590222dd1c9ea09` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.706801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b73c91f18d84691a590222dd1c9ea09)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:35.709374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:35.751016 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:35.776523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28943e-d8dc-4d86-8e58-48a194a25ce7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:35.782385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:35.783573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:35.784129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:35.784613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/users/341063ffbd73420abc483089f7a26ecc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:35.787541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorizing `identity:delete_user(user_id=341063ffbd73420abc483089f7a26ecc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:35.788182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b73c91f18d84691a590222dd1c9ea09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.790488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:35.806129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b73c91f18d84691a590222dd1c9ea09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.813362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b73c91f18d84691a590222dd1c9ea09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.828912 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:35.862946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b73c91f18d84691a590222dd1c9ea09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.863380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341063ffbd73420abc483089f7a26ecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.863639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b73c91f18d84691a590222dd1c9ea09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.864223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341063ffbd73420abc483089f7a26ecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.872913 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2594/5197] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:35 2022] DELETE /identity/v3/users/2b73c91f18d84691a590222dd1c9ea09 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:35.874621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.876950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.882414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341063ffbd73420abc483089f7a26ecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.883958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341063ffbd73420abc483089f7a26ecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.895062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341063ffbd73420abc483089f7a26ecc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:35.912228 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2604/5198] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:35 2022] DELETE /identity/v3/users/341063ffbd73420abc483089f7a26ecc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:35.918187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:35.920577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:35.973628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef475a-9e38-44bb-8909-9d8859410431 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.002814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2770b-f3ce-4705-b105-333894a4e29e tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.009236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.010173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.010535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.011046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/b764f484aa69401a8d11725cd0b1550c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.021904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:36.033674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.034326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.034642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.034918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Could not find domain: b764f484aa69401a8d11725cd0b1550c.: keystone.exception.DomainNotFound: Could not find domain: b764f484aa69401a8d11725cd0b1550c. Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b764f484aa69401a8d11725cd0b1550c. Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:36.035404 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:36.036406 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b764f484aa69401a8d11725cd0b1550c. Jul 11 15:07:36.037364 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.038378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2605/5199] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:35 2022] PATCH /identity/v3/domains/b764f484aa69401a8d11725cd0b1550c => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 11 15:07:36.040725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.041896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.047964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.064350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ecd0-2128-4db9-809f-22b38337ec57 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.069212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.070091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.070381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.070694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.081612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Could not find domain: 3e36cd6a37ae406fb2216c3b812bf0c2.: keystone.exception.DomainNotFound: Could not find domain: 3e36cd6a37ae406fb2216c3b812bf0c2. Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3e36cd6a37ae406fb2216c3b812bf0c2. Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:36.093867 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:36.095062 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3e36cd6a37ae406fb2216c3b812bf0c2. Jul 11 15:07:36.096038 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.097061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2606/5200] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:36 2022] PATCH /identity/v3/domains/3e36cd6a37ae406fb2216c3b812bf0c2 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 11 15:07:36.099407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.112583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1db7-084b-49b8-bd77-277576fdfd1b tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.117340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.118212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.118523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.118813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/e99ad1f0237642cf989a9c855d30ba51` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.122295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:36.124518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:36.126767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:36.137837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2595/5201] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Could not find domain: e99ad1f0237642cf989a9c855d30ba51.: keystone.exception.DomainNotFound: Could not find domain: e99ad1f0237642cf989a9c855d30ba51. Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e99ad1f0237642cf989a9c855d30ba51. Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:36.138085 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:36.139332 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e99ad1f0237642cf989a9c855d30ba51. Jul 11 15:07:36.140482 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:36.141673 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2607/5202] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:36 2022] PATCH /identity/v3/domains/e99ad1f0237642cf989a9c855d30ba51 => generated 112 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 11 15:07:36.143124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.154595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ccaa-5b9f-49d9-9c85-e2865be19ef4 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.159622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d792d6-af67-45f0-922c-ac58e6fd1540 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8762e11822314fe39feeae1408b27e2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65ba6320955461fbfc633cf32eccb57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.160754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d792d6-af67-45f0-922c-ac58e6fd1540 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.161147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d792d6-af67-45f0-922c-ac58e6fd1540 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.161550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d792d6-af67-45f0-922c-ac58e6fd1540 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] PATH_INFO: `/v3/domains/ae77e2856ff94ee79ed55e31de73e766` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.164301 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:36.170599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d792d6-af67-45f0-922c-ac58e6fd1540 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-a5d792d6-af67-45f0-922c-ac58e6fd1540 tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Could not find domain: ae77e2856ff94ee79ed55e31de73e766.: keystone.exception.DomainNotFound: Could not find domain: ae77e2856ff94ee79ed55e31de73e766. Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ae77e2856ff94ee79ed55e31de73e766. Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:36.181759 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:36.183183 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ae77e2856ff94ee79ed55e31de73e766. Jul 11 15:07:36.184313 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:36.186133 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2596/5203] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:36 2022] PATCH /identity/v3/domains/ae77e2856ff94ee79ed55e31de73e766 => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:36.189618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.192478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.214564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332264-221f-48d0-af4c-0ca3b20c2f0f tempest-TokensV3TestJSON-1737376206 tempest-TokensV3TestJSON-1737376206-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.220505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.221447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.221771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.222147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] PATH_INFO: `/v3/users/f240f141262543e2b14d065ee9f4a1e0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.223459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f240f141262543e2b14d065ee9f4a1e0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:36.225509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:36.281724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f240f141262543e2b14d065ee9f4a1e0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.282410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f240f141262543e2b14d065ee9f4a1e0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.300543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f240f141262543e2b14d065ee9f4a1e0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.301512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f240f141262543e2b14d065ee9f4a1e0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.328776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f240f141262543e2b14d065ee9f4a1e0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.332811 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:36.347110 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2608/5204] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:36 2022] DELETE /identity/v3/users/f240f141262543e2b14d065ee9f4a1e0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:36.351479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.351919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.352333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.383931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:36.387870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.423564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.425490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.483653 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2597/5205] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:36.497896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.501235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.523897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074b1f-13fe-496d-8938-667e0c1d2e07 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.540987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.543399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.545821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.545955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] PATH_INFO: `/v3/users/156329325d1446c4bf87a40690beaa82` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.548879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] RBAC: Authorizing `identity:delete_user(user_id=156329325d1446c4bf87a40690beaa82)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:36.553419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:36.564368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3a15-a4e8-4e1e-943d-915d4b4a7a31 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.570130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.570878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.571173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.571455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.601840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:36.603460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:36.615948 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2598/5206] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:07:36.658580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.660959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.686539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2526-78a9-489b-9e3c-a68abe000479 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.693612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.694564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.694825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.695070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] PATH_INFO: `/v3/projects/b4064c53b0654f04937e81b6bd8b6fbe` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.705441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156329325d1446c4bf87a40690beaa82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.706589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156329325d1446c4bf87a40690beaa82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.707001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4064c53b0654f04937e81b6bd8b6fbe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:36.709373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:36.729982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156329325d1446c4bf87a40690beaa82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.731343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156329325d1446c4bf87a40690beaa82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.740885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10334abf-75bd-4a62-91af-42f5e7b738db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156329325d1446c4bf87a40690beaa82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.764029 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2609/5207] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:36 2022] DELETE /identity/v3/users/156329325d1446c4bf87a40690beaa82 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:36.769017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa23de9-2f25-45a5-9b26-a5a62b5d27ea None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.769816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa23de9-2f25-45a5-9b26-a5a62b5d27ea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.770320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa23de9-2f25-45a5-9b26-a5a62b5d27ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.807323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4064c53b0654f04937e81b6bd8b6fbe', 'request_id': 'req-5001793b-7c60-4dfd-ab15-aef47f748491'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.812784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-caa23de9-2f25-45a5-9b26-a5a62b5d27ea None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:36.817666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-caa23de9-2f25-45a5-9b26-a5a62b5d27ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.820028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4064c53b0654f04937e81b6bd8b6fbe', 'request_id': 'req-5001793b-7c60-4dfd-ab15-aef47f748491'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.838047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4064c53b0654f04937e81b6bd8b6fbe', 'request_id': 'req-5001793b-7c60-4dfd-ab15-aef47f748491'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.858404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] The token cache is being invalidate because project b4064c53b0654f04937e81b6bd8b6fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:36.858777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.860413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:36.863085 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2599/5208] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:36 2022] DELETE /identity/v3/projects/b4064c53b0654f04937e81b6bd8b6fbe => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:36.863911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.865335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.905674 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:36.920179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2610/5209] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:36.920179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.920179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.920179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.943262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:36.944580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.953641 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2611/5210] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:36.954304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:36.955656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:36.956147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001793b-7c60-4dfd-ab15-aef47f748491 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:36.962055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:36.963936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:36.963936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:36.963936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] PATH_INFO: `/v3/projects/e7ef9bbb98b5486d8c161c84196122e9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:36.965076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ef9bbb98b5486d8c161c84196122e9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:36.967027 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:36.967185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.028418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ef9bbb98b5486d8c161c84196122e9', 'request_id': 'req-1131f066-f64f-4ed3-aabd-fb7a13f010fd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.029644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59f51b-523a-459d-ae76-77b1b46c7f0d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.035038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ef9bbb98b5486d8c161c84196122e9', 'request_id': 'req-1131f066-f64f-4ed3-aabd-fb7a13f010fd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.045442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ef9bbb98b5486d8c161c84196122e9', 'request_id': 'req-1131f066-f64f-4ed3-aabd-fb7a13f010fd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.066068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] The token cache is being invalidate because project e7ef9bbb98b5486d8c161c84196122e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:37.066416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.067069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1131f066-f64f-4ed3-aabd-fb7a13f010fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.069437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2600/5211] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:36 2022] DELETE /identity/v3/projects/e7ef9bbb98b5486d8c161c84196122e9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:37.075717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d18f-3577-4be5-a7f6-eba200c03ac7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.076011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d18f-3577-4be5-a7f6-eba200c03ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.076287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d18f-3577-4be5-a7f6-eba200c03ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.096682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-14f5d18f-3577-4be5-a7f6-eba200c03ac7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:37.097893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14f5d18f-3577-4be5-a7f6-eba200c03ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.123319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.127543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.127903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.128321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.131279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.164543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2601/5212] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:37.166361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.166692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.166972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.185676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:37.186934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.195290 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2602/5213] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:37.196065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.197292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.203989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.205438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.209178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091eaf9-fa59-4adb-8b62-5de1bb5fab6c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.214655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.215506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.215790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.216067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] PATH_INFO: `/v3/projects/204787d6227541baa38e5eaa57933c9e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.216302 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2612/5214] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:37.217137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.217345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=204787d6227541baa38e5eaa57933c9e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.219304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.226541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce61841-f84c-486f-a154-10858c4ae552 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.233189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.233855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.234145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.234424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.235188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:37.235497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.237092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae62a-377f-467b-9d0b-718050d86cf9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.250983 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2613/5215] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:37.252236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.252529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.252818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.270361 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:37.274360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:37.275949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204787d6227541baa38e5eaa57933c9e', 'request_id': 'req-1adb93f5-8290-4f98-9057-7b60c4854e3d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.276177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.282894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204787d6227541baa38e5eaa57933c9e', 'request_id': 'req-1adb93f5-8290-4f98-9057-7b60c4854e3d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.293243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204787d6227541baa38e5eaa57933c9e', 'request_id': 'req-1adb93f5-8290-4f98-9057-7b60c4854e3d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.305319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] The token cache is being invalidate because project 204787d6227541baa38e5eaa57933c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:37.305609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.306265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.310708 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2603/5216] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:37 2022] DELETE /identity/v3/projects/204787d6227541baa38e5eaa57933c9e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:37.310708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.310708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.348032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2614/5217] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:37.348857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.350582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.360382 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:37.365077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69748-2981-4f21-aaa4-17e37f6db454 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.370202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.371130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.371902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.371902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] PATH_INFO: `/v3/users/8762e11822314fe39feeae1408b27e2d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.373064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8762e11822314fe39feeae1408b27e2d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.375048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.386276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb93f5-8290-4f98-9057-7b60c4854e3d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.391098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.391764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.392364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.392364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.393002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.395074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.430840 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2604/5218] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:37.430840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.441757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8762e11822314fe39feeae1408b27e2d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.442444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8762e11822314fe39feeae1408b27e2d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.456096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8762e11822314fe39feeae1408b27e2d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.456796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8762e11822314fe39feeae1408b27e2d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.464961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8762e11822314fe39feeae1408b27e2d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.477757 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2615/5219] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:37 2022] DELETE /identity/v3/users/8762e11822314fe39feeae1408b27e2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:37.478708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.480059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.504677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff657acb-00a3-4b0e-844e-a324fb2e4bcd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.559275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac463e-9429-4719-aa3b-05a7fdf2edaf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.564472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.565339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.565617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.565892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] PATH_INFO: `/v3/projects/1f0334bd9a524ff2921646e3ddcda9cd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.567587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0334bd9a524ff2921646e3ddcda9cd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.569025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.575987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.577158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.577454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.577734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.578670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:37.578980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.580609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.588933 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:37.605565 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2605/5220] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:37.606568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.608580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.624716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8fde6-86ed-4052-be33-82f41898d7ca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.629900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.630790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.631082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.631363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.632061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.634051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.671307 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2606/5221] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:37.672467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.674410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0334bd9a524ff2921646e3ddcda9cd', 'request_id': 'req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.674713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.685327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0334bd9a524ff2921646e3ddcda9cd', 'request_id': 'req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.687511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1460c-76cf-4edd-a63e-8ae93eb81b92 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.692275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0334bd9a524ff2921646e3ddcda9cd', 'request_id': 'req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.706333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] The token cache is being invalidate because project 1f0334bd9a524ff2921646e3ddcda9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:37.706849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.707584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.709471 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2616/5222] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:37 2022] DELETE /identity/v3/projects/1f0334bd9a524ff2921646e3ddcda9cd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:37.710453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.711898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.724075 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:37.764571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f449225-b9d4-467e-a000-ab7e32db4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.765689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f449225-b9d4-467e-a000-ab7e32db4bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.765689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f449225-b9d4-467e-a000-ab7e32db4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.765992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f449225-b9d4-467e-a000-ab7e32db4bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.766691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f449225-b9d4-467e-a000-ab7e32db4bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.768769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f449225-b9d4-467e-a000-ab7e32db4bc9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.799736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051f9d-5cb9-41e8-b5dc-77d6cfedc166 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.802526 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2607/5223] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:37.802526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.802526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.802526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.819967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:37.821258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.869948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.871353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.871661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.871963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.872714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.874316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.885299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2617/5224] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:37.886163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.888319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.891337 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2608/5225] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:37.891337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.892668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.902598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75107eee-36d7-4980-b00d-4dd7d6a346fd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.905670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24d57-f9f8-4e33-8d59-8a5a88148383 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.907256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.907918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.908233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.908506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.909173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.910843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.911160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.911844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.912200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.912474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] PATH_INFO: `/v3/projects/c65ba6320955461fbfc633cf32eccb57` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.913670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65ba6320955461fbfc633cf32eccb57)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.915603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.933960 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2618/5226] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:37.934899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:37.944900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c72f2-056a-473d-8b47-d786c46e1b33 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:37.951299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab45de-6375-4b92-ac6e-d8a43cc3592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:37.951980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab45de-6375-4b92-ac6e-d8a43cc3592e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.952270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab45de-6375-4b92-ac6e-d8a43cc3592e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.952554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab45de-6375-4b92-ac6e-d8a43cc3592e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.953285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab45de-6375-4b92-ac6e-d8a43cc3592e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:37.954913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab45de-6375-4b92-ac6e-d8a43cc3592e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:37.962874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65ba6320955461fbfc633cf32eccb57', 'request_id': 'req-76dcf833-a888-4097-81a6-175bbde03d5d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.966220 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2619/5227] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:37.967355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:37.967651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:37.967931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:37.971372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65ba6320955461fbfc633cf32eccb57', 'request_id': 'req-76dcf833-a888-4097-81a6-175bbde03d5d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.973910 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:37.980428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65ba6320955461fbfc633cf32eccb57', 'request_id': 'req-76dcf833-a888-4097-81a6-175bbde03d5d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.988006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:37.989687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:37.996163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] The token cache is being invalidate because project c65ba6320955461fbfc633cf32eccb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:37.996508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.997226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:37.999162 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2609/5228] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:37 2022] DELETE /identity/v3/projects/c65ba6320955461fbfc633cf32eccb57 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:37.999574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.002679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.054657 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2620/5229] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:38.055653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.057553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.069112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d2578-d8a5-45a8-939a-984f58d744d6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.070671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf833-a888-4097-81a6-175bbde03d5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.074599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.075475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.075758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.076036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] PATH_INFO: `/v3/projects/dbb26bc07cab4e8880fccab12f739d13/users/760cf3dbd1114fc79b99c4eea5a3862e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.076260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.076935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.077222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.077499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.078229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.079989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.092960 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2610/5230] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:38.093128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb26bc07cab4e8880fccab12f739d13, user_id=760cf3dbd1114fc79b99c4eea5a3862e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.093229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.093319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.094883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.096357 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:38.108574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1d7d4-470d-49dd-9425-9b84c4aaa83a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.117280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2621/5231] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:38 2022] PUT /identity/v3/projects/dbb26bc07cab4e8880fccab12f739d13/users/760cf3dbd1114fc79b99c4eea5a3862e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:38.117280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.195063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.195833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.196256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.196547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] PATH_INFO: `/v3/users/f8070282196740f2b989b2432814ea23` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.198159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310069-b3d0-4297-ac2e-b3ffe763963b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.198793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8070282196740f2b989b2432814ea23)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.200745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.204870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.206695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.206989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.207273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.208304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:38.208620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.210235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.223632 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2622/5232] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:38.224767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.239470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d36c5-6c61-4672-b7a1-884569a84485 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.245251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f74c-d83e-40a8-beb3-87bf8af7ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.246221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f74c-d83e-40a8-beb3-87bf8af7ef3c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.246527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f74c-d83e-40a8-beb3-87bf8af7ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.246927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f74c-d83e-40a8-beb3-87bf8af7ef3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.247788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491f74c-d83e-40a8-beb3-87bf8af7ef3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.249491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491f74c-d83e-40a8-beb3-87bf8af7ef3c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.262798 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2623/5233] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:38.267667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.268031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.268387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.268655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:38.283246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:38.292759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:38.303179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:38.303831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8070282196740f2b989b2432814ea23'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:38.311063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] MFA Rules not processed for user `760cf3dbd1114fc79b99c4eea5a3862e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:38.311292 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2611/5234] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:38 2022] DELETE /identity/v3/users/f8070282196740f2b989b2432814ea23 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:38.314275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.314421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.314533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.320503 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:38.393561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe571-93d3-491e-a256-74bdf118a151 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.396682 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2624/5235] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:38.399181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.399578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.400425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.400949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.401107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.401545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.402441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.404656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.417520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0bd0-fe3e-4a79-83a8-93083a814764 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.423378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.424463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.424952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.425472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] PATH_INFO: `/v3/projects/5f1066e4886b4815b73a50df33f738c8/users/e9f06306e4604f8fa1c7a88d61476b69/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.439945 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2612/5236] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:38.442190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.443855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.447542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1066e4886b4815b73a50df33f738c8, user_id=e9f06306e4604f8fa1c7a88d61476b69, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.451398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.471165 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2625/5237] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:38 2022] PUT /identity/v3/projects/5f1066e4886b4815b73a50df33f738c8/users/e9f06306e4604f8fa1c7a88d61476b69/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:38.472095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.528343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d76e42-ff34-403e-a6e7-a045238729ca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.529283 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:38.549696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09dc6-7c3b-4ff2-b058-d14944a057d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.555510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52303810-fd60-4481-9bbf-527822befb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.556205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52303810-fd60-4481-9bbf-527822befb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.557539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52303810-fd60-4481-9bbf-527822befb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.557779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52303810-fd60-4481-9bbf-527822befb94 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.558593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52303810-fd60-4481-9bbf-527822befb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.560905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52303810-fd60-4481-9bbf-527822befb94 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.587984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2626/5238] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:38 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:38.587984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.587984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.587984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.597625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.598856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.599295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.599938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.600751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.602556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.621382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] MFA Rules not processed for user `e9f06306e4604f8fa1c7a88d61476b69`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:38.622762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.649730 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2613/5239] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:38 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:38.650444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.689428 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:38.732578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2627/5240] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:38.748070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.759690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0adbb-89db-4f14-baca-a19d5a93c944 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.790177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196213-3388-4dab-bc2e-34b9d3222560 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.806251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.807015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.807305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.807591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.808321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.825403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.868077 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2614/5241] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:38.869175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.889303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.917904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.918622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.918909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.919241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.919947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:38.921882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:38.951674 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2628/5242] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:38 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:38.952961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:38.955331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:38.972775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee2f-200e-4567-a35b-126f44f8a33b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:38.979309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:38.980629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:38.980908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:38.981258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] PATH_INFO: `/v3/projects/79a60fe6445847c4b426e3360eb972ff` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:38.983439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a60fe6445847c4b426e3360eb972ff)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.002933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.013800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d5ec-4db6-47e2-ad83-3ec61aad560e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.020467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.022055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.022620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.023108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.101091 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:39.102993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a60fe6445847c4b426e3360eb972ff', 'request_id': 'req-f294a78b-d90c-43da-b156-376f457290e5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:39.106219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.107788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.111337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a60fe6445847c4b426e3360eb972ff', 'request_id': 'req-f294a78b-d90c-43da-b156-376f457290e5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:39.117387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a60fe6445847c4b426e3360eb972ff', 'request_id': 'req-f294a78b-d90c-43da-b156-376f457290e5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:39.117635 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2615/5243] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:39.118518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.131112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f15805-de06-4681-af75-3a13e40026fa service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.133265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] The token cache is being invalidate because project 79a60fe6445847c4b426e3360eb972ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:39.134203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:39.135706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:39.137719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2629/5244] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:38 2022] DELETE /identity/v3/projects/79a60fe6445847c4b426e3360eb972ff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:39.138596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.139950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.199115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b143c7-2209-43b9-8217-3274ac39d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.199681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b143c7-2209-43b9-8217-3274ac39d2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.200070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b143c7-2209-43b9-8217-3274ac39d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.200350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b143c7-2209-43b9-8217-3274ac39d2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.201247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b143c7-2209-43b9-8217-3274ac39d2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.203914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b143c7-2209-43b9-8217-3274ac39d2f4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.214355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294a78b-d90c-43da-b156-376f457290e5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.215002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2616/5245] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:39.216145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.216575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.216859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.219450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.220119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.220408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.220681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.221404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.223020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.233222 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2630/5246] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:39.237097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.237239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:39.238375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.238854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.246607 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2617/5247] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:39.247544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.254098 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:39.260201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c481b-22ad-4bd1-8c05-787721b81b84 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.260518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5162f9c-0de7-46aa-95e0-7152d072dfd2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.266974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c18cac-0a82-43be-ae6c-dbe0ca44d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.267767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c18cac-0a82-43be-ae6c-dbe0ca44d4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.268363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c18cac-0a82-43be-ae6c-dbe0ca44d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.268363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c18cac-0a82-43be-ae6c-dbe0ca44d4ef admin admin] PATH_INFO: `/v3/projects/1fa814d6ca824ee8819cf129dce4d86c/users/fcee01561c1149a6aa892c7d1dd9057e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.272738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.273645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.273931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.276981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] PATH_INFO: `/v3/projects/5354e1cd4f8c4633a78cd6fd1879fdb6/users/dbb9bf058d4c40bc9c46ca9c7d2b2e35/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.289078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c18cac-0a82-43be-ae6c-dbe0ca44d4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa814d6ca824ee8819cf129dce4d86c, user_id=fcee01561c1149a6aa892c7d1dd9057e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.291905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c18cac-0a82-43be-ae6c-dbe0ca44d4ef admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.295229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5354e1cd4f8c4633a78cd6fd1879fdb6, user_id=dbb9bf058d4c40bc9c46ca9c7d2b2e35, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.298813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.306263 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2618/5248] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:39 2022] PUT /identity/v3/projects/1fa814d6ca824ee8819cf129dce4d86c/users/fcee01561c1149a6aa892c7d1dd9057e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:39.307734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bca50-c2d3-4a98-9186-9246eb1cb20e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.308255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bca50-c2d3-4a98-9186-9246eb1cb20e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.308561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bca50-c2d3-4a98-9186-9246eb1cb20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.320879 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2631/5249] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:39 2022] PUT /identity/v3/projects/5354e1cd4f8c4633a78cd6fd1879fdb6/users/dbb9bf058d4c40bc9c46ca9c7d2b2e35/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:39.324420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.338878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4f5bca50-c2d3-4a98-9186-9246eb1cb20e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:39.340634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4f5bca50-c2d3-4a98-9186-9246eb1cb20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.423213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873b69-e170-41e2-9a50-d12af20882b6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.430974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.433360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.434732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.435558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.436195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.438558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.453769 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2619/5250] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:39.470891 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2632/5251] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:39.471915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.479680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab453fa-16ed-43c6-891c-f8eef082efe3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.480141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab453fa-16ed-43c6-891c-f8eef082efe3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.480431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab453fa-16ed-43c6-891c-f8eef082efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.497386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e15d0-fafd-4308-8ec1-0d0c08b5fe91 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.503754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.504752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.505091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.505301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.506040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:39.506352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.508099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.523249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3ab453fa-16ed-43c6-891c-f8eef082efe3 None None] MFA Rules not processed for user `dbb9bf058d4c40bc9c46ca9c7d2b2e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:39.523608 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2633/5252] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:39.524517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.524927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3ab453fa-16ed-43c6-891c-f8eef082efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.535864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c35f9-152b-438d-abfb-487a3496ffc1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.552043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.552886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.561670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.561670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] PATH_INFO: `/v3/projects/1fa814d6ca824ee8819cf129dce4d86c/users/fcee01561c1149a6aa892c7d1dd9057e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.561670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa814d6ca824ee8819cf129dce4d86c, user_id=fcee01561c1149a6aa892c7d1dd9057e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.561670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.574530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2634/5253] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:39 2022] PUT /identity/v3/projects/1fa814d6ca824ee8819cf129dce4d86c/users/fcee01561c1149a6aa892c7d1dd9057e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:39.583742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.605054 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:39.610558 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2620/5254] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:39.611929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.612226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.612508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.646270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] MFA Rules not processed for user `fcee01561c1149a6aa892c7d1dd9057e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:39.649003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.663432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e551d39-ae61-437f-9278-ecdd8a572908 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.670106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.670106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.670106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.670106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.670913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.672862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.705036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2635/5255] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:39.705997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.709742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:39.719265 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:39.732031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2621/5256] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:39.732867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.745528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39e21c-be0d-4ff0-9919-af2fcd652b8d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.781427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841e984-056d-4a5a-9fdf-feb11617c506 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.785264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.785926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.786213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.786525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.809549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.810662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.811255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.811813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.812962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.814981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.837090 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2622/5257] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:39.839198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.852417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.854407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.863851 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2636/5258] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:39.864580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.878194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39826f6-40dd-481a-947e-c521dbb7dbe7 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.893388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.894861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.895489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.895782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.897500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.900151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.914030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f590-9595-425d-ab2e-87fe15d0e1b0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.917480 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2637/5259] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:39.921079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.923024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.923945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.924390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.924827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.926083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.928281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.935349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ee429-a5b6-4691-a9c9-ea7ee6cec000 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:39.941379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:39.942143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:39.942912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:39.943330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:39.944183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:39.945927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:39.951626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2623/5260] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/domains => generated 245 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:39.956431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.960775 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2638/5261] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:39.965427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:39.979031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31dc1a-af9f-4e59-8899-308e26c90803 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.025414 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:40.055793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dfc60-2426-4263-843e-f3f5b1650ec7 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.067488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.069180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.070929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.071368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.072599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.075357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.084095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e750f-ddf2-4ca6-8dc7-f7f4b08ac6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.086750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e750f-ddf2-4ca6-8dc7-f7f4b08ac6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.087271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e750f-ddf2-4ca6-8dc7-f7f4b08ac6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.088467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e750f-ddf2-4ca6-8dc7-f7f4b08ac6f5 admin admin] PATH_INFO: `/v3/projects/439f69034d6c45e3baea4c6c3370a809/users/4f6c660b5b614fb89aeef8036fbe1ec0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.107795 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:40.117599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e750f-ddf2-4ca6-8dc7-f7f4b08ac6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439f69034d6c45e3baea4c6c3370a809, user_id=4f6c660b5b614fb89aeef8036fbe1ec0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.127728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e750f-ddf2-4ca6-8dc7-f7f4b08ac6f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.132467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2624/5262] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:39 2022] POST /identity/v3/projects => generated 408 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:40.137187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.159326 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2639/5263] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:39 2022] PUT /identity/v3/projects/439f69034d6c45e3baea4c6c3370a809/users/4f6c660b5b614fb89aeef8036fbe1ec0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:40.170916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.171221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.171669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.217034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] MFA Rules not processed for user `4f6c660b5b614fb89aeef8036fbe1ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:40.218056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:40.234653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c601027-9a1b-4ada-b9df-b0da798130d0 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.327383 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2640/5264] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:40.332539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.348174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.348993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.349289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.349573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.350376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.354008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.399520 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2625/5265] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:40 2022] POST /identity/v3/users => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:40.399520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.410934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da057bc-f20b-4e5d-bbda-d24afcc3aa48 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.418838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.419517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.419856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.420137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.420959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.422646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.439936 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2626/5266] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:40.441119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.454260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe21e-22a0-4e5e-9d28-6404a60961a1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.460448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fdf93-c37f-438f-b458-a19298daf3ea tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.465263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.465955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.466659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.466949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.467665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.472014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.477431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50359-456f-4de0-8785-d49d0caeebbf tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.479000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50359-456f-4de0-8785-d49d0caeebbf tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.479291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50359-456f-4de0-8785-d49d0caeebbf tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.479577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50359-456f-4de0-8785-d49d0caeebbf tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/projects/bbc1a85feb9d41fc9ca637db8a006ee2/users/ff4c3ac362bc463e81438f022956dd5e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.498029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50359-456f-4de0-8785-d49d0caeebbf tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bbc1a85feb9d41fc9ca637db8a006ee2, user_id=ff4c3ac362bc463e81438f022956dd5e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.499644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50359-456f-4de0-8785-d49d0caeebbf tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.513810 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2641/5267] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:40 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:40.519357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.540210 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2627/5268] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:40 2022] PUT /identity/v3/projects/bbc1a85feb9d41fc9ca637db8a006ee2/users/ff4c3ac362bc463e81438f022956dd5e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:40.544863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b515-85ee-4a1c-bd70-fdce7f63a4a2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.545159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b515-85ee-4a1c-bd70-fdce7f63a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.545436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b515-85ee-4a1c-bd70-fdce7f63a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.587620 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:40.649311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3233-7e4c-4d7b-a933-0a34dcc10d5c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.659664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.660355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.661106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.661535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.662233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.664853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.678449 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:40.717816 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2642/5269] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:40 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:40.718566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-99e1b515-85ee-4a1c-bd70-fdce7f63a4a2 None None] MFA Rules not processed for user `ff4c3ac362bc463e81438f022956dd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:40.719484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.719907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-99e1b515-85ee-4a1c-bd70-fdce7f63a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:40.734409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03074f-aa79-4133-ad40-705d6f88f558 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.739701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.740492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.740881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.741262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.742101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.743874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.754655 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2628/5270] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3348 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:40.756764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.757087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.757372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.758709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2643/5271] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:40.763697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.776971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85c1e-a391-403c-87b7-e39547b6ec85 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.782974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:40.784832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:40.785589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:40.789993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] PATH_INFO: `/v3/projects/e5378789b1a242558a8a94bc87d9f238/users/773968564c4941909f04c4f19063ab6b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:40.792298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] MFA Rules not processed for user `ff4c3ac362bc463e81438f022956dd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:40.794743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:40.816311 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2629/5272] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3348 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:40.819046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:40.823564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5378789b1a242558a8a94bc87d9f238, user_id=773968564c4941909f04c4f19063ab6b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:40.827288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:40.839616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33a03-4d83-4748-ace1-9787269b062d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:40.878882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2644/5273] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:40 2022] PUT /identity/v3/projects/e5378789b1a242558a8a94bc87d9f238/users/773968564c4941909f04c4f19063ab6b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:40.883614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.006748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c3ac362bc463e81438f022956dd5e', 'user_domain_id': '17cadfe98eec4c638010e2b66f5a4526', 'system_scope': None, 'project_id': 'bbc1a85feb9d41fc9ca637db8a006ee2', 'project_domain_id': '17cadfe98eec4c638010e2b66f5a4526', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.007645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.007827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.008391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.028018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:41.031486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:41.034438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb470-f786-43d9-9bc8-d09279888ae1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.052421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.053153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.053450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.053759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.059142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:41.060163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2630/5274] 10.222.0.77 () {56 vars in 1283 bytes} [Mon Jul 11 15:07:40 2022] GET /identity/v3/auth/tokens => generated 3348 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:41.061120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:41.064442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.091976 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2645/5275] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:41.096333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.140411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ae2d8-47d9-422c-bf55-e4e31b4150eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.162986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192e4b-594d-4d0d-af6b-e84865f38aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.164041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192e4b-594d-4d0d-af6b-e84865f38aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.164629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192e4b-594d-4d0d-af6b-e84865f38aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.165132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192e4b-594d-4d0d-af6b-e84865f38aea admin admin] PATH_INFO: `/v3/projects/e5378789b1a242558a8a94bc87d9f238/users/773968564c4941909f04c4f19063ab6b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.170192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192e4b-594d-4d0d-af6b-e84865f38aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5378789b1a242558a8a94bc87d9f238, user_id=773968564c4941909f04c4f19063ab6b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:41.184609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192e4b-594d-4d0d-af6b-e84865f38aea admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:41.217995 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2646/5276] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:41 2022] PUT /identity/v3/projects/e5378789b1a242558a8a94bc87d9f238/users/773968564c4941909f04c4f19063ab6b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:41.229097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.229532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163c6cc-5514-4d12-b127-8ae96f7985af tempest-test_project-19776154 tempest-user-890597351] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.229642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.230000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.350623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] MFA Rules not processed for user `773968564c4941909f04c4f19063ab6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:41.353911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:41.361511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.362868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.363154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.363431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/users/ff4c3ac362bc463e81438f022956dd5e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.364911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ff4c3ac362bc463e81438f022956dd5e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:41.367789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:41.370855 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:41.500781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4c3ac362bc463e81438f022956dd5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:41.506940 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:41.552290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4c3ac362bc463e81438f022956dd5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:41.556116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2647/5277] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:41.562410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.565591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4c3ac362bc463e81438f022956dd5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:41.582784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4c3ac362bc463e81438f022956dd5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:41.583579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4c3ac362bc463e81438f022956dd5e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:41.583835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491f3c3-a072-4fc1-bae3-194d25155249 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.593105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2631/5278] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:41 2022] DELETE /identity/v3/users/ff4c3ac362bc463e81438f022956dd5e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:41.594948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.595980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.596440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.596730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.597545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:41.598760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.599525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:41.604108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:41.693743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2648/5279] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:41 2022] POST /identity/v3/projects => generated 360 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:41.695974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.699325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:41.874834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2623b-8311-4aff-ac9a-1a1e6e2c4408 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.883973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.884475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41010068-5e62-4adf-877b-bc1f0314c061 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.885388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.885940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.886386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.887560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:41.890234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:41.941892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2649/5280] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:41 2022] POST /identity/v3/users => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:41.948138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:41.977981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4544085-559f-41ca-abb9-c81e46f51484 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:41.994842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:41.995682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:41.996045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:41.996594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:41.997697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:41.998124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.000850 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:07:42.000850 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:07:42.000850 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:07:42.003043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.032002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.032998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.033364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.033726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/projects/bbc1a85feb9d41fc9ca637db8a006ee2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.036181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbc1a85feb9d41fc9ca637db8a006ee2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.041889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.079755 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2650/5281] 10.222.0.77 () {58 vars in 1156 bytes} [Mon Jul 11 15:07:41 2022] GET /identity/v3/users?domain_id=default => generated 8563 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:42.089084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:42.112547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2bc5-67db-4716-ae2d-473a7584ce82 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:42.118944 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:42.125466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.126763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.127067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.127356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/users/ebf447c183d4467dae2f4c8233c13ae1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.146544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc1a85feb9d41fc9ca637db8a006ee2', 'request_id': 'req-9019bb7b-a539-437f-b306-41cdfa77ee97'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.152019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:update_user(user_id=ebf447c183d4467dae2f4c8233c13ae1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.153587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc1a85feb9d41fc9ca637db8a006ee2', 'request_id': 'req-9019bb7b-a539-437f-b306-41cdfa77ee97'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.161077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.168397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc1a85feb9d41fc9ca637db8a006ee2', 'request_id': 'req-9019bb7b-a539-437f-b306-41cdfa77ee97'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.189923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] The token cache is being invalidate because project bbc1a85feb9d41fc9ca637db8a006ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:42.190218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.190922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.192791 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2632/5282] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:41 2022] DELETE /identity/v3/projects/bbc1a85feb9d41fc9ca637db8a006ee2 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:42.198327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:42.201557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:42.228966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ebf447c183d4467dae2f4c8233c13ae1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.239781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invalidating the token cache because user ebf447c183d4467dae2f4c8233c13ae1 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:42.240071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.240816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bcbc17e4-93fd-4d20-b105-5d336b6432e7 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.248708 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2651/5283] 10.222.0.77 () {60 vars in 1243 bytes} [Mon Jul 11 15:07:42 2022] PATCH /identity/v3/users/ebf447c183d4467dae2f4c8233c13ae1 => generated 482 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:42.248708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.248708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.248708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.282178 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.auth.plugins.core [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] User is disabled: ebf447c183d4467dae2f4c8233c13ae1: AssertionError: User is disabled: ebf447c183d4467dae2f4c8233c13ae1 Jul 11 15:07:42.294368 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.application [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.77: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 11 15:07:42.296775 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2652/5284] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 50 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 11 15:07:42.302877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:42.305523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:42.344697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bb7b-a539-437f-b306-41cdfa77ee97 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:42.349843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.350819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.351105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.351381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/domains/17cadfe98eec4c638010e2b66f5a4526` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.352878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=17cadfe98eec4c638010e2b66f5a4526)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.354651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.379449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.380336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.402082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507bc16-85c0-4cb7-b42a-95e61d14d5b2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:42.417144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.418062 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:42.418708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.421828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2633/5285] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:42 2022] PATCH /identity/v3/domains/17cadfe98eec4c638010e2b66f5a4526 => generated 246 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:42.427563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:42.429434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:42.503291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.505164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.505680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.506908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/users/ebf447c183d4467dae2f4c8233c13ae1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.539643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737a82-5641-422d-bb8d-5a8a30a7afc6 tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:42.539823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ebf447c183d4467dae2f4c8233c13ae1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.542037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.545407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcee01561c1149a6aa892c7d1dd9057e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fa814d6ca824ee8819cf129dce4d86c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.546282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.546610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.546937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] PATH_INFO: `/v3/domains/17cadfe98eec4c638010e2b66f5a4526` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.570374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=17cadfe98eec4c638010e2b66f5a4526)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.574080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.594180 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:42.613546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.622880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.640326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf447c183d4467dae2f4c8233c13ae1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.641299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf447c183d4467dae2f4c8233c13ae1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.660650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf447c183d4467dae2f4c8233c13ae1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.661908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf447c183d4467dae2f4c8233c13ae1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.672119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf447c183d4467dae2f4c8233c13ae1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.689225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526', 'request_id': 'req-50c37b8e-f399-4534-a947-3cb64a23ad1a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.694125 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2653/5286] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:42 2022] DELETE /identity/v3/users/ebf447c183d4467dae2f4c8233c13ae1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:42.698852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:42.699724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526', 'request_id': 'req-50c37b8e-f399-4534-a947-3cb64a23ad1a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.701008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:42.711095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526', 'request_id': 'req-50c37b8e-f399-4534-a947-3cb64a23ad1a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.726629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] The token cache is being invalidate because project 17cadfe98eec4c638010e2b66f5a4526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:42.727058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.727751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.738144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526', 'request_id': 'req-50c37b8e-f399-4534-a947-3cb64a23ad1a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.741986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526', 'request_id': 'req-50c37b8e-f399-4534-a947-3cb64a23ad1a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.742770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '17cadfe98eec4c638010e2b66f5a4526', 'request_id': 'req-50c37b8e-f399-4534-a947-3cb64a23ad1a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:42.750226 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2634/5287] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:42 2022] DELETE /identity/v3/domains/17cadfe98eec4c638010e2b66f5a4526 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:42.756136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:42.757893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:42.793733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a73c7-2e58-4a8f-a9f7-2023d0088883 tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:42.798860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.799866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.800283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.800568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/projects/69681b2e35f64f65a3e3086723a6783c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.802029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69681b2e35f64f65a3e3086723a6783c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.804665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.848639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c37b8e-f399-4534-a947-3cb64a23ad1a tempest-TestDefaultProjectId-238463179 tempest-TestDefaultProjectId-238463179-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:42.938398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:42.940099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:42.940396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:42.940679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] PATH_INFO: `/v3/users/760cf3dbd1114fc79b99c4eea5a3862e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:42.941998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=760cf3dbd1114fc79b99c4eea5a3862e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:42.944122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:42.952252 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:43.004812 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:43.032519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760cf3dbd1114fc79b99c4eea5a3862e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.049402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760cf3dbd1114fc79b99c4eea5a3862e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.058615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760cf3dbd1114fc79b99c4eea5a3862e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.070111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760cf3dbd1114fc79b99c4eea5a3862e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.071104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3b2cfca-b076-4742-804e-9e8874baf84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760cf3dbd1114fc79b99c4eea5a3862e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.074828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69681b2e35f64f65a3e3086723a6783c', 'request_id': 'req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.083710 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2635/5288] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:42 2022] DELETE /identity/v3/users/760cf3dbd1114fc79b99c4eea5a3862e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:43.090381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.090850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.091135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.095314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69681b2e35f64f65a3e3086723a6783c', 'request_id': 'req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.103146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69681b2e35f64f65a3e3086723a6783c', 'request_id': 'req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.155361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] The token cache is being invalidate because project 69681b2e35f64f65a3e3086723a6783c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:43.155664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.161768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:43.163343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.165856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:43.166473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2654/5289] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:42 2022] DELETE /identity/v3/projects/69681b2e35f64f65a3e3086723a6783c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:43.174759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:43.190179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:43.310335 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2636/5290] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:43.333768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:43.336069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:43.341533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a1501-bbd5-4b50-b0e9-264d96c5a71f tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:43.455827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71d9c-cf0e-4a14-bdfe-9a648adda270 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:43.456985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773968564c4941909f04c4f19063ab6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5378789b1a242558a8a94bc87d9f238', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:43.457655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.457951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.458258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.458982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:43.463823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:43.466061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32163954-72a5-49e6-affb-867328dd63cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:43.467217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163954-72a5-49e6-affb-867328dd63cf service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.467828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163954-72a5-49e6-affb-867328dd63cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.468221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163954-72a5-49e6-affb-867328dd63cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Could not find domain: 686fbe4acd4d4f1a804dbf5178666420.: keystone.exception.DomainNotFound: Could not find domain: 686fbe4acd4d4f1a804dbf5178666420. Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 686fbe4acd4d4f1a804dbf5178666420. Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:43.478158 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 11 15:07:43.479588 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:43.480707 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:43.481997 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:43.481997 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 686fbe4acd4d4f1a804dbf5178666420. Jul 11 15:07:43.481997 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:43.483903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2655/5291] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:43 2022] POST /identity/v3/users => generated 112 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:43.488464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32163954-72a5-49e6-affb-867328dd63cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:43.489531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:43.490782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32163954-72a5-49e6-affb-867328dd63cf service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:43.494669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:43.515035 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2637/5292] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:43.523459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88c98-abd0-4c67-bea2-b931fc554b1d tempest-UsersNegativeTest-941819631 tempest-UsersNegativeTest-941819631-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:43.530087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:43.531590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.532075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.532380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] PATH_INFO: `/v3/users/4f6c660b5b614fb89aeef8036fbe1ec0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.533835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6c660b5b614fb89aeef8036fbe1ec0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:43.537243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:43.615653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6c660b5b614fb89aeef8036fbe1ec0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.616981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6c660b5b614fb89aeef8036fbe1ec0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.625082 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:43.640853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6c660b5b614fb89aeef8036fbe1ec0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.642512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6c660b5b614fb89aeef8036fbe1ec0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.653596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6c660b5b614fb89aeef8036fbe1ec0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:43.688791 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2656/5293] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:43 2022] DELETE /identity/v3/users/4f6c660b5b614fb89aeef8036fbe1ec0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:43.693952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.694967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.695418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.717847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:43.719387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:43.751533 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:43.816678 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2638/5294] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:43.840675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:43.842127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:43.933523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0614d-3d19-4b42-b7e5-c1c130364bfe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:43.943773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:43.944608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:43.944881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:43.945227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:43.970546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:43.972133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:43.990849 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2657/5295] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:44.221291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:44.222880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:44.251303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc47d5-dd3f-4d7b-8085-2bc96ab8f47a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:44.255857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:44.256790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:44.257083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:44.257366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] PATH_INFO: `/v3/projects/dbb26bc07cab4e8880fccab12f739d13` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:44.258797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb26bc07cab4e8880fccab12f739d13)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:44.260772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:44.372480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb26bc07cab4e8880fccab12f739d13', 'request_id': 'req-5196dc7f-523c-4239-923a-ce898e2662a7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.414689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb26bc07cab4e8880fccab12f739d13', 'request_id': 'req-5196dc7f-523c-4239-923a-ce898e2662a7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.437742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb26bc07cab4e8880fccab12f739d13', 'request_id': 'req-5196dc7f-523c-4239-923a-ce898e2662a7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.463282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] The token cache is being invalidate because project dbb26bc07cab4e8880fccab12f739d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:44.463825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.465316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.479996 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2639/5296] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:44 2022] DELETE /identity/v3/projects/dbb26bc07cab4e8880fccab12f739d13 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:44.481192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:44.500728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5181c8-4b44-467c-a508-4032398c2267 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:44.637765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:44.640040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:44.659388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:44.661701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:44.662286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:44.662985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] PATH_INFO: `/v3/users/fcee01561c1149a6aa892c7d1dd9057e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:44.675760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcee01561c1149a6aa892c7d1dd9057e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:44.677785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:44.780947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcee01561c1149a6aa892c7d1dd9057e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.781834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcee01561c1149a6aa892c7d1dd9057e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.800039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcee01561c1149a6aa892c7d1dd9057e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.802278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcee01561c1149a6aa892c7d1dd9057e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.813068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcee01561c1149a6aa892c7d1dd9057e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:44.815095 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:44.823742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196dc7f-523c-4239-923a-ce898e2662a7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:44.837652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:44.838564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:44.838855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:44.839139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] PATH_INFO: `/v3/projects/439f69034d6c45e3baea4c6c3370a809` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:44.840394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439f69034d6c45e3baea4c6c3370a809)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:44.842340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:44.845447 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2658/5297] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:44 2022] DELETE /identity/v3/users/fcee01561c1149a6aa892c7d1dd9057e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:44.985943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439f69034d6c45e3baea4c6c3370a809', 'request_id': 'req-2e0b2962-539b-4f08-865d-628111bc6720'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.005756 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:45.011179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439f69034d6c45e3baea4c6c3370a809', 'request_id': 'req-2e0b2962-539b-4f08-865d-628111bc6720'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.025186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439f69034d6c45e3baea4c6c3370a809', 'request_id': 'req-2e0b2962-539b-4f08-865d-628111bc6720'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.053961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] The token cache is being invalidate because project 439f69034d6c45e3baea4c6c3370a809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:45.054257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.055191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.060883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2640/5298] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:44 2022] DELETE /identity/v3/projects/439f69034d6c45e3baea4c6c3370a809 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:45.062170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:45.063901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:45.157608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbdf10-676f-4751-aaa6-d0a45c246e7e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:45.274471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:45.274471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.274471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.274471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] PATH_INFO: `/v3/users/773968564c4941909f04c4f19063ab6b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.274954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773968564c4941909f04c4f19063ab6b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:45.276569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:45.333409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773968564c4941909f04c4f19063ab6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.334450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773968564c4941909f04c4f19063ab6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.348738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773968564c4941909f04c4f19063ab6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.349680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773968564c4941909f04c4f19063ab6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.358096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bc2ff11f-7d1c-40c5-8929-6e94c7e140b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773968564c4941909f04c4f19063ab6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.383140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2659/5299] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:45 2022] DELETE /identity/v3/users/773968564c4941909f04c4f19063ab6b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:45.434570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:45.436620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:45.451241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b2962-539b-4f08-865d-628111bc6720 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:45.544983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:45.546056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.546439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.546825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] PATH_INFO: `/v3/projects/1fa814d6ca824ee8819cf129dce4d86c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.548257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa814d6ca824ee8819cf129dce4d86c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:45.550935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:45.613432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa814d6ca824ee8819cf129dce4d86c', 'request_id': 'req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.621070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa814d6ca824ee8819cf129dce4d86c', 'request_id': 'req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.633326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa814d6ca824ee8819cf129dce4d86c', 'request_id': 'req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.677260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] The token cache is being invalidate because project 1fa814d6ca824ee8819cf129dce4d86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:45.678052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.680472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.682312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2641/5300] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:45 2022] DELETE /identity/v3/projects/1fa814d6ca824ee8819cf129dce4d86c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:45.688384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b097-a07b-4f9c-90c1-a601d01353a1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.689363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b097-a07b-4f9c-90c1-a601d01353a1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.689872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b097-a07b-4f9c-90c1-a601d01353a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.722018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-49e9b097-a07b-4f9c-90c1-a601d01353a1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:45.723827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-49e9b097-a07b-4f9c-90c1-a601d01353a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:45.741959 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:45.830656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:45.831592 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2660/5301] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:45.832756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:45.839574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.839850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.840123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.864328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5596-bf59-4c94-8e99-cd63b56c34bc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:45.868429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:45.869679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:45.875446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:45.876312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.876605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.877331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] PATH_INFO: `/v3/projects/e5378789b1a242558a8a94bc87d9f238` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.879871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5378789b1a242558a8a94bc87d9f238)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:45.879999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:45.893686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2661/5302] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:45.902364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:45.938655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2398-14d3-434f-9246-c58d16de6771 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:45.952765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:45.953631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:45.954393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:45.954709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:45.955508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:45.955824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:45.957580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:45.971757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5378789b1a242558a8a94bc87d9f238', 'request_id': 'req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.977820 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2662/5303] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:45.978473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5378789b1a242558a8a94bc87d9f238', 'request_id': 'req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:45.979003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:45.993873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5378789b1a242558a8a94bc87d9f238', 'request_id': 'req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:46.001574 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:46.001672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2be35-c74c-4d14-9196-9efb46af2976 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.042646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] The token cache is being invalidate because project e5378789b1a242558a8a94bc87d9f238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:46.043433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:46.050447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73ac5960-d2a6-4b7f-ac80-a207abb36cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:46.054395 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2642/5304] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:45 2022] DELETE /identity/v3/projects/e5378789b1a242558a8a94bc87d9f238 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:46.062131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.062541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.062922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.095738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:46.098351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:46.136739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134642a8-d4f6-4d15-b221-45e4d3a52416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.137537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134642a8-d4f6-4d15-b221-45e4d3a52416 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.138073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134642a8-d4f6-4d15-b221-45e4d3a52416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.138459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134642a8-d4f6-4d15-b221-45e4d3a52416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.139261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134642a8-d4f6-4d15-b221-45e4d3a52416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.143902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134642a8-d4f6-4d15-b221-45e4d3a52416 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.191894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2643/5305] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:46.200036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2663/5306] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:45 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:46.202445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.203297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.203297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.203297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.205388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:46.237419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:46.239147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:46.250790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7403cbb-c568-4ced-9d38-53f3257439bd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.408559 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2664/5307] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:46.418873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.440085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.440774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.441063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.441348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.442316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.445607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.445957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a6ca-fe57-4401-86c4-55b34fb3eef8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.459716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.460729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.461175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.461612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.462710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:46.463180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.465748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.489835 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2644/5308] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:46.491167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.493113 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2665/5309] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:46.494538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.514288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eaa53-5c79-424b-a024-4320abbefc9b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.519728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a84a-3045-4629-9897-24686dad84ff admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.521403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.522137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.522472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.522832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.523695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.526126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.534913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.535782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.536073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.536356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.537217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.539183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.551850 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2645/5310] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:46.555498 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:46.556900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.572540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd70f-de43-400f-acd6-2a50ba300672 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.578407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.579126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.579416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.579744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.580528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.582146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.594124 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2646/5311] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:46.597996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.600869 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2666/5312] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:46.605335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.621287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68598-94bc-4411-a45f-b72fddaefeaf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.732665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433626aa-8ccc-4d10-91b8-9f7a46a2ae8c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.739759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.741434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.741946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.742391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.743591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.746626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.747965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330df8a-84a1-400c-87a5-646eab50a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.749260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330df8a-84a1-400c-87a5-646eab50a405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.750550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330df8a-84a1-400c-87a5-646eab50a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.750836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330df8a-84a1-400c-87a5-646eab50a405 admin admin] PATH_INFO: `/v3/projects/784c2b005275491980c76f7597f35ff9/users/08497248eace43ecb6c1aa5f249acaa3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.767304 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:46.779682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330df8a-84a1-400c-87a5-646eab50a405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784c2b005275491980c76f7597f35ff9, user_id=08497248eace43ecb6c1aa5f249acaa3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.782586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330df8a-84a1-400c-87a5-646eab50a405 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.798712 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2667/5313] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:46.802549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.816409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2647/5314] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:46 2022] PUT /identity/v3/projects/784c2b005275491980c76f7597f35ff9/users/08497248eace43ecb6c1aa5f249acaa3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:46.826839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfef0d1-9768-4460-a20f-811d9d0360c6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.827560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.827850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.828185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.880876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] MFA Rules not processed for user `08497248eace43ecb6c1aa5f249acaa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:46.882120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:46.928249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.928933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.929217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.929492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.930223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.932505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.947316 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2668/5315] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:46.949843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.964505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f310-ea6c-42ca-99ae-240829acc842 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:46.970213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:46.971204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:46.971706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:46.972328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:46.973517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:46.975619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:46.993142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2648/5316] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:46.993344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2669/5317] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:46.993615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:46.994857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.008318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159fa5-42c8-412c-b6a8-9653c2a5f290 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.009013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa8dc2-0137-4abc-bdaa-43fce0dfc1d7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.014961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.015887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.016277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.016441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703401f-63b5-470d-9600-5c8a204ba93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.016746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.017487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703401f-63b5-470d-9600-5c8a204ba93a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.017696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.017824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703401f-63b5-470d-9600-5c8a204ba93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.018079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703401f-63b5-470d-9600-5c8a204ba93a admin admin] PATH_INFO: `/v3/projects/43b9dc2369a7467d90ec4a43426fcf23/users/514d7d72009043a49c115ec380c13753/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.020365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.067564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703401f-63b5-470d-9600-5c8a204ba93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b9dc2369a7467d90ec4a43426fcf23, user_id=514d7d72009043a49c115ec380c13753, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.068813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2670/5318] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:46 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:47.070252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703401f-63b5-470d-9600-5c8a204ba93a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.074805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.117333 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2649/5319] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:46 2022] PUT /identity/v3/projects/43b9dc2369a7467d90ec4a43426fcf23/users/514d7d72009043a49c115ec380c13753/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:47.120068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.120364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.120646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.161004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] MFA Rules not processed for user `514d7d72009043a49c115ec380c13753`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:47.163779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:47.171753 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:47.222366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd390af1-0f96-4102-ace0-0002d9e2f69b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.315877 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2650/5320] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:47.330076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.330672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.331466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.331590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:47.331934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.332517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.333852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.338011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.366090 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2671/5321] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:47 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:47.369371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.380494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8614fb-3564-49d7-8d93-8c7f6da6c67d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.386739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.387717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.388010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.388297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.389122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.391393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.396357 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:47.410973 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2672/5322] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:07:47.415438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.426687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100b8c-31e3-44fe-a422-8cc4029b5f2c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.431791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.432690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.432976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.433257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] PATH_INFO: `/v3/projects/a9b0d36933674075ad8760cbfbac01c5/users/c7badaacecf1430fa1106849f3f0b84a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.455984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b0d36933674075ad8760cbfbac01c5, user_id=c7badaacecf1430fa1106849f3f0b84a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.459481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.464874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ce9f6-e49a-4f17-bf5e-8070365c64ec None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.471312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.472234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.472670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.473084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.478275 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2673/5323] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:47 2022] PUT /identity/v3/projects/a9b0d36933674075ad8760cbfbac01c5/users/c7badaacecf1430fa1106849f3f0b84a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:47.483559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.486819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.507974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.538606 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2651/5324] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:07:47.596195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463e7f-84a8-4050-a8b0-5a660937fc45 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.603729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58328f-d48f-4831-9b96-3718bc5be6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.604704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58328f-d48f-4831-9b96-3718bc5be6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.605173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58328f-d48f-4831-9b96-3718bc5be6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.605608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58328f-d48f-4831-9b96-3718bc5be6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.606528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58328f-d48f-4831-9b96-3718bc5be6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.608280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58328f-d48f-4831-9b96-3718bc5be6aa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.620639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2674/5325] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:47.625159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.653697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff0ee-f6c9-4f7e-987a-118e36464c1b service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.666089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.667540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.668864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.669507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] PATH_INFO: `/v3/projects/a9b0d36933674075ad8760cbfbac01c5/users/c7badaacecf1430fa1106849f3f0b84a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.676955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b0d36933674075ad8760cbfbac01c5, user_id=c7badaacecf1430fa1106849f3f0b84a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.684145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.719870 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2652/5326] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:47 2022] PUT /identity/v3/projects/a9b0d36933674075ad8760cbfbac01c5/users/c7badaacecf1430fa1106849f3f0b84a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:47.723328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.723697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.724043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.786386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] MFA Rules not processed for user `c7badaacecf1430fa1106849f3f0b84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:47.787933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:47.843234 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:47.889869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.927570 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2675/5327] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:47.927570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.944062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f9f51-0fdb-4cd5-a975-1a7e0fe0d1d0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:47.949011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:47.950100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:47.950729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:47.951111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:47.952087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:47.953919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:47.976339 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2676/5328] 10.222.0.77 () {60 vars in 1149 bytes} [Mon Jul 11 15:07:47 2022] POST /identity/v3/domains => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:47.976339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:47.977763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:47.998029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952bf3-daf3-4666-be2d-3cf6b1e23816 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:48.066239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d928-fef1-4c85-a839-50dab0aa9bf4 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:48.070859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:48.072362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.072362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.073152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] PATH_INFO: `/v3/users/dbb9bf058d4c40bc9c46ca9c7d2b2e35` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.074465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb9bf058d4c40bc9c46ca9c7d2b2e35)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:48.076921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:48.094357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:48.095445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.095737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.096018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] PATH_INFO: `/v3/users/514d7d72009043a49c115ec380c13753` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.097481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514d7d72009043a49c115ec380c13753)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:48.101136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:48.137863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb9bf058d4c40bc9c46ca9c7d2b2e35'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.139448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb9bf058d4c40bc9c46ca9c7d2b2e35'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.165965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb9bf058d4c40bc9c46ca9c7d2b2e35'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.167097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb9bf058d4c40bc9c46ca9c7d2b2e35'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.171441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514d7d72009043a49c115ec380c13753'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.175386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb9bf058d4c40bc9c46ca9c7d2b2e35'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.186479 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:48.189198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514d7d72009043a49c115ec380c13753'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.199505 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2677/5329] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:47 2022] DELETE /identity/v3/users/dbb9bf058d4c40bc9c46ca9c7d2b2e35 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:48.200641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514d7d72009043a49c115ec380c13753'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.204830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:48.207622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:48.214291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514d7d72009043a49c115ec380c13753'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.216622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3200c4a9-8404-42bf-a60f-56c56318ae00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514d7d72009043a49c115ec380c13753'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:48.226606 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2653/5330] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:47 2022] DELETE /identity/v3/users/514d7d72009043a49c115ec380c13753 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:48.231096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a7753-48a7-49f7-8204-36476e78f135 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.231379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a7753-48a7-49f7-8204-36476e78f135 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.232720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a7753-48a7-49f7-8204-36476e78f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.269685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b19a7753-48a7-49f7-8204-36476e78f135 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:48.271185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b19a7753-48a7-49f7-8204-36476e78f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:48.278061 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:48.318370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725af2c-c8d0-49d6-a6cc-9a2b2e2fdede admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:48.389876 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2654/5331] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:48.391340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380182-86ce-414f-9279-21bedae77560 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.391698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380182-86ce-414f-9279-21bedae77560 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.392055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380182-86ce-414f-9279-21bedae77560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.432890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:48.433579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.433877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.434165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.434950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:48.437724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-94380182-86ce-414f-9279-21bedae77560 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:48.439403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94380182-86ce-414f-9279-21bedae77560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:48.453962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:48.454716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2655/5332] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:48.456158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380182-86ce-414f-9279-21bedae77560 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:48.457751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94380182-86ce-414f-9279-21bedae77560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:48.484206 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2678/5333] 10.222.0.77 () {60 vars in 1149 bytes} [Mon Jul 11 15:07:48 2022] POST /identity/v3/domains => generated 276 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:48.485073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:48.494141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:48.552610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380182-86ce-414f-9279-21bedae77560 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:48.620306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:48.621362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.621983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.622544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.672755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a179-9b8e-4562-8c15-1b42df3d5c1c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:48.673586 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:48.685873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:48.687838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.688174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.688698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.711505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:48.713793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:48.741477 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2656/5334] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:48.742903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:48.747103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:48.835388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:48.837130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:48.865782 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2679/5335] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:48.907181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae9fe0-c863-4190-8e91-e24f86265098 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:48.921537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:48.922387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:48.922810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:48.923197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:48.924192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:48.926063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:48.960016 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2657/5336] 10.222.0.77 () {60 vars in 1149 bytes} [Mon Jul 11 15:07:48 2022] POST /identity/v3/domains => generated 277 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:48.964821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:48.981793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9f5d-ea29-48e8-a70a-8084a6f9eceb service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:49.028270 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:49.121909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:49.122811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:49.123113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:49.123399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:49.124810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:49.126428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:49.151023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2680/5337] 10.222.0.77 () {60 vars in 1149 bytes} [Mon Jul 11 15:07:48 2022] POST /identity/v3/domains => generated 279 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:49.151943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:49.175769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06111b57-9366-4d81-afec-44ffe1131758 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:49.298844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:49.299821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:49.300180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:49.300668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/e05f8c4913834b94b5c030715fdc2d8f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:49.318053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e05f8c4913834b94b5c030715fdc2d8f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:49.320147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:49.343571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:49.351837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:49.379508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.383903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.476747 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:49.488291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f', 'request_id': 'req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.502024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f', 'request_id': 'req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.519832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f', 'request_id': 'req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.539462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project e05f8c4913834b94b5c030715fdc2d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:49.539755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.541518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.557780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c02eb0-d648-41e3-aca8-bd69ac9d95ba tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:49.563243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f', 'request_id': 'req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.574866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f', 'request_id': 'req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.575465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e05f8c4913834b94b5c030715fdc2d8f', 'request_id': 'req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.582327 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2658/5338] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:49 2022] DELETE /identity/v3/domains/e05f8c4913834b94b5c030715fdc2d8f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:07:49.587547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:49.589069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:49.693054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:49.693938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:49.694273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:49.694778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] PATH_INFO: `/v3/projects/5354e1cd4f8c4633a78cd6fd1879fdb6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:49.696158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5354e1cd4f8c4633a78cd6fd1879fdb6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:49.699161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:49.705657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9a55d-fbf9-400f-b204-f6dc77f589c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:49.711902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:49.712852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:49.713423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:49.713711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:49.714464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:49.716849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:49.741000 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2659/5339] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:49 2022] POST /identity/v3/domains => generated 249 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:07:49.743190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:49.746257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:49.769346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5354e1cd4f8c4633a78cd6fd1879fdb6', 'request_id': 'req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.778885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5354e1cd4f8c4633a78cd6fd1879fdb6', 'request_id': 'req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.788575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5354e1cd4f8c4633a78cd6fd1879fdb6', 'request_id': 'req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.790026 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:49.803540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] The token cache is being invalidate because project 5354e1cd4f8c4633a78cd6fd1879fdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:49.805020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.806683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.813357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2681/5340] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:49 2022] DELETE /identity/v3/projects/5354e1cd4f8c4633a78cd6fd1879fdb6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:49.814594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:49.816216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:49.837896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8497-667c-46ec-875d-4e00588cf889 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:49.892794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4bd4-c2ba-464f-ad57-19694cce9f73 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:49.899394 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:49.900360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:49.901416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:49.901746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:49.902104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/3222658292f345609799f9a6dd7371ba` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:49.918080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:49.918307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3222658292f345609799f9a6dd7371ba)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:49.919557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:49.920068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:49.920485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:49.920787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] PATH_INFO: `/v3/projects/43b9dc2369a7467d90ec4a43426fcf23` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:49.922271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b9dc2369a7467d90ec4a43426fcf23)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:49.925629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:49.955486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3222658292f345609799f9a6dd7371ba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:49.958175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3222658292f345609799f9a6dd7371ba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.000639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3222658292f345609799f9a6dd7371ba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.001347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0df6bd0f-dc0a-483b-98ce-8025617fa54e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3222658292f345609799f9a6dd7371ba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.007456 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2682/5341] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:49 2022] PATCH /identity/v3/domains/3222658292f345609799f9a6dd7371ba => generated 250 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:50.007456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e43b1-11a3-4181-aaa5-2dfa9b7d25ff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.007456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e43b1-11a3-4181-aaa5-2dfa9b7d25ff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.008382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e43b1-11a3-4181-aaa5-2dfa9b7d25ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.019041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b9dc2369a7467d90ec4a43426fcf23', 'request_id': 'req-1d500a96-ba5f-43a8-92de-35ff765ec0bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.030405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b9dc2369a7467d90ec4a43426fcf23', 'request_id': 'req-1d500a96-ba5f-43a8-92de-35ff765ec0bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.036829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-737e43b1-11a3-4181-aaa5-2dfa9b7d25ff None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:50.038244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-737e43b1-11a3-4181-aaa5-2dfa9b7d25ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.056043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b9dc2369a7467d90ec4a43426fcf23', 'request_id': 'req-1d500a96-ba5f-43a8-92de-35ff765ec0bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.081525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] The token cache is being invalidate because project 43b9dc2369a7467d90ec4a43426fcf23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:50.081902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.082754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.086740 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2660/5342] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:49 2022] DELETE /identity/v3/projects/43b9dc2369a7467d90ec4a43426fcf23 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:50.088572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:50.093050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.153932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2683/5343] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:50.155639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc26be-e7df-487f-a431-d78a9d24889b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.158873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc26be-e7df-487f-a431-d78a9d24889b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.159377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc26be-e7df-487f-a431-d78a9d24889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.184866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d1bc26be-e7df-487f-a431-d78a9d24889b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:50.186953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d1bc26be-e7df-487f-a431-d78a9d24889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.197060 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2684/5344] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:50.198756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9dc5-ac48-416a-994f-d7d56c658670 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.199588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9dc5-ac48-416a-994f-d7d56c658670 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.199885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9dc5-ac48-416a-994f-d7d56c658670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.240413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d500a96-ba5f-43a8-92de-35ff765ec0bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:50.249771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:50.250871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.250980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.251261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/3222658292f345609799f9a6dd7371ba` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.266538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3222658292f345609799f9a6dd7371ba)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:50.267020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c97a9dc5-ac48-416a-994f-d7d56c658670 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:50.268172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:50.268417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c97a9dc5-ac48-416a-994f-d7d56c658670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.281023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2685/5345] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:50.281023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.281023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.281023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.306097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3222658292f345609799f9a6dd7371ba'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.306485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:50.308062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.314462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3222658292f345609799f9a6dd7371ba'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.319475 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2686/5346] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:50.324689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:50.337175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14773-4961-4eb0-bfa7-d4ef833425b1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:50.349994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:50.350966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.351522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.353449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.354623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:50.355313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:50.357668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:50.374778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2687/5347] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:50.375368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:50.395314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e7532-d537-42c6-a2d5-e8e61e2c3ce2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:50.411110 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:50.426450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3222658292f345609799f9a6dd7371ba', 'request_id': 'req-13b7b591-39aa-4192-9012-35cb842332c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.428277 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:50.444425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3222658292f345609799f9a6dd7371ba', 'request_id': 'req-13b7b591-39aa-4192-9012-35cb842332c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.458214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3222658292f345609799f9a6dd7371ba', 'request_id': 'req-13b7b591-39aa-4192-9012-35cb842332c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.483006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project 3222658292f345609799f9a6dd7371ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:50.483006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.484585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.504569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3222658292f345609799f9a6dd7371ba', 'request_id': 'req-13b7b591-39aa-4192-9012-35cb842332c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.512177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3222658292f345609799f9a6dd7371ba', 'request_id': 'req-13b7b591-39aa-4192-9012-35cb842332c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.515409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3222658292f345609799f9a6dd7371ba', 'request_id': 'req-13b7b591-39aa-4192-9012-35cb842332c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:50.528923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2661/5348] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:50 2022] DELETE /identity/v3/domains/3222658292f345609799f9a6dd7371ba => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:50.529091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:50.539464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.562993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:50.563957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.564589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.566297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.567509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:50.569803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:50.574753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:50.605083 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2688/5349] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:50.606176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:50.609469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.710814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7b591-39aa-4192-9012-35cb842332c2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:50.724372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:50.725074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.725378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.725640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.727284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:50.729862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:50.781723 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2662/5350] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:50.784256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:50.788318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:50.791741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18551-3e80-4e9e-942b-2fa558b82819 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:50.953394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5250c54-cc47-4934-b800-79b99030ccc5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:50.967114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:50.968741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:50.970027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.970455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:50.970867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.971195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:50.971579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.971953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:50.972914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:50.973813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:50.978067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:50.979340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.031232 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2689/5351] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/domains => generated 277 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:51.032773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.045642 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2663/5352] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:50 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:51.047721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.113146 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:51.164319 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:51.170130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5abc4-f815-4a9a-b516-0e9962ddbe47 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.177250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.178469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.178835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.179650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/9b091190639d4fadb79c6075f740ae09` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.192273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f002-ec3f-483d-9485-3f2f6ce9e0e6 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.195774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9b091190639d4fadb79c6075f740ae09)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.199130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.232586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9b091190639d4fadb79c6075f740ae09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.234702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9b091190639d4fadb79c6075f740ae09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.291779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9b091190639d4fadb79c6075f740ae09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.292890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9b091190639d4fadb79c6075f740ae09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.294298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.295087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.295372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.295651 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2664/5353] 10.222.0.77 () {60 vars in 1249 bytes} [Mon Jul 11 15:07:51 2022] PATCH /identity/v3/domains/9b091190639d4fadb79c6075f740ae09 => generated 278 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:51.296369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.297130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.300479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.301809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.302178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:51.335882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2690/5354] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:51 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:51.336832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.339841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:51.355498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124207-1115-43e5-8073-6f31421615e2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.430773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036706b-7da1-41d4-bf75-de98b764d338 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.437721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.439767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.440206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.440621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.442158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.445331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.450375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.451703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.451842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.452128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/9b091190639d4fadb79c6075f740ae09` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.465768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=9b091190639d4fadb79c6075f740ae09)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.470650 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2665/5355] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:51 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:51.470789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.470903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.472157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:51.472909 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2691/5356] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:07:51 2022] GET /identity/v3/domains/9b091190639d4fadb79c6075f740ae09 => generated 278 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:51.473826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.487173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046095-60c5-497d-8f1e-aaad8d5aef38 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.488059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b82fd-3b63-489c-97fa-ac920ff6b20a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.494097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.494580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.494938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.495286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.496134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.497751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.497913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.499594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.500515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.500692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.501550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.510142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.513210 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2666/5357] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:51.514772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.527700 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2692/5358] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:51.527700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.540356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ecf6-21bb-4815-9ad6-5adcf2658275 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.545618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.546319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.547420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.547420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.547881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.548331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0429f-4cc0-4476-8e2d-d0290609a59e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.549522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.561901 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2693/5359] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:51.565072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.575755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.576476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b79a3-10bd-490a-849c-3f9e8b42c2aa admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.578005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.578746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.579193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/9b091190639d4fadb79c6075f740ae09` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.580875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9b091190639d4fadb79c6075f740ae09)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.582244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.582979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.583268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.583548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.584364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.585908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.586050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.598296 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2694/5360] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:51.599589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.613004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd1edc-f032-4f31-8be3-18e72fae3a2f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.618263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.619901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.620196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.620519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] PATH_INFO: `/v3/projects/d2759184fd444c76becf2613f83d2a6e/users/7ac2b6ba1679408ea2a1800bfd9eacd6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.622658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9b091190639d4fadb79c6075f740ae09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.628392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9b091190639d4fadb79c6075f740ae09'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.642710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2759184fd444c76becf2613f83d2a6e, user_id=7ac2b6ba1679408ea2a1800bfd9eacd6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.645714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.685165 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:51.685325 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2695/5361] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:51 2022] PUT /identity/v3/projects/d2759184fd444c76becf2613f83d2a6e/users/7ac2b6ba1679408ea2a1800bfd9eacd6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:51.694905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.698137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b091190639d4fadb79c6075f740ae09', 'request_id': 'req-36a0be06-cd4e-4944-8827-b0931a0190ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.706071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b091190639d4fadb79c6075f740ae09', 'request_id': 'req-36a0be06-cd4e-4944-8827-b0931a0190ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.714241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b091190639d4fadb79c6075f740ae09', 'request_id': 'req-36a0be06-cd4e-4944-8827-b0931a0190ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.733018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project 9b091190639d4fadb79c6075f740ae09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:51.733367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.733992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.737873 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:51.748976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9b091190639d4fadb79c6075f740ae09', 'request_id': 'req-36a0be06-cd4e-4944-8827-b0931a0190ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.752658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9b091190639d4fadb79c6075f740ae09', 'request_id': 'req-36a0be06-cd4e-4944-8827-b0931a0190ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.753381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-36a0be06-cd4e-4944-8827-b0931a0190ad tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9b091190639d4fadb79c6075f740ae09', 'request_id': 'req-36a0be06-cd4e-4944-8827-b0931a0190ad'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:51.760377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2667/5362] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:51 2022] DELETE /identity/v3/domains/9b091190639d4fadb79c6075f740ae09 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:51.762520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.763368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.763804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.781771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b8bfc-2b23-42eb-8640-9762bd6a875d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.798649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] MFA Rules not processed for user `7ac2b6ba1679408ea2a1800bfd9eacd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:51.800040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:51.854478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.855411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.855703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.855986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] PATH_INFO: `/v3/projects/f5184f337f0b40209016095d1b318d3c/users/4972abff957644dc97cb103a82b1b96b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.872052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2668/5363] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:51.872254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5184f337f0b40209016095d1b318d3c, user_id=4972abff957644dc97cb103a82b1b96b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.874916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.876635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.878264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:51.892577 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2696/5364] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:51 2022] PUT /identity/v3/projects/f5184f337f0b40209016095d1b318d3c/users/4972abff957644dc97cb103a82b1b96b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:51.893435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:51.895334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ca489-afb3-400d-a44d-dfdf918365a9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.895665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:51.957576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.958760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.959045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.959316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] PATH_INFO: `/v3/users/ee9654eea6394375bb289b3a63c34733` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.960529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9654eea6394375bb289b3a63c34733)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.962797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:51.971976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df317bc-9ba5-490a-aaef-58d3820fac81 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:51.976846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:51.978228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:51.978551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:51.979029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:51.980193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:51.982032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.003582 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2697/5365] 10.222.0.77 () {58 vars in 1127 bytes} [Mon Jul 11 15:07:51 2022] GET /identity/v3/domains => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:52.007569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.007886 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:52.009578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.020048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9654eea6394375bb289b3a63c34733'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.034403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9654eea6394375bb289b3a63c34733'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.042045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9654eea6394375bb289b3a63c34733'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.056772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9654eea6394375bb289b3a63c34733'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.057467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1800dafa-37b4-4c68-981c-15cc05fc07aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9654eea6394375bb289b3a63c34733'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.068230 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2669/5366] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:51 2022] DELETE /identity/v3/users/ee9654eea6394375bb289b3a63c34733 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:52.069764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.070211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.070521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.086259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017e46f-a134-4767-abb4-2d83ce3b0a0e tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.096559 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:52.111303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] MFA Rules not processed for user `4972abff957644dc97cb103a82b1b96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:52.112581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.158570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.159362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.159652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.160162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.162981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.197281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2670/5367] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:52.198453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.199980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.234863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.236600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.246802 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2698/5368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:52.247693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.249209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.302108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1eef3-56c8-4164-98c0-6ed494476008 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.308051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.308924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.309210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.309553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/9b091190639d4fadb79c6075f740ae09` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.317217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find domain: 9b091190639d4fadb79c6075f740ae09.: keystone.exception.DomainNotFound: Could not find domain: 9b091190639d4fadb79c6075f740ae09. Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9b091190639d4fadb79c6075f740ae09. Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:52.327778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:52.328860 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9b091190639d4fadb79c6075f740ae09. Jul 11 15:07:52.331058 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:52.332087 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2671/5369] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:52 2022] PATCH /identity/v3/domains/9b091190639d4fadb79c6075f740ae09 => generated 112 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:52.332087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.333814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.348811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b617-a84f-4b5e-a6f2-295aa6a4a2d5 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.349625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815945-7dc3-4830-93c8-0dd7b1f71d90 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.354824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.355249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.355804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.356092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.356372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] PATH_INFO: `/v3/projects/74c7fc64ffd44ad287216c942e74bae0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.356563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.357051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.357342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.357575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c7fc64ffd44ad287216c942e74bae0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.358047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.359543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.360173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.391173 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2699/5370] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:52.392011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.421026 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:52.437424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c7fc64ffd44ad287216c942e74bae0', 'request_id': 'req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.452373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c7fc64ffd44ad287216c942e74bae0', 'request_id': 'req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.468417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c7fc64ffd44ad287216c942e74bae0', 'request_id': 'req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.489120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] The token cache is being invalidate because project 74c7fc64ffd44ad287216c942e74bae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:52.489475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.490296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:52.492639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2672/5371] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:52 2022] DELETE /identity/v3/projects/74c7fc64ffd44ad287216c942e74bae0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:52.493439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.497367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.508928 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:52.544333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4709364-ddbd-4517-a8fc-b478baad94cb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.590176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2b76-32ec-4b6c-a92a-0cd72cf4aa15 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.596040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db776e9-1db1-4386-aa2a-53a10d1b210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.596693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db776e9-1db1-4386-aa2a-53a10d1b210a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.597574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db776e9-1db1-4386-aa2a-53a10d1b210a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.597863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db776e9-1db1-4386-aa2a-53a10d1b210a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.600061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db776e9-1db1-4386-aa2a-53a10d1b210a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.600914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db776e9-1db1-4386-aa2a-53a10d1b210a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.626924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2673/5372] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:52.629013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.629317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.629605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.662536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:52.664048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.678437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2674/5373] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:52.679662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.704738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.705611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.706111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.706474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.706763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0999afe-fbc1-44b6-8005-f2f255a396dd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.707447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.709378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.714713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c13d-c8c2-4792-8563-f262973b5ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.715768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c13d-c8c2-4792-8563-f262973b5ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.715768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c13d-c8c2-4792-8563-f262973b5ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.716062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c13d-c8c2-4792-8563-f262973b5ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.716782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c13d-c8c2-4792-8563-f262973b5ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.718852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c13d-c8c2-4792-8563-f262973b5ecc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.731284 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2675/5374] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:52.732635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.732931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.733215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.749202 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2700/5375] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/domains => generated 276 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:52.752353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.756513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:52.757740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.840259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2676/5376] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:52.840454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1110f-b06c-419a-9356-0297285f199d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.841153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.842508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:52.847812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.848996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.849381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.849761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] PATH_INFO: `/v3/projects/cb4d7e0eccff4fb09110ebc01853e069/users/fd2724c6298345f0a787179b56f55c76/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.872439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4d7e0eccff4fb09110ebc01853e069, user_id=fd2724c6298345f0a787179b56f55c76, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.876689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.893425 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2701/5377] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:52 2022] PUT /identity/v3/projects/cb4d7e0eccff4fb09110ebc01853e069/users/fd2724c6298345f0a787179b56f55c76/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:52.896375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:52.897710 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:52.933093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98959ace-dbc6-40a6-9478-8a04f1186483 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.969927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24880de-a0b8-49ec-8a45-0cac09583c2b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:52.975527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:52.976796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:52.976796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:52.977161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:52.978055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:52.978434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:52.980670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:52.998833 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2702/5378] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:53.000013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.003585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.005474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.006170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.006738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.007164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.007991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.010610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.013516 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:53.017781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607edce-963b-4e22-af95-4c5ed20fb799 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.024786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.026056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.026411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.026788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] PATH_INFO: `/v3/users/7ac2b6ba1679408ea2a1800bfd9eacd6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.028105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac2b6ba1679408ea2a1800bfd9eacd6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.030104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.046546 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2677/5379] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:52 2022] POST /identity/v3/users => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:53.046546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.057998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c791f-fcdb-483e-8a07-14dc5e4e7fdb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.062944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.063622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.063905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.064231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.065034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.066751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.078922 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2678/5380] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:53.079705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.087135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac2b6ba1679408ea2a1800bfd9eacd6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.087813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac2b6ba1679408ea2a1800bfd9eacd6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.089119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911eb7-e020-4b85-9f06-b4997c9e8998 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.093821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.094450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.094773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.095056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.095735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.097600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.100444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac2b6ba1679408ea2a1800bfd9eacd6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.101148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac2b6ba1679408ea2a1800bfd9eacd6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.108201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac2b6ba1679408ea2a1800bfd9eacd6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.122813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2703/5381] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:52 2022] DELETE /identity/v3/users/7ac2b6ba1679408ea2a1800bfd9eacd6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:53.123722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.125061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.128454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2679/5382] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:53 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:53.129343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.131166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.197298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa8bd4-17ba-492b-bdc6-a01c33813890 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.202330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.203044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.203330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.203610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.204290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.206232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.209280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0aa4f-f2e9-4533-93b6-b36bd007d659 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.219585 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2680/5383] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 15:07:53 2022] POST /identity/v3/groups => generated 324 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:53.220292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.221867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.250602 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:53.274405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.275156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.275446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.275726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.277606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.287664 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:53.288288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159847-2747-42bc-9001-bd12a60d6b89 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.293875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f635e0-44a5-4720-b1bb-173853bbb444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.294800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f635e0-44a5-4720-b1bb-173853bbb444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.295091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f635e0-44a5-4720-b1bb-173853bbb444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.295371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f635e0-44a5-4720-b1bb-173853bbb444 admin admin] PATH_INFO: `/v3/projects/cb4d7e0eccff4fb09110ebc01853e069/users/fd2724c6298345f0a787179b56f55c76/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.297737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f635e0-44a5-4720-b1bb-173853bbb444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4d7e0eccff4fb09110ebc01853e069, user_id=fd2724c6298345f0a787179b56f55c76, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.300461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f635e0-44a5-4720-b1bb-173853bbb444 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.311551 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2681/5384] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:53 2022] PUT /identity/v3/projects/cb4d7e0eccff4fb09110ebc01853e069/users/fd2724c6298345f0a787179b56f55c76/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:53.312790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.313089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.313370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.330821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:53.332031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.349493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.351123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.359893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2704/5385] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:07:53.360668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.362081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.376457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2fd8-a4ee-4b58-ac9d-d73abaf03984 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.395722 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2682/5386] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:53.396611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.440583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b7643-4457-44c4-b726-22879e666952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.441400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b7643-4457-44c4-b726-22879e666952 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.441804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b7643-4457-44c4-b726-22879e666952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.442181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b7643-4457-44c4-b726-22879e666952 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.443073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b7643-4457-44c4-b726-22879e666952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.445286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b7643-4457-44c4-b726-22879e666952 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.463399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf0cad-bffe-4ff7-997c-8a0ccf5ad668 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.470822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2705/5387] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:53 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:53.470992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.470992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.470992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.471318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.471410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/dac59fd4bbf94889b9b884b4720bf6da` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.471500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.471500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.471676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dac59fd4bbf94889b9b884b4720bf6da)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.473326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.497263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.498001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.501302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] MFA Rules not processed for user `fd2724c6298345f0a787179b56f55c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:53.502577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.526249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.526888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.529404 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2683/5388] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:53 2022] PATCH /identity/v3/domains/dac59fd4bbf94889b9b884b4720bf6da => generated 277 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:53.530212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.531619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.564532 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:53.597258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5a7a-aa0d-4143-aff3-e275adfb5375 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.601036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.601754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.602126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.602460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.604867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.608952 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2706/5389] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:53.608952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.608952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.644565 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:53.688541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.690213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.691515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949298-293f-4c2f-afe7-af0f360c4b35 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.696235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.697601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.698146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.698435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.699203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.701276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.707025 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2684/5390] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:53.709523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.713372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.718846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2707/5391] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:53.718846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.722088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.737128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f241fb2-053f-4000-87af-cd9dd54c5cb7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.741024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.741800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.742144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.742434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.749021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:53.798908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624eaa8-ad32-49af-9ac2-4fda4283d432 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.805425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.807118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.807528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.807908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/dac59fd4bbf94889b9b884b4720bf6da` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.822562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dac59fd4bbf94889b9b884b4720bf6da)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.826007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.840150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.842191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.868039 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2708/5392] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:53.871057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.903760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.908118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:53.910189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81879d-2328-4550-8af8-71f297b219fb service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.916313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.917087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.917371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.917713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.918635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:53.920693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:53.934305 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2709/5393] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:53.938426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:53.959219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d1c9-6247-4a89-9961-f95521a58535 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:53.964814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d1426-b737-4d69-ba31-624bdde7e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:53.966106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d1426-b737-4d69-ba31-624bdde7e608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:53.966979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d1426-b737-4d69-ba31-624bdde7e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:53.967370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d1426-b737-4d69-ba31-624bdde7e608 admin admin] PATH_INFO: `/v3/projects/6b6f24ee0aab46ddab2922967e8eedf5/users/9015043df1c94dd491c322808783e709/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:53.968241 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:53.998427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d1426-b737-4d69-ba31-624bdde7e608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6f24ee0aab46ddab2922967e8eedf5, user_id=9015043df1c94dd491c322808783e709, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.001262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d1426-b737-4d69-ba31-624bdde7e608 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.021497 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2710/5394] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:53 2022] PUT /identity/v3/projects/6b6f24ee0aab46ddab2922967e8eedf5/users/9015043df1c94dd491c322808783e709/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:54.033202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.033499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.033989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.069509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] MFA Rules not processed for user `9015043df1c94dd491c322808783e709`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:54.070922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.083506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30e280a6d9a406792cb3e6d7d2b037f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.102248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30e280a6d9a406792cb3e6d7d2b037f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.116018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30e280a6d9a406792cb3e6d7d2b037f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.129236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30e280a6d9a406792cb3e6d7d2b037f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.130356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30e280a6d9a406792cb3e6d7d2b037f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.188749 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2711/5395] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:54.189704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.191371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.215429 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:54.224681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da', 'request_id': 'req-690da60e-8723-40b9-a98c-5f807f299300'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.237019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da', 'request_id': 'req-690da60e-8723-40b9-a98c-5f807f299300'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.256951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da', 'request_id': 'req-690da60e-8723-40b9-a98c-5f807f299300'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.278481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project dac59fd4bbf94889b9b884b4720bf6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:54.279105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.280497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.280898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977fc39-f95c-4900-8da2-fefe0663c32c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.292496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da', 'request_id': 'req-690da60e-8723-40b9-a98c-5f807f299300'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.296913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da', 'request_id': 'req-690da60e-8723-40b9-a98c-5f807f299300'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.297788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-690da60e-8723-40b9-a98c-5f807f299300 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dac59fd4bbf94889b9b884b4720bf6da', 'request_id': 'req-690da60e-8723-40b9-a98c-5f807f299300'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.304488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2685/5396] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:53 2022] DELETE /identity/v3/domains/dac59fd4bbf94889b9b884b4720bf6da => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:54.307031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.307327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.307611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.331657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] MFA Rules not processed for user `9015043df1c94dd491c322808783e709`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:54.334951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.373974 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:54.390054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.391491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.392024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.392541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] PATH_INFO: `/v3/projects/d2759184fd444c76becf2613f83d2a6e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.394189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2759184fd444c76becf2613f83d2a6e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.396535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.424187 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2686/5397] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:54.439650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.443846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.508980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2759184fd444c76becf2613f83d2a6e', 'request_id': 'req-f08b9952-505b-4e53-9b23-77f78ebf99df'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.521781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2759184fd444c76becf2613f83d2a6e', 'request_id': 'req-f08b9952-505b-4e53-9b23-77f78ebf99df'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.523184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf518-dc88-4cc5-b9b5-f6aacaf77046 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.561166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2759184fd444c76becf2613f83d2a6e', 'request_id': 'req-f08b9952-505b-4e53-9b23-77f78ebf99df'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.577118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] The token cache is being invalidate because project d2759184fd444c76becf2613f83d2a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:54.577716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.578396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:54.581916 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2712/5398] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:07:54 2022] DELETE /identity/v3/projects/d2759184fd444c76becf2613f83d2a6e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:54.582767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.584133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.626061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.627614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.628097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.628592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/dac59fd4bbf94889b9b884b4720bf6da` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.636436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=dac59fd4bbf94889b9b884b4720bf6da)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.638938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.651847 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-85ee2438-3418-406b-b5b9-12824aea5cc2 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find domain: dac59fd4bbf94889b9b884b4720bf6da.: keystone.exception.DomainNotFound: Could not find domain: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:54.656976 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:54.658007 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:54.659063 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:07:54.666269 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2687/5399] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:07:54 2022] GET /identity/v3/domains/dac59fd4bbf94889b9b884b4720bf6da => generated 112 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:54.667883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d04a-b9f1-4bf4-8ee0-dde13939e56b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.668387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d04a-b9f1-4bf4-8ee0-dde13939e56b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.668848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d04a-b9f1-4bf4-8ee0-dde13939e56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.681054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b9952-505b-4e53-9b23-77f78ebf99df admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.689464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.690141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.690428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.690745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.692629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.707550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-03f0d04a-b9f1-4bf4-8ee0-dde13939e56b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:54.710245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-03f0d04a-b9f1-4bf4-8ee0-dde13939e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.769533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.771749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.784786 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2713/5400] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:54.797634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.800128 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2688/5401] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:54.800789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.801805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.802212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.802609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.825560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c81dd-a79f-4ce0-aa2a-e5920f2d93f9 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.830749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:54.832070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:54.833972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.835108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.835475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.836349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/users/d30e280a6d9a406792cb3e6d7d2b037f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.847388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2689/5402] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:54.848496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.863726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:get_user(user_id=d30e280a6d9a406792cb3e6d7d2b037f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.866067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.866834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73976141-5924-4ae3-ad4a-d7539ffa2fb4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.872678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.873678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.874122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.874660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.875842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:54.876696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.878428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.887187 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:54.896494 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2690/5403] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:54.897695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find user: d30e280a6d9a406792cb3e6d7d2b037f.: keystone.exception.UserNotFound: Could not find user: d30e280a6d9a406792cb3e6d7d2b037f. Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:07:54.901526 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:54.902723 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: d30e280a6d9a406792cb3e6d7d2b037f. Jul 11 15:07:54.903961 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:54.906244 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2714/5404] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:07:54 2022] GET /identity/v3/users/d30e280a6d9a406792cb3e6d7d2b037f => generated 110 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:54.907160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:54.918640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a73c49-0fa6-4d2f-a8b6-66c5be25e08f tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.938685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.939764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.940152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9ac02-6c0a-40ea-be44-4a82282ddfd5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:54.941362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.941809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/groups/8c87789dd0294dd08627950d6d387ac5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.952551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:get_group(group_id=8c87789dd0294dd08627950d6d387ac5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.954742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:54.955562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:54.969518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:54.970246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:54.970620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:54.973145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:54.977996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find group: 8c87789dd0294dd08627950d6d387ac5.: keystone.exception.GroupNotFound: Could not find group: 8c87789dd0294dd08627950d6d387ac5. Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 11 15:07:55.000842 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:55.002272 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 8c87789dd0294dd08627950d6d387ac5. Jul 11 15:07:55.003510 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.005888 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2715/5405] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:54 2022] GET /identity/v3/groups/8c87789dd0294dd08627950d6d387ac5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:55.010657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.029110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518d6d-4e0c-4150-9c6f-6ffb1f5dde39 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.041550 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2691/5406] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:54 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:55.056996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.059281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.063050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.063457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.063839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/groups/8c87789dd0294dd08627950d6d387ac5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.069404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find group: 8c87789dd0294dd08627950d6d387ac5.: keystone.exception.GroupNotFound: Could not find group: 8c87789dd0294dd08627950d6d387ac5. Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 11 15:07:55.081278 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:55.082440 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 8c87789dd0294dd08627950d6d387ac5. Jul 11 15:07:55.083716 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.085745 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2716/5407] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:07:55 2022] DELETE /identity/v3/groups/8c87789dd0294dd08627950d6d387ac5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 11 15:07:55.093533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.153673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1219a-340c-4d89-991d-4d136b9cb7c5 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.238955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6cd5b-226e-46e6-bda2-f07400322584 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.253383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.254293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.254795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.255260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.256148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.258288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.295270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.296256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.296616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.297013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/users/d30e280a6d9a406792cb3e6d7d2b037f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.303873 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2692/5408] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:55 2022] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:55.307508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.316799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d30e280a6d9a406792cb3e6d7d2b037f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.321567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.326716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54834a-4723-467c-a786-932c77c399bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.337976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.340900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.341276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.341681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.342602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.347019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find user: d30e280a6d9a406792cb3e6d7d2b037f.: keystone.exception.UserNotFound: Could not find user: d30e280a6d9a406792cb3e6d7d2b037f. Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 11 15:07:55.358155 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:55.359560 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: d30e280a6d9a406792cb3e6d7d2b037f. Jul 11 15:07:55.360858 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.368106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2717/5409] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:55 2022] DELETE /identity/v3/users/d30e280a6d9a406792cb3e6d7d2b037f => generated 110 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:55.368106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.373285 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2693/5410] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:55.376423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.395810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd985-b2e4-44e0-948d-09252b12d18c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.398395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb076e-c658-45f4-a28a-5dd190874bfc tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.409353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.410781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.411236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.411520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.411915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/dac59fd4bbf94889b9b884b4720bf6da` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.412999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.413393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.414571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.416001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.422695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.435241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:55.456924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2694/5411] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:55.460598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find domain: dac59fd4bbf94889b9b884b4720bf6da.: keystone.exception.DomainNotFound: Could not find domain: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:55.466395 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:55.467489 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:55.468422 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.474383 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2718/5412] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:55 2022] PATCH /identity/v3/domains/dac59fd4bbf94889b9b884b4720bf6da => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:55.475812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.479283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e10d5b-a9c9-4b06-bc56-e960b793f7c3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.496771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebf90-9b5d-438e-a2c6-5dcc8ab0e5cb tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.497225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae257dae-0976-4a50-93c6-2cd189cd1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.498519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae257dae-0976-4a50-93c6-2cd189cd1595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.498993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae257dae-0976-4a50-93c6-2cd189cd1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.499817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae257dae-0976-4a50-93c6-2cd189cd1595 admin admin] PATH_INFO: `/v3/projects/bbb970847e9b4abd866d1f6d28a6d34c/users/ab705295186840609273c11cd0b64393/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.515479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.517245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.517897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.518394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.519788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.521602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.542997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae257dae-0976-4a50-93c6-2cd189cd1595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb970847e9b4abd866d1f6d28a6d34c, user_id=ab705295186840609273c11cd0b64393, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.547674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae257dae-0976-4a50-93c6-2cd189cd1595 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.567133 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2719/5413] 10.222.0.77 () {58 vars in 1127 bytes} [Mon Jul 11 15:07:55 2022] GET /identity/v3/domains => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:55.568872 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2695/5414] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:55 2022] PUT /identity/v3/projects/bbb970847e9b4abd866d1f6d28a6d34c/users/ab705295186840609273c11cd0b64393/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:55.572449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.576195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.576496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.576986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.593264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397b4e-9d5e-4ee6-bbb6-f65e9b00f640 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.601992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:55.604256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:55.664393 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:55.730048 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2696/5415] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:55.731182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.733101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:55.766541 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:55.777251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.779532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.779806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.780174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.780931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:55.781229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.782898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.824686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2720/5416] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:07:55 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:55.830025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.858299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6ebd6-eca7-4376-b3f5-f6fc2b2b05ae tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.876540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.877462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.877856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.878480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.879181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23111-f235-4a74-bfdc-9f5254f2ff07 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.879651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-37387766) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:07:55.880199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.882988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.888078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.889391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.891766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.892159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.909705 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2721/5417] 10.222.0.77 () {58 vars in 1194 bytes} [Mon Jul 11 15:07:55 2022] GET /identity/v3/domains?name=tempest-test_domain-37387766 => generated 405 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:55.912694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:55.915434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:55.920610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:55.939758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440080f-07cf-4ad5-b121-613a1d6506e8 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:55.948135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2697/5418] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:55.950908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:55.952520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:55.952520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:55.952966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/dac59fd4bbf94889b9b884b4720bf6da` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:55.962772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Could not find domain: dac59fd4bbf94889b9b884b4720bf6da.: keystone.exception.DomainNotFound: Could not find domain: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:07:55.977021 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:07:55.978340 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dac59fd4bbf94889b9b884b4720bf6da. Jul 11 15:07:55.980689 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:07:55.982602 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2722/5419] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:55 2022] PATCH /identity/v3/domains/dac59fd4bbf94889b9b884b4720bf6da => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:07:55.986827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:56.007772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906d28a-9765-4de2-b1ed-496472d83560 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:56.017652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:56.018967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:56.019355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:56.019836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/834e1aca28434bbe87333f17f4ec93d4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:56.035489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=834e1aca28434bbe87333f17f4ec93d4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:56.038063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:56.102952 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2698/5420] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:55 2022] PATCH /identity/v3/domains/834e1aca28434bbe87333f17f4ec93d4 => generated 277 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:56.104980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:56.124372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9fb2f-cfcb-4b48-bb2a-df66ff874b2d tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:56.132342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:56.133275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:56.133603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:56.134627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/834e1aca28434bbe87333f17f4ec93d4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:56.151952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=834e1aca28434bbe87333f17f4ec93d4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:56.155796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:56.232403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.244449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.399472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4', 'request_id': 'req-2f7b37a0-6cae-43c7-a4da-5738d6633a36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.413773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4', 'request_id': 'req-2f7b37a0-6cae-43c7-a4da-5738d6633a36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.420568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4', 'request_id': 'req-2f7b37a0-6cae-43c7-a4da-5738d6633a36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.445621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project 834e1aca28434bbe87333f17f4ec93d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:56.445922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.457485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.479808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4', 'request_id': 'req-2f7b37a0-6cae-43c7-a4da-5738d6633a36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.486900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4', 'request_id': 'req-2f7b37a0-6cae-43c7-a4da-5738d6633a36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.491126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '834e1aca28434bbe87333f17f4ec93d4', 'request_id': 'req-2f7b37a0-6cae-43c7-a4da-5738d6633a36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.504339 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2723/5421] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:56 2022] DELETE /identity/v3/domains/834e1aca28434bbe87333f17f4ec93d4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:56.512624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:56.514933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:56.556626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323fe4-8f92-4487-869e-61bcca85a2ec tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:56.715541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:56.726697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:56.726697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:56.726697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/8b658962e12e47fabd3454205d8df271` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:56.758984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8b658962e12e47fabd3454205d8df271)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:56.761829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:56.841068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8b658962e12e47fabd3454205d8df271'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.842158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8b658962e12e47fabd3454205d8df271'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.901870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8b658962e12e47fabd3454205d8df271'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.902690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8b658962e12e47fabd3454205d8df271'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:56.917143 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2699/5422] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:56 2022] PATCH /identity/v3/domains/8b658962e12e47fabd3454205d8df271 => generated 277 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:07:56.919455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:56.936547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b37a0-6cae-43c7-a4da-5738d6633a36 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:57.016221 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:57.069837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:57.070760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:57.071046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:57.071900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/8b658962e12e47fabd3454205d8df271` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:57.084567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8b658962e12e47fabd3454205d8df271)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:57.087957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:57.153268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8b658962e12e47fabd3454205d8df271'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.164350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8b658962e12e47fabd3454205d8df271'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.287073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b658962e12e47fabd3454205d8df271', 'request_id': 'req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.302894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b658962e12e47fabd3454205d8df271', 'request_id': 'req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.314574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b658962e12e47fabd3454205d8df271', 'request_id': 'req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.340560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project 8b658962e12e47fabd3454205d8df271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:57.340853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.342864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.359696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8b658962e12e47fabd3454205d8df271', 'request_id': 'req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.360741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8b658962e12e47fabd3454205d8df271', 'request_id': 'req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.365851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8b658962e12e47fabd3454205d8df271', 'request_id': 'req-2ee8dcbb-121e-46a0-84a7-e4e3c5ff277a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.375467 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2724/5423] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:56 2022] DELETE /identity/v3/domains/8b658962e12e47fabd3454205d8df271 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:57.379103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:57.380562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:57.414242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f5f9-5364-45a7-9e3e-91c75c7a953c tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:57.505876 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:57.527716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:57.528024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:57.528289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:57.564087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:57.565035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:57.565500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:57.565789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/5dfbe42f304340949182102e2cd1c89e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:57.573587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] MFA Rules not processed for user `ab705295186840609273c11cd0b64393`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:57.575883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:57.585989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5dfbe42f304340949182102e2cd1c89e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:57.653417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:57.659604 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:57.678926 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2725/5424] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:07:57.684816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:57.687775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:57.757549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5dfbe42f304340949182102e2cd1c89e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.760488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5dfbe42f304340949182102e2cd1c89e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.828034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4628f-644d-4137-bf7f-440cf8de7999 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:57.835128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5dfbe42f304340949182102e2cd1c89e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.842852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5dfbe42f304340949182102e2cd1c89e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:57.845917 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2700/5425] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:07:57 2022] PATCH /identity/v3/domains/5dfbe42f304340949182102e2cd1c89e => generated 276 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:07:57.850271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:57.851905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:57.955250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:57.957659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:57.957987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:57.958333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:57.959259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:57.971153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:57.976136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0e9e4-530f-4361-97ac-1041e106a75a tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:57.981941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:57.983871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:57.984654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:57.984836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:57.987491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:58.015457 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2726/5426] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:07:57 2022] POST /identity/v3/projects => generated 405 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:58.017154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:58.019163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:58.158436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.160680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.168703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35f593-1f27-4a0e-8faa-b79e63ad200e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:58.173634 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2701/5427] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:07:58.174746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:58.176246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:58.187341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7badaacecf1430fa1106849f3f0b84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b0d36933674075ad8760cbfbac01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:58.190053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:58.190774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:58.191578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] PATH_INFO: `/v3/domains/5dfbe42f304340949182102e2cd1c89e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:58.203618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094992-209d-4313-bd81-fb33b686acfc service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:58.221353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5dfbe42f304340949182102e2cd1c89e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.223567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.261067 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:58.261299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5dfbe42f304340949182102e2cd1c89e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.262738 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:58.272460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5dfbe42f304340949182102e2cd1c89e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.302138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:58.303006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:58.303296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:58.303577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:58.304280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.307171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.337964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2702/5428] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:07:58 2022] POST /identity/v3/users => generated 309 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:07:58.338866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:58.357746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abc9b-3f3c-49be-8fc0-1aa5756a24c4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:58.384912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfbe42f304340949182102e2cd1c89e', 'request_id': 'req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.401172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfbe42f304340949182102e2cd1c89e', 'request_id': 'req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.421832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfbe42f304340949182102e2cd1c89e', 'request_id': 'req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.451215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] The token cache is being invalidate because project 5dfbe42f304340949182102e2cd1c89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:07:58.455637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.456721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.511275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5dfbe42f304340949182102e2cd1c89e', 'request_id': 'req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.512978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5dfbe42f304340949182102e2cd1c89e', 'request_id': 'req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.529548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5dfbe42f304340949182102e2cd1c89e', 'request_id': 'req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:58.550249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2727/5429] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:07:58 2022] DELETE /identity/v3/domains/5dfbe42f304340949182102e2cd1c89e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:58.554590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:58.559398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:58.602005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:58.603847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:58.604230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:58.604611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:58.605983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.608434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.634759 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2703/5430] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:58.637461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:58.642715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:58.673843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624904e-9794-41e5-a043-fef161072eda admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:58.679938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:58.682072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:58.682218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:58.682576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] PATH_INFO: `/v3/projects/41e9106896444b5eba99bf2739bdc554/users/e4b8c9d88a1e45edbb3ad37ccb898d25/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:58.702755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e9106896444b5eba99bf2739bdc554, user_id=e4b8c9d88a1e45edbb3ad37ccb898d25, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.705533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.735956 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2704/5431] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:58 2022] PUT /identity/v3/projects/41e9106896444b5eba99bf2739bdc554/users/e4b8c9d88a1e45edbb3ad37ccb898d25/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:58.744486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:58.756588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbeb25-fa78-4784-93fe-60c8d7af2fd3 tempest-DomainsTestJSON-44970465 tempest-DomainsTestJSON-44970465-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:58.845925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:58.848072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:58.848749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:58.849207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] PATH_INFO: `/v3/users/08497248eace43ecb6c1aa5f249acaa3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:58.851172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08497248eace43ecb6c1aa5f249acaa3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.855538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.889864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34b289-45b4-4974-bd04-416cc128fc74 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:58.906633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:58.907163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:58.907449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:58.907726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:58.908461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:58.909710 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:58.910066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:58.936808 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2705/5432] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:07:58.941064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:59.014428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998155-631e-4597-a961-22a73e9da4ba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:59.037337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a57f8-562f-4fa4-a15f-143c92a900ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:59.040258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a57f8-562f-4fa4-a15f-143c92a900ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:59.040680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a57f8-562f-4fa4-a15f-143c92a900ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:59.040805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a57f8-562f-4fa4-a15f-143c92a900ad admin admin] PATH_INFO: `/v3/projects/41e9106896444b5eba99bf2739bdc554/users/e4b8c9d88a1e45edbb3ad37ccb898d25/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:59.044195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08497248eace43ecb6c1aa5f249acaa3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:59.046288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08497248eace43ecb6c1aa5f249acaa3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:59.052409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a57f8-562f-4fa4-a15f-143c92a900ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e9106896444b5eba99bf2739bdc554, user_id=e4b8c9d88a1e45edbb3ad37ccb898d25, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:59.083139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a57f8-562f-4fa4-a15f-143c92a900ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:59.115307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08497248eace43ecb6c1aa5f249acaa3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:59.126347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08497248eace43ecb6c1aa5f249acaa3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:59.137332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08497248eace43ecb6c1aa5f249acaa3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:07:59.161021 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2706/5433] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:07:58 2022] PUT /identity/v3/projects/41e9106896444b5eba99bf2739bdc554/users/e4b8c9d88a1e45edbb3ad37ccb898d25/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:59.173169 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2728/5434] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:07:58 2022] DELETE /identity/v3/users/08497248eace43ecb6c1aa5f249acaa3 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:07:59.177799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:59.178093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:59.178381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:59.212454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:07:59.213858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:59.270417 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:07:59.365950 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2707/5435] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:07:59.382655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:07:59.384895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:07:59.521299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb593a-1bb0-42ba-afdb-78add84eec94 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:07:59.533418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:07:59.534307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:07:59.534806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:07:59.535676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:07:59.590545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:07:59.601814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:07:59.638342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2729/5436] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:00.366569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:00.368107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:00.388430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e050a-0133-4b76-ac95-771f61f6459c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:00.403264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:00.404725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:00.405947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:00.406655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] PATH_INFO: `/v3/projects/784c2b005275491980c76f7597f35ff9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:00.413463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] RBAC: Authorizing `identity:delete_project(project_id=784c2b005275491980c76f7597f35ff9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:00.420397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:00.502063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784c2b005275491980c76f7597f35ff9', 'request_id': 'req-49129926-69e0-4030-bfe4-4fd912cba11f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.515592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784c2b005275491980c76f7597f35ff9', 'request_id': 'req-49129926-69e0-4030-bfe4-4fd912cba11f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.530664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784c2b005275491980c76f7597f35ff9', 'request_id': 'req-49129926-69e0-4030-bfe4-4fd912cba11f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.573302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] The token cache is being invalidate because project 784c2b005275491980c76f7597f35ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:00.574123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.575112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-49129926-69e0-4030-bfe4-4fd912cba11f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.578409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2708/5437] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:00 2022] DELETE /identity/v3/projects/784c2b005275491980c76f7597f35ff9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:00.582340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:00.600993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb0ae4-f039-47f4-8be8-358adde9604e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:00.712874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:00.713518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:00.714060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:00.771858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] MFA Rules not processed for user `e4b8c9d88a1e45edbb3ad37ccb898d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:00.773577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:00.776203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:00.777213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:00.777611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:00.778017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] PATH_INFO: `/v3/users/c7badaacecf1430fa1106849f3f0b84a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:00.780435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7badaacecf1430fa1106849f3f0b84a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:00.782550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:00.919744 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:00.951021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7badaacecf1430fa1106849f3f0b84a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.951842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7badaacecf1430fa1106849f3f0b84a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:00.960719 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2709/5438] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:01.007915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7badaacecf1430fa1106849f3f0b84a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:01.017474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7badaacecf1430fa1106849f3f0b84a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:01.029200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-37413e82-00c6-479d-a797-e7d18b5cfc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7badaacecf1430fa1106849f3f0b84a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:01.074747 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2730/5439] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:00 2022] DELETE /identity/v3/users/c7badaacecf1430fa1106849f3f0b84a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:02.018250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:02.021113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:02.058091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab16f-838b-47de-a318-91cd559a5148 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:02.159495 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:02.231772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:02.234273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:02.235155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:02.236075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] PATH_INFO: `/v3/projects/a9b0d36933674075ad8760cbfbac01c5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:02.239241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b0d36933674075ad8760cbfbac01c5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:02.247772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:02.382406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b0d36933674075ad8760cbfbac01c5', 'request_id': 'req-6ec04387-157f-4407-ad9b-6c913408a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:02.429010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b0d36933674075ad8760cbfbac01c5', 'request_id': 'req-6ec04387-157f-4407-ad9b-6c913408a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:02.449656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b0d36933674075ad8760cbfbac01c5', 'request_id': 'req-6ec04387-157f-4407-ad9b-6c913408a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:02.473365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] The token cache is being invalidate because project a9b0d36933674075ad8760cbfbac01c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:02.473652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:02.478477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec04387-157f-4407-ad9b-6c913408a92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:02.487968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2710/5440] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:02 2022] DELETE /identity/v3/projects/a9b0d36933674075ad8760cbfbac01c5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:02.489767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e133a-5347-4146-b617-2362bea5b37c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:02.490234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e133a-5347-4146-b617-2362bea5b37c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:02.490524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e133a-5347-4146-b617-2362bea5b37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:02.536377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f04e133a-5347-4146-b617-2362bea5b37c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:02.537904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f04e133a-5347-4146-b617-2362bea5b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:02.696489 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2731/5441] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:02.704892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:02.705381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:02.705730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:02.750535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:02.751992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:02.767986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:02.768279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:02.768618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:02.798138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2711/5442] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:02.799096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:02.826316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:02.830872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:02.834946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22d4a-692d-4c34-bcbb-49c29be93f76 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:02.854267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:02.856103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:02.857641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:02.858241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:02.864892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:02.865670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:02.872737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:02.897123 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2712/5443] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:02.904873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:02.928082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae670-d07a-44cc-b323-46725fdebea0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:02.943034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:02.943714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:02.944002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:02.944285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:02.944991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:02.946992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.025099 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2713/5444] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:02 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:03.026227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2732/5445] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:03.027313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.093468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1490ee-817c-487a-b8e0-b3f8b8ac8ca3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.145308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.146771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:03.194325 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:03.219907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.220704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.220875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.221157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.221861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.226886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.291199 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2733/5446] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:03 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:03.292673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.297489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:03.326604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89876b4-c021-4ed3-a713-492eb01ee92f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.327272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e357-072c-4a0b-a333-ed94eb971a7c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.338472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.339393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.339687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.340053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] PATH_INFO: `/v3/users/ab705295186840609273c11cd0b64393` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.344108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.344810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.345210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.345961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.359548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab705295186840609273c11cd0b64393)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.364443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.404120 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:03.469688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.471475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.477688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab705295186840609273c11cd0b64393'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.482935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab705295186840609273c11cd0b64393'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.484945 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2714/5447] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:08:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:08:03.486063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.522017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da30f6-88a1-4de9-aabe-864481d60ddd service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.529067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.530525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.531399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.531817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.532804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.535786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.559702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab705295186840609273c11cd0b64393'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.562902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab705295186840609273c11cd0b64393'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.577004 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2715/5448] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:03.577902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.580591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:03.586613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab705295186840609273c11cd0b64393'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.623708 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2734/5449] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:03 2022] DELETE /identity/v3/users/ab705295186840609273c11cd0b64393 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:03.627774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb4ce9-7ac6-465a-855b-b646e3d3361c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.667488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.669053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:03.787265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.787982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.788290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.788586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.789352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.792902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.816929 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2716/5450] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:03.818615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:03.818897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b8273-4dfa-42e6-a2da-0e64ed96cc82 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.824156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.829921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.830134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785802df-f75c-4687-9103-c0eddad2cc8f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:03.830251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.830439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] PATH_INFO: `/v3/users/4972abff957644dc97cb103a82b1b96b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.831922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4972abff957644dc97cb103a82b1b96b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.833868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.835506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1433c8-e93b-49da-a434-b40ce1965145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:03.836410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1433c8-e93b-49da-a434-b40ce1965145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.837125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1433c8-e93b-49da-a434-b40ce1965145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.837420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1433c8-e93b-49da-a434-b40ce1965145 admin admin] PATH_INFO: `/v3/projects/fc6ebaa35c384404a975df400c356f95/users/2b0c86b684b344daa0480aff735d62a8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.856888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1433c8-e93b-49da-a434-b40ce1965145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6ebaa35c384404a975df400c356f95, user_id=2b0c86b684b344daa0480aff735d62a8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:03.859898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1433c8-e93b-49da-a434-b40ce1965145 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:03.879828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2717/5451] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:03 2022] PUT /identity/v3/projects/fc6ebaa35c384404a975df400c356f95/users/2b0c86b684b344daa0480aff735d62a8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:03.890132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c783e3-f318-4fce-8e66-c6265285f2db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:03.890576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c783e3-f318-4fce-8e66-c6265285f2db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:03.890868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c783e3-f318-4fce-8e66-c6265285f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:03.926201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d4c783e3-f318-4fce-8e66-c6265285f2db None None] MFA Rules not processed for user `2b0c86b684b344daa0480aff735d62a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:03.927940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4c783e3-f318-4fce-8e66-c6265285f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:03.936725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4972abff957644dc97cb103a82b1b96b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.937998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4972abff957644dc97cb103a82b1b96b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.948603 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=78,keystone:INSERT=4,keystone:DELETE=18 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:03.985948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4972abff957644dc97cb103a82b1b96b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:03.987441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4972abff957644dc97cb103a82b1b96b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.014902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4972abff957644dc97cb103a82b1b96b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.039018 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2735/5452] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:03 2022] DELETE /identity/v3/users/4972abff957644dc97cb103a82b1b96b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:04.040945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.042582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.091697 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2718/5453] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:04.091697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.091697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.092423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.138946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511f5cb-a8c6-44b7-8f05-2871834685a6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.147859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:04.148942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.150939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.151232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.151518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] PATH_INFO: `/v3/projects/bbb970847e9b4abd866d1f6d28a6d34c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.153449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.156677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb970847e9b4abd866d1f6d28a6d34c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.161472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.162310 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2719/5454] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:04.167123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.168882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.178230 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:04.197669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688b1bf-0115-4c55-9111-64d4436c642d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.214466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.214466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.214466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.214466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.215236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.215236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.295519 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2720/5455] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:04 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:04.296942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.298627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb970847e9b4abd866d1f6d28a6d34c', 'request_id': 'req-3363fd85-aadf-4b62-bd68-e04fd25585f6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.299132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.313581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb970847e9b4abd866d1f6d28a6d34c', 'request_id': 'req-3363fd85-aadf-4b62-bd68-e04fd25585f6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.330324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb970847e9b4abd866d1f6d28a6d34c', 'request_id': 'req-3363fd85-aadf-4b62-bd68-e04fd25585f6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.359035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] The token cache is being invalidate because project bbb970847e9b4abd866d1f6d28a6d34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:04.359335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.360448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.365968 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2736/5456] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:04 2022] DELETE /identity/v3/projects/bbb970847e9b4abd866d1f6d28a6d34c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:04.366892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.369028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.441242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c87f7-39f2-4cf7-aaea-ede7589b27ff admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.446105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.447508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.448212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.448649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.449610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363fd85-aadf-4b62-bd68-e04fd25585f6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.453112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.460170 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:04.559323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.562860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.597836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.599183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2721/5457] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:04.600189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.600706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.601090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.601485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.602869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.603963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:04.606021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.640561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef95146-33f3-4f2d-a078-3257904e94b8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.656760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.659734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.660242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.660749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] PATH_INFO: `/v3/users/e4b8c9d88a1e45edbb3ad37ccb898d25` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.664276 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2737/5458] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:04 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:04.667239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b8c9d88a1e45edbb3ad37ccb898d25)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.668304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.670911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.690308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8e95-afa0-46ae-a491-7beb9220258f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.703753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.704932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.705709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.706152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.707787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.709730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.738227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2738/5459] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:04.743435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.759906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e447-97ac-43a9-b46c-0441f4eb7dca admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:04.786253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:04.786253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:04.786253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:04.786253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] PATH_INFO: `/v3/projects/21c7b4ca51f14f5cbaad0e7ddbeec583/users/1a8b64d930bb41dd91446faf22682f50/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:04.794795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b8c9d88a1e45edbb3ad37ccb898d25'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.824420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c7b4ca51f14f5cbaad0e7ddbeec583, user_id=1a8b64d930bb41dd91446faf22682f50, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:04.831655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:04.850516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b8c9d88a1e45edbb3ad37ccb898d25'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.873939 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2739/5460] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:04 2022] PUT /identity/v3/projects/21c7b4ca51f14f5cbaad0e7ddbeec583/users/1a8b64d930bb41dd91446faf22682f50/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:04.875077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:04.876937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b8c9d88a1e45edbb3ad37ccb898d25'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.895692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b8c9d88a1e45edbb3ad37ccb898d25'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.896684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b8c9d88a1e45edbb3ad37ccb898d25'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:04.915358 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2722/5461] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:04 2022] DELETE /identity/v3/users/e4b8c9d88a1e45edbb3ad37ccb898d25 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:04.978249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e6dd-e4b4-475e-9dea-501d87f00090 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.090278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853fdb-fde5-4015-855f-b350dd473730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.091040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853fdb-fde5-4015-855f-b350dd473730 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.091493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853fdb-fde5-4015-855f-b350dd473730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.091798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853fdb-fde5-4015-855f-b350dd473730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.092510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb853fdb-fde5-4015-855f-b350dd473730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.094504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb853fdb-fde5-4015-855f-b350dd473730 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.108231 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2740/5462] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:05.112537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.114086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:05.126015 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:05.132567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595374f-e679-4862-8676-8e7e4af69e6d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.141506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.142423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.143067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.143356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] PATH_INFO: `/v3/projects/21c7b4ca51f14f5cbaad0e7ddbeec583/users/1a8b64d930bb41dd91446faf22682f50/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.145969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c7b4ca51f14f5cbaad0e7ddbeec583, user_id=1a8b64d930bb41dd91446faf22682f50, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.150747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.178644 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2723/5463] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:05 2022] PUT /identity/v3/projects/21c7b4ca51f14f5cbaad0e7ddbeec583/users/1a8b64d930bb41dd91446faf22682f50/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:05.179441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.179441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.179666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.194774 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:05.232010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] MFA Rules not processed for user `1a8b64d930bb41dd91446faf22682f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:05.233308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:05.393447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.395405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:05.426677 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2741/5464] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:05.432286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.463280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c71e5-ad89-4077-95d5-40ef73c2a3df None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.475880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.476577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.477703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.477703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.480558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.486093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.512093 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2742/5465] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:05 2022] POST /identity/v3/services => generated 290 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:05.518683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.561363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13850-ae49-48b0-ae20-91bc4dfdb3ad tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.563415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5975b-a606-4fa7-ac78-ca75d69efd59 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.580647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.581981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.582899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.583184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.583467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] PATH_INFO: `/v3/projects/f5184f337f0b40209016095d1b318d3c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.584676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5184f337f0b40209016095d1b318d3c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.584816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.585258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.585702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.586810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.586936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.588120 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:05.588120 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:08:05.588120 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:08:05.589369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.608902 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2743/5466] 10.222.0.77 () {60 vars in 1212 bytes} [Mon Jul 11 15:08:05 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:05.612177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.615128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:05.639507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c2b29-64af-43f1-9f43-126d904417a2 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.651638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.653253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.653922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.654219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] PATH_INFO: `/v3/projects/41e9106896444b5eba99bf2739bdc554` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.657094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e9106896444b5eba99bf2739bdc554)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.659083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.675029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5184f337f0b40209016095d1b318d3c', 'request_id': 'req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.681523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5184f337f0b40209016095d1b318d3c', 'request_id': 'req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.691755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5184f337f0b40209016095d1b318d3c', 'request_id': 'req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.706805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] The token cache is being invalidate because project f5184f337f0b40209016095d1b318d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:05.707153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.707972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.714186 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2724/5467] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:05 2022] DELETE /identity/v3/projects/f5184f337f0b40209016095d1b318d3c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:05.714186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.716716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:05.739606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e9106896444b5eba99bf2739bdc554', 'request_id': 'req-5d2e06c3-8674-48dc-b125-f720bf9d6aec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.758426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e9106896444b5eba99bf2739bdc554', 'request_id': 'req-5d2e06c3-8674-48dc-b125-f720bf9d6aec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.766372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e9106896444b5eba99bf2739bdc554', 'request_id': 'req-5d2e06c3-8674-48dc-b125-f720bf9d6aec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.790793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] The token cache is being invalidate because project 41e9106896444b5eba99bf2739bdc554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:05.791522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.793424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:05.795879 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2744/5468] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:05 2022] DELETE /identity/v3/projects/41e9106896444b5eba99bf2739bdc554 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:05.797564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:05.799240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:05.803483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb0ca0-5d02-40f2-a5c4-e053c60913af admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.826946 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:05.904978 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:05.906822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d56fc-2a2a-4a50-9f5a-3e20dae7f62d tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.907956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d56fc-2a2a-4a50-9f5a-3e20dae7f62d tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.909005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d56fc-2a2a-4a50-9f5a-3e20dae7f62d tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.911106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d56fc-2a2a-4a50-9f5a-3e20dae7f62d tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.913205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d56fc-2a2a-4a50-9f5a-3e20dae7f62d tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.916587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d56fc-2a2a-4a50-9f5a-3e20dae7f62d tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.937222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e06c3-8674-48dc-b125-f720bf9d6aec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:05.942871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:05.946559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.946559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.946559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] PATH_INFO: `/v3/users/fd2724c6298345f0a787179b56f55c76` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.946934 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2725/5469] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:05 2022] POST /identity/v3/services => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:05.949470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:05.953158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:05.953158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:05.953321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2724c6298345f0a787179b56f55c76)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:05.953321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:05.979970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:05.981393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:06.007569 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2726/5470] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3495 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:06.007569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.007569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:06.031311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075685-0a88-458b-9b9e-89e98bcf4711 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.037343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.038053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.038574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.039020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.040567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.041564 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:06.041564 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:06.041564 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:06.042400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32713375-16fb-468d-ae6e-b26add3c1594 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.056936 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2727/5471] 10.222.0.77 () {60 vars in 1212 bytes} [Mon Jul 11 15:08:06 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:06.058547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.059154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.059514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.066899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2724c6298345f0a787179b56f55c76'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:06.067605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2724c6298345f0a787179b56f55c76'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:06.094898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:06.096275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:06.100095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2724c6298345f0a787179b56f55c76'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:06.100843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2724c6298345f0a787179b56f55c76'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:06.107427 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2728/5472] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:06 2022] POST /identity/v3/auth/tokens => generated 3495 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:06.109400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.112043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:06.112274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2724c6298345f0a787179b56f55c76'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:06.132348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbf6d-988a-4f19-88bf-76f3408334a7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.138885 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2745/5473] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:05 2022] DELETE /identity/v3/users/fd2724c6298345f0a787179b56f55c76 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:06.140349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.151541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.152445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.152736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.154766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.155792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.159226 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:06.159226 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:06.159226 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:06.160134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.169744 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2729/5474] 10.222.0.77 () {58 vars in 1190 bytes} [Mon Jul 11 15:08:06 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:06.174141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.188264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0436599-b6c5-4a4d-b518-445ad7246d03 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.237589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef1cf-962c-4c19-896e-80e58c24df4f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.246095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.250768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.251065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.251357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.252700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:06.253016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.257914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.284560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2746/5475] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:06.287868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.300956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.302106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.302636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.302890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.303597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a0760bb5ec3e4c1baccab42ca52e6819)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.304314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b30715-1f21-4bb9-a4ad-94c960835716 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.304675 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:06.304675 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:06.304675 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:06.305633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.313341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.314894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2730/5476] 10.222.0.77 () {58 vars in 1289 bytes} [Mon Jul 11 15:08:06 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819 => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:06.317442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.317841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.318231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.319286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.321615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.322308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.333898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2122-1b2c-4f81-9e51-cff810f57853 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.354787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.354787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.354787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.355222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.355222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a0760bb5ec3e4c1baccab42ca52e6819)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.355222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.356449 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2731/5477] 10.222.0.77 () {58 vars in 1290 bytes} [Mon Jul 11 15:08:06 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 11 15:08:06.370873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.388670 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2747/5478] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:06 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:06.390320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.397233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f687-a9d1-4baa-8f6e-af4d564459e5 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.515829 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:06.540997 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:06.551352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.554134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc9a5-eeca-4f53-ba36-34219cf688b0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.554918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.555486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.555785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.556467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a0760bb5ec3e4c1baccab42ca52e6819)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.557509 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:06.557509 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:06.557509 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:06.558416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.570646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.571330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.571618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.571898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.572978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.575996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.585329 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2732/5479] 10.222.0.77 () {58 vars in 1292 bytes} [Mon Jul 11 15:08:06 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:06.587155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.606742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dcf8e-e356-4a3e-ace0-9cab047f728a tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.620311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.621818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.622116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.625762 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2748/5480] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:06 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:06.626261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.626261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.627159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.628270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.642296 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2733/5481] 10.222.0.77 () {58 vars in 1190 bytes} [Mon Jul 11 15:08:06 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:06.642296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.648840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44ba7-d819-4a4f-9407-371c7b7ced0f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.660163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.660770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef7a01-bf75-405a-b7c5-a92a586eb885 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.661498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.661907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.662405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.663879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.666251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.667359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.667559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.667642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.667905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.668587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a0760bb5ec3e4c1baccab42ca52e6819)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.670611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.682053 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2749/5482] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:06.686131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Could not find Endpoint Group: a0760bb5ec3e4c1baccab42ca52e6819.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a0760bb5ec3e4c1baccab42ca52e6819. Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 11 15:08:06.688265 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 11 15:08:06.689248 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 11 15:08:06.689248 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 11 15:08:06.689248 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 11 15:08:06.689248 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 11 15:08:06.689248 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a0760bb5ec3e4c1baccab42ca52e6819. Jul 11 15:08:06.689248 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:06.690070 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2734/5483] 10.222.0.77 () {58 vars in 1292 bytes} [Mon Jul 11 15:08:06 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a0760bb5ec3e4c1baccab42ca52e6819 => generated 120 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:08:06.694827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.701826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378bd55-2951-4a4c-acf9-d6cd92646c0c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.709393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.710126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.710601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.710887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.712109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523916-9ded-41ca-9217-090eda2bd263 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.712229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.714716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.724012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.725399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.725698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.726482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services/7c8e20d3de0146ac8e612b3bd334e854` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.728128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7c8e20d3de0146ac8e612b3bd334e854)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.730966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.732947 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2750/5484] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:06.734596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.748545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb07356-f019-42f7-8b9f-caaaf19bfa9d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:06.780682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:06.781612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:06.781904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:06.782211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] PATH_INFO: `/v3/projects/0fcccc2e015b48caa5cae0d9891bf622/users/d9fb7cad9efe432ebd26d96ade78b364/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:06.823797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2735/5485] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:06 2022] DELETE /identity/v3/services/7c8e20d3de0146ac8e612b3bd334e854 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:06.824016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.828174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:06.850612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcccc2e015b48caa5cae0d9891bf622, user_id=d9fb7cad9efe432ebd26d96ade78b364, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:06.853635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:06.878397 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2751/5486] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:06 2022] PUT /identity/v3/projects/0fcccc2e015b48caa5cae0d9891bf622/users/d9fb7cad9efe432ebd26d96ade78b364/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:06.879345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:06.897367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf11eb-a564-41e0-bce6-bbf60838417e tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.039296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea4d5-e605-4fc1-907d-c956315ab61e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.057064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe908e95-a249-4cd6-884c-14da3d238456 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.057724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe908e95-a249-4cd6-884c-14da3d238456 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.058050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe908e95-a249-4cd6-884c-14da3d238456 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.058276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe908e95-a249-4cd6-884c-14da3d238456 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.059057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe908e95-a249-4cd6-884c-14da3d238456 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.061239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe908e95-a249-4cd6-884c-14da3d238456 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.063466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.065143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.065498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.067645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] PATH_INFO: `/v3/projects/cb4d7e0eccff4fb09110ebc01853e069` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.070482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4d7e0eccff4fb09110ebc01853e069)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.075692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.084350 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2752/5487] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:06 2022] POST /identity/v3/services => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:07.086330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.087407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.087698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.128555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] MFA Rules not processed for user `d9fb7cad9efe432ebd26d96ade78b364`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:07.130445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:07.166140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4d7e0eccff4fb09110ebc01853e069', 'request_id': 'req-f2368c7d-2175-4563-8623-5edb155ba433'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:07.176742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4d7e0eccff4fb09110ebc01853e069', 'request_id': 'req-f2368c7d-2175-4563-8623-5edb155ba433'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:07.207761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4d7e0eccff4fb09110ebc01853e069', 'request_id': 'req-f2368c7d-2175-4563-8623-5edb155ba433'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:07.208543 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:07.223709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2753/5488] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3507 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:07.224811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.236339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] The token cache is being invalidate because project cb4d7e0eccff4fb09110ebc01853e069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:07.236639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:07.237779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:07.243367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2736/5489] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:06 2022] DELETE /identity/v3/projects/cb4d7e0eccff4fb09110ebc01853e069 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:07.244843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.248150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:07.339942 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:07.341970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e461abb-46a0-4b68-adb5-615140cc56d3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.352123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc35ee-19f2-4cd8-bb65-872e1ebc38e4 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.354060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc35ee-19f2-4cd8-bb65-872e1ebc38e4 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.355492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc35ee-19f2-4cd8-bb65-872e1ebc38e4 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.357645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc35ee-19f2-4cd8-bb65-872e1ebc38e4 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.360247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc35ee-19f2-4cd8-bb65-872e1ebc38e4 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.366634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc35ee-19f2-4cd8-bb65-872e1ebc38e4 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.412106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2754/5490] 10.222.0.77 () {60 vars in 1212 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:07.413443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.413443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.413443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.438959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2368c7d-2175-4563-8623-5edb155ba433 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.479581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bd692-8de0-481d-9213-2450a6502ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.482044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bd692-8de0-481d-9213-2450a6502ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.482681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bd692-8de0-481d-9213-2450a6502ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.483400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bd692-8de0-481d-9213-2450a6502ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.485839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bd692-8de0-481d-9213-2450a6502ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.489248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:07.489961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bd692-8de0-481d-9213-2450a6502ff9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.493510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:07.513929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2755/5491] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3496 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:07.514652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.517268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:07.554290 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2737/5492] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/projects => generated 371 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:07.556482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.557202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.557495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.560240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700039c-5a16-4512-84e0-40aec86732ce None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.586229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:07.589310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:07.722421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2738/5493] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3496 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:07.725121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.730998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.732373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.732892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.733387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.734473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.736431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.749291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490851eb-67ed-4b05-bd34-c706dc30b30c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.755274 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2756/5494] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/services => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:07.755274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.779757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601fff2-a29c-43d4-8ad9-c8536399a163 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.783337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.784024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.784330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.784601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.785304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.785423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.786317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.786699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.787041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.787892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:07.788267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.789952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.790740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.815290 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2757/5495] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:07.816231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.834211 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2739/5496] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:07.835540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.853487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c753-6782-4104-adfe-db8d1884b1f9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.856457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d5b5-4d89-4ebc-b282-036f00224514 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.861281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.862222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.862646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.863070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/36d03ec3f68f4e63871985d7627408f1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.864012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=36d03ec3f68f4e63871985d7627408f1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.865527 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:07.865527 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:08:07.865527 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:08:07.866871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.870642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.872587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.873122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.874121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.875816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.879130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.887250 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2758/5497] 10.222.0.77 () {60 vars in 1312 bytes} [Mon Jul 11 15:08:07 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/36d03ec3f68f4e63871985d7627408f1 => generated 335 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:07.888264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.911115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b2391-d054-460c-b815-081253a5e813 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.915989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:07.916733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:07.917086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:07.917437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:07.918241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:07.920051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:07.925360 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2740/5498] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:07.926612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.935661 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2759/5499] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:07.939418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:07.951015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a9c70-9951-4a21-95d1-ada21d68b487 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:07.973352 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:08.046314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.047114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.047469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.047845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.048597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.051168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.065173 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:08.067175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8c3b0-2870-47c0-b040-eeed779e034e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.073647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.074715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.075015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.075338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services/019dd150289648f39b78cd023620b7f3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.076092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=019dd150289648f39b78cd023620b7f3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.078296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.079674 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2760/5500] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:07 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:08.080752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.097846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd5a38-3561-44c5-b180-94fa673adeeb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.104162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.105267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.105844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.106361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] PATH_INFO: `/v3/projects/7c7c0d71e2a04f57894132adb5664fd0/users/e2ddd5b33c904f0fb2539b8a8bb469d7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.108338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2741/5501] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:07 2022] DELETE /identity/v3/services/019dd150289648f39b78cd023620b7f3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.109334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.127715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7c0d71e2a04f57894132adb5664fd0, user_id=e2ddd5b33c904f0fb2539b8a8bb469d7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.131485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.132003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b923208-fc71-43ab-9c92-96b039766398 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.137773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.138687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.138982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.139266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.140052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.141989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.153642 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2742/5502] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:08.154538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.155678 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2761/5503] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:08 2022] PUT /identity/v3/projects/7c7c0d71e2a04f57894132adb5664fd0/users/e2ddd5b33c904f0fb2539b8a8bb469d7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.157788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.177817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1372-afb8-4d26-ad17-309b7a124bb1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.253457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.254590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.254983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.255467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/36d03ec3f68f4e63871985d7627408f1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.256223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=36d03ec3f68f4e63871985d7627408f1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.257914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.277134 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2743/5504] 10.222.0.77 () {58 vars in 1292 bytes} [Mon Jul 11 15:08:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/36d03ec3f68f4e63871985d7627408f1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.278286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.283981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9d65-0c53-406b-a1ab-1d16ffe464f2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.290315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.291102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.291471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.291817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.292672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.294797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.303859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24ead2-5e2c-4f9e-b13f-0eb276042dbc tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.308793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2762/5505] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:08:08.310041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.315452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.316124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.316412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.316688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.317545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.319425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.327229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519531e4-523a-4ef1-a9b8-77b9c7012879 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.333090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.334088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.335350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.335350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services/46d9b98164514a0c8cb6e1e5427e9f0b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.335836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=46d9b98164514a0c8cb6e1e5427e9f0b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.337936 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2744/5506] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:08.338588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.339140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.349903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea96-a9af-4ecf-bce2-6a8f1d3c1e10 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.355137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.356138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.356420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.356721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] PATH_INFO: `/v3/projects/b0bdc81b3b034bf68920f56155113688/users/f58e70d6d21a42c7b832deed98a3044a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.387848 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2763/5507] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:08 2022] DELETE /identity/v3/services/46d9b98164514a0c8cb6e1e5427e9f0b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.388881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.389302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0bdc81b3b034bf68920f56155113688, user_id=f58e70d6d21a42c7b832deed98a3044a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.393194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.416055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957a430-cd2a-4e6a-ab0a-2286d098a771 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.419388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2745/5508] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:08 2022] PUT /identity/v3/projects/b0bdc81b3b034bf68920f56155113688/users/f58e70d6d21a42c7b832deed98a3044a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.423794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.514764 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:08.544446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75b7c-247d-4fad-a357-1702c343da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.546151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75b7c-247d-4fad-a357-1702c343da8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.547095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75b7c-247d-4fad-a357-1702c343da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.547614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75b7c-247d-4fad-a357-1702c343da8a admin admin] PATH_INFO: `/v3/projects/7c7c0d71e2a04f57894132adb5664fd0/users/e2ddd5b33c904f0fb2539b8a8bb469d7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.554221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e75b7c-247d-4fad-a357-1702c343da8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7c0d71e2a04f57894132adb5664fd0, user_id=e2ddd5b33c904f0fb2539b8a8bb469d7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.557037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e75b7c-247d-4fad-a357-1702c343da8a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.582599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2764/5509] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:08 2022] PUT /identity/v3/projects/7c7c0d71e2a04f57894132adb5664fd0/users/e2ddd5b33c904f0fb2539b8a8bb469d7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.582599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.582599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.582599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.584526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bf48-9e70-444b-bd97-22fa72352f82 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.619125 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:08.620916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] MFA Rules not processed for user `f58e70d6d21a42c7b832deed98a3044a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:08.622486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:08.726479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66006006-95c1-4398-a246-d5c29e129bed tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.728987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006006-95c1-4398-a246-d5c29e129bed tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.729403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006006-95c1-4398-a246-d5c29e129bed tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.729696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006006-95c1-4398-a246-d5c29e129bed tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9ccf9151170943bc924d258f7497fa2c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.730378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66006006-95c1-4398-a246-d5c29e129bed tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9ccf9151170943bc924d258f7497fa2c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.732312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66006006-95c1-4398-a246-d5c29e129bed tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.738915 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2765/5510] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:08.739886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.741693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:08.767138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2746/5511] 10.222.0.77 () {58 vars in 1292 bytes} [Mon Jul 11 15:08:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9ccf9151170943bc924d258f7497fa2c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:08.773514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.773514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.773514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.834463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] MFA Rules not processed for user `e2ddd5b33c904f0fb2539b8a8bb469d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:08.839358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:08.844179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb635a-7df9-4599-aa67-bf23ea8cd94f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:08.860551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:08.861558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:08.861898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:08.862609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] PATH_INFO: `/v3/users/0775a166e56e4d299afc541eada3480f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:08.866852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0775a166e56e4d299afc541eada3480f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:08.869860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:08.963998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0775a166e56e4d299afc541eada3480f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:08.965753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0775a166e56e4d299afc541eada3480f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:08.976242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2747/5512] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3439 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:08.976242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:08.995197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191eaea-602a-4147-a18c-e86720c66265 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.003161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.003512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0775a166e56e4d299afc541eada3480f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.003902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.004149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.004277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0775a166e56e4d299afc541eada3480f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.004513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.005611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.008190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.013733 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:09.015738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0775a166e56e4d299afc541eada3480f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.038952 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2766/5513] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:08 2022] DELETE /identity/v3/users/0775a166e56e4d299afc541eada3480f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:09.040493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.043171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.055148 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2748/5514] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:08 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:09.056695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.062585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.147253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809898-64f1-42d5-afb8-52ac265349ff admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.151544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.152212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.152562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.152877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.154933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.177486 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:09.195060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5452df7-fb30-47cc-a42c-b3ee9a106989 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.265831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a8b64d930bb41dd91446faf22682f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.266928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.267226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.267354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.267788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] PATH_INFO: `/v3/services/f68eff0e9c634390a64e3618e487eceb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.268352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f68eff0e9c634390a64e3618e487eceb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.269354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921d67e-98c0-4416-80be-3cb458501022 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.270465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.286421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2749/5515] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3439 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:09.287855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.288157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.288447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.313805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:09.315335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.336675 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2767/5516] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:09 2022] DELETE /identity/v3/services/f68eff0e9c634390a64e3618e487eceb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:09.340548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.344324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.469535 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2750/5517] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:09.472254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.473766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.496255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae667ca6-aea9-4d63-8208-b44c3baa6529 tempest-EndPointGroupsTest-1614400906 tempest-EndPointGroupsTest-1614400906-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.498794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5c61-28ff-4ef8-b246-41894e1f5d46 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.511323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.512217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.512507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.512785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] PATH_INFO: `/v3/users/2b0c86b684b344daa0480aff735d62a8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.514330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0c86b684b344daa0480aff735d62a8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.517226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.518024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.519021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.519412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.520195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.521968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.528433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.582012 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2768/5518] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:09 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:09.584358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.588749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.612946 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:09.613746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0c86b684b344daa0480aff735d62a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.643955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0c86b684b344daa0480aff735d62a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.659354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0c86b684b344daa0480aff735d62a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.676340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0c86b684b344daa0480aff735d62a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.677339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0c86b684b344daa0480aff735d62a8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:09.693857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2751/5519] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:09 2022] DELETE /identity/v3/users/2b0c86b684b344daa0480aff735d62a8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:09.695327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.699375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.719018 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:09.765435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c42dce-03a8-444d-8538-891da2da937d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.811391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8236f13-ee47-4571-b4b3-d91f79bfc3b3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.829336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a8bd-3ed1-487c-a927-61da838c0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.830173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a8bd-3ed1-487c-a927-61da838c0776 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.830456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a8bd-3ed1-487c-a927-61da838c0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.830764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a8bd-3ed1-487c-a927-61da838c0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.831623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a8bd-3ed1-487c-a927-61da838c0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.844489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a8bd-3ed1-487c-a927-61da838c0776 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.866678 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2752/5520] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:09.866678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.868049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.868437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.885951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.886792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.887138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.887467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.889842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.903022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:09.904272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.909420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.911038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.916552 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2753/5521] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:09.916552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.927156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce783b0-b0b5-47d5-8ddf-afc723cc038a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.942024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:09.943038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:09.943516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:09.944086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:09.945424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:09.948346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:09.949088 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2769/5522] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:09.951029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.961259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:09.964547 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2754/5523] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:09.968800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:09.993985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760170-98f6-4b25-bc30-ddb1ada97c17 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:09.994199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082003d5-793f-493e-a737-38bbf622e381 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:10.007293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:10.008022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.008921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.009309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.013794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7977-472a-4667-9b93-315f854531b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:10.015348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7977-472a-4667-9b93-315f854531b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.017959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7977-472a-4667-9b93-315f854531b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.018333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7977-472a-4667-9b93-315f854531b8 admin admin] PATH_INFO: `/v3/projects/e5802a7c202c4b8b842e26e3143016a3/users/32a4323fa9b0496baeaae911d976b8e0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.036672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.038205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.059503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f7977-472a-4667-9b93-315f854531b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5802a7c202c4b8b842e26e3143016a3, user_id=32a4323fa9b0496baeaae911d976b8e0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.063562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f7977-472a-4667-9b93-315f854531b8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.069864 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2770/5524] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:10.073913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:10.076841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:10.094462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf78a15-0013-4d74-8335-f537cdb468c4 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:10.096020 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2755/5525] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:09 2022] PUT /identity/v3/projects/e5802a7c202c4b8b842e26e3143016a3/users/32a4323fa9b0496baeaae911d976b8e0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:10.106705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.107091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.107449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.186695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] MFA Rules not processed for user `32a4323fa9b0496baeaae911d976b8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:10.188559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:10.271164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:10.272464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.272642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.272944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] PATH_INFO: `/v3/users/d9fb7cad9efe432ebd26d96ade78b364` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.275068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fb7cad9efe432ebd26d96ade78b364)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.277529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.374682 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2756/5526] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:10.380163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:10.403403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fb7cad9efe432ebd26d96ade78b364'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:10.404971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fb7cad9efe432ebd26d96ade78b364'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:10.408961 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:10.423566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c37c2-7277-41eb-bc7b-00bd5a8d35db None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:10.438220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fb7cad9efe432ebd26d96ade78b364'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:10.439841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fb7cad9efe432ebd26d96ade78b364'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:10.440570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:10.446664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.446959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.447241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.448214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.455424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8a56e9fd-aef5-4b7d-9926-e431171110dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fb7cad9efe432ebd26d96ade78b364'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:10.456686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.490790 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2771/5527] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:10 2022] DELETE /identity/v3/users/d9fb7cad9efe432ebd26d96ade78b364 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:10.495543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.495837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.496113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.518969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2757/5528] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:10 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:10.523289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:10.529750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:10.581786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:10.588197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:10.633676 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:10.751121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6146-86e4-4995-ae88-3e96bc7b5e05 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:10.787875 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2772/5529] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:10.788546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:10.789008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:10.792121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.792738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:10.793900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.809658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.810735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.812946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.827613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8011-87ab-45d7-81a5-d3c6e2d494d0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:10.839051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:10.841330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:10.841920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:10.842636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] PATH_INFO: `/v3/projects/fe781cd8395448e8a703bdfb16a1aad7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:10.845347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe781cd8395448e8a703bdfb16a1aad7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:10.852151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2758/5530] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:10 2022] POST /identity/v3/users => generated 298 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:10.852151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:10.852478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:10.854731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.001815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe781cd8395448e8a703bdfb16a1aad7', 'request_id': 'req-ec66783d-ed6f-404d-93ef-f170ae23bffb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.010520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcba88-a1de-4a18-91d6-3893ad33ee35 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:11.012102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe781cd8395448e8a703bdfb16a1aad7', 'request_id': 'req-ec66783d-ed6f-404d-93ef-f170ae23bffb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.018421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe781cd8395448e8a703bdfb16a1aad7', 'request_id': 'req-ec66783d-ed6f-404d-93ef-f170ae23bffb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.040396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] The token cache is being invalidate because project fe781cd8395448e8a703bdfb16a1aad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:11.040681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.041668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.044575 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2773/5531] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:10 2022] DELETE /identity/v3/projects/fe781cd8395448e8a703bdfb16a1aad7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:11.053615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:11.064965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.108138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:11.108806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:11.109095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:11.114787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:11.124278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.201294 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:11.238291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66783d-ed6f-404d-93ef-f170ae23bffb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:11.246593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:11.248058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:11.251211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:11.252049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:11.252380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:11.252640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:11.253422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:11.255061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:11.286716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2759/5532] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:11.287728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:11.289846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2774/5533] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:11.292705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:11.293778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.298974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.314818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467c51-70d8-4cd8-9011-c50ed44d4585 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:11.327018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9471af-8776-4833-9ef0-c8b5aa0e17ed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:11.331022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:11.332019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:11.332307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:11.332588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] PATH_INFO: `/v3/projects/fc6ebaa35c384404a975df400c356f95` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:11.333482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:11.333810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6ebaa35c384404a975df400c356f95)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:11.334972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:11.335498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:11.335786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:11.336722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] PATH_INFO: `/v3/users/a831f8428a4e489fa062db712c15dc63` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:11.338853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a831f8428a4e489fa062db712c15dc63)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:11.341325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:11.395683 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:11.437757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6ebaa35c384404a975df400c356f95', 'request_id': 'req-b67a2411-53b2-4d5f-84da-b85e6aeaf458'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.451842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6ebaa35c384404a975df400c356f95', 'request_id': 'req-b67a2411-53b2-4d5f-84da-b85e6aeaf458'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.470186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6ebaa35c384404a975df400c356f95', 'request_id': 'req-b67a2411-53b2-4d5f-84da-b85e6aeaf458'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.483928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] The token cache is being invalidate because project fc6ebaa35c384404a975df400c356f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:11.484222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.484912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.490482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2760/5534] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:11 2022] DELETE /identity/v3/projects/fc6ebaa35c384404a975df400c356f95 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:11.491106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a831f8428a4e489fa062db712c15dc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.491357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:11.493531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.495265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a831f8428a4e489fa062db712c15dc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.523037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a831f8428a4e489fa062db712c15dc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.523957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a831f8428a4e489fa062db712c15dc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.560994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a831f8428a4e489fa062db712c15dc63'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.610100 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2775/5535] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:11 2022] DELETE /identity/v3/users/a831f8428a4e489fa062db712c15dc63 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:11.610100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:11.626157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.717581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a2411-53b2-4d5f-84da-b85e6aeaf458 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:11.820692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:11.821613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:11.821904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:11.822186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] PATH_INFO: `/v3/projects/af813031a66a407e957200de2fa5ecf2/users/eb732f93a0634413bacd88c76337cbef/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:11.823891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78c2f-69a2-49cb-a322-5b67318d3282 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:11.830883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:11.832491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:11.833009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:11.833904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] PATH_INFO: `/v3/users/1a8b64d930bb41dd91446faf22682f50` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:11.835660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8b64d930bb41dd91446faf22682f50)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:11.839189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:11.853751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af813031a66a407e957200de2fa5ecf2, user_id=eb732f93a0634413bacd88c76337cbef, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:11.859191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:11.889355 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2761/5536] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:11 2022] PUT /identity/v3/projects/af813031a66a407e957200de2fa5ecf2/users/eb732f93a0634413bacd88c76337cbef/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:11.891158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:11.894717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:11.967231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8b64d930bb41dd91446faf22682f50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.968508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8b64d930bb41dd91446faf22682f50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.979845 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:11.985916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8b64d930bb41dd91446faf22682f50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:11.987898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8b64d930bb41dd91446faf22682f50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.001627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8b64d930bb41dd91446faf22682f50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.028089 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:12.034956 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2776/5537] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:11 2022] DELETE /identity/v3/users/1a8b64d930bb41dd91446faf22682f50 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:12.079662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311e056-9996-4450-9eeb-4399005b1e8c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:12.230713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:12.232475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:12.234238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:12.234832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:12.235961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:12.238256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:12.264130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:12.266922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:12.280238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2762/5538] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:08:12.296494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70660397-b410-4f24-80c8-8a3bf5975cd8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:12.314222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f078-add7-45bc-b7ee-babc5fca194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:12.315453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f078-add7-45bc-b7ee-babc5fca194c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:12.318055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f078-add7-45bc-b7ee-babc5fca194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:12.318658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f078-add7-45bc-b7ee-babc5fca194c admin admin] PATH_INFO: `/v3/projects/af813031a66a407e957200de2fa5ecf2/users/eb732f93a0634413bacd88c76337cbef/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:12.324122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f078-add7-45bc-b7ee-babc5fca194c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af813031a66a407e957200de2fa5ecf2, user_id=eb732f93a0634413bacd88c76337cbef, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:12.330944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f078-add7-45bc-b7ee-babc5fca194c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:12.344732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:12.350828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:12.394141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e7d54-0d73-44aa-a12c-ecd7b0418c33 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:12.394881 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2777/5539] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:12 2022] PUT /identity/v3/projects/af813031a66a407e957200de2fa5ecf2/users/eb732f93a0634413bacd88c76337cbef/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:12.409536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:12.409920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:12.410207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:12.493435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] MFA Rules not processed for user `eb732f93a0634413bacd88c76337cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:12.495186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:12.643391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:12.650796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:12.650988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:12.651239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] PATH_INFO: `/v3/projects/0fcccc2e015b48caa5cae0d9891bf622` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:12.655242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcccc2e015b48caa5cae0d9891bf622)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:12.659877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:12.823250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcccc2e015b48caa5cae0d9891bf622', 'request_id': 'req-94e29f9a-e411-4b0d-8c8d-8fde0900c010'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.838963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcccc2e015b48caa5cae0d9891bf622', 'request_id': 'req-94e29f9a-e411-4b0d-8c8d-8fde0900c010'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.842427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2778/5540] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:12.843125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:12.845268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:12.852513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcccc2e015b48caa5cae0d9891bf622', 'request_id': 'req-94e29f9a-e411-4b0d-8c8d-8fde0900c010'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.871281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] The token cache is being invalidate because project 0fcccc2e015b48caa5cae0d9891bf622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:12.871965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.872829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:12.876110 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2763/5541] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:12 2022] DELETE /identity/v3/projects/0fcccc2e015b48caa5cae0d9891bf622 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:12.878310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:12.880998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:12.888073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7bef7-8d4a-4c34-bab8-05cb0ddf5aee None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:12.921358 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:13.020844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:13.021811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.022965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.027560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] PATH_INFO: `/v3/projects/4c1bdbb9bda5423d85af31acc5775439` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.032250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1bdbb9bda5423d85af31acc5775439)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:13.032797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e29f9a-e411-4b0d-8c8d-8fde0900c010 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:13.037189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:13.039981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:13.041329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.041731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.042710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] PATH_INFO: `/v3/projects/21c7b4ca51f14f5cbaad0e7ddbeec583` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.043820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c7b4ca51f14f5cbaad0e7ddbeec583)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:13.045986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:13.152057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1bdbb9bda5423d85af31acc5775439', 'request_id': 'req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.153734 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:13.166744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1bdbb9bda5423d85af31acc5775439', 'request_id': 'req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.173711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1bdbb9bda5423d85af31acc5775439', 'request_id': 'req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.188627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] The token cache is being invalidate because project 4c1bdbb9bda5423d85af31acc5775439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:13.188919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.190931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.193131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2779/5542] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:12 2022] DELETE /identity/v3/projects/4c1bdbb9bda5423d85af31acc5775439 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:13.194574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'request_id': 'req-23221736-f032-4675-a638-bfd6ca8bb951'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.196386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:13.199097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.206349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'request_id': 'req-23221736-f032-4675-a638-bfd6ca8bb951'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.219272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c7b4ca51f14f5cbaad0e7ddbeec583', 'request_id': 'req-23221736-f032-4675-a638-bfd6ca8bb951'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.238652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] The token cache is being invalidate because project 21c7b4ca51f14f5cbaad0e7ddbeec583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:13.238949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.240627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.244189 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2764/5543] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:12 2022] DELETE /identity/v3/projects/21c7b4ca51f14f5cbaad0e7ddbeec583 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:13.245681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:13.248810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.305982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e44b9-5ce8-4f36-af16-14e2ecc5964b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:13.356810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23221736-f032-4675-a638-bfd6ca8bb951 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:13.361943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:13.363387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.363387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.363621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] PATH_INFO: `/v3/users/e2ddd5b33c904f0fb2539b8a8bb469d7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.364937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ddd5b33c904f0fb2539b8a8bb469d7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:13.366928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:13.415117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:13.415825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.416107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.416382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.428570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.476345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ddd5b33c904f0fb2539b8a8bb469d7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.478417 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:13.493147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ddd5b33c904f0fb2539b8a8bb469d7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.502566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ddd5b33c904f0fb2539b8a8bb469d7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.514427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ddd5b33c904f0fb2539b8a8bb469d7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.515485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9db0918d-ee4e-4160-b02b-966b73a43e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ddd5b33c904f0fb2539b8a8bb469d7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:13.526816 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2765/5544] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:13 2022] DELETE /identity/v3/users/e2ddd5b33c904f0fb2539b8a8bb469d7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:13.528619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2f8a-780c-4fde-9bab-fec78575606e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.529119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2f8a-780c-4fde-9bab-fec78575606e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.529585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2f8a-780c-4fde-9bab-fec78575606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.557644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-48cf2f8a-780c-4fde-9bab-fec78575606e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:13.558934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-48cf2f8a-780c-4fde-9bab-fec78575606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.584846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:13.588914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ffc9-7a74-46a2-b71f-d99a16de7904 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:13.642345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2780/5545] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:13.648091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d0fc-7d68-4cce-95b3-bf87393e1208 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.648091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d0fc-7d68-4cce-95b3-bf87393e1208 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.649654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d0fc-7d68-4cce-95b3-bf87393e1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.697625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f527d0fc-7d68-4cce-95b3-bf87393e1208 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:13.702140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f527d0fc-7d68-4cce-95b3-bf87393e1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.723333 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2766/5546] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:13.730441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.730936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.731229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.780028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:13.781444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.809861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2767/5547] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:13.810467 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:13.811476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:13.853795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9507965-b0ec-4838-9bd5-3529a1c9d9b1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:13.868097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:13.868801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.869410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.869410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.870102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:13.877165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:13.884493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:13.904365 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2781/5548] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:13.908657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.908961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.909542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.928084 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2768/5549] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:13.932835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:13.951100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:13.952350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:13.957571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999319-4e91-4d2f-a989-8abd46fc1c21 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:13.976092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:13.977802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:13.978407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:13.979010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:13.979944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:13.983385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:13.989058 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2782/5550] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:13.990028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.011671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2cd63-b054-4a3b-8106-0ff40697da36 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.023069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.025022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.025317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.025710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.027081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:14.027394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.030109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.038055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2769/5551] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:13 2022] POST /identity/v3/projects => generated 395 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:14.040765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.066402 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2783/5552] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:14.078535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.105184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6470-c084-4d20-bc80-334fd3761366 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.218821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ae49-57ff-4662-9ea8-1c9c9376ffd9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.225760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.226900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.227376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.227986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.228860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.235227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.247990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.248849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.249202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.249561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.250331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.252526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.262457 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2770/5553] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:14.263711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.266130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:14.306104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de93b05-3073-49e7-abd4-794250d39733 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.325754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.326580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.326928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.327213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] PATH_INFO: `/v3/projects/7c7c0d71e2a04f57894132adb5664fd0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.328838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7c0d71e2a04f57894132adb5664fd0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.330836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.333542 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2784/5554] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:14.335269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.362347 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:14.444112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee2345-8d87-4375-b2f9-959f9f6db6a8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.462062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7c0d71e2a04f57894132adb5664fd0', 'request_id': 'req-5079fd39-f7e1-48d8-8a6c-881edd7080e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:14.476465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7c0d71e2a04f57894132adb5664fd0', 'request_id': 'req-5079fd39-f7e1-48d8-8a6c-881edd7080e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:14.494042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7c0d71e2a04f57894132adb5664fd0', 'request_id': 'req-5079fd39-f7e1-48d8-8a6c-881edd7080e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:14.518866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] The token cache is being invalidate because project 7c7c0d71e2a04f57894132adb5664fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:14.519289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:14.521097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:14.524414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2771/5555] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:14 2022] DELETE /identity/v3/projects/7c7c0d71e2a04f57894132adb5664fd0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:14.526262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.528883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:14.559618 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:14.582959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e5a61-973f-47dd-994e-7f7fc3c10f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.583679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5a61-973f-47dd-994e-7f7fc3c10f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.584033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5a61-973f-47dd-994e-7f7fc3c10f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.584383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5a61-973f-47dd-994e-7f7fc3c10f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.585123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e5a61-973f-47dd-994e-7f7fc3c10f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.587165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e5a61-973f-47dd-994e-7f7fc3c10f09 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.611287 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2785/5556] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:14.617135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.617135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.617135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.640311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:14.641795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:14.663658 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2786/5557] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:14.665960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.667159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:14.681118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e4f3-dab8-4523-a038-932ead5e506a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.690722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f045e1-c7a9-46d1-b54a-b52c28f2a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.691708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f045e1-c7a9-46d1-b54a-b52c28f2a796 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.692524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f045e1-c7a9-46d1-b54a-b52c28f2a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.692832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f045e1-c7a9-46d1-b54a-b52c28f2a796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.693682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f045e1-c7a9-46d1-b54a-b52c28f2a796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.697065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f045e1-c7a9-46d1-b54a-b52c28f2a796 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.711733 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2787/5558] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:14.713080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.713375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.713655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.716878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079fd39-f7e1-48d8-8a6c-881edd7080e0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.729663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.730368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.730663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.730942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.731638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.733598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.742888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:14.744155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:14.755604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2788/5559] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:14.756385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.777598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f369ea-bfdd-4fb3-995c-8f3dc6e84a79 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.779067 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2772/5560] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:14.779982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.790786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.792799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.793269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.793730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] PATH_INFO: `/v3/projects/afcb7e0e6e584ebaad3a4b7e14387223/users/7dc2395a6d864ae4ae31be5cb3809891/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.798871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c37131-3346-40cd-a8ba-365a08336697 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.804860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.805540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.805826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.806106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.806889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:14.807193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.808802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.814116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcb7e0e6e584ebaad3a4b7e14387223, user_id=7dc2395a6d864ae4ae31be5cb3809891, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.817497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.831061 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2773/5561] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:14.831061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.837316 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2789/5562] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:14 2022] PUT /identity/v3/projects/afcb7e0e6e584ebaad3a4b7e14387223/users/7dc2395a6d864ae4ae31be5cb3809891/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:14.838765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:14.859611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7f631-c9fd-4413-adb5-05dcd4eadc15 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.936603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9c58-4a72-459e-888c-94f4fb594ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.938083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9c58-4a72-459e-888c-94f4fb594ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.938389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9c58-4a72-459e-888c-94f4fb594ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.938708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9c58-4a72-459e-888c-94f4fb594ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.939627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9c58-4a72-459e-888c-94f4fb594ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.941398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9c58-4a72-459e-888c-94f4fb594ae6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:14.953256 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2774/5563] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:14.954851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.955157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.955440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.971259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429d3c5-a7c3-4049-adc0-c889b83a4d91 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:14.977697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:14.978783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:14.979278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:14.979778 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:14.979907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:14.981535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:14.984669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.004386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] MFA Rules not processed for user `7dc2395a6d864ae4ae31be5cb3809891`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:15.005792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:15.051219 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2790/5564] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:15.055593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.179348 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2775/5565] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:15.180617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.192617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ea89-191e-4dee-9f1a-70650072860f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.199761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6fd17-88aa-4b0d-9d88-22a7601e5578 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.200088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.200971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.201544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.201978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.202883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.205000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.214964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.215692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.215985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.216259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.218139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.220871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.253392 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2776/5566] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:15 2022] POST /identity/v3/users => generated 287 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:15.254957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.274710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2affe9f-a993-4087-be59-bb128ddd7148 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.275264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2791/5567] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:15.276268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.284070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.285407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.285696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.285976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.287562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.291240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.302838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cab211-229d-471f-bda6-feaf42be8bfb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.321684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.323039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.323497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.323960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.324962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.327080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.339513 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2792/5568] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:15.340739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.342859 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2777/5569] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:15 2022] POST /identity/v3/projects => generated 395 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:15.348746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.353628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4d163-7f54-40d6-8b08-07f5913c5517 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.364985 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:15.424302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.425457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.425987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.426730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] PATH_INFO: `/v3/projects/58f03117e1c44832b41f8885f6a4c67f/users/d7ad3414041748e9be70302444c4f69e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.436451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a6cca-2512-48cb-89ad-26336f3eb8f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.442127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.442864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.443290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.443733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.444481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.446745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.449693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f03117e1c44832b41f8885f6a4c67f, user_id=d7ad3414041748e9be70302444c4f69e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.452690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.462407 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2778/5570] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:15.462407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.474569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff831e7-6ca4-4ec6-925a-0e6487f64329 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.495453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2793/5571] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:15 2022] PUT /identity/v3/projects/58f03117e1c44832b41f8885f6a4c67f/users/d7ad3414041748e9be70302444c4f69e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:15.496882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.555495 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:15.565100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad162b-0f96-48ba-acaa-46f5d7d167be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.567463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad162b-0f96-48ba-acaa-46f5d7d167be admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.567905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad162b-0f96-48ba-acaa-46f5d7d167be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.572330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad162b-0f96-48ba-acaa-46f5d7d167be admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.573778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad162b-0f96-48ba-acaa-46f5d7d167be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.578189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad162b-0f96-48ba-acaa-46f5d7d167be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.632405 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2779/5572] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:15 2022] POST /identity/v3/users => generated 304 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:15.634350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b402033-60e5-47f4-824d-0e38954589e5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.634669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b402033-60e5-47f4-824d-0e38954589e5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.636596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b402033-60e5-47f4-824d-0e38954589e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.647954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830174a-a456-4cf1-b4c7-256983131302 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.663713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.664765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.665125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.665502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] PATH_INFO: `/v3/projects/cbac9797d5744dc9b1f5680f643ecb0f/users/89f81b82fd254c14a71b470a8a01e857/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.690651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbac9797d5744dc9b1f5680f643ecb0f, user_id=89f81b82fd254c14a71b470a8a01e857, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.694211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.728023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2794/5573] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:15 2022] PUT /identity/v3/projects/cbac9797d5744dc9b1f5680f643ecb0f/users/89f81b82fd254c14a71b470a8a01e857/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:15.728133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6b402033-60e5-47f4-824d-0e38954589e5 None None] MFA Rules not processed for user `d7ad3414041748e9be70302444c4f69e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:15.728240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.728349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b402033-60e5-47f4-824d-0e38954589e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:15.883744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43708e15-db07-4cb3-9a85-6274a54b09db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.888375 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2780/5574] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:15.889767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.890060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.890341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.893182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.894431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.895049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.895657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.900732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.902852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.918126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2795/5575] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:15.920421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:15.939994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17a43-3e53-47dc-bd24-4838e1ab62e0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:15.949745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:15.951455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:15.952061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:15.952675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:15.953665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:15.957919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:15.968460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] MFA Rules not processed for user `89f81b82fd254c14a71b470a8a01e857`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:15.969853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:15.973505 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:16.000586 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2796/5576] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:15 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:16.002341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.104623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc659d-82bf-4c26-8f6c-f24e306156b2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.115839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2781/5577] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:16.122768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.128720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.129665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.130471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.130846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] PATH_INFO: `/v3/projects/36e94f33b540413ba61cf7132b357a53/users/967e3bd18c29498db5235d7f1bdc31d2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.137606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d643-151a-49ac-82f2-79f350e09aa3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.145626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.147238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.147700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.148543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.149737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.152163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.161056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e94f33b540413ba61cf7132b357a53, user_id=967e3bd18c29498db5235d7f1bdc31d2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.163867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.182418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2782/5578] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:16 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:16.184572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.186330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:16.200976 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2797/5579] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:16 2022] PUT /identity/v3/projects/36e94f33b540413ba61cf7132b357a53/users/967e3bd18c29498db5235d7f1bdc31d2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:16.205016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.282026 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:16.353656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0d949-f154-45ae-9471-098b838a8857 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.360516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ac91-bb24-45cd-8029-b74f61c1c295 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.363272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.363965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.364251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.364532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.365269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.371208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.396704 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2798/5580] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:16.397803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.422207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31c90e-cede-4f23-87ee-40a8bf21295e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.435026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.435739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.436027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.436307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.437356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.440832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.466427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2799/5581] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:16.471597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.493539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.494231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.494547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.494953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.527561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff188e9-dfe2-4739-becf-ea312762d760 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.543916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.545231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.545616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.546010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] PATH_INFO: `/v3/projects/0133cda0b3c245868a9b95402a3e4505/users/c3b352f4b71a48f7862ed55a752fd4c2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.581060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0133cda0b3c245868a9b95402a3e4505, user_id=c3b352f4b71a48f7862ed55a752fd4c2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.584082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.614781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.621040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.636748 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2783/5582] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:16.637827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.652130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64bc19-b95b-4f5b-b3eb-1c9f1506c480 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.653412 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2800/5583] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:16 2022] PUT /identity/v3/projects/0133cda0b3c245868a9b95402a3e4505/users/c3b352f4b71a48f7862ed55a752fd4c2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:16.657100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.759944 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:16.819660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de76796-96da-4153-832f-ee8957c2dd11 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.828193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.828783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb7e2-dcff-4fd7-837a-1182c0c22421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.828997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.829283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.829615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.829718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb7e2-dcff-4fd7-837a-1182c0c22421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.830131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb7e2-dcff-4fd7-837a-1182c0c22421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.830298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb7e2-dcff-4fd7-837a-1182c0c22421 admin admin] PATH_INFO: `/v3/projects/36e94f33b540413ba61cf7132b357a53/users/967e3bd18c29498db5235d7f1bdc31d2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.830469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.832417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.837016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb7e2-dcff-4fd7-837a-1182c0c22421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e94f33b540413ba61cf7132b357a53, user_id=967e3bd18c29498db5235d7f1bdc31d2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:16.840228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb7e2-dcff-4fd7-837a-1182c0c22421 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:16.849773 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2801/5584] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:16.853932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:16.866551 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2784/5585] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:16 2022] PUT /identity/v3/projects/36e94f33b540413ba61cf7132b357a53/users/967e3bd18c29498db5235d7f1bdc31d2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:16.867949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c438-1825-44f2-a3f9-d9f0a8414262 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:16.874750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.875121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.875479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.925741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] MFA Rules not processed for user `967e3bd18c29498db5235d7f1bdc31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:16.927939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:16.989749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b946d-b830-4f0d-be6a-46a070e87c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:16.991629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b946d-b830-4f0d-be6a-46a070e87c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:16.992092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b946d-b830-4f0d-be6a-46a070e87c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:16.992614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b946d-b830-4f0d-be6a-46a070e87c9b admin admin] PATH_INFO: `/v3/projects/0133cda0b3c245868a9b95402a3e4505/users/c3b352f4b71a48f7862ed55a752fd4c2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:16.997495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b946d-b830-4f0d-be6a-46a070e87c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0133cda0b3c245868a9b95402a3e4505, user_id=c3b352f4b71a48f7862ed55a752fd4c2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:17.002076 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:17.007051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b946d-b830-4f0d-be6a-46a070e87c9b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:17.024125 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2802/5586] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:16 2022] PUT /identity/v3/projects/0133cda0b3c245868a9b95402a3e4505/users/c3b352f4b71a48f7862ed55a752fd4c2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:17.116050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:17.116351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:17.116666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:17.128553 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2785/5587] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:17.135601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:17.137847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:17.168795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] MFA Rules not processed for user `c3b352f4b71a48f7862ed55a752fd4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:17.171300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:17.274131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2803/5588] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:17.275082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:17.286630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9bf7-4031-4b51-b49f-ca6a783600ff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:17.293801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:17.294479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:17.294811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:17.295692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:17.299682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:17.301413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:17.337596 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2804/5589] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:08:17 2022] POST /identity/v3/domains => generated 274 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:17.338678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:17.381323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7340830-ba9d-403c-aa19-837bf1a5f752 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:17.472594 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:17.530823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:17.531826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:17.532429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:17.534694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:17.580651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b56b7-3ad6-480b-896f-7e58d1c5ab50 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:17.599891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:17.605589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:17.605783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:17.606055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:17.610589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:17.613782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:17.685434 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:17.710610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:17.712699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:17.744519 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2786/5590] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:08:17.769702 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2805/5591] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:17 2022] POST /identity/v3/projects => generated 402 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:17.774021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:17.786237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a577e-f26c-4984-b4e8-1504f58cfaf3 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:17.913918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:17.915386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:17.916043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:17.916534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/groups` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:17.920340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:17.928858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:17.971832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:17.978184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2787/5592] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 15:08:17 2022] POST /identity/v3/groups => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:17.988628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54985c-434b-4f01-898d-98e7f9d7fc3d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.007412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.026279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.026594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.026885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.031500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.033497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.100780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.102297 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2806/5593] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:17 2022] POST /identity/v3/users => generated 445 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:18.117039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630743a0-8a8f-4466-a57c-d8ef68fece22 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.132434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.133868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.134266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.134681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.135559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.137526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.173354 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2788/5594] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:08:18 2022] POST /identity/v3/roles => generated 239 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:08:18.178034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.197481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406772-3da3-403c-8d05-c284cf8152f3 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.220195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.227040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.229838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.230086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.258596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_grant(project_id=755237015fd54a29ab1336ceb04d4861, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f, role_id=dc7f3d7e3fbc4eeb9e1ae02e879ebd7f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.271258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.312643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.314873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:18.317899 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2807/5595] 10.222.0.77 () {60 vars in 1584 bytes} [Mon Jul 11 15:08:18 2022] PUT /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f/inherited_to_projects => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:18.328795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.503149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f9171-9cf4-4395-bd21-cb3a292dab5f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.507493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b3a04-567a-40fd-99a8-bf8b6972ae93 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.518429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.521075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.522032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.522844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.528157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:check_grant(project_id=755237015fd54a29ab1336ceb04d4861, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f, role_id=dc7f3d7e3fbc4eeb9e1ae02e879ebd7f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.529643 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:18.529643 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:08:18.529643 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:08:18.535428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.557249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2808/5596] 10.222.0.77 () {58 vars in 1566 bytes} [Mon Jul 11 15:08:18 2022] HEAD /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:18.561625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.582978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ecbd-8676-45c9-b8a0-9bcf16097951 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.596454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.597910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.598427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.600040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.606443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=755237015fd54a29ab1336ceb04d4861, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f, role_id=dc7f3d7e3fbc4eeb9e1ae02e879ebd7f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.614321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.629127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role dc7f3d7e3fbc4eeb9e1ae02e879ebd7f was removed from group 052ad1f7f9e941b1ba7f67e2e1cdfb3f on project 755237015fd54a29ab1336ceb04d4861. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:18.629431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.630902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.653365 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2809/5597] 10.222.0.77 () {58 vars in 1568 bytes} [Mon Jul 11 15:08:18 2022] DELETE /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:18.656879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.657559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.657850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.658181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.664557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:18.665496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.668979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:18.678807 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:18.848614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.850109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.873428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10596184-2504-4655-a01a-b4ae69135854 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:18.888557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:18.889398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:18.889698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:18.889961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:18.891627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dc7f3d7e3fbc4eeb9e1ae02e879ebd7f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:18.893313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:18.895036 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:18.899492 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2789/5598] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:18.931307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:18.933062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:18.991151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role dc7f3d7e3fbc4eeb9e1ae02e879ebd7f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:18.991453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.993467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:18.997139 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2810/5599] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:18 2022] DELETE /identity/v3/roles/dc7f3d7e3fbc4eeb9e1ae02e879ebd7f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:19.005059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:19.015096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:19.134074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740bf7-30e6-41ea-824d-f8c910229c96 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:19.294235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5f1b-1daf-46b4-a11f-cc5a9265d9eb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:19.313198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:19.313198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.313198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.313583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.331132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:19.332817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:19.384512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2811/5600] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:08:19 2022] POST /identity/v3/roles => generated 240 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:19.386431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:19.428394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19495bc-7a8c-4217-a347-0ee1eb5fcdd6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:19.441368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:19.442370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.442694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.445538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/46e68dd8a2e3467cb3b92e95ecc8f877/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.457110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:19.458017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.458302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.458619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] PATH_INFO: `/v3/users/7dc2395a6d864ae4ae31be5cb3809891` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.460664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc2395a6d864ae4ae31be5cb3809891)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:19.463165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:19.487477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_grant(project_id=755237015fd54a29ab1336ceb04d4861, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=46e68dd8a2e3467cb3b92e95ecc8f877)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:19.494146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:19.526072 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2812/5601] 10.222.0.77 () {60 vars in 1581 bytes} [Mon Jul 11 15:08:19 2022] PUT /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/46e68dd8a2e3467cb3b92e95ecc8f877/inherited_to_projects => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:19.531486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:19.629546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc2395a6d864ae4ae31be5cb3809891'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.644944 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:19.686656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc2395a6d864ae4ae31be5cb3809891'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.707202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc2395a6d864ae4ae31be5cb3809891'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.719851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc2395a6d864ae4ae31be5cb3809891'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.720941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-513cb588-59da-49a0-a38d-3dc08c0953f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc2395a6d864ae4ae31be5cb3809891'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:19.732331 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2790/5602] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:18 2022] DELETE /identity/v3/users/7dc2395a6d864ae4ae31be5cb3809891 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:19.739878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.740655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.741192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.746391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e60f8-b7e0-417b-a1e9-b226a4268fab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:19.784090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:19.786622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:19.868510 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:19.904906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:19.905790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.906085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.906375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/46e68dd8a2e3467cb3b92e95ecc8f877/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.915031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:check_grant(project_id=755237015fd54a29ab1336ceb04d4861, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=46e68dd8a2e3467cb3b92e95ecc8f877)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:19.917825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:19.939165 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2813/5603] 10.222.0.77 () {58 vars in 1563 bytes} [Mon Jul 11 15:08:19 2022] HEAD /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/46e68dd8a2e3467cb3b92e95ecc8f877/inherited_to_projects => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:19.943930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:19.956818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:19.981236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2db598-2b60-466f-b8b3-04f6053ea977 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:19.987035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:19.988106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:19.988540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:19.989152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/46e68dd8a2e3467cb3b92e95ecc8f877/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:19.991999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=755237015fd54a29ab1336ceb04d4861, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=46e68dd8a2e3467cb3b92e95ecc8f877)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.001204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:20.008972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 46e68dd8a2e3467cb3b92e95ecc8f877 was removed from user 3ecd4f2d297646169c7957f9496a1968 on project 755237015fd54a29ab1336ceb04d4861. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:20.014100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2791/5604] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:20.028793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:20.031516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:20.032738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:20.040117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:20.085675 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2814/5605] 10.222.0.77 () {58 vars in 1565 bytes} [Mon Jul 11 15:08:19 2022] DELETE /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/46e68dd8a2e3467cb3b92e95ecc8f877/inherited_to_projects => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:20.086421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:20.093739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:20.200292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949a5f-746e-45a7-ba5a-3eb189704c59 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:20.245206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748073-d788-422b-87bc-d6ad3092d70f tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:20.260078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:20.261450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.261741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.262020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles/46e68dd8a2e3467cb3b92e95ecc8f877` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.263706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=46e68dd8a2e3467cb3b92e95ecc8f877)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.265444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:20.310399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:20.312312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.312851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.313351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.316005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:20.335105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 46e68dd8a2e3467cb3b92e95ecc8f877 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:20.335391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:20.338915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:20.341351 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2815/5606] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:20 2022] DELETE /identity/v3/roles/46e68dd8a2e3467cb3b92e95ecc8f877 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:20.346202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:20.347948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:20.382949 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:20.477419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.480097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:20.531739 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2792/5607] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:20.540624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463d75c-3c03-40fe-b883-96f7eb027ecb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:20.562437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:20.563176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.563471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.563772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.564618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.566420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:20.594029 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2816/5608] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:08:20 2022] POST /identity/v3/roles => generated 239 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:20.598330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:20.619370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4014-45cb-41ea-9ece-26df1ac35db7 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:20.627065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76da0e-0f69-4507-81d3-35a7c72b5a72 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:20.639072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76da0e-0f69-4507-81d3-35a7c72b5a72 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.639374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76da0e-0f69-4507-81d3-35a7c72b5a72 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.639980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76da0e-0f69-4507-81d3-35a7c72b5a72 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/a5668f389760448cb61769ae66afe074/inherited_to_projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.656367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76da0e-0f69-4507-81d3-35a7c72b5a72 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f, role_id=a5668f389760448cb61769ae66afe074)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.678812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76da0e-0f69-4507-81d3-35a7c72b5a72 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:20.723108 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2793/5609] 10.222.0.77 () {60 vars in 1581 bytes} [Mon Jul 11 15:08:20 2022] PUT /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/a5668f389760448cb61769ae66afe074/inherited_to_projects => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:20.725272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:20.745472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d724729-8b03-4235-8a0b-a7c565704631 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:20.774001 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:20.797226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.797595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.797883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.825529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] MFA Rules not processed for user `89f81b82fd254c14a71b470a8a01e857`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:20.833467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:20.897816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:20.898830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.899832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.900173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.903118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=40b34480df274f089a45ab7f982e1d4f, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.904287 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:20.904287 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:08:20.904287 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:08:20.906483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:20.932371 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2817/5610] 10.222.0.77 () {58 vars in 1463 bytes} [Mon Jul 11 15:08:20 2022] GET /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/inherited_to_projects => generated 447 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:20.933364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:20.961980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509c2e-3af7-4d3f-8ea3-2e78133f20b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:20.981812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:20.985141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:20.985452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:20.985721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/a5668f389760448cb61769ae66afe074/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:20.988367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f, role_id=a5668f389760448cb61769ae66afe074)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:20.991518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:21.003226 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2818/5611] 10.222.0.77 () {58 vars in 1563 bytes} [Mon Jul 11 15:08:20 2022] HEAD /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/a5668f389760448cb61769ae66afe074/inherited_to_projects => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:21.005009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:21.026748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7bbf8-4a15-4a6d-808c-a59f83fe8396 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:21.044767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:21.045636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:21.045932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:21.046367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/a5668f389760448cb61769ae66afe074/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:21.049646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f, role_id=a5668f389760448cb61769ae66afe074)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:21.057283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:21.070689 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2794/5612] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:21.079492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role a5668f389760448cb61769ae66afe074 was removed from group 052ad1f7f9e941b1ba7f67e2e1cdfb3f on domain 40b34480df274f089a45ab7f982e1d4f. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:21.079801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:21.084504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:21.124787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:21.124978 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2819/5613] 10.222.0.77 () {58 vars in 1565 bytes} [Mon Jul 11 15:08:21 2022] DELETE /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f/roles/a5668f389760448cb61769ae66afe074/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:21.139639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2ac94-d64c-45f4-8346-b9f46c21f8b4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:21.296716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:21.297741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:21.298137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:21.298545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles/a5668f389760448cb61769ae66afe074` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:21.301548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a5668f389760448cb61769ae66afe074)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:21.303345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:21.398818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role a5668f389760448cb61769ae66afe074 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:21.399127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:21.400721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:21.418236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:21.418824 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2795/5614] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:21 2022] DELETE /identity/v3/roles/a5668f389760448cb61769ae66afe074 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:21.420106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:21.455362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4868009-e5d0-4860-ba25-512b94d3b8f0 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:21.551184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:21.552300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:21.552703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:21.553191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:21.554263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:21.557231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:21.585472 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2820/5615] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:08:21 2022] POST /identity/v3/roles => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:08:21.591134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:21.592709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:21.646413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79c28-c9b4-4884-b9a0-1eb5d8499a6a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:21.666283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:21.669316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:21.669767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:21.669891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/30c471aa699949d5ba50e5732b1c64f2/inherited_to_projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:21.684132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=30c471aa699949d5ba50e5732b1c64f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:21.694519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:21.759774 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2796/5616] 10.222.0.77 () {60 vars in 1578 bytes} [Mon Jul 11 15:08:21 2022] PUT /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/30c471aa699949d5ba50e5732b1c64f2/inherited_to_projects => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:21.761757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:21.779962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9e97-036e-4125-9d90-abe9cc4d39d6 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.107325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.108277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.108624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.108991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.113161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=40b34480df274f089a45ab7f982e1d4f, user_id=3ecd4f2d297646169c7957f9496a1968)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.115888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.164699 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2821/5617] 10.222.0.77 () {58 vars in 1460 bytes} [Mon Jul 11 15:08:21 2022] GET /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/inherited_to_projects => generated 447 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:22.169335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.195766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79fbfc-c2a6-4a58-bba1-a12370c61c68 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.224989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.229387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.233378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.233378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/30c471aa699949d5ba50e5732b1c64f2/inherited_to_projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.234931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.237597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:22.243936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=30c471aa699949d5ba50e5732b1c64f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.252030 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:22.252030 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:22.252030 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:22.264490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.274070 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:22.296518 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2797/5618] 10.222.0.77 () {58 vars in 1560 bytes} [Mon Jul 11 15:08:22 2022] HEAD /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/30c471aa699949d5ba50e5732b1c64f2/inherited_to_projects => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:22.297515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.341236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d6af-f714-47bb-8972-abbc98e8b0e1 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.354960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.356127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.356265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.356467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/30c471aa699949d5ba50e5732b1c64f2/inherited_to_projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.390730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=30c471aa699949d5ba50e5732b1c64f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.392071 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:22.392071 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:22.392071 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:22.406044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.407448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23685b-fbb5-40e1-8d0d-ea0c973b3d03 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.420968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.421861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.422141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.422419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] PATH_INFO: `/v3/projects/afcb7e0e6e584ebaad3a4b7e14387223` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.423676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcb7e0e6e584ebaad3a4b7e14387223)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.425584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.435119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 30c471aa699949d5ba50e5732b1c64f2 was removed from user 3ecd4f2d297646169c7957f9496a1968 on domain 40b34480df274f089a45ab7f982e1d4f. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:22.435487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.444778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.457522 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:22.480026 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2798/5619] 10.222.0.77 () {58 vars in 1562 bytes} [Mon Jul 11 15:08:22 2022] DELETE /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/30c471aa699949d5ba50e5732b1c64f2/inherited_to_projects => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:22.484919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.487347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:22.522984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcb7e0e6e584ebaad3a4b7e14387223', 'request_id': 'req-661c4887-b35c-458c-be7b-1a890ed7a28d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.533979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcb7e0e6e584ebaad3a4b7e14387223', 'request_id': 'req-661c4887-b35c-458c-be7b-1a890ed7a28d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.542201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcb7e0e6e584ebaad3a4b7e14387223', 'request_id': 'req-661c4887-b35c-458c-be7b-1a890ed7a28d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.558201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] The token cache is being invalidate because project afcb7e0e6e584ebaad3a4b7e14387223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:22.558580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.559291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.564334 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2822/5620] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:22 2022] DELETE /identity/v3/projects/afcb7e0e6e584ebaad3a4b7e14387223 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:22.565503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.569628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:22.573911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9209-399c-47d1-ad69-01581e6f9444 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.684733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.685694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.685902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.686226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles/30c471aa699949d5ba50e5732b1c64f2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.688281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=30c471aa699949d5ba50e5732b1c64f2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.689467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.737674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 30c471aa699949d5ba50e5732b1c64f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:22.737980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.740873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:22.743853 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2799/5621] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:22 2022] DELETE /identity/v3/roles/30c471aa699949d5ba50e5732b1c64f2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:22.748937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.750540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:22.825857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc332a-be25-4a59-b868-ddb465af752d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.832299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.833396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.834104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.834404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.835269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.837847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.884328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2800/5622] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:08:22 2022] POST /identity/v3/roles => generated 239 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:22.885615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:22.888224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4887-b35c-458c-be7b-1a890ed7a28d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.902388 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:22.920494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3bea-9974-4c40-894a-92aafe59f92b tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:22.934483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:22.935564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:22.936393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:22.936987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:22.938395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:22.941404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:22.991649 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:23.004558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:23.005444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:23.005726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:23.006000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] PATH_INFO: `/v3/users/967e3bd18c29498db5235d7f1bdc31d2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:23.007296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] RBAC: Authorizing `identity:delete_user(user_id=967e3bd18c29498db5235d7f1bdc31d2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:23.009886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:23.033882 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2801/5623] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:22 2022] POST /identity/v3/projects => generated 408 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:23.037977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:23.170473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967e3bd18c29498db5235d7f1bdc31d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:23.174554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967e3bd18c29498db5235d7f1bdc31d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:23.208823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967e3bd18c29498db5235d7f1bdc31d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:23.211461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967e3bd18c29498db5235d7f1bdc31d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:23.249760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967e3bd18c29498db5235d7f1bdc31d2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:23.261979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd81ce-5b6f-418a-a25b-ef79991d54b8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:23.277682 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2823/5624] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:22 2022] DELETE /identity/v3/users/967e3bd18c29498db5235d7f1bdc31d2 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:23.277843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:23.277843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:23.277843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:23.278148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/81ff74a1b69d451b924c876a2fc5ac5d/inherited_to_projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:23.279854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=81ff74a1b69d451b924c876a2fc5ac5d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:23.284394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:23.308775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:23.311024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:23.314703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2802/5625] 10.222.0.77 () {60 vars in 1578 bytes} [Mon Jul 11 15:08:23 2022] PUT /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/81ff74a1b69d451b924c876a2fc5ac5d/inherited_to_projects => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:23.497729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87ca53-3b3a-4e84-bc74-34c16cbb21df admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:23.617917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:23.619030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:23.619579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:23.620095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:23.621291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Adding query filter params (scope.project.id=755237015fd54a29ab1336ceb04d4861, user.id=3ecd4f2d297646169c7957f9496a1968) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:23.621911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:23.623303 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:23.623303 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:08:23.623303 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:08:23.625061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:23.668740 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:23.712234 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2824/5626] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:08:23 2022] GET /identity/v3/role_assignments?scope.project.id=755237015fd54a29ab1336ceb04d4861&user.id=3ecd4f2d297646169c7957f9496a1968&effective => generated 648 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:23.716240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:23.735527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cc012-f9f3-411c-84fb-13663876c85d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:23.744282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:23.744964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:23.745250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:23.745529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:23.747883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Adding query filter params (scope.project.id=bd5e31cf674b453d9f423beeb1e040d9, user.id=3ecd4f2d297646169c7957f9496a1968) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:23.748211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:23.750138 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:08:23.750138 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:08:23.750138 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:08:23.752873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:23.836754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:23.838939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:23.972639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2803/5627] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:08:23 2022] GET /identity/v3/role_assignments?scope.project.id=bd5e31cf674b453d9f423beeb1e040d9&user.id=3ecd4f2d297646169c7957f9496a1968&effective => generated 648 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:23.979942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.024557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac0614-bc9d-46cc-9a31-1ebb2f9a1aab tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.053960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.056310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.056602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.056924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/81ff74a1b69d451b924c876a2fc5ac5d/inherited_to_projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.061882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc931832-a17c-48e7-94c1-90d5860a0027 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.063046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=40b34480df274f089a45ab7f982e1d4f, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=81ff74a1b69d451b924c876a2fc5ac5d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.071564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.072428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.074599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.074887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.076698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] PATH_INFO: `/v3/projects/36e94f33b540413ba61cf7132b357a53` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.079289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e94f33b540413ba61cf7132b357a53)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.082380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.083977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 81ff74a1b69d451b924c876a2fc5ac5d was removed from user 3ecd4f2d297646169c7957f9496a1968 on domain 40b34480df274f089a45ab7f982e1d4f. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:24.084327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.085058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.118316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2804/5628] 10.222.0.77 () {58 vars in 1562 bytes} [Mon Jul 11 15:08:23 2022] DELETE /identity/v3/OS-INHERIT/domains/40b34480df274f089a45ab7f982e1d4f/users/3ecd4f2d297646169c7957f9496a1968/roles/81ff74a1b69d451b924c876a2fc5ac5d/inherited_to_projects => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:24.119453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.120940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:24.198576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e94f33b540413ba61cf7132b357a53', 'request_id': 'req-e90dddc7-21d0-4d80-92b5-c487d836ac0d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.217706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e94f33b540413ba61cf7132b357a53', 'request_id': 'req-e90dddc7-21d0-4d80-92b5-c487d836ac0d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.231303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e94f33b540413ba61cf7132b357a53', 'request_id': 'req-e90dddc7-21d0-4d80-92b5-c487d836ac0d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.245787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] The token cache is being invalidate because project 36e94f33b540413ba61cf7132b357a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:24.246093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.247083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e90dddc7-21d0-4d80-92b5-c487d836ac0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:24.256454 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2825/5629] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:23 2022] DELETE /identity/v3/projects/36e94f33b540413ba61cf7132b357a53 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:24.258764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0bcb-33ee-49a8-9f78-49b800fb22a4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.259051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0bcb-33ee-49a8-9f78-49b800fb22a4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.259375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0bcb-33ee-49a8-9f78-49b800fb22a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.283480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-daad0bcb-33ee-49a8-9f78-49b800fb22a4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:24.284746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-daad0bcb-33ee-49a8-9f78-49b800fb22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:24.302019 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:24.361304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cb9cd-3209-438d-82fc-a54942ba5b2d tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.448737 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2826/5630] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:24.458505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.458819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.459078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.474020 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:24.496099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:24.498429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:24.518136 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2827/5631] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:24.533505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.548549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf517cf9-0a05-40e6-9339-b68ce133970f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.549758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.553190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.553963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.555377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.559006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Adding query filter params (scope.project.id=755237015fd54a29ab1336ceb04d4861, user.id=3ecd4f2d297646169c7957f9496a1968) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:24.561546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.566102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.572104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.573347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.573919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.574760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.577016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:24.577834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.580582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.609172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2828/5632] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:24.611174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.628921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9e067-0bf8-4337-a132-fe0a6b4a9281 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.635494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.636697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.636994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.637439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.638401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.640845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.661704 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2805/5633] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:08:24 2022] GET /identity/v3/role_assignments?scope.project.id=755237015fd54a29ab1336ceb04d4861&user.id=3ecd4f2d297646169c7957f9496a1968&effective => generated 228 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:08:24.666263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.668567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:24.688282 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2829/5634] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:24 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:24.693781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.707296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447a074-ea7b-46c6-a9a5-b1731f6985e8 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.847673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab0b31-e463-49b8-94b6-0173865d2b35 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.857515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.859525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.860041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.860449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.861168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.863430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.886912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.887772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.888195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.888605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.889642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Adding query filter params (scope.project.id=bd5e31cf674b453d9f423beeb1e040d9, user.id=3ecd4f2d297646169c7957f9496a1968) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:24.890068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.892364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.910925 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2830/5635] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:24 2022] POST /identity/v3/users => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:24.913692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:24.941731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56772f-b7bc-40af-b974-02ccf3aaa4c3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:24.955622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:24.956495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:24.956808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:24.957192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:24.958286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:24.962129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:24.992172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2831/5636] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:24 2022] GET /identity/v3/roles => generated 1650 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:25.006599 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2806/5637] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:08:24 2022] GET /identity/v3/role_assignments?scope.project.id=bd5e31cf674b453d9f423beeb1e040d9&user.id=3ecd4f2d297646169c7957f9496a1968&effective => generated 228 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:08:25.009032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.011177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.025753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac10cdd-a493-4842-8497-ed5c3cf361af tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.033282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b6dd-90d3-4a57-b455-a8f27b0f28f0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.040054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.041115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.041976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.041976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.042848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.044828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.047369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.048326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.048691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.049040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/projects/bd5e31cf674b453d9f423beeb1e040d9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.055383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd5e31cf674b453d9f423beeb1e040d9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.057647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.062146 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2832/5638] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:24 2022] GET /identity/v3/roles => generated 1650 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:25.063257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.076063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6606-b6c4-4f26-adaa-1075efeed4dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.081902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.083674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.084032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.084380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] PATH_INFO: `/v3/projects/6a8220514cfd44fd9e435e28a4b51ad4/users/42b20a99d79a4965a6bd700b8d6a2d6d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.097731 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:25.138072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5e31cf674b453d9f423beeb1e040d9', 'request_id': 'req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.142793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8220514cfd44fd9e435e28a4b51ad4, user_id=42b20a99d79a4965a6bd700b8d6a2d6d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.150177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.151349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5e31cf674b453d9f423beeb1e040d9', 'request_id': 'req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.160157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5e31cf674b453d9f423beeb1e040d9', 'request_id': 'req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.174153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] The token cache is being invalidate because project bd5e31cf674b453d9f423beeb1e040d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:25.174465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.174985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2833/5639] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:25 2022] PUT /identity/v3/projects/6a8220514cfd44fd9e435e28a4b51ad4/users/42b20a99d79a4965a6bd700b8d6a2d6d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:25.175268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fb2226c8-d70b-4f32-b1f6-0a1d3c8fc4a9 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.177126 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2807/5640] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:25 2022] DELETE /identity/v3/projects/bd5e31cf674b453d9f423beeb1e040d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:25.181727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.183690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:25.186758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.187226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.188256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.232259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] MFA Rules not processed for user `42b20a99d79a4965a6bd700b8d6a2d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:25.233491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:25.274456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5677a1e-a724-469c-ba00-71b53ee3dcde admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.286040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.286963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.287257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.287539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles/81ff74a1b69d451b924c876a2fc5ac5d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.289509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=81ff74a1b69d451b924c876a2fc5ac5d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.291701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.303288 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:25.349230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 81ff74a1b69d451b924c876a2fc5ac5d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:25.349624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.350903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:25.354743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2834/5641] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:25 2022] DELETE /identity/v3/roles/81ff74a1b69d451b924c876a2fc5ac5d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:25.359832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.361309 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2808/5642] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:25.361782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:25.365722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.369886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:25.498083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cae51-4f54-465b-b5e0-508673dab44f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.532667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696d3d-d6c4-4b51-9729-d2561e4d6041 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.547776 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:25.550908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.551676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.552059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.552413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.553255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.555551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.570739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.571424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.571754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.572414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.573910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.576192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.587470 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2835/5643] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:08:25 2022] POST /identity/v3/roles => generated 239 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:25.588590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.609522 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2809/5644] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:25 2022] POST /identity/v3/projects => generated 401 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:25.613864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.617931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562cfb-8b88-45d3-acb7-a803800e3f0c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.619323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:25.698328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15fd14-9fea-4956-8ae6-69f0fa927c18 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.703932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.704676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.704976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.705316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.706183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.708510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.758251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.758488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2810/5645] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:25 2022] POST /identity/v3/users => generated 307 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:25.758921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.758921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.758921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.760332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.760527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.765343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.775083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a2a94-7e82-4624-9ba1-c709e01e8ea6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.781092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.782253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.782697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.783070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.783890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.785576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.802593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2811/5646] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:25 2022] GET /identity/v3/roles => generated 1650 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:25.804047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.821983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb7eb5-4aed-4e3e-90a2-62040ceee84a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.826907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2836/5647] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:25 2022] POST /identity/v3/projects => generated 409 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:08:25.828142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.917938 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:25.936079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea8990-bedb-4879-aa41-649355dc9415 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:25.943455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.944715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.945126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.945524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/3659f82800324ca2afb71ad99c578b20/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:25.949307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:create_grant(project_id=755237015fd54a29ab1336ceb04d4861, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=3659f82800324ca2afb71ad99c578b20)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:25.964933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:25.989140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2837/5648] 10.222.0.77 () {60 vars in 1581 bytes} [Mon Jul 11 15:08:25 2022] PUT /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/3659f82800324ca2afb71ad99c578b20/inherited_to_projects => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:25.992691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:25.993388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:25.993798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:25.994150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:25.994481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] PATH_INFO: `/v3/projects/293eabbfa4124506a40fd42d99d7e0d4/users/a0c6c836acb841eab7dea46be54b74de/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.025234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=293eabbfa4124506a40fd42d99d7e0d4, user_id=a0c6c836acb841eab7dea46be54b74de, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.030177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.058874 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2812/5649] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:25 2022] PUT /identity/v3/projects/293eabbfa4124506a40fd42d99d7e0d4/users/a0c6c836acb841eab7dea46be54b74de/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:26.061470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:26.096077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c580-1aff-4854-b070-be651aac8e6e tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.100676 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:26.149543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18153ca-9cbd-4257-b302-fe47dbac64fe admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.155368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.156114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.156404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.157363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.157852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.160252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.178082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2813/5650] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:26 2022] GET /identity/v3/roles => generated 1650 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:08:26.179556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:26.195460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.196601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.196601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.196876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ac03-0ac5-44a5-b910-e2c4c55e2fe3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.198127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.200245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Adding query filter params (scope.project.id=d1e331e253234865b79931fd8027116e, user.id=3ecd4f2d297646169c7957f9496a1968) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:26.201476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.204185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.208410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802df1-49cf-4802-b71c-2745385a93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.210226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802df1-49cf-4802-b71c-2745385a93a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.215804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802df1-49cf-4802-b71c-2745385a93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.217373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802df1-49cf-4802-b71c-2745385a93a3 admin admin] PATH_INFO: `/v3/projects/293eabbfa4124506a40fd42d99d7e0d4/users/a0c6c836acb841eab7dea46be54b74de/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.221081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802df1-49cf-4802-b71c-2745385a93a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293eabbfa4124506a40fd42d99d7e0d4, user_id=a0c6c836acb841eab7dea46be54b74de, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.224881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802df1-49cf-4802-b71c-2745385a93a3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.238915 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2814/5651] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:26 2022] PUT /identity/v3/projects/293eabbfa4124506a40fd42d99d7e0d4/users/a0c6c836acb841eab7dea46be54b74de/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:26.251668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.252080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.252370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.292981 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2838/5652] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:08:25 2022] GET /identity/v3/role_assignments?scope.project.id=d1e331e253234865b79931fd8027116e&user.id=3ecd4f2d297646169c7957f9496a1968&effective => generated 649 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:08:26.297230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:26.320999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] MFA Rules not processed for user `a0c6c836acb841eab7dea46be54b74de`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:26.323380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:26.338008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3042-d051-46ea-9fb7-0d3cabdec86a tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.395559 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:26.423168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.424034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.424446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.428694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/3659f82800324ca2afb71ad99c578b20/inherited_to_projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.428694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=755237015fd54a29ab1336ceb04d4861, user_id=3ecd4f2d297646169c7957f9496a1968, role_id=3659f82800324ca2afb71ad99c578b20)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.430077 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2815/5653] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:26.437113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:26.438602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.438739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:26.446259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 3659f82800324ca2afb71ad99c578b20 was removed from user 3ecd4f2d297646169c7957f9496a1968 on project 755237015fd54a29ab1336ceb04d4861. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:26.457483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:26.459344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:26.487211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2839/5654] 10.222.0.77 () {58 vars in 1565 bytes} [Mon Jul 11 15:08:26 2022] DELETE /identity/v3/OS-INHERIT/projects/755237015fd54a29ab1336ceb04d4861/users/3ecd4f2d297646169c7957f9496a1968/roles/3659f82800324ca2afb71ad99c578b20/inherited_to_projects => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:26.492409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:26.496791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:26.563781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df270f-52ce-4feb-a481-747b26475b51 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.609175 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:26.651712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.652539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.652933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.653319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.655823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:26.726453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd7cb0-7ee8-470d-8b9b-832e132c5ecd tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.736095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.737795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.748827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.749766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.750204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.750692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.750894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2816/5655] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:08:26.752334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Adding query filter params (scope.project.id=d1e331e253234865b79931fd8027116e, user.id=3ecd4f2d297646169c7957f9496a1968) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:26.753732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.755816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:26.891855 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2840/5656] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:08:26 2022] GET /identity/v3/role_assignments?scope.project.id=d1e331e253234865b79931fd8027116e&user.id=3ecd4f2d297646169c7957f9496a1968&effective => generated 228 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:26.895674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:26.911718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848ac3-e284-4ce3-83ba-e382bdd7a924 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:26.924340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:26.925841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:26.927301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:26.927744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/projects/d1e331e253234865b79931fd8027116e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:26.932267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1e331e253234865b79931fd8027116e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:26.936295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:27.024144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e331e253234865b79931fd8027116e', 'request_id': 'req-31987807-6306-4411-938b-31e70831408c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.090724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e331e253234865b79931fd8027116e', 'request_id': 'req-31987807-6306-4411-938b-31e70831408c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.116179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e331e253234865b79931fd8027116e', 'request_id': 'req-31987807-6306-4411-938b-31e70831408c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.133809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] The token cache is being invalidate because project d1e331e253234865b79931fd8027116e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:27.134944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.135809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.143972 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2817/5657] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:26 2022] DELETE /identity/v3/projects/d1e331e253234865b79931fd8027116e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:27.144758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:27.147006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:27.184675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12ae2-23c7-4f8c-8856-cef068923774 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:27.339393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:27.340276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:27.340558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:27.340832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/roles/3659f82800324ca2afb71ad99c578b20` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:27.343177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3659f82800324ca2afb71ad99c578b20)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:27.344810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:27.413456 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:27.454488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invalidating the token cache because role 3659f82800324ca2afb71ad99c578b20 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:27.454888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.463017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.465598 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2841/5658] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:27 2022] DELETE /identity/v3/roles/3659f82800324ca2afb71ad99c578b20 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:27.470753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:27.484806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987807-6306-4411-938b-31e70831408c tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:27.637722 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:27.674687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:27.675600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:27.675892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:27.676175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/users/3ecd4f2d297646169c7957f9496a1968` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:27.680917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3ecd4f2d297646169c7957f9496a1968)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:27.682912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:27.708269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:27.709726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:27.780186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecd4f2d297646169c7957f9496a1968'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.805996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecd4f2d297646169c7957f9496a1968'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.821167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecd4f2d297646169c7957f9496a1968'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.841928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecd4f2d297646169c7957f9496a1968'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.842976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecd4f2d297646169c7957f9496a1968'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:27.848295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67207c06-66c1-46dd-9cb1-96e1364920cb tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:27.852312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2818/5659] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:27 2022] DELETE /identity/v3/users/3ecd4f2d297646169c7957f9496a1968 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:27.854983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:27.855730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:27.856022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:27.856399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:27.857208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:27.858318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:27.859209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:27.946931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:27.950085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:27.964140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2842/5660] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:08:27.991188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:27.994459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:28.004670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8591d-0cb6-4b67-abf7-e67f99ab8342 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:28.021628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:28.022767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:28.022916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:28.023147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:28.024545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_group(group_id=052ad1f7f9e941b1ba7f67e2e1cdfb3f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:28.026715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:28.106100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2819/5661] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:08:27 2022] DELETE /identity/v3/groups/052ad1f7f9e941b1ba7f67e2e1cdfb3f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:28.110334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:28.153307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744717d9-8313-48d6-a31c-8768b3f10508 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:28.195187 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:28.241138 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:28.294607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65a63e-4972-4df9-bf25-7df2a19cfdcf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:28.310346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:28.311399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:28.314128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:28.314451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/projects/755237015fd54a29ab1336ceb04d4861` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:28.318631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=755237015fd54a29ab1336ceb04d4861)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:28.326802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:28.364177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:28.365089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:28.365377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:28.365656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] PATH_INFO: `/v3/users/42b20a99d79a4965a6bd700b8d6a2d6d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:28.368200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b20a99d79a4965a6bd700b8d6a2d6d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:28.370183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:28.497902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755237015fd54a29ab1336ceb04d4861', 'request_id': 'req-5ffa5609-24ff-40a2-a187-70cbae052d86'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.509870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b20a99d79a4965a6bd700b8d6a2d6d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.511086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b20a99d79a4965a6bd700b8d6a2d6d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.516196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755237015fd54a29ab1336ceb04d4861', 'request_id': 'req-5ffa5609-24ff-40a2-a187-70cbae052d86'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.529512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755237015fd54a29ab1336ceb04d4861', 'request_id': 'req-5ffa5609-24ff-40a2-a187-70cbae052d86'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.543217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b20a99d79a4965a6bd700b8d6a2d6d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.544365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b20a99d79a4965a6bd700b8d6a2d6d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.554545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] The token cache is being invalidate because project 755237015fd54a29ab1336ceb04d4861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:28.555855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.557940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.565205 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2820/5662] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:28 2022] DELETE /identity/v3/projects/755237015fd54a29ab1336ceb04d4861 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:28.565406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b20a99d79a4965a6bd700b8d6a2d6d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.566311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:28.569635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:28.599322 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2843/5663] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:27 2022] DELETE /identity/v3/users/42b20a99d79a4965a6bd700b8d6a2d6d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:28.602365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:28.604949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:28.742770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43a938-4671-49f2-9981-4eccd584b9e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:28.746731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:28.748067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:28.748365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:28.748647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:28.751702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:28.772055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5609-24ff-40a2-a187-70cbae052d86 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:28.903483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:28.905214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1dd33-397f-44cb-86b8-da39a8f6fad2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:28.911463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:28.913090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:28.915070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:28.915515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/domains/40b34480df274f089a45ab7f982e1d4f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:28.917794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=40b34480df274f089a45ab7f982e1d4f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:28.920633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:28.933278 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:28.936606 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2844/5664] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:28.941104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:28.941527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:28.942437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:28.962693 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:28.977229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '40b34480df274f089a45ab7f982e1d4f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.981961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '40b34480df274f089a45ab7f982e1d4f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:28.993010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:28.994327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:29.050637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '40b34480df274f089a45ab7f982e1d4f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.051482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '40b34480df274f089a45ab7f982e1d4f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.056775 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2821/5665] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:08:28 2022] PATCH /identity/v3/domains/40b34480df274f089a45ab7f982e1d4f => generated 275 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:08:29.059597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:29.064369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:29.187791 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2845/5666] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:29.189261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f5d1-2681-490c-86be-a2adb2f00ac5 tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:29.196408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b352f4b71a48f7862ed55a752fd4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0133cda0b3c245868a9b95402a3e4505', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:29.197304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:29.197856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:29.198144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] PATH_INFO: `/v3/domains/40b34480df274f089a45ab7f982e1d4f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:29.211127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=40b34480df274f089a45ab7f982e1d4f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:29.212784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:29.224440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:29.225886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:29.254412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '40b34480df274f089a45ab7f982e1d4f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.258696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '40b34480df274f089a45ab7f982e1d4f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.333049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4b27f-ab8c-4df9-8728-7ac4ec5c1c43 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:29.340664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b34480df274f089a45ab7f982e1d4f', 'request_id': 'req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.348277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b34480df274f089a45ab7f982e1d4f', 'request_id': 'req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.361063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b34480df274f089a45ab7f982e1d4f', 'request_id': 'req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.376784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] The token cache is being invalidate because project 40b34480df274f089a45ab7f982e1d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:29.377196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.378526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.389533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '40b34480df274f089a45ab7f982e1d4f', 'request_id': 'req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.393775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '40b34480df274f089a45ab7f982e1d4f', 'request_id': 'req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.394664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '40b34480df274f089a45ab7f982e1d4f', 'request_id': 'req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.405719 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2822/5667] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:08:29 2022] DELETE /identity/v3/domains/40b34480df274f089a45ab7f982e1d4f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:29.407037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:29.408751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:29.425775 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:29.464898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:29.466015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:29.466320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:29.466641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:29.468526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:29.543366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dd14f-fd1d-4760-a5e8-25b76c20f0bf tempest-InheritsV3TestJSON-866828161 tempest-InheritsV3TestJSON-866828161-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:29.556962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:29.558128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:29.558561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:29.559203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] PATH_INFO: `/v3/users/d7ad3414041748e9be70302444c4f69e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:29.562529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ad3414041748e9be70302444c4f69e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:29.564896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:29.566900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c955a0-ad01-4d05-aa7f-5e754cc7c7f2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:29.567406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:29.584318 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2846/5668] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:29.651255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ad3414041748e9be70302444c4f69e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.709653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ad3414041748e9be70302444c4f69e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.718426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ad3414041748e9be70302444c4f69e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.730617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ad3414041748e9be70302444c4f69e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.731631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ad3414041748e9be70302444c4f69e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:29.740704 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2823/5669] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:29 2022] DELETE /identity/v3/users/d7ad3414041748e9be70302444c4f69e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:29.745757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:29.746259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:29.746753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:29.786954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:29.787698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:29.807528 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:29.894931 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2847/5670] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:29.909542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:29.911298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:30.008376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:30.010405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:30.034457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16730936-94e6-4587-8081-12b0ad1d924b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:30.046669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfea8e-77c8-4514-b1b4-b8092f1cc5e8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:30.058019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:30.058720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:30.059013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:30.059293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:30.069167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:30.070931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:30.071054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:30.071351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] PATH_INFO: `/v3/projects/6a8220514cfd44fd9e435e28a4b51ad4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:30.072959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8220514cfd44fd9e435e28a4b51ad4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:30.079385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:30.089087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:30.092160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:30.106297 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2824/5671] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:30.216328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8220514cfd44fd9e435e28a4b51ad4', 'request_id': 'req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.243883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8220514cfd44fd9e435e28a4b51ad4', 'request_id': 'req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.261488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8220514cfd44fd9e435e28a4b51ad4', 'request_id': 'req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.297004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] The token cache is being invalidate because project 6a8220514cfd44fd9e435e28a4b51ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:30.298660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.300848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.318169 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2848/5672] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:30 2022] DELETE /identity/v3/projects/6a8220514cfd44fd9e435e28a4b51ad4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:30.320185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:30.335535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455847b6-be2e-4d88-871b-328a3fc0098b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:30.405892 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:30.450207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:30.451313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:30.451991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:30.452429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] PATH_INFO: `/v3/users/a0c6c836acb841eab7dea46be54b74de` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:30.454783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c6c836acb841eab7dea46be54b74de)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:30.456987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:30.556832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c6c836acb841eab7dea46be54b74de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.583888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c6c836acb841eab7dea46be54b74de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.631396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c6c836acb841eab7dea46be54b74de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.640928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c6c836acb841eab7dea46be54b74de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.641672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c6c836acb841eab7dea46be54b74de'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:30.666469 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2825/5673] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:30 2022] DELETE /identity/v3/users/a0c6c836acb841eab7dea46be54b74de => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:30.842699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:30.844249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:30.860092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281ba8d-7fe6-44f0-8fc1-f9c98f11137e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:30.977569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:30.980370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:30.980677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:30.980967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] PATH_INFO: `/v3/projects/58f03117e1c44832b41f8885f6a4c67f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:30.983235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f03117e1c44832b41f8885f6a4c67f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:30.987216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:31.082909 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:31.105167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f03117e1c44832b41f8885f6a4c67f', 'request_id': 'req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.120179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f03117e1c44832b41f8885f6a4c67f', 'request_id': 'req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.131249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f03117e1c44832b41f8885f6a4c67f', 'request_id': 'req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.167598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] The token cache is being invalidate because project 58f03117e1c44832b41f8885f6a4c67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:31.168257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.169039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.172300 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2849/5674] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:30 2022] DELETE /identity/v3/projects/58f03117e1c44832b41f8885f6a4c67f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:31.177156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:31.180012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:31.209242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6a59-fb7b-4137-9b92-d29f49d5837b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:31.377352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:31.378734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:31.379183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:31.379639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] PATH_INFO: `/v3/users/c3b352f4b71a48f7862ed55a752fd4c2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:31.381262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b352f4b71a48f7862ed55a752fd4c2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:31.383814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:31.486534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:31.488097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:31.502108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b352f4b71a48f7862ed55a752fd4c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.510612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5f838-d4f8-452c-8a67-6ae9dd5d08c9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:31.518292 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:31.531230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:31.532260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:31.532614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:31.532973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] PATH_INFO: `/v3/projects/293eabbfa4124506a40fd42d99d7e0d4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:31.533809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b352f4b71a48f7862ed55a752fd4c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.534522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293eabbfa4124506a40fd42d99d7e0d4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:31.536780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:31.553873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b352f4b71a48f7862ed55a752fd4c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.566982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b352f4b71a48f7862ed55a752fd4c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.573288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0deb0616-9d82-4774-8e61-372cdade0470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b352f4b71a48f7862ed55a752fd4c2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.585073 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2826/5675] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:31 2022] DELETE /identity/v3/users/c3b352f4b71a48f7862ed55a752fd4c2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:31.633517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293eabbfa4124506a40fd42d99d7e0d4', 'request_id': 'req-7a121acf-81a7-46ca-91c7-172b1cc018c8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.647533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293eabbfa4124506a40fd42d99d7e0d4', 'request_id': 'req-7a121acf-81a7-46ca-91c7-172b1cc018c8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.664310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293eabbfa4124506a40fd42d99d7e0d4', 'request_id': 'req-7a121acf-81a7-46ca-91c7-172b1cc018c8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.679376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] The token cache is being invalidate because project 293eabbfa4124506a40fd42d99d7e0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:31.679676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.680364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a121acf-81a7-46ca-91c7-172b1cc018c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:31.682431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2850/5676] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:31 2022] DELETE /identity/v3/projects/293eabbfa4124506a40fd42d99d7e0d4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:31.687266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:31.687661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:31.688172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:31.714879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:31.716292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:31.811323 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2827/5677] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:31.819439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:31.820051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:31.820420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:31.845060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:31.846791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:31.858588 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2851/5678] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:31.862770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:31.891490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fe6d4-b260-4570-852f-f746a00f8c30 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:31.910947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:31.911645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:31.911990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:31.912276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:31.913035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:31.913352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:31.915878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:31.939391 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2828/5679] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:08:31.943516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:31.983642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04107-07fd-47f8-aa59-67d0cac10dbf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.009648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.014078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.014731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.030360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.031597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.033899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.099287 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2852/5680] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:31 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:08:32.100450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.113479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f6bd7-ed76-42fe-bd65-616fe56a4dae admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.255184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcab02-5ebb-4d61-be23-746b62717200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.256771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcab02-5ebb-4d61-be23-746b62717200 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.258484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcab02-5ebb-4d61-be23-746b62717200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.259470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcab02-5ebb-4d61-be23-746b62717200 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.271306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcab02-5ebb-4d61-be23-746b62717200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.274205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcab02-5ebb-4d61-be23-746b62717200 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.342016 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2829/5681] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:32 2022] POST /identity/v3/users => generated 282 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:32.344566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.389601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73bd5-47a0-4811-945d-8abd62de97f4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.405998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.407388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.409166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.409609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.411828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.414536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.432912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.433205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.433485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.442983 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2853/5682] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:32.447161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.464098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:32.465372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:32.466641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07307-1c05-4689-82fd-4579715d73e7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.499684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.502210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.505432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.509798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.511938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.520635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.560654 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:32.574846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2854/5683] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:32.589657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.616545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2830/5684] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:32.634941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.636446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:32.657976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dcbb2-41d2-4129-85fd-87ba12a5fc87 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.681201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.682469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.683321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.683775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] PATH_INFO: `/v3/projects/bffd5bee345b414f82da18bece4d21e9/users/1dfed9df4c8a4de98a315124dc7cfe94/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.722462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffd5bee345b414f82da18bece4d21e9, user_id=1dfed9df4c8a4de98a315124dc7cfe94, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.725194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.749268 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2855/5685] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:32 2022] PUT /identity/v3/projects/bffd5bee345b414f82da18bece4d21e9/users/1dfed9df4c8a4de98a315124dc7cfe94/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:32.752704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:32.755034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:32.796102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e182821-67e1-4045-a0b5-0d35be085e6b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.836099 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:32.919231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b7d9e-f584-44c8-b67c-7a2489386456 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:32.921624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad007d0-1b71-4246-9759-097dbd8c3bbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.923539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad007d0-1b71-4246-9759-097dbd8c3bbe service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.923837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad007d0-1b71-4246-9759-097dbd8c3bbe service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.924125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad007d0-1b71-4246-9759-097dbd8c3bbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.924300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:32.925271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:32.925567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:32.925850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] PATH_INFO: `/v3/projects/0133cda0b3c245868a9b95402a3e4505` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:32.927577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0133cda0b3c245868a9b95402a3e4505)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:32.930254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:32.983357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0133cda0b3c245868a9b95402a3e4505', 'request_id': 'req-ad2a5c50-b962-4880-8f57-ac217451e745'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:32.993821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0133cda0b3c245868a9b95402a3e4505', 'request_id': 'req-ad2a5c50-b962-4880-8f57-ac217451e745'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:33.002313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0133cda0b3c245868a9b95402a3e4505', 'request_id': 'req-ad2a5c50-b962-4880-8f57-ac217451e745'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:33.010530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad007d0-1b71-4246-9759-097dbd8c3bbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:33.012345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad007d0-1b71-4246-9759-097dbd8c3bbe service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:33.017564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] The token cache is being invalidate because project 0133cda0b3c245868a9b95402a3e4505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:33.017859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:33.019474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ad2a5c50-b962-4880-8f57-ac217451e745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:33.024763 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2856/5686] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:32 2022] DELETE /identity/v3/projects/0133cda0b3c245868a9b95402a3e4505 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:33.025624 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2831/5687] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:08:33.027345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874d69a-7679-43a2-8cc2-16e566bf196a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.027869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874d69a-7679-43a2-8cc2-16e566bf196a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.028241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874d69a-7679-43a2-8cc2-16e566bf196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.034474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.034990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.035323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.090582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5874d69a-7679-43a2-8cc2-16e566bf196a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:33.091941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5874d69a-7679-43a2-8cc2-16e566bf196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:33.100391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:33.108790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:33.133843 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:33.265080 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2857/5688] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:33.266397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:33.271573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:33.280056 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2832/5689] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:33.287588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759742-dfae-4887-b587-0252fb116985 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.287941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759742-dfae-4887-b587-0252fb116985 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.288165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759742-dfae-4887-b587-0252fb116985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.357186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-52759742-dfae-4887-b587-0252fb116985 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:33.358971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-52759742-dfae-4887-b587-0252fb116985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:33.410882 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2833/5690] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:33.411976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52759742-dfae-4887-b587-0252fb116985 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:33.432484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52759742-dfae-4887-b587-0252fb116985 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:33.453208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:33.455188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.455598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.460610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.461523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:33.461918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:33.471212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:33.498740 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2834/5691] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:33.509633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:33.524385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dade7f1-fe9d-4b34-a978-8fd2f79058e5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:33.537285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:33.540331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.540331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.540331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.550656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba6935-ceb7-4316-b5c4-2a3f1ac6fa80 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:33.568209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:33.570899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.571130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:33.573817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.574872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:33.575100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.575965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:33.583467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:33.600057 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2858/5692] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:33.668423 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2835/5693] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:33 2022] POST /identity/v3/projects => generated 397 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:33.672088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:33.696818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0041d-6a04-471d-b81a-e91a5b2014d1 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:33.703550 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:33.896528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:33.897295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.897585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.898623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.900829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:33.907646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:33.958718 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2859/5694] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:33 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:33.959341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:33.973713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05591459-62e2-49d2-835f-ff2d22b012cd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:33.979755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:33.983814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:33.983814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:33.986413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:33.996462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:34.005232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:34.045980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:34.056063 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2836/5695] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:08:34.058531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfb73e-8092-43c0-8c92-800af321c8eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:34.081861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2584-424e-41c5-a80e-93f0ec1bbf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:34.082597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2584-424e-41c5-a80e-93f0ec1bbf77 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:34.082898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2584-424e-41c5-a80e-93f0ec1bbf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:34.083186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2584-424e-41c5-a80e-93f0ec1bbf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:34.083931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2584-424e-41c5-a80e-93f0ec1bbf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:34.086147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2584-424e-41c5-a80e-93f0ec1bbf77 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:34.120491 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2860/5696] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:34.124812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:34.147368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e101e2-8670-4d62-8e2e-06f175d6924d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:34.168306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:34.169226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:34.169583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:34.170437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] PATH_INFO: `/v3/projects/8f661e1005874585ba81e1a8f62dac53/users/bf3cacb06b024f96a563b4fbd7c5c3b7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:34.227606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f661e1005874585ba81e1a8f62dac53, user_id=bf3cacb06b024f96a563b4fbd7c5c3b7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:34.238262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:34.310433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:34.310762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:34.311048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:34.313869 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2837/5697] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:34 2022] PUT /identity/v3/projects/8f661e1005874585ba81e1a8f62dac53/users/bf3cacb06b024f96a563b4fbd7c5c3b7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:34.365057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] MFA Rules not processed for user `bf3cacb06b024f96a563b4fbd7c5c3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:34.368378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:34.558472 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2861/5698] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:34.563650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:34.748461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3dec-dd56-4a5a-b377-723321d8907d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:34.754481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:34.755394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:34.755749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:34.756133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:34.756929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:34.759638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:34.800828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2838/5699] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:34 2022] POST /identity/v3/projects => generated 397 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:34.805103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:34.821541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22adfa-a939-462f-acda-eddc339237b2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:34.985757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:34.986755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:34.988158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:34.988575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:34.989402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:34.992761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.080283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2862/5700] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:34 2022] POST /identity/v3/users => generated 305 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:35.080751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.100875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87f4dc-7f49-46fc-ab13-b2d69caf588c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:35.109176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:35.110054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.110964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.111355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.112859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:35.115777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.138018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.149011 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2839/5701] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:08:35.149564 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:35.155837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce740de-f10c-4703-be17-0cb9c9e8a199 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:35.187529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:35.190960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.191560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.191739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] PATH_INFO: `/v3/projects/5f42a51b0e6a4e9c89179c97c3a52a74/users/cafe03f511574732a2bfabd99a894043/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.271697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.274372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:35.283804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f42a51b0e6a4e9c89179c97c3a52a74, user_id=cafe03f511574732a2bfabd99a894043, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:35.291954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.309757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66c6b-efa0-4d3c-9de2-ae6672c8aeef admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:35.324370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:35.325183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.325479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.325761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] PATH_INFO: `/v3/users/9015043df1c94dd491c322808783e709` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.327249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9015043df1c94dd491c322808783e709)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:35.329244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.354858 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:35.411446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2863/5702] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:35 2022] PUT /identity/v3/projects/5f42a51b0e6a4e9c89179c97c3a52a74/users/cafe03f511574732a2bfabd99a894043/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:35.426485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.458343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9015043df1c94dd491c322808783e709'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:35.486520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9015043df1c94dd491c322808783e709'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:35.503473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9015043df1c94dd491c322808783e709'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:35.519674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9015043df1c94dd491c322808783e709'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:35.520414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d8e9bfe3-e2f7-4a5f-b0bb-156639714a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9015043df1c94dd491c322808783e709'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:35.541023 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2840/5703] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:35 2022] DELETE /identity/v3/users/9015043df1c94dd491c322808783e709 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:35.545416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.545988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.547137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.591168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b4887-8d6b-41a1-bf17-1dcbfc331e78 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:35.611375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:35.613043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:35.759889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:35.761905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.761905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.763567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.765045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:35.769351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.782299 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2841/5704] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:35.803472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.804059 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2864/5705] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:35.805113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:35.807784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:35.813979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:35.824233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66af8-348c-480a-86f9-b9605983ccf3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:35.844038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7e9a4-85f4-48b5-b3b0-173b4d25bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:35.844846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e9a4-85f4-48b5-b3b0-173b4d25bcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.845141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e9a4-85f4-48b5-b3b0-173b4d25bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.849724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e9a4-85f4-48b5-b3b0-173b4d25bcc7 admin admin] PATH_INFO: `/v3/projects/5f42a51b0e6a4e9c89179c97c3a52a74/users/cafe03f511574732a2bfabd99a894043/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.856392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7e9a4-85f4-48b5-b3b0-173b4d25bcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f42a51b0e6a4e9c89179c97c3a52a74, user_id=cafe03f511574732a2bfabd99a894043, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:35.865312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7e9a4-85f4-48b5-b3b0-173b4d25bcc7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:35.901973 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2842/5706] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:35 2022] PUT /identity/v3/projects/5f42a51b0e6a4e9c89179c97c3a52a74/users/cafe03f511574732a2bfabd99a894043/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:35.904561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:35.904879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:35.905169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:35.964560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85da9e-a6fb-498e-aee1-83067f5c3467 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.065050 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:36.072988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] MFA Rules not processed for user `cafe03f511574732a2bfabd99a894043`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:36.078839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:36.091247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.094745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.095096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.095452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.237224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.241294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:36.277255 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2865/5707] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:36.279344 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:36.292024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2843/5708] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:36.297259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.298842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:36.441380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ba130-7414-4ee9-8aad-93314d58575d service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.447483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3cacb06b024f96a563b4fbd7c5c3b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f661e1005874585ba81e1a8f62dac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.448752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.449204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.449666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.450611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 11 15:08:36.457952 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 11 15:08:36.459341 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.461748 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2866/5709] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:08:36 2022] POST /identity/v3/projects => generated 136 bytes in 165 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:08:36.468470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.482073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c906a-e30e-498d-9924-c01c35678ccf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.488523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafe03f511574732a2bfabd99a894043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f42a51b0e6a4e9c89179c97c3a52a74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.489567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.490101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.490663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.492149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.495851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invalid input for field 'name': '' is too short Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: On instance['name']: Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: On instance['name']: Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: '' Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise error Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application '' Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.505114 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 15:08:36.506733 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application '' Jul 11 15:08:36.508700 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.512035 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2844/5710] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:08:36 2022] POST /identity/v3/projects => generated 283 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:08:36.516878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.534049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74acbe-e4a8-4d38-8fbc-2007b23882db tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.540350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafe03f511574732a2bfabd99a894043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f42a51b0e6a4e9c89179c97c3a52a74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.541982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.542559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.543144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.544378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.546598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: On instance['name']: Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: On instance['name']: Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise error Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:08:36.554474 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:36.556368 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 11 15:08:36.557481 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.560853 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2867/5711] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:08:36 2022] POST /identity/v3/projects => generated 412 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:08:36.566442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.583767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3746c-a52c-4d02-96b8-03a9e34ff6a5 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.601896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafe03f511574732a2bfabd99a894043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f42a51b0e6a4e9c89179c97c3a52a74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.602951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.603226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.603503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] PATH_INFO: `/v3/projects/04e27a0ee3ec4a00a0c866cdb2d3b6ad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.635369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04e27a0ee3ec4a00a0c866cdb2d3b6ad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.637953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Could not find project: 04e27a0ee3ec4a00a0c866cdb2d3b6ad.: keystone.exception.ProjectNotFound: Could not find project: 04e27a0ee3ec4a00a0c866cdb2d3b6ad. Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 11 15:08:36.670310 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 04e27a0ee3ec4a00a0c866cdb2d3b6ad. Jul 11 15:08:36.671397 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:36.676463 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2845/5712] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:36 2022] DELETE /identity/v3/projects/04e27a0ee3ec4a00a0c866cdb2d3b6ad => generated 113 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:08:36.677676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.696878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a08c1e-74d1-4228-9ead-083926fa6904 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.707052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3cacb06b024f96a563b4fbd7c5c3b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f661e1005874585ba81e1a8f62dac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.710819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.714827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.715479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.716495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] RBAC: Authorizing `identity:list_projects()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 11 15:08:36.733968 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._list_projects() Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 11 15:08:36.735169 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:36.744090 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2868/5713] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:08:36 2022] GET /identity/v3/projects => generated 135 bytes in 67 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 11 15:08:36.748797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.764146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3fc2-59ac-447d-bf8c-0b9b18ea841f tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.778435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafe03f511574732a2bfabd99a894043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f42a51b0e6a4e9c89179c97c3a52a74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.779817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.780109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.780390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.781089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.784294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:36.873756 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2846/5714] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:36 2022] POST /identity/v3/projects => generated 359 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:36.874552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:36.892668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3c5f9-edca-4be3-88b4-5c4dd28eacca tempest-ProjectsNegativeStaticTestJSON-2011105326 tempest-ProjectsNegativeStaticTestJSON-2011105326-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:36.969475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafe03f511574732a2bfabd99a894043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f42a51b0e6a4e9c89179c97c3a52a74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:36.970607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:36.971056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:36.971872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:36.972802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:36.975166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:37.001738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.sql.core [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1601014928' for key 'project.ixu_project_name_domain_id'") Jul 11 15:08:37.001738 n-d-master-1 devstack@keystone.service[80989]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:08:37.001738 n-d-master-1 devstack@keystone.service[80989]: [parameters: {'id': '919a5a4e595e41cfb7d528bdc9de6bc4', 'name': 'tempest-project-dup-1601014928', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 15:08:37.001738 n-d-master-1 devstack@keystone.service[80989]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80989) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1601014928, project id 919a5a4e595e41cfb7d528bdc9de6bc4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1601014928, project id 919a5a4e595e41cfb7d528bdc9de6bc4. Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:08:37.070809 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result.read() Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1601014928' for key 'project.ixu_project_name_domain_id'") Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:08:37.072351 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application yield resource Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise self.value Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:08:37.073966 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application session.commit() Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:08:37.075319 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:08:37.076699 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result.read() Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:08:37.078083 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1601014928' for key 'project.ixu_project_name_domain_id'") Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [parameters: {'id': '919a5a4e595e41cfb7d528bdc9de6bc4', 'name': 'tempest-project-dup-1601014928', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:37.079514 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1601014928 at domain ID default. Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:37.082788 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1601014928, project id 919a5a4e595e41cfb7d528bdc9de6bc4. Jul 11 15:08:37.085906 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:37.091039 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2869/5715] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:08:36 2022] POST /identity/v3/projects => generated 285 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:08:37.092550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:37.108712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5723-f1ea-41c8-a2c9-98b06736d28d tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:37.116086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cafe03f511574732a2bfabd99a894043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f42a51b0e6a4e9c89179c97c3a52a74', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:37.117615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:37.118070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:37.118574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] PATH_INFO: `/v3/projects/3ff98660eedf4805907397f260b3eef3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:37.121451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ff98660eedf4805907397f260b3eef3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:37.124895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:37.248630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff98660eedf4805907397f260b3eef3', 'request_id': 'req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.254840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff98660eedf4805907397f260b3eef3', 'request_id': 'req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.274677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff98660eedf4805907397f260b3eef3', 'request_id': 'req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.292796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] The token cache is being invalidate because project 3ff98660eedf4805907397f260b3eef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:37.295207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.296288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.306814 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2847/5716] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:37 2022] DELETE /identity/v3/projects/3ff98660eedf4805907397f260b3eef3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:37.307812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:37.309918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:37.380435 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:37.561305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe81b6-7c1b-451b-9ab8-d0bd9ff26096 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:37.697131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:37.698808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:37.699364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:37.699959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] PATH_INFO: `/v3/users/bf3cacb06b024f96a563b4fbd7c5c3b7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:37.701543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3cacb06b024f96a563b4fbd7c5c3b7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:37.705712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:37.800787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:37.803140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:37.861015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3cacb06b024f96a563b4fbd7c5c3b7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.862095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3cacb06b024f96a563b4fbd7c5c3b7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.892893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3cacb06b024f96a563b4fbd7c5c3b7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.893761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3cacb06b024f96a563b4fbd7c5c3b7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.911355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-919b8d1a-6bac-422b-bdd1-b85eb7e741af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3cacb06b024f96a563b4fbd7c5c3b7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:37.923566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aea935-5b71-4ee2-a7a7-4bfdee2baae1 tempest-ProjectsNegativeStaticTestJSON-1233790256 tempest-ProjectsNegativeStaticTestJSON-1233790256-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:37.929816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:37.930614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:37.931205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:37.931608 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2870/5717] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:37 2022] DELETE /identity/v3/users/bf3cacb06b024f96a563b4fbd7c5c3b7 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:37.935578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:37.936571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:37.936873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:37.937160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:37.937763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:37.983955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:37.985216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:38.022132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:38.026925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:38.032939 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:38.070359 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2848/5718] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:08:38.138181 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:38.219015 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2871/5719] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:38.239812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:38.242181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:38.264158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3099af5-a107-445f-9d5b-a8fd3d8628b8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:38.364467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7128496-8132-459d-b84b-594c9d77b233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:38.366326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7128496-8132-459d-b84b-594c9d77b233 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:38.367951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7128496-8132-459d-b84b-594c9d77b233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:38.368861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7128496-8132-459d-b84b-594c9d77b233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:38.384509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7128496-8132-459d-b84b-594c9d77b233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:38.386029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7128496-8132-459d-b84b-594c9d77b233 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:38.417965 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2849/5720] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:38.553916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:38.556407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:38.591636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b5cb-59bb-4856-baa2-e9890e95b1c9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:38.629425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:38.633177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:38.652575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:38.652868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] PATH_INFO: `/v3/projects/6b6f24ee0aab46ddab2922967e8eedf5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:38.661191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6f24ee0aab46ddab2922967e8eedf5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:38.674236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:38.907421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6f24ee0aab46ddab2922967e8eedf5', 'request_id': 'req-2b50c809-7a56-4a1b-8367-2aed812f90a4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:38.925727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6f24ee0aab46ddab2922967e8eedf5', 'request_id': 'req-2b50c809-7a56-4a1b-8367-2aed812f90a4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:38.945628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6f24ee0aab46ddab2922967e8eedf5', 'request_id': 'req-2b50c809-7a56-4a1b-8367-2aed812f90a4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:38.984034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] The token cache is being invalidate because project 6b6f24ee0aab46ddab2922967e8eedf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:38.984384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:38.987681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2b50c809-7a56-4a1b-8367-2aed812f90a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:38.999314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2872/5721] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:38 2022] DELETE /identity/v3/projects/6b6f24ee0aab46ddab2922967e8eedf5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:39.004356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.004927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.005182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.063299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:39.065629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:39.227931 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2850/5722] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:39.235439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.236031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.236031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.285471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:39.286758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:39.342134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:39.350183 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2873/5723] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:39.355142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b78035-64b2-4837-b3ac-6ff947923304 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:39.369421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:39.371204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.371518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.372465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.373010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:39.375637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:39.380511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:39.426105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2851/5724] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:39.433548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:39.497425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fcbfe-cff0-43f0-8286-fae3aa9e4f90 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:39.511749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:39.513558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.514050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.514554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.515840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:39.518347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:39.559372 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2874/5725] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:39 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:39.564624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:39.581663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4122c-6737-4386-9604-60a320f406a4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:39.713174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:39.714564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.715218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.716387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.717363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:39.728090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:39.771561 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2852/5726] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:39 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:08:39.775593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:39.790266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29e044-9ea0-4db8-96b9-ad858d5ea336 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:39.806749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:39.818622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.819062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.819507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.820908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:39.826009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:39.861770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:39.869620 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2875/5727] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:39.876414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13428c1-f4f4-4bb0-a59a-f51ecbba9839 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:39.889874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca76efe-33e5-4faf-80d2-ec9773fb2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:39.890754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca76efe-33e5-4faf-80d2-ec9773fb2778 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.891048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca76efe-33e5-4faf-80d2-ec9773fb2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.891436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca76efe-33e5-4faf-80d2-ec9773fb2778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.892117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca76efe-33e5-4faf-80d2-ec9773fb2778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:39.893738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca76efe-33e5-4faf-80d2-ec9773fb2778 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:39.921541 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2853/5728] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:39.922254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:39.934210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdaef5-83a0-4d5f-9b2f-b0656bd0aaa7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:39.951679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:39.952548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:39.952805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:39.953086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b/users/97af8679178b49ec960c2ba484a828c8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:39.992838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560ec8ae9f914fd5a619bb06ddc08d4b, user_id=97af8679178b49ec960c2ba484a828c8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:39.996942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:40.029838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2876/5729] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:39 2022] PUT /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b/users/97af8679178b49ec960c2ba484a828c8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:40.041333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:40.042275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:40.042638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:40.075311 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:40.111774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] MFA Rules not processed for user `97af8679178b49ec960c2ba484a828c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:40.113114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:40.337265 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2854/5730] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:40.352367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:40.355118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:40.549442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:40.551289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:40.686289 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:40.703352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86fb81-e36d-4741-8a36-ab1c2ebee200 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:40.715403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3d772-ae06-4797-ae5e-83d3f435a1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:40.720046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3d772-ae06-4797-ae5e-83d3f435a1f7 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:40.720379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3d772-ae06-4797-ae5e-83d3f435a1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:40.720667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3d772-ae06-4797-ae5e-83d3f435a1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:40.761886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3d772-ae06-4797-ae5e-83d3f435a1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:40.764270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3d772-ae06-4797-ae5e-83d3f435a1f7 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:40.805747 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2877/5731] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:40.826144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f1dea-f687-41c5-9550-1d17bf19132d None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:40.826893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f1dea-f687-41c5-9550-1d17bf19132d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:40.826893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f1dea-f687-41c5-9550-1d17bf19132d None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:40.828569 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2878/5732] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:08:40.860780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f1dea-f687-41c5-9550-1d17bf19132d None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:08:40.894254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c149204-4ccf-4d71-abce-f5e6cac11d5c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:40.901085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f1dea-f687-41c5-9550-1d17bf19132d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:40.919809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:40.921459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f1dea-f687-41c5-9550-1d17bf19132d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:40.922146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:40.924431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:40.924746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] PATH_INFO: `/v3/projects/8f661e1005874585ba81e1a8f62dac53` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:40.929295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f661e1005874585ba81e1a8f62dac53)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:40.931288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:40.940550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d115df-12d8-471c-9147-97c351eebe4d tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97af8679178b49ec960c2ba484a828c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560ec8ae9f914fd5a619bb06ddc08d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:40.942888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d115df-12d8-471c-9147-97c351eebe4d tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:40.943565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d115df-12d8-471c-9147-97c351eebe4d tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:40.944096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d115df-12d8-471c-9147-97c351eebe4d tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:40.949070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d115df-12d8-471c-9147-97c351eebe4d tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorizing `identity:get_project(project_id=560ec8ae9f914fd5a619bb06ddc08d4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:40.954156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d115df-12d8-471c-9147-97c351eebe4d tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:40.959325 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2879/5733] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:08:40 2022] GET /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b => generated 363 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:40.994385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:40.994829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:40.995351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:40.996969 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2880/5734] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:08:41.020383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:08:41.022578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:41.075263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:41.092575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f661e1005874585ba81e1a8f62dac53', 'request_id': 'req-44e09256-601f-4a7e-901c-804c3ce7d3f4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.106886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fca6b-2fe0-4d9e-a512-885dd5939cc0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:41.116076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f661e1005874585ba81e1a8f62dac53', 'request_id': 'req-44e09256-601f-4a7e-901c-804c3ce7d3f4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.138207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f661e1005874585ba81e1a8f62dac53', 'request_id': 'req-44e09256-601f-4a7e-901c-804c3ce7d3f4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.179878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] The token cache is being invalidate because project 8f661e1005874585ba81e1a8f62dac53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:41.180246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.180865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.196110 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2855/5735] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:40 2022] DELETE /identity/v3/projects/8f661e1005874585ba81e1a8f62dac53 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:41.199098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:41.202913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:41.237295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faf8b0-007c-49da-b70c-4af69f57bfbe tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97af8679178b49ec960c2ba484a828c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560ec8ae9f914fd5a619bb06ddc08d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:41.238179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf8b0-007c-49da-b70c-4af69f57bfbe tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.238464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf8b0-007c-49da-b70c-4af69f57bfbe tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.238768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf8b0-007c-49da-b70c-4af69f57bfbe tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.239715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faf8b0-007c-49da-b70c-4af69f57bfbe tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorizing `identity:get_project(project_id=560ec8ae9f914fd5a619bb06ddc08d4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:41.242073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faf8b0-007c-49da-b70c-4af69f57bfbe tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:41.266550 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2881/5736] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:08:41 2022] GET /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b => generated 363 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:41.300938 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:41.301119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.301383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.301626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.303481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2882/5737] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:08:41.311499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:08:41.316051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:41.411742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09256-601f-4a7e-901c-804c3ce7d3f4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:41.435285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:41.436205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.436496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.436776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] PATH_INFO: `/v3/users/cafe03f511574732a2bfabd99a894043` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.442742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafe03f511574732a2bfabd99a894043)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:41.444772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:41.529091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:41.532337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:41.594293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e291e0-94e4-4dab-b862-94e438208b0a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:41.605377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c0c38-5d40-4c3e-a758-7c47565ba075 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97af8679178b49ec960c2ba484a828c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560ec8ae9f914fd5a619bb06ddc08d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:41.606410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0c38-5d40-4c3e-a758-7c47565ba075 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.606726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0c38-5d40-4c3e-a758-7c47565ba075 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.607006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0c38-5d40-4c3e-a758-7c47565ba075 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.609321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c0c38-5d40-4c3e-a758-7c47565ba075 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorizing `identity:get_project(project_id=560ec8ae9f914fd5a619bb06ddc08d4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:41.613091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c0c38-5d40-4c3e-a758-7c47565ba075 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:41.653034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafe03f511574732a2bfabd99a894043'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.654478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2883/5738] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:08:41 2022] GET /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b => generated 363 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:08:41.671633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.671633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.675162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.678362 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2884/5739] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:08:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:08:41.679795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:08:41.683446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:41.702751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafe03f511574732a2bfabd99a894043'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.724987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafe03f511574732a2bfabd99a894043'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.737297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafe03f511574732a2bfabd99a894043'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.737935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f8e33a84-69da-4aab-89ca-0e87d2e1bd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafe03f511574732a2bfabd99a894043'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:41.754348 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2856/5740] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:41 2022] DELETE /identity/v3/users/cafe03f511574732a2bfabd99a894043 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:41.760483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:41.829622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebdddb-18e0-4f66-840d-15cc8a88ea86 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:41.963121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97af8679178b49ec960c2ba484a828c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560ec8ae9f914fd5a619bb06ddc08d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:41.964232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:41.964578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:41.964927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:41.965962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorizing `identity:get_project(project_id=560ec8ae9f914fd5a619bb06ddc08d4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:41.970950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:41.975003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2885/5741] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:08:41 2022] GET /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b => generated 363 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:42.084213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f7a2-6b61-4217-a9a5-72216c83620a None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:42.084560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f7a2-6b61-4217-a9a5-72216c83620a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:42.084895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f7a2-6b61-4217-a9a5-72216c83620a None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:42.086330 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2857/5742] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:08:42.091600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:08:42.093754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:42.155547 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:42.342131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:42.343635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:42.380617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4378a76-668b-4552-a74e-c4305a9a10ab tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:42.410123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0233c-8cbb-4bcf-afcf-6712b28ffa93 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97af8679178b49ec960c2ba484a828c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560ec8ae9f914fd5a619bb06ddc08d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:42.411515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0233c-8cbb-4bcf-afcf-6712b28ffa93 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:42.411923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0233c-8cbb-4bcf-afcf-6712b28ffa93 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:42.412306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0233c-8cbb-4bcf-afcf-6712b28ffa93 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:42.416031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0233c-8cbb-4bcf-afcf-6712b28ffa93 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorizing `identity:get_project(project_id=560ec8ae9f914fd5a619bb06ddc08d4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:42.418044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0233c-8cbb-4bcf-afcf-6712b28ffa93 tempest-QuotasTestJSON-894972016 tempest-QuotasTestJSON-894972016-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:42.442099 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2886/5743] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:08:42 2022] GET /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b => generated 363 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:42.521750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f7a2-6b61-4217-a9a5-72216c83620a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:42.525885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4293f7a2-6b61-4217-a9a5-72216c83620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:42.822071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f7a2-6b61-4217-a9a5-72216c83620a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:42.841489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:42.843372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:42.843773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:42.852061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] PATH_INFO: `/v3/users/97af8679178b49ec960c2ba484a828c8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:42.855088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97af8679178b49ec960c2ba484a828c8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:42.858119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:42.962430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97af8679178b49ec960c2ba484a828c8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:42.966859 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:42.999862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97af8679178b49ec960c2ba484a828c8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:43.019995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97af8679178b49ec960c2ba484a828c8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:43.044867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97af8679178b49ec960c2ba484a828c8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:43.045712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97af8679178b49ec960c2ba484a828c8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:43.058146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2858/5744] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:42 2022] DELETE /identity/v3/users/97af8679178b49ec960c2ba484a828c8 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:43.060327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:43.060817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:43.061192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:43.114235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:43.117930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:43.274660 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2887/5745] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:43.448800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:43.452036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:43.587638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3915be0-3ccd-4e77-ab7b-a4fccaea818e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:43.592241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb70e0-0772-44dc-a747-367c5e3ca160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:43.593312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb70e0-0772-44dc-a747-367c5e3ca160 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:43.593615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb70e0-0772-44dc-a747-367c5e3ca160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:43.593895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb70e0-0772-44dc-a747-367c5e3ca160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:43.632696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb70e0-0772-44dc-a747-367c5e3ca160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:43.634110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb70e0-0772-44dc-a747-367c5e3ca160 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:43.698506 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2859/5746] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:44.534284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:44.535909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:44.570852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4ce97-feb5-45c1-af11-339a0bd1dcc7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:44.596520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:44.601736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:44.601736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:44.601736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] PATH_INFO: `/v3/projects/5f42a51b0e6a4e9c89179c97c3a52a74` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:44.604840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f42a51b0e6a4e9c89179c97c3a52a74)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:44.607734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:44.734648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f42a51b0e6a4e9c89179c97c3a52a74', 'request_id': 'req-9f06d61c-5090-44e3-8348-9ce82a099ea5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:44.748854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f42a51b0e6a4e9c89179c97c3a52a74', 'request_id': 'req-9f06d61c-5090-44e3-8348-9ce82a099ea5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:44.760576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f42a51b0e6a4e9c89179c97c3a52a74', 'request_id': 'req-9f06d61c-5090-44e3-8348-9ce82a099ea5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:44.794847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] The token cache is being invalidate because project 5f42a51b0e6a4e9c89179c97c3a52a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:44.795391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:44.796871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9f06d61c-5090-44e3-8348-9ce82a099ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:44.814150 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2888/5747] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:44 2022] DELETE /identity/v3/projects/5f42a51b0e6a4e9c89179c97c3a52a74 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:44.819381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:44.819878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:44.819994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:44.894698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:44.896191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:45.136548 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2860/5748] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:45.144579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.145012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.145394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.214404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:45.215424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:45.234159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2889/5749] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:45.238176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:45.253251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebafdf-f4a2-4abf-920b-04ad89c4ed28 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:45.266577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:45.267625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.268687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.268687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.269345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:45.269809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:45.273663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:45.306237 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2861/5750] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:45.310849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:45.325245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1fd05-3847-48e2-ae3f-843a5d95d79f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:45.343134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:45.344005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.344397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.345144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.345968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:45.348078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:45.399344 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:45.420473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2890/5751] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:45 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:45.422109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:45.436014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304a5b-2c94-4bfe-813e-285a07c54b3b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:45.555189 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:45.579223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:45.580337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.580537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.584376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.585191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:45.591098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:45.636609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2862/5752] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:45 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:45.640692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:45.658812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579a0e-b454-4686-bcf5-e195dcbee55d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:45.673632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:45.675821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.679019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.681224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.683592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:45.687606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:45.725893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2891/5753] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:45.727241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:45.745750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f824c-66b0-467b-8a82-d76ff683132c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:45.751901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a0e8-1273-49c5-a2a9-207dd6173130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:45.753095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a0e8-1273-49c5-a2a9-207dd6173130 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.753485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a0e8-1273-49c5-a2a9-207dd6173130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.753884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a0e8-1273-49c5-a2a9-207dd6173130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.755204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643a0e8-1273-49c5-a2a9-207dd6173130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:45.757536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643a0e8-1273-49c5-a2a9-207dd6173130 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:45.782969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2863/5754] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:45.786944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:45.803409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2e89-266d-4f79-a67f-689ff61464e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:45.817860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:45.821142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.821435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.821715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] PATH_INFO: `/v3/projects/f9738a4b56e44d388a11479f4fdaac5b/users/2b3b543253c142dc8535500212c2f4a6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:45.935136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9738a4b56e44d388a11479f4fdaac5b, user_id=2b3b543253c142dc8535500212c2f4a6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:45.939904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:45.983915 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2892/5755] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:45 2022] PUT /identity/v3/projects/f9738a4b56e44d388a11479f4fdaac5b/users/2b3b543253c142dc8535500212c2f4a6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:45.998510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:45.999278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:45.999453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:46.080503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:46.082254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:46.119127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:46.121673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:46.362844 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2864/5756] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:46.365808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:46.390456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d7b3a-36c0-4296-b426-b7dafa1d282a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:46.405264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb0d10-f079-4ed5-a2f4-1ab8ed5d45bc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:46.408986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f351a3-2e00-40e1-9efe-86b6cabfbcf9 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:46.410136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f351a3-2e00-40e1-9efe-86b6cabfbcf9 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:46.410899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f351a3-2e00-40e1-9efe-86b6cabfbcf9 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:46.411818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f351a3-2e00-40e1-9efe-86b6cabfbcf9 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:46.425964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:46.426837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:46.427231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:46.433046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] PATH_INFO: `/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:46.435424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=560ec8ae9f914fd5a619bb06ddc08d4b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:46.437443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:46.527692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59f351a3-2e00-40e1-9efe-86b6cabfbcf9 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:46.560832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560ec8ae9f914fd5a619bb06ddc08d4b', 'request_id': 'req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:46.569456 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2865/5757] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:46 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:46.578266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560ec8ae9f914fd5a619bb06ddc08d4b', 'request_id': 'req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:46.590979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560ec8ae9f914fd5a619bb06ddc08d4b', 'request_id': 'req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:46.623441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] The token cache is being invalidate because project 560ec8ae9f914fd5a619bb06ddc08d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:46.623814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:46.624563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f0aaa5b2-c359-4a02-9c50-ebe362c7ac9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:46.626545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2893/5758] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:46 2022] DELETE /identity/v3/projects/560ec8ae9f914fd5a619bb06ddc08d4b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:46.632606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:46.633139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:46.633522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:46.679537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:46.681546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:46.812424 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2866/5759] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:46.820129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:46.820655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:46.820847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:46.867870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:46.869184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:46.890574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2894/5760] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:46.894949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:46.923647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2379b14-472f-42b9-95b5-0d3a9d94eb03 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:46.942248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:46.943226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:46.943671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:46.944701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:46.948124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:08:46.948615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:46.952646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:46.984967 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2867/5761] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:08:46.989675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:47.003819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f9f5-cae7-47e8-8702-dc7dbace2214 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:47.022364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:47.023432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.024054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.024588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.025507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:47.031311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:47.103563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2895/5762] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:08:46 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:47.108173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:47.124504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa55e06-633f-4ed8-b8e9-fb3c9bb3d213 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:47.153728 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:47.249633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:47.250719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.251411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.252017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.252918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:47.256021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:47.298234 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2868/5763] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:08:47.299085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:47.312702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03c3d-aa09-481b-8be6-d8c5841870ec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:47.318034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:47.319230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.319959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.323894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.325662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:47.327597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:47.346990 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2896/5764] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:47.348982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:47.365819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed52af-8e2b-4908-b7bc-3bd16f04ffe3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:47.376016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f227f23-839e-4a38-9280-72631bfcd629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:47.376850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227f23-839e-4a38-9280-72631bfcd629 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.377728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227f23-839e-4a38-9280-72631bfcd629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.378094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227f23-839e-4a38-9280-72631bfcd629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.379712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f227f23-839e-4a38-9280-72631bfcd629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:47.385948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f227f23-839e-4a38-9280-72631bfcd629 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:47.415286 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2869/5765] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:08:47.415617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:47.438778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d009-a003-4621-b3bf-776ea143ba84 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.439096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d009-a003-4621-b3bf-776ea143ba84 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.439372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d009-a003-4621-b3bf-776ea143ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.441263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893621-72ef-4223-b633-848dd3c19c85 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:47.451662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71298ae-2e15-4ed2-b17d-c94d971b3500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:47.453072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71298ae-2e15-4ed2-b17d-c94d971b3500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.453310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71298ae-2e15-4ed2-b17d-c94d971b3500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.453589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71298ae-2e15-4ed2-b17d-c94d971b3500 admin admin] PATH_INFO: `/v3/projects/e14fba68147e4c3cb9d36b193d0927ec/users/c1179bddbd9a43559d7e38b1b62695ef/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.487983 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:47.494615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71298ae-2e15-4ed2-b17d-c94d971b3500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14fba68147e4c3cb9d36b193d0927ec, user_id=c1179bddbd9a43559d7e38b1b62695ef, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:47.499525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71298ae-2e15-4ed2-b17d-c94d971b3500 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:47.522784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-19d2d009-a003-4621-b3bf-776ea143ba84 None None] MFA Rules not processed for user `1dfed9df4c8a4de98a315124dc7cfe94`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:47.527105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-19d2d009-a003-4621-b3bf-776ea143ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:47.573804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2897/5766] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:08:47 2022] PUT /identity/v3/projects/e14fba68147e4c3cb9d36b193d0927ec/users/c1179bddbd9a43559d7e38b1b62695ef/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:47.588957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae495690-3d1d-4b14-9c03-491596d78956 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.592739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae495690-3d1d-4b14-9c03-491596d78956 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.594707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae495690-3d1d-4b14-9c03-491596d78956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.654773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ae495690-3d1d-4b14-9c03-491596d78956 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:47.656395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae495690-3d1d-4b14-9c03-491596d78956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:47.661992 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2898/5767] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:08:47.667057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.667353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.667646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.743589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] MFA Rules not processed for user `c1179bddbd9a43559d7e38b1b62695ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:47.747802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:47.774683 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2870/5768] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:47.778316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8987d-41e1-43a9-89ef-8d2cb0e2adc7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.780523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8987d-41e1-43a9-89ef-8d2cb0e2adc7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.780845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8987d-41e1-43a9-89ef-8d2cb0e2adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.826936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-10a8987d-41e1-43a9-89ef-8d2cb0e2adc7 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:47.828097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-10a8987d-41e1-43a9-89ef-8d2cb0e2adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:47.938334 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2871/5769] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:47.938334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:47.938334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:47.938334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:47.969700 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2899/5770] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:47.975368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:47.998725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717fd2-2e88-4956-a992-42f5ecb2651b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:48.000565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] MFA Rules not processed for user `1dfed9df4c8a4de98a315124dc7cfe94`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:48.002779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:48.004574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:48.006198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:48.007598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:48.008225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:48.071626 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:48.123288 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 11 15:08:48.124536 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:08:48.126922 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2900/5771] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 188 bytes in 157 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:08:48.128037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:48.134800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:48.182662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2872/5772] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:48.182662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:48.232396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58226dc-7521-4a3b-86ed-da16cdcf1cad None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:48.251380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:48.252277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:48.252565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:48.252845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:48.371376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379cc02-e957-4b2c-bcab-15164b748097 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:08:48.379630 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 11 15:08:48.380769 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:08:48.381919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:48.381919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:48.381919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:48.381919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:48.383765 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2873/5773] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:48 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 188 bytes in 203 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:08:48.386910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:48.393061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:48.397502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:48.399009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:48.421045 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2901/5774] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:48.421863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:48.446019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c562f-dbd9-4e34-b5b0-970ade78912f service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:48.454424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcbe2b-6142-4089-b6b7-117819f0cbf3 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:48.455337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbe2b-6142-4089-b6b7-117819f0cbf3 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:48.455628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbe2b-6142-4089-b6b7-117819f0cbf3 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:48.455928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbe2b-6142-4089-b6b7-117819f0cbf3 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:48.600027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e987-ccc2-4324-8c5e-e319abec4e73 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:48.607907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddcbe2b-6142-4089-b6b7-117819f0cbf3 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:48.627918 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2902/5775] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:48 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:48.646155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de658e5-bb82-4cc3-8c89-491f69cd94f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:48.646882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de658e5-bb82-4cc3-8c89-491f69cd94f7 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:48.647761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de658e5-bb82-4cc3-8c89-491f69cd94f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:48.647970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de658e5-bb82-4cc3-8c89-491f69cd94f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:48.676970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de658e5-bb82-4cc3-8c89-491f69cd94f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:48.678635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de658e5-bb82-4cc3-8c89-491f69cd94f7 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:48.720617 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2874/5776] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:48 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:49.634426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:49.635346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:49.635789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:49.681866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:49.684040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:49.701587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c450f1-cc30-4d86-94be-d0121483bc14 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:49.702485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c450f1-cc30-4d86-94be-d0121483bc14 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:49.702485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c450f1-cc30-4d86-94be-d0121483bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:49.729331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2903/5777] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:49 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:08:49.745610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b5c450f1-cc30-4d86-94be-d0121483bc14 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:49.746866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5c450f1-cc30-4d86-94be-d0121483bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:49.788591 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2875/5778] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:49.792493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:49.812983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe4eb-f1df-4778-9dca-96615a7edeb0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:49.832923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf22a-6aa2-4329-8425-88e93f779488 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:49.833839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf22a-6aa2-4329-8425-88e93f779488 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:49.834128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf22a-6aa2-4329-8425-88e93f779488 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:49.834406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf22a-6aa2-4329-8425-88e93f779488 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:49.899754 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:49.953946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70acf22a-6aa2-4329-8425-88e93f779488 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:49.997940 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2904/5779] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:49 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:51.002231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:51.003011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:51.003011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:51.095507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:51.100465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:51.112117 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2876/5780] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:08:51.116705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee446-ee78-49c7-9903-acf0e032b0c1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:51.117206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee446-ee78-49c7-9903-acf0e032b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:51.117206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee446-ee78-49c7-9903-acf0e032b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:51.179822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68bee446-ee78-49c7-9903-acf0e032b0c1 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:51.181072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68bee446-ee78-49c7-9903-acf0e032b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:51.233177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:51.239249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2905/5781] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:51.248570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09068d5d-4663-4998-b2bb-bc08e5842caf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:51.253994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65924934-cd40-4ddc-9517-f47d30fbee74 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:51.255247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65924934-cd40-4ddc-9517-f47d30fbee74 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:51.255695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65924934-cd40-4ddc-9517-f47d30fbee74 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:51.256194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65924934-cd40-4ddc-9517-f47d30fbee74 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:51.336790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-65924934-cd40-4ddc-9517-f47d30fbee74 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:51.358938 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2877/5782] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:51 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:08:52.365828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:52.366389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:52.366519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:52.407882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:52.409374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:52.423526 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2906/5783] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:52 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:08:52.428794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8668202-bfd5-4fcf-9f63-81d5c528945c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:52.429807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8668202-bfd5-4fcf-9f63-81d5c528945c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:52.430255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8668202-bfd5-4fcf-9f63-81d5c528945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:52.471182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d8668202-bfd5-4fcf-9f63-81d5c528945c None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:52.481354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8668202-bfd5-4fcf-9f63-81d5c528945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:52.507610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2878/5784] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:52.511440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:52.539774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5289998-4d6f-4807-9bad-3e92e3abeb95 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:52.546180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c4558-745a-4143-a2d0-74a3ae569d3c tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:52.547099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4558-745a-4143-a2d0-74a3ae569d3c tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:52.547394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4558-745a-4143-a2d0-74a3ae569d3c tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:52.547677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4558-745a-4143-a2d0-74a3ae569d3c tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:52.711572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b31c4558-745a-4143-a2d0-74a3ae569d3c tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:52.752087 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2907/5785] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:08:52 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:53.757539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245dbc-d19b-4344-815d-4775eb185ba4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:53.758462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245dbc-d19b-4344-815d-4775eb185ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:53.758954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245dbc-d19b-4344-815d-4775eb185ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:53.810632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-23245dbc-d19b-4344-815d-4775eb185ba4 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:53.814616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-23245dbc-d19b-4344-815d-4775eb185ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:53.832118 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2879/5786] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:08:54.837707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfa9dc-3502-4ad8-933e-8f7f893ca6d2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:54.838244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfa9dc-3502-4ad8-933e-8f7f893ca6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:54.838332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfa9dc-3502-4ad8-933e-8f7f893ca6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:54.880449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-89bfa9dc-3502-4ad8-933e-8f7f893ca6d2 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:54.882136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-89bfa9dc-3502-4ad8-933e-8f7f893ca6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:54.891818 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2908/5787] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:08:54.898076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a290-74cb-4012-8f46-c11f24d7e3a4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:54.898596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a290-74cb-4012-8f46-c11f24d7e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:54.898717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a290-74cb-4012-8f46-c11f24d7e3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:54.924687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9b49a290-74cb-4012-8f46-c11f24d7e3a4 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:54.926977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9b49a290-74cb-4012-8f46-c11f24d7e3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:54.949060 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2880/5788] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:08:54.953466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00f619-cefd-49c1-b518-f432c898bf05 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:54.953878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00f619-cefd-49c1-b518-f432c898bf05 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:54.954227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00f619-cefd-49c1-b518-f432c898bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:55.047028 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.application [None req-ce00f619-cefd-49c1-b518-f432c898bf05 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.77: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 11 15:08:55.048766 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2909/5789] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:54 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 96 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 11 15:08:55.054356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:55.054677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:55.055139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:55.174906 n-d-master-1 devstack@keystone.service[80990]: WARNING keystone.server.flask.application [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.77: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 11 15:08:55.181538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17583644-45b2-4b6d-a220-9cc96b06e5d6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:55.182154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17583644-45b2-4b6d-a220-9cc96b06e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:55.182843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17583644-45b2-4b6d-a220-9cc96b06e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:55.201552 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2881/5790] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 148 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 11 15:08:55.223291 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.application [None req-17583644-45b2-4b6d-a220-9cc96b06e5d6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.77: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 11 15:08:55.230040 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2910/5791] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 50 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Jul 11 15:08:58.252646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:58.255201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:58.278530 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:58.383069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ee714-846d-40e1-8fe5-670c298a861c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:58.389625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:58.390883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:58.391280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:58.391809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] PATH_INFO: `/v3/users/f58e70d6d21a42c7b832deed98a3044a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:58.393262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58e70d6d21a42c7b832deed98a3044a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:58.395682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:58.524401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58e70d6d21a42c7b832deed98a3044a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:58.585279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58e70d6d21a42c7b832deed98a3044a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:58.602358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58e70d6d21a42c7b832deed98a3044a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:58.611510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58e70d6d21a42c7b832deed98a3044a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:58.612140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58e70d6d21a42c7b832deed98a3044a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:58.625414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2882/5792] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:58 2022] DELETE /identity/v3/users/f58e70d6d21a42c7b832deed98a3044a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:58.630249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:58.630844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:58.630844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:58.666836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:08:58.668292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:58.785477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2911/5793] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:08:58.799306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:58.799306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:58.946248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22588f8c-bd41-4385-a4c5-569ec66d7b77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:58.950650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:58.951309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:58.951595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:58.951995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:58.967794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:58.969445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:59.020549 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2883/5794] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:08:59.327328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:59.328948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:08:59.348929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b846-6d4f-4a97-9f1b-9678bd696cc9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:59.362817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:59.367643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:59.370752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:59.371294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] PATH_INFO: `/v3/projects/b0bdc81b3b034bf68920f56155113688` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:59.375052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0bdc81b3b034bf68920f56155113688)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:59.379416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:59.512681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0bdc81b3b034bf68920f56155113688', 'request_id': 'req-ef948926-7498-4521-a9be-2f82dab1f7dc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.516011 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:59.533802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0bdc81b3b034bf68920f56155113688', 'request_id': 'req-ef948926-7498-4521-a9be-2f82dab1f7dc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.541221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0bdc81b3b034bf68920f56155113688', 'request_id': 'req-ef948926-7498-4521-a9be-2f82dab1f7dc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.557795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] The token cache is being invalidate because project b0bdc81b3b034bf68920f56155113688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:08:59.558362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.559813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.565407 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2912/5795] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:08:59 2022] DELETE /identity/v3/projects/b0bdc81b3b034bf68920f56155113688 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:08:59.566218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:08:59.581254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4242d-f74e-4922-8aca-3e115046c055 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:08:59.653653 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:08:59.716216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:08:59.717348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:08:59.717927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:08:59.720649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] PATH_INFO: `/v3/users/32a4323fa9b0496baeaae911d976b8e0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:08:59.723089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a4323fa9b0496baeaae911d976b8e0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:08:59.725223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:08:59.795318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a4323fa9b0496baeaae911d976b8e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.809930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a4323fa9b0496baeaae911d976b8e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.828631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a4323fa9b0496baeaae911d976b8e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.841921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a4323fa9b0496baeaae911d976b8e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.843111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a4323fa9b0496baeaae911d976b8e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:08:59.857417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2884/5796] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:08:59 2022] DELETE /identity/v3/users/32a4323fa9b0496baeaae911d976b8e0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:00.202992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:00.205121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:00.219114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948926-7498-4521-a9be-2f82dab1f7dc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:00.282023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:00.283062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:00.283358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:00.283643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] PATH_INFO: `/v3/projects/e5802a7c202c4b8b842e26e3143016a3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:00.284869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5802a7c202c4b8b842e26e3143016a3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:00.286830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:00.348232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5802a7c202c4b8b842e26e3143016a3', 'request_id': 'req-9c374e44-0463-4a00-94f8-d4cf0909862e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.361974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5802a7c202c4b8b842e26e3143016a3', 'request_id': 'req-9c374e44-0463-4a00-94f8-d4cf0909862e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.373210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5802a7c202c4b8b842e26e3143016a3', 'request_id': 'req-9c374e44-0463-4a00-94f8-d4cf0909862e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.386968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] The token cache is being invalidate because project e5802a7c202c4b8b842e26e3143016a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:00.387277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.388393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.390461 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2913/5797] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:00 2022] DELETE /identity/v3/projects/e5802a7c202c4b8b842e26e3143016a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:09:00.394853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:00.396490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:00.413496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec754a-77a2-46d7-bdaa-ddc0ddf0fe5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:00.497840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:00.498892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:00.499367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:00.499767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] PATH_INFO: `/v3/users/eb732f93a0634413bacd88c76337cbef` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:00.501122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb732f93a0634413bacd88c76337cbef)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:00.503235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:00.558432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb732f93a0634413bacd88c76337cbef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.567463 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:00.581140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb732f93a0634413bacd88c76337cbef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.614028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb732f93a0634413bacd88c76337cbef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.622755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb732f93a0634413bacd88c76337cbef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.625847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27443987-c9c7-48dc-af00-40bb3aa0a741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb732f93a0634413bacd88c76337cbef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:00.636508 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2885/5798] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:00 2022] DELETE /identity/v3/users/eb732f93a0634413bacd88c76337cbef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:01.113016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:01.113961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:01.138368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c374e44-0463-4a00-94f8-d4cf0909862e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:01.250193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:01.251508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.251863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.252274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] PATH_INFO: `/v3/projects/af813031a66a407e957200de2fa5ecf2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.253654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af813031a66a407e957200de2fa5ecf2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:01.255668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:01.270947 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:01.316029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af813031a66a407e957200de2fa5ecf2', 'request_id': 'req-fc33444c-e440-491d-b46b-1d848abc3323'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:01.327965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af813031a66a407e957200de2fa5ecf2', 'request_id': 'req-fc33444c-e440-491d-b46b-1d848abc3323'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:01.334833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af813031a66a407e957200de2fa5ecf2', 'request_id': 'req-fc33444c-e440-491d-b46b-1d848abc3323'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:01.352248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] The token cache is being invalidate because project af813031a66a407e957200de2fa5ecf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:01.352551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:01.353293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc33444c-e440-491d-b46b-1d848abc3323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:01.355559 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2914/5799] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:01 2022] DELETE /identity/v3/projects/af813031a66a407e957200de2fa5ecf2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:01.360523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.361107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.361426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.386100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:01.387478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:01.472245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2886/5800] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:01.482018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.485593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.486098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.522408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:01.524596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:01.540551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:01.542474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2915/5801] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:01.554780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc85d-1a25-4cba-a4d2-ecd48072923c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:01.562264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:01.562971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.563265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.563530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.568657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:01.569158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:01.570645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:01.585204 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2887/5802] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:09:01.590753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:01.616543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdccbef-dc66-4c4e-a68f-1be7813161c9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:01.621964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:01.622893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.623223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.623480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.624519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:01.626891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:01.673323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2916/5803] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:01 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:01.677694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:01.709890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc692-ba20-43a3-9641-098e514e55f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:01.856860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:01.857961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.859936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.860508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.861024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:01.864578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:01.905547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:01.906174 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2888/5804] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:01 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:01.969767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279676-d6b9-49bd-be0c-88e726cb8ead admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:01.976275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:01.977219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:01.977667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:01.980652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:01.982748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:01.984483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.002572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2917/5805] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:02.006580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.018968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b9a7-6b86-4440-8efa-f0707ab4e42a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.025463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762137d-07c2-4947-8c5a-24f3837ced53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.026638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762137d-07c2-4947-8c5a-24f3837ced53 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.028580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762137d-07c2-4947-8c5a-24f3837ced53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.029024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762137d-07c2-4947-8c5a-24f3837ced53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.029990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762137d-07c2-4947-8c5a-24f3837ced53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.032101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762137d-07c2-4947-8c5a-24f3837ced53 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.048194 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2889/5806] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:02.052345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.069645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e7657-9765-4d45-b7b8-51388601919b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.077307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.078447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.078949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.079289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] PATH_INFO: `/v3/projects/6840e4c4271d4c99851ca787b9c81698/users/d77f21b7666040b2bbbb460782a39e53/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.108358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6840e4c4271d4c99851ca787b9c81698, user_id=d77f21b7666040b2bbbb460782a39e53, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.111954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.136964 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2918/5807] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:02 2022] PUT /identity/v3/projects/6840e4c4271d4c99851ca787b9c81698/users/d77f21b7666040b2bbbb460782a39e53/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:02.148182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.148504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.148879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.213502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] MFA Rules not processed for user `d77f21b7666040b2bbbb460782a39e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:02.215217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:02.252437 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:02.300331 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2890/5808] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:02.305082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.391920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537b17f-cd9b-4487-baf0-3670db27ace7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.398255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.399162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.399557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.399942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.400804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.402938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.442633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.451483 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2919/5809] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:02 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:02.456891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b7a3-4588-4619-8419-30b2427eb737 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.561311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.563572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.564084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.564693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.570911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.576757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.625136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2891/5810] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:02 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:02.629576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.650789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607910-10fa-4c9d-a18c-5e11c291d937 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.664331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.665944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.666398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.666930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.667833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.669734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.705174 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2920/5811] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:02.709790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.722112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a59a6c-e3d4-443e-8ee5-e6b0dd5e0003 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.737605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.742453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.742775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.743068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] PATH_INFO: `/v3/projects/c0d05c02a25b45ec8d143f3f5448f0b6/users/d8c0f846c57a4dbd97db301d4898d4cc/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.785651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d05c02a25b45ec8d143f3f5448f0b6, user_id=d8c0f846c57a4dbd97db301d4898d4cc, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.788825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.817724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:02.818157 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2892/5812] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:02 2022] PUT /identity/v3/projects/c0d05c02a25b45ec8d143f3f5448f0b6/users/d8c0f846c57a4dbd97db301d4898d4cc/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:02.833372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2878-bf6f-4130-85a1-51e9288de32e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:02.844886 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:02.967213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa198-9b56-4cd1-96e1-79c422ae6d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:02.967998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa198-9b56-4cd1-96e1-79c422ae6d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:02.968349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa198-9b56-4cd1-96e1-79c422ae6d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:02.969190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa198-9b56-4cd1-96e1-79c422ae6d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:02.970222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aa198-9b56-4cd1-96e1-79c422ae6d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:02.971947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aa198-9b56-4cd1-96e1-79c422ae6d2f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:02.989702 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2921/5813] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:02.995004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:03.032133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2865c-669d-47d6-92c2-b50593ac8c5b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:03.077864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:03.079584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:03.084233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:03.084233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] PATH_INFO: `/v3/projects/c0d05c02a25b45ec8d143f3f5448f0b6/users/d8c0f846c57a4dbd97db301d4898d4cc/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:03.087112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d05c02a25b45ec8d143f3f5448f0b6, user_id=d8c0f846c57a4dbd97db301d4898d4cc, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:03.103214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:03.216536 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2893/5814] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:02 2022] PUT /identity/v3/projects/c0d05c02a25b45ec8d143f3f5448f0b6/users/d8c0f846c57a4dbd97db301d4898d4cc/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:03.230538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239e5f-51a0-4392-9cac-378a14af9682 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:03.230538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239e5f-51a0-4392-9cac-378a14af9682 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:03.230538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239e5f-51a0-4392-9cac-378a14af9682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:03.323925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-da239e5f-51a0-4392-9cac-378a14af9682 None None] MFA Rules not processed for user `d8c0f846c57a4dbd97db301d4898d4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:03.326530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da239e5f-51a0-4392-9cac-378a14af9682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:03.627973 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2922/5815] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:03.634897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:03.636654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:03.812667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfce8c-7db0-4069-89df-1178c93b6935 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:03.828484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:03.829414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:03.829886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:03.830270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:03.849590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:03.851286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:03.877648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2894/5816] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:06.246060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feadef1-897c-4e1d-a4de-fb29c7b337d5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:06.246623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feadef1-897c-4e1d-a4de-fb29c7b337d5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:06.246623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feadef1-897c-4e1d-a4de-fb29c7b337d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:06.325732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8feadef1-897c-4e1d-a4de-fb29c7b337d5 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:06.327272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8feadef1-897c-4e1d-a4de-fb29c7b337d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:06.335433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2923/5817] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:06 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:09:06.341272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:06.342928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:06.406126 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:06.519765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0327-3469-40a3-880e-040a2989e9a1 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:06.533697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:06.536314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:06.536689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:06.539643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8db946-f2c5-49c8-a51e-1e21d86bf232 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:06.540007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8db946-f2c5-49c8-a51e-1e21d86bf232 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:06.540358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8db946-f2c5-49c8-a51e-1e21d86bf232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:06.546465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:06.585052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2d8db946-f2c5-49c8-a51e-1e21d86bf232 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:06.588958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2d8db946-f2c5-49c8-a51e-1e21d86bf232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:06.685953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:06.723484 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2895/5818] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:09:06 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:06.776402 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2924/5819] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:06.801546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:06.804484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:06.954081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d14378-c9bd-427c-b68c-83a183d62afc tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:06.968068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f2f9-dbcb-4b58-a467-f8d4b47d3495 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:06.968751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f2f9-dbcb-4b58-a467-f8d4b47d3495 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:06.969038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f2f9-dbcb-4b58-a467-f8d4b47d3495 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:06.969318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f2f9-dbcb-4b58-a467-f8d4b47d3495 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:06.987368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77f2f9-dbcb-4b58-a467-f8d4b47d3495 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:06.989072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77f2f9-dbcb-4b58-a467-f8d4b47d3495 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:07.002100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2896/5820] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:09:07.729207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8709c-9a39-4bfc-96b3-af753ef684a2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:07.730475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8709c-9a39-4bfc-96b3-af753ef684a2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:07.731208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8709c-9a39-4bfc-96b3-af753ef684a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:07.784660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4be8709c-9a39-4bfc-96b3-af753ef684a2 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:07.790689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4be8709c-9a39-4bfc-96b3-af753ef684a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:07.804686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2925/5821] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:07 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:09:07.808344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1bdca-48cf-48bd-b9ed-dc27b32fcf40 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:07.808832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1bdca-48cf-48bd-b9ed-dc27b32fcf40 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:07.809102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1bdca-48cf-48bd-b9ed-dc27b32fcf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d1d1bdca-48cf-48bd-b9ed-dc27b32fcf40 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 11 15:09:07.869121 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:09:07.870384 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 11 15:09:07.871470 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:09:07.876110 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2897/5822] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:07 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:09:07.879063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d0e2-8d3b-4d8a-9bb4-1bb7da499ee4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:07.880122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d0e2-8d3b-4d8a-9bb4-1bb7da499ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:07.880481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d0e2-8d3b-4d8a-9bb4-1bb7da499ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:07.909956 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:08.004122 n-d-master-1 devstack@keystone.service[80989]: WARNING keystone.server.flask.application [None req-0667d0e2-8d3b-4d8a-9bb4-1bb7da499ee4 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.77: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 11 15:09:08.017410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1a1b-b790-4f8c-9667-ea8b846e5d6a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:08.017772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1a1b-b790-4f8c-9667-ea8b846e5d6a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:08.017884 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2926/5823] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 140 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 11 15:09:08.018357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1a1b-b790-4f8c-9667-ea8b846e5d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:08.102185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b73a1a1b-b790-4f8c-9667-ea8b846e5d6a None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:08.103804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b73a1a1b-b790-4f8c-9667-ea8b846e5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:08.120386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2898/5824] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:08.124604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667d0e2-8d3b-4d8a-9bb4-1bb7da499ee4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:08.144772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667d0e2-8d3b-4d8a-9bb4-1bb7da499ee4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:08.159455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6a18-5bc6-4955-ad81-23f22dc64815 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:08.163625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6a18-5bc6-4955-ad81-23f22dc64815 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:08.163923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6a18-5bc6-4955-ad81-23f22dc64815 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:08.164256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6a18-5bc6-4955-ad81-23f22dc64815 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:08.298710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ddc6a18-5bc6-4955-ad81-23f22dc64815 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:08.324195 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2927/5825] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:09:08 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:09.329558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:09.329949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:09.329949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:09.369002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:09.370252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:09.396627 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2899/5826] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:09 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:09:09.398395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbf4fb-d3bc-43eb-964d-a6840ab44481 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:09.398902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbf4fb-d3bc-43eb-964d-a6840ab44481 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:09.398999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbf4fb-d3bc-43eb-964d-a6840ab44481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:09.444195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fcdbf4fb-d3bc-43eb-964d-a6840ab44481 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:09.446554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fcdbf4fb-d3bc-43eb-964d-a6840ab44481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:09.466508 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2928/5827] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:09.470439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:09.494116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556123-2824-41eb-87d5-c07dfd5c0b7b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:09.509611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec49a71-2975-419c-8b36-0cefa5123b59 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:09.511336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49a71-2975-419c-8b36-0cefa5123b59 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:09.512065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49a71-2975-419c-8b36-0cefa5123b59 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:09.512584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49a71-2975-419c-8b36-0cefa5123b59 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:09.632011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ec49a71-2975-419c-8b36-0cefa5123b59 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:09.650774 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2900/5828] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:09:09 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:10.656092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:10.656638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:10.656638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:10.695246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:10.696709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:10.709465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2929/5829] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:10 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:09:10.713748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:10.714608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:10.715047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:10.749008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:10.750444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:10.776237 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2901/5830] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:10.780180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:10.801590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce65cae-1487-4a2e-a5fe-b5effa878d45 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:10.808718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a167c-990b-48ca-9e46-b96549002327 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b543253c142dc8535500212c2f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9738a4b56e44d388a11479f4fdaac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:10.809843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a167c-990b-48ca-9e46-b96549002327 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:10.810310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a167c-990b-48ca-9e46-b96549002327 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:10.810772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a167c-990b-48ca-9e46-b96549002327 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6/password` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:10.908596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff4a167c-990b-48ca-9e46-b96549002327 tempest-IdentityV3UsersTest-198101984 tempest-IdentityV3UsersTest-198101984-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:10.915812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:10.917409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:10.946032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2930/5831] 10.222.0.77 () {60 vars in 1268 bytes} [Mon Jul 11 15:09:10 2022] POST /identity/v3/users/2b3b543253c142dc8535500212c2f4a6/password => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:10.969148 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:11.119220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6747-6d4e-4a5c-aac7-86108987ae96 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:11.138831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:11.139815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:11.140276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:11.140721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:11.142878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:11.291076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:11.292474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9004-fba9-4cdb-9cf4-8b0c7f183b56 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:11.316721 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2902/5832] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:11.863017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:11.863757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:11.863757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:11.908015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:11.909268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:11.930846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2931/5833] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:11.950759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:11.951306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:11.951306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:11.966428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:11.997946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:11.999347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4490a5-9208-4ab1-a503-703db92b993f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:12.003366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:12.018421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2903/5834] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:11 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:09:12.020034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83c1f-91f4-43d7-929d-a2f6e7ab7f98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:12.020903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83c1f-91f4-43d7-929d-a2f6e7ab7f98 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:12.021376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83c1f-91f4-43d7-929d-a2f6e7ab7f98 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:12.021813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83c1f-91f4-43d7-929d-a2f6e7ab7f98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:12.039406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83c1f-91f4-43d7-929d-a2f6e7ab7f98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:12.044751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83c1f-91f4-43d7-929d-a2f6e7ab7f98 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:12.068907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2932/5835] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:09:12.436293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:12.437952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:12.664032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e69c-8d58-42cd-b923-d6e6c708fd5c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:12.673927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:12.675373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:12.675905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:12.676419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] PATH_INFO: `/v3/users/c1179bddbd9a43559d7e38b1b62695ef` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:12.679260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1179bddbd9a43559d7e38b1b62695ef)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:12.681527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:12.782324 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:12.799666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1179bddbd9a43559d7e38b1b62695ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:12.822745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1179bddbd9a43559d7e38b1b62695ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:12.841734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1179bddbd9a43559d7e38b1b62695ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:12.865943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1179bddbd9a43559d7e38b1b62695ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:12.866785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a561baca-af40-4f38-92a0-3b708671cb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1179bddbd9a43559d7e38b1b62695ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:12.888750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2904/5836] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:12 2022] DELETE /identity/v3/users/c1179bddbd9a43559d7e38b1b62695ef => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:12.890327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:12.890830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:12.890938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:12.929404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:12.934793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:13.026315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:13.026949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:13.027455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:13.127992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] MFA Rules not processed for user `2b3b543253c142dc8535500212c2f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:13.129255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:13.176028 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2933/5837] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:13.194997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:13.196805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:13.341611 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2905/5838] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:13.342923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:13.348333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:13.364040 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:13.401830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f439f04-79a2-4c1f-879a-f10a0fcdfa91 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:13.403467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134bf7f-45be-4cc0-8019-1fc328c82bed None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:13.418412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1616a-08a3-4974-9f09-96f87d980a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:13.419339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:13.420229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1616a-08a3-4974-9f09-96f87d980a18 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:13.421286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:13.428222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1616a-08a3-4974-9f09-96f87d980a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:13.428877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:13.429330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1616a-08a3-4974-9f09-96f87d980a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:13.430519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] PATH_INFO: `/v3/users/2b3b543253c142dc8535500212c2f4a6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:13.433652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3b543253c142dc8535500212c2f4a6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:13.435829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:13.458584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1616a-08a3-4974-9f09-96f87d980a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:13.461130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1616a-08a3-4974-9f09-96f87d980a18 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:13.502129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2934/5839] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:09:13.640861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:13.673826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:13.694040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:13.714884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:13.718586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3b543253c142dc8535500212c2f4a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:13.743930 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2906/5840] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:13 2022] DELETE /identity/v3/users/2b3b543253c142dc8535500212c2f4a6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:13.748641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:13.749033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:13.749376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:13.815608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:13.816660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:14.167962 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2935/5841] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:14.260974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:14.267197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:14.355385 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:14.405787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4732-8e6e-4fab-a9b2-e1b628acccac admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:14.426044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:14.431382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:14.432031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:14.433124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:14.511490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:14.519355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:14.591041 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2907/5842] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:14.946539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:14.952428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:15.010551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0e8d-03f6-4f84-955a-f4aff2e4fa7f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:15.025555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:15.026952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:15.026952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:15.027518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] PATH_INFO: `/v3/projects/e14fba68147e4c3cb9d36b193d0927ec` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:15.035379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14fba68147e4c3cb9d36b193d0927ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:15.035596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:15.136990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:15.138768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:15.174540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1a84b-7ed5-4579-821a-74157749267a service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:15.180550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14fba68147e4c3cb9d36b193d0927ec', 'request_id': 'req-8b612174-0854-4a82-98ce-9de275a2c39f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.195779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14fba68147e4c3cb9d36b193d0927ec', 'request_id': 'req-8b612174-0854-4a82-98ce-9de275a2c39f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.210340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14fba68147e4c3cb9d36b193d0927ec', 'request_id': 'req-8b612174-0854-4a82-98ce-9de275a2c39f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.229327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] The token cache is being invalidate because project e14fba68147e4c3cb9d36b193d0927ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:15.229956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.231305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8b612174-0854-4a82-98ce-9de275a2c39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.236061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2936/5843] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:14 2022] DELETE /identity/v3/projects/e14fba68147e4c3cb9d36b193d0927ec => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:15.245794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2842-f062-4711-908d-c86385d6c9e8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:15.246706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2842-f062-4711-908d-c86385d6c9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:15.247163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2842-f062-4711-908d-c86385d6c9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:15.320899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-16eb2842-f062-4711-908d-c86385d6c9e8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:15.322861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16eb2842-f062-4711-908d-c86385d6c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:15.367341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:15.368252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:15.368540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:15.372800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] PATH_INFO: `/v3/users/e9f06306e4604f8fa1c7a88d61476b69` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:15.375792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f06306e4604f8fa1c7a88d61476b69)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:15.380204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:15.548608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f06306e4604f8fa1c7a88d61476b69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.583966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2937/5844] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:15.585608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:15.586714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:15.587188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:15.589437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f06306e4604f8fa1c7a88d61476b69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.618442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f06306e4604f8fa1c7a88d61476b69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.636614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:15.637988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:15.642690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f06306e4604f8fa1c7a88d61476b69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.643515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-57e82df0-7f8e-40f9-b458-41dac2d4a3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f06306e4604f8fa1c7a88d61476b69'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:15.666388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2938/5846] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:15.668377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:15.668488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2908/5846] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:15 2022] DELETE /identity/v3/users/e9f06306e4604f8fa1c7a88d61476b69 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:15.669577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:15.669577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:15.669577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:15.689390 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:15.702299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003303-8fc2-4a4c-b0c2-c498e5f245d2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:15.740325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:15.742428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:15.960031 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:15.984209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2909/5847] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:16.012668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.013883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.018815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.019564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.020267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:16.020712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.022855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.076819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:16.078293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:16.090227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2939/5848] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:16.099892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:16.138117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96c4d-3fd7-4078-8c9d-8d9c0b0fc4bf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:16.143594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.153358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.156012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.157013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.157931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.166255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.225299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2940/5849] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:16 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:16.226627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:16.394377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3063-7d56-4bb1-9eb3-a97eb1c6d4e2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:16.404727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc5c6-7f55-47b4-b9f6-005a5d12ea0c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:16.417092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.417925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.421200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.421643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.422622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.428007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.477883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2941/5850] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:16 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:16.478802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:16.503197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc266d7-4baa-4cab-a827-1bf8d638ac90 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:16.515303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.516184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.516861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.518327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.519397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.524948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.581761 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2942/5851] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:16.585856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:16.626439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8cd50-b8b9-4f64-b8ba-130a4bbfc78b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:16.639376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.639763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d4f48-b549-44b4-baf3-1bb93adc858c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.640455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d4f48-b549-44b4-baf3-1bb93adc858c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.640737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d4f48-b549-44b4-baf3-1bb93adc858c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.641962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.644266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d4f48-b549-44b4-baf3-1bb93adc858c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.644408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.644743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.646799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.653447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.679003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d4f48-b549-44b4-baf3-1bb93adc858c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.681162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d4f48-b549-44b4-baf3-1bb93adc858c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.698172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2943/5852] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:16.703102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:16.736603 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2910/5853] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:16.758607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d611176-902a-45c6-b193-6c17761c4d48 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:16.779235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:16.785098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.785687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.786208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] PATH_INFO: `/v3/projects/e605a0184eab4e118ad5e4b5a4f50634/users/e887993c0a80489cb80284a206c80fde/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:16.869512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e605a0184eab4e118ad5e4b5a4f50634, user_id=e887993c0a80489cb80284a206c80fde, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:16.876772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:16.949323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2944/5854] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:16 2022] PUT /identity/v3/projects/e605a0184eab4e118ad5e4b5a4f50634/users/e887993c0a80489cb80284a206c80fde/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:16.950628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:16.953096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:16.953409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.053297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] MFA Rules not processed for user `e887993c0a80489cb80284a206c80fde`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:17.054585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:17.242656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:17.244495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:17.283949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2911/5855] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:17.289249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:17.321148 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:17.321607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b64b-f1c7-4135-b505-382c9f261e6d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:17.333896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87252aff-e85e-4bba-8d95-a4b13d35c285 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e887993c0a80489cb80284a206c80fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e605a0184eab4e118ad5e4b5a4f50634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:17.335736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87252aff-e85e-4bba-8d95-a4b13d35c285 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.338031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87252aff-e85e-4bba-8d95-a4b13d35c285 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.338507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87252aff-e85e-4bba-8d95-a4b13d35c285 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] PATH_INFO: `/v3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.341065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2912/5856] 10.222.0.77 () {58 vars in 1103 bytes} [Mon Jul 11 15:09:17 2022] GET /identity/v3 => generated 255 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:09:17.359237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87252aff-e85e-4bba-8d95-a4b13d35c285 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:17.416200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87252aff-e85e-4bba-8d95-a4b13d35c285 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:17.436592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79bff-1e26-404a-b370-f31269cc72b1 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e887993c0a80489cb80284a206c80fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e605a0184eab4e118ad5e4b5a4f50634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:17.441704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79bff-1e26-404a-b370-f31269cc72b1 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.445756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79bff-1e26-404a-b370-f31269cc72b1 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.450420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79bff-1e26-404a-b370-f31269cc72b1 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] PATH_INFO: `/v3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.453206 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2913/5857] 10.222.0.77 () {58 vars in 1103 bytes} [Mon Jul 11 15:09:17 2022] GET /identity/v3 => generated 255 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:17.459740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79bff-1e26-404a-b370-f31269cc72b1 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:17.504816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79bff-1e26-404a-b370-f31269cc72b1 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:17.545458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16b8e-f5db-4c18-84f1-b71a56a1aa31 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e887993c0a80489cb80284a206c80fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e605a0184eab4e118ad5e4b5a4f50634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:17.546160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16b8e-f5db-4c18-84f1-b71a56a1aa31 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.546457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16b8e-f5db-4c18-84f1-b71a56a1aa31 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.546750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16b8e-f5db-4c18-84f1-b71a56a1aa31 tempest-TestApiDiscovery-1442534177 tempest-TestApiDiscovery-1442534177-project] PATH_INFO: `/v3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.570924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2914/5858] 10.222.0.77 () {58 vars in 1103 bytes} [Mon Jul 11 15:09:17 2022] GET /identity/v3 => generated 255 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:17.572677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cecd4-cf19-4d63-b03d-a71c9aa58218 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.572957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cecd4-cf19-4d63-b03d-a71c9aa58218 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.573364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cecd4-cf19-4d63-b03d-a71c9aa58218 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.601880 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2915/5859] 10.222.0.77 () {56 vars in 894 bytes} [Mon Jul 11 15:09:17 2022] GET /identity/ => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:09:17.603346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bb0c4-7e8a-4e97-ad3e-d9b430c1f2a7 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.603696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bb0c4-7e8a-4e97-ad3e-d9b430c1f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.604078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bb0c4-7e8a-4e97-ad3e-d9b430c1f2a7 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.630793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f5cfc-96fa-4e16-8644-da244732c19b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:17.636878 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2916/5860] 10.222.0.77 () {56 vars in 894 bytes} [Mon Jul 11 15:09:17 2022] GET /identity/ => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:09:17.643383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bb0c4-7e8a-4e97-ad3e-d9b430c1f2a7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:17.656320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:17.657942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.657942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.657942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] PATH_INFO: `/v3/projects/f9738a4b56e44d388a11479f4fdaac5b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.669066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9738a4b56e44d388a11479f4fdaac5b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:17.672564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:17.749624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bb0c4-7e8a-4e97-ad3e-d9b430c1f2a7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:17.766592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:17.767496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.767799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.768080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] PATH_INFO: `/v3/users/e887993c0a80489cb80284a206c80fde` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.775923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e887993c0a80489cb80284a206c80fde)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:17.777640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:17.843021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9738a4b56e44d388a11479f4fdaac5b', 'request_id': 'req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.859072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9738a4b56e44d388a11479f4fdaac5b', 'request_id': 'req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.875576 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:17.875883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9738a4b56e44d388a11479f4fdaac5b', 'request_id': 'req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.905692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] The token cache is being invalidate because project f9738a4b56e44d388a11479f4fdaac5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:17.907164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.907398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e8fd4cd2-7273-4f9f-93e2-c84cdf89aef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.925172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2945/5861] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:17 2022] DELETE /identity/v3/projects/f9738a4b56e44d388a11479f4fdaac5b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:17.926821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dfe6b-99f7-4de0-b1e1-32f260701874 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:17.928623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dfe6b-99f7-4de0-b1e1-32f260701874 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:17.928623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dfe6b-99f7-4de0-b1e1-32f260701874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:17.929776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e887993c0a80489cb80284a206c80fde'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.962424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e887993c0a80489cb80284a206c80fde'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:17.980245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d16dfe6b-99f7-4de0-b1e1-32f260701874 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:17.981503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d16dfe6b-99f7-4de0-b1e1-32f260701874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:17.984437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e887993c0a80489cb80284a206c80fde'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:18.007755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e887993c0a80489cb80284a206c80fde'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:18.008305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-917bf3ad-2e2d-4f10-9709-b0eedaeb4eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e887993c0a80489cb80284a206c80fde'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:18.053818 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2917/5862] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:17 2022] DELETE /identity/v3/users/e887993c0a80489cb80284a206c80fde => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:18.061640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:18.062901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:18.064600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:18.173718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:18.182082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:18.264224 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2946/5863] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:18.265897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:18.266044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:18.266316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:18.323029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:18.324288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:18.564711 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:18.628384 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2918/5864] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:18.639263 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2947/5865] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:18.640493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:18.681349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:18.682837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:18.702368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70468f-f655-44af-80f3-cf70dd49302d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:18.746874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:18.747568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:18.747856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:18.748137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:18.754328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:18.762849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:18.764774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:18.801875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2919/5866] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:18.804740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:18.827341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58484616-b711-4fde-bb1a-679e2582d668 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:18.843380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:18.850327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:18.854045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:18.854340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:18.856526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:18.866059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d522-53a1-48e5-b548-33e3d96e3897 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:18.869880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:18.878655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:18.879598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:18.879743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:18.880074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:18.910769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:18.912299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:18.930041 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2948/5867] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:09:19.018114 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2920/5868] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:19.022905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:19.041145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91217b-f39b-4c41-a299-e516ba576b65 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:19.323562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:19.324929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:19.325376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:19.325814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:19.327755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:19.339315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:19.401663 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2949/5869] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:19 2022] POST /identity/v3/users => generated 293 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:19.406794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:19.479708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dd6f-15d3-4a4b-93d2-983c5d275672 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:19.531289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:19.532972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:19.535324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:19.537045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:19.545037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:19.561725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:19.608424 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2921/5870] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:19.613183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:19.637579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d267a-357f-42ec-8bea-22fdf2a1a1cd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:19.657581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc80a78-44f9-4edd-841c-208ab5f61979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:19.668824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc80a78-44f9-4edd-841c-208ab5f61979 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:19.669286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc80a78-44f9-4edd-841c-208ab5f61979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:19.669543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc80a78-44f9-4edd-841c-208ab5f61979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:19.670386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc80a78-44f9-4edd-841c-208ab5f61979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:19.672681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc80a78-44f9-4edd-841c-208ab5f61979 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:19.715216 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2950/5871] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:19.719413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:19.738175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef85a-37ac-449a-8589-3291fe64b388 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:19.763381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:19.764718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:19.765232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:19.765808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] PATH_INFO: `/v3/projects/2cb672193e024afdba5b2390f73e9043/users/f8826c4753ef4f43ba4f33b30acec4b4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:19.814285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb672193e024afdba5b2390f73e9043, user_id=f8826c4753ef4f43ba4f33b30acec4b4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:19.823699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:19.858914 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2922/5872] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:19 2022] PUT /identity/v3/projects/2cb672193e024afdba5b2390f73e9043/users/f8826c4753ef4f43ba4f33b30acec4b4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:19.872255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:19.872698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:19.873094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:19.944305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] MFA Rules not processed for user `f8826c4753ef4f43ba4f33b30acec4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:19.944954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:20.226237 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2951/5873] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:21.104334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:21.106146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:21.110128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:21.111181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:21.135027 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:21.304057 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:21.421472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059e194-92f5-42c8-8bd3-a2baf058f790 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:21.446558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d4e4d-7d94-4c63-aba3-2e8dbfc9a8e9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:21.453113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:21.454098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:21.454297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:21.454599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] PATH_INFO: `/v3/projects/5f1066e4886b4815b73a50df33f738c8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:21.466351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1066e4886b4815b73a50df33f738c8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:21.468355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:21.470687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:21.471591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:21.471867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:21.472146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] PATH_INFO: `/v3/projects/e605a0184eab4e118ad5e4b5a4f50634` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:21.477524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e605a0184eab4e118ad5e4b5a4f50634)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:21.479402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:21.682698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1066e4886b4815b73a50df33f738c8', 'request_id': 'req-b7dd7911-0d63-4802-8209-08d24bdb27b8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.700527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1066e4886b4815b73a50df33f738c8', 'request_id': 'req-b7dd7911-0d63-4802-8209-08d24bdb27b8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.719497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e605a0184eab4e118ad5e4b5a4f50634', 'request_id': 'req-3dd354cb-52a8-4d7e-a129-e6615ba496a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.725021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1066e4886b4815b73a50df33f738c8', 'request_id': 'req-b7dd7911-0d63-4802-8209-08d24bdb27b8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.743365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e605a0184eab4e118ad5e4b5a4f50634', 'request_id': 'req-3dd354cb-52a8-4d7e-a129-e6615ba496a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.769040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e605a0184eab4e118ad5e4b5a4f50634', 'request_id': 'req-3dd354cb-52a8-4d7e-a129-e6615ba496a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.769715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] The token cache is being invalidate because project 5f1066e4886b4815b73a50df33f738c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:21.770118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.773705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7dd7911-0d63-4802-8209-08d24bdb27b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.779414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2923/5874] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:21 2022] DELETE /identity/v3/projects/5f1066e4886b4815b73a50df33f738c8 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:21.785525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb349c8-c392-4a8a-9b36-5aa735e7df61 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:21.785857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb349c8-c392-4a8a-9b36-5aa735e7df61 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:21.786809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb349c8-c392-4a8a-9b36-5aa735e7df61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:21.837372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] The token cache is being invalidate because project e605a0184eab4e118ad5e4b5a4f50634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:21.843108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.844156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3dd354cb-52a8-4d7e-a129-e6615ba496a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:21.853667 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2952/5875] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:21 2022] DELETE /identity/v3/projects/e605a0184eab4e118ad5e4b5a4f50634 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:21.855237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7eb349c8-c392-4a8a-9b36-5aa735e7df61 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:21.863805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7eb349c8-c392-4a8a-9b36-5aa735e7df61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:21.865446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615018-e462-4316-bd33-9810058d6791 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:21.868099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615018-e462-4316-bd33-9810058d6791 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:21.869415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615018-e462-4316-bd33-9810058d6791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:21.969632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a7615018-e462-4316-bd33-9810058d6791 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:21.970927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a7615018-e462-4316-bd33-9810058d6791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:22.129497 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2924/5876] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:22.138486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:22.138806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:22.139079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:22.283457 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2953/5877] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:22.327541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:22.327541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:22.327889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:22.354994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:22.421787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:22.450536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:22.453882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:22.473108 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2925/5878] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:22.475316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:22.481653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2954/5879] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:22.483393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:22.516207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0dcb0-fe53-431b-9c10-11730adbad1f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:22.523363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc97781-5915-412d-b33e-e2b9dec01ea3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:22.532806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:22.533840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:22.534541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:22.534975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:22.535958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:22.537045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:22.542958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:22.543851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:22.544370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:22.544761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:22.545613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:22.547324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:22.547458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:22.549210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:22.588963 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2926/5880] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:09:22.593010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:22.603276 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2955/5881] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:22.613701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:22.616563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05fefe-4e0d-4b62-bab1-03515b185a4d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:22.628778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:22.629678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:22.630678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:22.631128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:22.631980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:22.636709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:22.648918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefde0b-64ca-4441-b99c-33b7de4302a0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:22.678401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:22.679334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:22.679884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:22.680392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:22.681218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:22.684217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:22.692258 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2927/5882] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:22 2022] POST /identity/v3/projects => generated 361 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:22.698368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:22.730580 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:22.763167 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:22.783615 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2956/5883] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:22 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:22.787567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:22.862653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bf15-7763-4884-a2c5-ab87b51a13c2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.016652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5c456-ec8c-4735-b6ed-4d3e74c866ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.039232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.040100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.040501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.040893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.041766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.066443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.067345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.068419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.068872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.069723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.070151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.074279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.128866 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2957/5884] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:22 2022] POST /identity/v3/users => generated 281 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:23.137632 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2928/5885] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:22 2022] POST /identity/v3/users => generated 281 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:23.139136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.151657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.178144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a425f-a561-4a5f-a16a-ab0c0dd8526d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.197828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bf476-a548-4b14-a4d5-3cd8e9006f19 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.202855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.203750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.204256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.204927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.205856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.214029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.214292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.215029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.215328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.215703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.222152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.229835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.254171 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2958/5886] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:23.257892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.278052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2929/5887] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:23.280159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.295667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2f95-8eb9-4bb8-8d0d-4d1b8e9185c2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.323310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.324171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.324566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.324953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.325869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.325984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e145f-0bf2-4b98-af8f-3ad064e078a0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.327984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.340500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.341488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.342992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.343287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.344052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.345711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.362782 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2959/5888] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:23.375208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.407187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5134df2-b11c-4ae4-89ed-309d08fd2169 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.410736 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2930/5889] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:23.413009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.431210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95e66-58b5-4445-8266-c77acdf7d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.432291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95e66-58b5-4445-8266-c77acdf7d58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.434054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95e66-58b5-4445-8266-c77acdf7d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.434444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95e66-58b5-4445-8266-c77acdf7d58a admin admin] PATH_INFO: `/v3/projects/8555565c53ff4d3280ebfedf7f5ec2b5/users/1bd4195100c640a0b44893ac9880b956/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.434796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdad9b-ac2d-4c7d-a439-7d30f7e91183 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:23.445013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fb29-4c5b-463d-8e44-6cd4341e6db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:23.445935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fb29-4c5b-463d-8e44-6cd4341e6db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.446224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fb29-4c5b-463d-8e44-6cd4341e6db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.446521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fb29-4c5b-463d-8e44-6cd4341e6db2 admin admin] PATH_INFO: `/v3/projects/437e93c5840e496e806a4b70c428e94a/users/87da4de7bbfa4381af636c4b4ab8a9b0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.490632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3fb29-4c5b-463d-8e44-6cd4341e6db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=437e93c5840e496e806a4b70c428e94a, user_id=87da4de7bbfa4381af636c4b4ab8a9b0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.495480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3fb29-4c5b-463d-8e44-6cd4341e6db2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.501970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95e66-58b5-4445-8266-c77acdf7d58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8555565c53ff4d3280ebfedf7f5ec2b5, user_id=1bd4195100c640a0b44893ac9880b956, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:23.505785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95e66-58b5-4445-8266-c77acdf7d58a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:23.543003 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2931/5890] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:23 2022] PUT /identity/v3/projects/437e93c5840e496e806a4b70c428e94a/users/87da4de7bbfa4381af636c4b4ab8a9b0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:23.546372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.546562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2960/5891] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:23 2022] PUT /identity/v3/projects/8555565c53ff4d3280ebfedf7f5ec2b5/users/1bd4195100c640a0b44893ac9880b956/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:23.546730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.546990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.548667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:23.549074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:23.549474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:23.593936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] MFA Rules not processed for user `87da4de7bbfa4381af636c4b4ab8a9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:23.595853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:23.620064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] MFA Rules not processed for user `1bd4195100c640a0b44893ac9880b956`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:23.621489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:23.838978 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2961/5892] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:23.843795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2932/5893] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:23.857895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:23.860130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:23.921785 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:24.001282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105a1a-e779-4ccc-81ec-0906c69efb86 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:24.011990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:24.012720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:24.013175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:24.013577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:24.035033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:24.070587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:24.095866 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2962/5894] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:24.501285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:24.503321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:24.527973 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:24.815437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6138-a12f-47a4-85e2-fd506211fbd8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:24.831095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:24.832476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:24.851249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:24.852104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:24.852526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:24.853007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:24.862727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:24.929982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:24.933805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:24.990912 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2933/5895] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:25.195734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15428-63ea-42f6-812b-fd19d0778ffd service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:25.245319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0f846c57a4dbd97db301d4898d4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:25.246029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:25.246323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:25.251406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:25.252324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:25.252655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:25.254327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:25.329272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:25.333455 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2963/5896] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:25.351779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3db6-aef7-4823-8f83-c639cb836dc4 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:25.372602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0f846c57a4dbd97db301d4898d4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:25.380653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:25.385331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:25.385775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:25.389042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:25.401006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:25.491482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2934/5897] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:25 2022] POST /identity/v3/projects => generated 348 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:25.492736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:25.503910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e4075-21f4-45d1-a8d2-28dd08501ef6 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:25.785503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0f846c57a4dbd97db301d4898d4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:25.786448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:25.786939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:25.787378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:25.788294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:25.788778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:25.790568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:25.828633 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2964/5898] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:09:27.537617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:27.548758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6022b3-6b33-4442-91d2-eb6e7c28caf5 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:27.578617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0f846c57a4dbd97db301d4898d4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:27.579656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:27.579959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:27.580349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] PATH_INFO: `/v3/projects/55f4453a9cb041c0863be19d59da2036` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:27.584356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55f4453a9cb041c0863be19d59da2036)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:27.593711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:27.773839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f4453a9cb041c0863be19d59da2036', 'request_id': 'req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:27.793436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f4453a9cb041c0863be19d59da2036', 'request_id': 'req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:27.810079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f4453a9cb041c0863be19d59da2036', 'request_id': 'req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:27.831299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] The token cache is being invalidate because project 55f4453a9cb041c0863be19d59da2036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:27.831600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:27.833197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:27.837261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2935/5899] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:27 2022] DELETE /identity/v3/projects/55f4453a9cb041c0863be19d59da2036 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:27.859456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:27.872337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:28.077444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b633a1-df2f-45f9-8fa1-c505bee5c378 tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:28.097220 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:28.264044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:28.268000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:28.268415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:28.272568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:28.283017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:28.544623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:28.546468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:28.580835 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2965/5900] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:33.778327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:33.780088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:33.868382 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:33.887389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eadeff-6eb2-4fa0-8899-9eecdc1e294a tempest-RoutersIpV6AdminTest-188421904 tempest-RoutersIpV6AdminTest-188421904-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:33.891819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:33.892583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:33.892949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:33.893322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:33.896060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:34.064285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:34.065780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141916a-4234-4641-9093-aa75f5f39d76 service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:34.094185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2936/5901] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:34.185769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:34.189404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:34.347658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db81cc7-d809-4383-bcf2-0979f7766bcb service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:34.359801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:34.363083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:34.363083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:34.363083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] PATH_INFO: `/v3/users/1bd4195100c640a0b44893ac9880b956` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:34.364669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd4195100c640a0b44893ac9880b956)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:34.368455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:34.373644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:34.374096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:34.374451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:34.408876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:34.410373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:34.518973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd4195100c640a0b44893ac9880b956'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:34.523024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd4195100c640a0b44893ac9880b956'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:34.537973 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2937/5902] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 11 15:09:34.554476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:34.555744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:34.562166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd4195100c640a0b44893ac9880b956'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:34.563094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd4195100c640a0b44893ac9880b956'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:34.568466 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:34.586736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6244dea-5fbb-43d5-b7f0-59e43f5e1729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd4195100c640a0b44893ac9880b956'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:34.618627 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2966/5903] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:34 2022] DELETE /identity/v3/users/1bd4195100c640a0b44893ac9880b956 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:34.623907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:34.624202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:34.624485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:34.679687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:34.680922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:34.753038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19655-9abf-4180-ac72-0754bcc5fbe2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:34.901803 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2967/5904] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:34.913550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:34.915165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:34.920843 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:34.980352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d179f8-c68a-444c-a739-ba64be5af1f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:34.981424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d179f8-c68a-444c-a739-ba64be5af1f3 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:34.981715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d179f8-c68a-444c-a739-ba64be5af1f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:34.982277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d179f8-c68a-444c-a739-ba64be5af1f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:35.067747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ceba-549e-41a8-9f28-76b7ca8a76cc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:35.073236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:35.074093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:35.074331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:35.074676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:35.099757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:35.101229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:35.125717 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2968/5905] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:35.156770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d179f8-c68a-444c-a739-ba64be5af1f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:35.158783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d179f8-c68a-444c-a739-ba64be5af1f3 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:35.189210 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2938/5906] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:09:35.805749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:35.807853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:35.844829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003176a8-2497-493d-a7cb-c879d78b576b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:35.887682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:35.892973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:35.893530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:35.894426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] PATH_INFO: `/v3/projects/8555565c53ff4d3280ebfedf7f5ec2b5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:35.900319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8555565c53ff4d3280ebfedf7f5ec2b5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:35.904574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:36.076847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8555565c53ff4d3280ebfedf7f5ec2b5', 'request_id': 'req-04a348e2-2f17-43a2-bd4f-099a38896e58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:36.094618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8555565c53ff4d3280ebfedf7f5ec2b5', 'request_id': 'req-04a348e2-2f17-43a2-bd4f-099a38896e58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:36.107554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8555565c53ff4d3280ebfedf7f5ec2b5', 'request_id': 'req-04a348e2-2f17-43a2-bd4f-099a38896e58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:36.134268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] The token cache is being invalidate because project 8555565c53ff4d3280ebfedf7f5ec2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:36.134991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:36.137728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04a348e2-2f17-43a2-bd4f-099a38896e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:36.142552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2969/5907] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:35 2022] DELETE /identity/v3/projects/8555565c53ff4d3280ebfedf7f5ec2b5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:36.148209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0ee3-868b-416f-8df0-0dc0163e9cdf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.148737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0ee3-868b-416f-8df0-0dc0163e9cdf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.149211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0ee3-868b-416f-8df0-0dc0163e9cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.208781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-aa7b0ee3-868b-416f-8df0-0dc0163e9cdf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:36.222374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa7b0ee3-868b-416f-8df0-0dc0163e9cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:36.264432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.264845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.265232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.286919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:36.288313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:36.296962 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:36.405220 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2970/5908] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:36.431261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:36.433264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:36.450317 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2939/5909] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:36.458167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.458460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.458767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.491337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:36.492579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:36.516786 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2940/5910] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:36.517719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:36.532327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2d12-5e17-4dc5-b14a-b3b85ebae9f9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:36.546322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:36.547073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.547402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.547679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.548424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:36.548728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:36.550669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:36.580227 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2941/5911] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:36.584388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:36.595749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c4ca-053e-4dde-a76e-aaae5eb7b4b9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:36.607955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:36.608640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.608929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.609202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.609908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:36.611875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:36.619448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180938-9512-45b8-b43b-4a17ccf31e6f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:36.624667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e91d0f-11b6-487c-9fd2-9924969a0f30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:36.625322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e91d0f-11b6-487c-9fd2-9924969a0f30 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.625611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e91d0f-11b6-487c-9fd2-9924969a0f30 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.625893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e91d0f-11b6-487c-9fd2-9924969a0f30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.651036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e91d0f-11b6-487c-9fd2-9924969a0f30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:36.652659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e91d0f-11b6-487c-9fd2-9924969a0f30 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:36.668728 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2942/5912] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:36.669580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:36.671131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2971/5913] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:36.760216 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:36.808930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e81077-bcc3-4977-a0be-29fff6002933 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:36.843254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:36.844071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.844365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.844647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.845358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:36.847346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:36.874878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:36.875869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:36.876368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:36.913342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:36.914990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:36.942656 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2943/5914] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:36 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:36.961075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:36.999315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29513-3d01-4641-ae97-ed34ac1239f2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:37.027411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:37.028524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:37.029181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:37.030825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:37.032445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:37.036410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:37.063451 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2972/5915] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:37.077172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2944/5916] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:37.080919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:37.099076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:37.112033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c6dd2-55ae-4c00-ae68-152daa8f81a8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:37.130082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:37.130922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:37.131216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:37.131499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:37.132247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:37.133870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:37.167280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2973/5917] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:37.171016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:37.198940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8983-eea9-495a-9576-5ae2bd011657 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:37.210222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30eee6-b011-4395-b9c8-d33fdce50a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:37.211595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30eee6-b011-4395-b9c8-d33fdce50a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:37.211838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30eee6-b011-4395-b9c8-d33fdce50a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:37.212125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30eee6-b011-4395-b9c8-d33fdce50a40 admin admin] PATH_INFO: `/v3/projects/6eae931461f14b97acbe24e1d543b681/users/5e95632485ce427c9a82fd668c11c23a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:37.250526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30eee6-b011-4395-b9c8-d33fdce50a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eae931461f14b97acbe24e1d543b681, user_id=5e95632485ce427c9a82fd668c11c23a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:37.256153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30eee6-b011-4395-b9c8-d33fdce50a40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:37.280170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17009-e2b9-42f3-8426-b6f2bc9917d2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:37.291152 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2974/5918] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:37 2022] PUT /identity/v3/projects/6eae931461f14b97acbe24e1d543b681/users/5e95632485ce427c9a82fd668c11c23a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:37.303514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:37.303870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:37.304151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:37.369814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] MFA Rules not processed for user `5e95632485ce427c9a82fd668c11c23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:37.370520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:37.375466 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:37.485248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:37.485248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:37.485248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:37.485248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:37.723882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2975/5919] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:37.725352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:37.789931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:37.791974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:37.812573 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2945/5920] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:09:37.869096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6fab9-8992-4b0b-9f02-158318b8cc5e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:37.876403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:37.877196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:37.877669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:37.878037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:37.879201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:37.881432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:37.994954 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2976/5921] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:37 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:37.998012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:38.010287 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:38.022186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764549dc-99b7-4127-b556-7c92ca9acbd2 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:38.165364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:38.183687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:38.184091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:38.184383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:38.185144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:38.189680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:38.230891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:38.238616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2946/5922] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:37 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:38.245713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde20de-b7fa-4f99-bf32-7d52c535a34a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:38.257520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:38.258220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:38.258539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:38.260147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:38.265079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:38.267158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:38.301726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:38.318876 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2977/5923] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:38.334310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79131b25-008b-4210-b433-3c8748b57075 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:38.355313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:38.356393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:38.356620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:38.357146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] PATH_INFO: `/v3/projects/194077df26ea46b0ab1a1c2dbcd53c0b/users/55a0f709ee9d48a68b165e8fd1e06e5f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:38.404077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194077df26ea46b0ab1a1c2dbcd53c0b, user_id=55a0f709ee9d48a68b165e8fd1e06e5f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:38.407005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:38.433746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:38.434207 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2947/5924] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:38 2022] PUT /identity/v3/projects/194077df26ea46b0ab1a1c2dbcd53c0b/users/55a0f709ee9d48a68b165e8fd1e06e5f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:38.446269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3e75e-4020-4308-a431-739f73e1611c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:38.599503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2ea7-9be3-407e-8e08-ba717a7010ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:38.600250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2ea7-9be3-407e-8e08-ba717a7010ef admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:38.600547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2ea7-9be3-407e-8e08-ba717a7010ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:38.603682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2ea7-9be3-407e-8e08-ba717a7010ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:38.604449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2ea7-9be3-407e-8e08-ba717a7010ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:38.614320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2ea7-9be3-407e-8e08-ba717a7010ef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:38.663226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:38.679772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2978/5925] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:38.681740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907c13-5195-4e11-b9ec-1e548c4e3098 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:38.699032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:38.705135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:38.705466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:38.705724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] PATH_INFO: `/v3/projects/194077df26ea46b0ab1a1c2dbcd53c0b/users/55a0f709ee9d48a68b165e8fd1e06e5f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:38.710629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=194077df26ea46b0ab1a1c2dbcd53c0b, user_id=55a0f709ee9d48a68b165e8fd1e06e5f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:38.724546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:38.771616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2948/5926] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:38 2022] PUT /identity/v3/projects/194077df26ea46b0ab1a1c2dbcd53c0b/users/55a0f709ee9d48a68b165e8fd1e06e5f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:38.782466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32779d4-54c6-41ef-8fc0-ad8473e72521 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:38.783055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32779d4-54c6-41ef-8fc0-ad8473e72521 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:38.783603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32779d4-54c6-41ef-8fc0-ad8473e72521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:38.851113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d32779d4-54c6-41ef-8fc0-ad8473e72521 None None] MFA Rules not processed for user `55a0f709ee9d48a68b165e8fd1e06e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:38.854242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d32779d4-54c6-41ef-8fc0-ad8473e72521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:38.865370 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:39.073717 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2979/5927] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:39.088861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:39.091198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:39.382782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f379-74b3-42b5-9f82-a48393bbd27d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:39.398863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95997020-8ca5-4194-9267-1f37e0426f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:39.400490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997020-8ca5-4194-9267-1f37e0426f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:39.402747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997020-8ca5-4194-9267-1f37e0426f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:39.403205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997020-8ca5-4194-9267-1f37e0426f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:39.433511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95997020-8ca5-4194-9267-1f37e0426f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:39.438212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95997020-8ca5-4194-9267-1f37e0426f6e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:39.468242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2949/5928] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:39.602544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026245d-b734-463e-a607-5b27135823ab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:39.602846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026245d-b734-463e-a607-5b27135823ab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:39.603128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026245d-b734-463e-a607-5b27135823ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:39.618536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:39.618838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:39.619118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:39.636704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b026245d-b734-463e-a607-5b27135823ab None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:39.639528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b026245d-b734-463e-a607-5b27135823ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:39.640229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:39.642236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:39.750182 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2950/5929] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:39.767876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:39.774840 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2980/5930] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:39.777268 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:39.790997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026245d-b734-463e-a607-5b27135823ab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:39.939991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026245d-b734-463e-a607-5b27135823ab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:39.967753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134529b-b5ba-4245-8685-81e630e12de8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:39.970792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab0d48-c209-4ff8-b3a8-0130e61cfb73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:39.971631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0d48-c209-4ff8-b3a8-0130e61cfb73 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:39.971887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0d48-c209-4ff8-b3a8-0130e61cfb73 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:39.972174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0d48-c209-4ff8-b3a8-0130e61cfb73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:39.981328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:39.981999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:39.983493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:39.983711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:39.998076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab0d48-c209-4ff8-b3a8-0130e61cfb73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:40.002061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab0d48-c209-4ff8-b3a8-0130e61cfb73 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:40.007473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:40.013457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:40.027013 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2981/5931] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:40.042066 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2951/5932] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:40.558725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654cbd-bc5b-4b8d-a0dd-1899994fac29 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:40.559283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654cbd-bc5b-4b8d-a0dd-1899994fac29 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:40.559532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654cbd-bc5b-4b8d-a0dd-1899994fac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:40.636809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ac654cbd-bc5b-4b8d-a0dd-1899994fac29 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:40.647508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac654cbd-bc5b-4b8d-a0dd-1899994fac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:40.678919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2982/5933] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:40.693147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:40.713113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:40.713583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:40.713984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:40.722467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295c3a5-5edb-422c-a524-527744abe301 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:40.749925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e183-bdfb-4496-a18f-0d94d8e137e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:40.752140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e183-bdfb-4496-a18f-0d94d8e137e2 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:40.753901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e183-bdfb-4496-a18f-0d94d8e137e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:40.754526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e183-bdfb-4496-a18f-0d94d8e137e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:40.760187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:40.761583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:40.791849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e183-bdfb-4496-a18f-0d94d8e137e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:40.793155 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2983/5934] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:40.795428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e183-bdfb-4496-a18f-0d94d8e137e2 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:40.802622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:40.841294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a9ad5-2411-411e-bfc7-d52b9d55fa0b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:40.841501 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2952/5935] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:40.857873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:40.858605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:40.858891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:40.859173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:40.890717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:40.897648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:40.931373 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2984/5936] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:41.381574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a14e4-cd30-484a-941d-332b45815c4a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:41.381870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a14e4-cd30-484a-941d-332b45815c4a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:41.382444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a14e4-cd30-484a-941d-332b45815c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:41.441274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-040a14e4-cd30-484a-941d-332b45815c4a None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:41.441274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-040a14e4-cd30-484a-941d-332b45815c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:41.468945 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2953/5937] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:41.477955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:41.495274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a4782-a91a-455b-a999-7651b1d5e2a0 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:41.511382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:41.512964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:41.514882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:41.516385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:41.539011 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:41.543894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:41.548918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:41.578200 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2985/5938] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:41.912627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ecef6-96f3-452b-8dc4-87ff8d84b407 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:41.913159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ecef6-96f3-452b-8dc4-87ff8d84b407 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:41.913277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ecef6-96f3-452b-8dc4-87ff8d84b407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:41.963800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9e7ecef6-96f3-452b-8dc4-87ff8d84b407 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:41.965748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e7ecef6-96f3-452b-8dc4-87ff8d84b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:42.002848 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2954/5939] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:42.018365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:42.042332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021620cd-28a9-4d3b-a66d-197f0685dbad service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:42.068839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:42.069523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:42.069814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:42.070094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:42.104295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:42.109208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:42.139073 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2986/5940] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:09:42.449399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:42.449990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:42.450482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:42.473844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:42.476268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:42.486295 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2955/5941] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:09:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:42.505241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:42.522520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1704-7ee5-4f4c-971a-0d0e5d796497 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:42.531581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aaa51-9642-4ac7-8eb0-4fcbb7b40e77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:42.532724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaa51-9642-4ac7-8eb0-4fcbb7b40e77 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:42.533253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaa51-9642-4ac7-8eb0-4fcbb7b40e77 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:42.533934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaa51-9642-4ac7-8eb0-4fcbb7b40e77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:42.547450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aaa51-9642-4ac7-8eb0-4fcbb7b40e77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:42.550601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aaa51-9642-4ac7-8eb0-4fcbb7b40e77 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:42.563531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2987/5942] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:09:42.815148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:42.817884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:42.909920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de209aae-39e6-442c-a005-4c9d6de2b6de None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:42.911032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de209aae-39e6-442c-a005-4c9d6de2b6de None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:42.911293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de209aae-39e6-442c-a005-4c9d6de2b6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:42.959181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-de209aae-39e6-442c-a005-4c9d6de2b6de None None] MFA Rules not processed for user `1dfed9df4c8a4de98a315124dc7cfe94`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:42.960425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de209aae-39e6-442c-a005-4c9d6de2b6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:43.068458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79a6ad-a4c7-419a-8ef6-fada1dbe1f59 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:43.078875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:43.080089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:43.080540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:43.080976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] PATH_INFO: `/v3/users/f8826c4753ef4f43ba4f33b30acec4b4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:43.083063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8826c4753ef4f43ba4f33b30acec4b4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:43.085544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:43.111543 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2988/5943] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:43.230260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8826c4753ef4f43ba4f33b30acec4b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:43.275138 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:43.281098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8826c4753ef4f43ba4f33b30acec4b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:43.296365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8826c4753ef4f43ba4f33b30acec4b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:43.312568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8826c4753ef4f43ba4f33b30acec4b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:43.331074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8826c4753ef4f43ba4f33b30acec4b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:43.346113 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2956/5944] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:42 2022] DELETE /identity/v3/users/f8826c4753ef4f43ba4f33b30acec4b4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:43.350590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:43.350849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:43.351136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:43.374691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:43.376068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:43.531570 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2989/5945] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:43.648254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:43.650783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:43.832676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff5e13-6a90-4e57-bd4e-0072acdc283c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:43.838125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:43.839162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:43.839611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:43.840082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:43.854312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:43.856167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:43.869571 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2957/5946] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:44.165014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:44.183015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a5e19-d716-45c8-bc4b-1bbe97e469b3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:44.210137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:44.213797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:44.214125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:44.214419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:44.220245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:44.263735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:44.266966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58de33b-972b-427f-9801-6c8f1b6d0fcd service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:44.305299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2990/5947] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:45.452693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:45.454300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:45.482622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d2a14-5172-4b7b-8834-80a2858fb3de service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:45.492808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:45.494927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:45.498730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:45.499449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] PATH_INFO: `/v3/projects/2cb672193e024afdba5b2390f73e9043` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:45.506068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb672193e024afdba5b2390f73e9043)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:45.508516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:45.626769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb672193e024afdba5b2390f73e9043', 'request_id': 'req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:45.641574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb672193e024afdba5b2390f73e9043', 'request_id': 'req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:45.668877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb672193e024afdba5b2390f73e9043', 'request_id': 'req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:45.699986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] The token cache is being invalidate because project 2cb672193e024afdba5b2390f73e9043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:45.702015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:45.704916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5ad7d157-03a9-48ed-a617-fddd4fbfc9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:45.712822 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2958/5948] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:45 2022] DELETE /identity/v3/projects/2cb672193e024afdba5b2390f73e9043 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:45.714715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:45.715541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:45.717228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:45.752436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:45.754888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:46.009778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2991/5949] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:46.014581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.015098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.015484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.055176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:46.079165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:46.106185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2959/5950] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:46.110576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.116742 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:46.125583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692c47-e77c-4df3-9d51-0fd09e6f6313 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.136220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.137275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.139162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.140056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.142331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:46.142885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.147370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.178108 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2992/5951] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:46.182690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.198747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0cf7b-2ae1-4965-b672-feb8021c87db None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.226228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.227327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.231072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.232393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.233576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.243908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.314634 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2960/5952] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:46 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:46.315509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.335175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40ef02-aa48-4535-b751-1bf0831e83b7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.509816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.511177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.511726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.513110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.514546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.521092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.571025 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2993/5953] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:46 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:46.575878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.601140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534fc28-5747-4545-b632-033c39a1db29 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.612508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.613345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.613703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.614077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.614922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.620680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.652531 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2961/5954] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:46.653383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.701130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d0a89-2abc-4dec-b76c-ce44b21710ca admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.732898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.733595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.733880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.734278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.737194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.737580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:46.741580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.749080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.763996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246691a-96e7-4e59-93d3-578b86d8c8ba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.785106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2994/5955] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:46.800539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.801804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.802090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.802368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] PATH_INFO: `/v3/users/5e95632485ce427c9a82fd668c11c23a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.805145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e95632485ce427c9a82fd668c11c23a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.807143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.811883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.849333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6e33e-232c-4470-beeb-efdf46996eef admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:46.869451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:46.871821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:46.872740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:46.873283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] PATH_INFO: `/v3/projects/64f3ec06b5ff4378af0dac5a986013f1/users/cf661e5f93d747d99a3b8fdbb60be4fd/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:46.918226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f3ec06b5ff4378af0dac5a986013f1, user_id=cf661e5f93d747d99a3b8fdbb60be4fd, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:46.920123 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:46.928458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:46.982790 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2995/5956] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:46 2022] PUT /identity/v3/projects/64f3ec06b5ff4378af0dac5a986013f1/users/cf661e5f93d747d99a3b8fdbb60be4fd/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:46.985431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:46.987831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e95632485ce427c9a82fd668c11c23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:46.994730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.035491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e95632485ce427c9a82fd668c11c23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:47.080234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e95632485ce427c9a82fd668c11c23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:47.101242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e95632485ce427c9a82fd668c11c23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:47.102359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a166927b-7416-46aa-8980-11dd44119f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e95632485ce427c9a82fd668c11c23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:47.115016 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2962/5957] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:46 2022] DELETE /identity/v3/users/5e95632485ce427c9a82fd668c11c23a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:47.116556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b0154-34b9-4982-ae1f-5daed7adb7b7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:47.117550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b0154-34b9-4982-ae1f-5daed7adb7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:47.135039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b0154-34b9-4982-ae1f-5daed7adb7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:47.219826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bafbb6-f0a5-4b9c-b304-362127bd9e04 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:47.228349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e36b0154-34b9-4982-ae1f-5daed7adb7b7 None None] MFA Rules not processed for user `cf661e5f93d747d99a3b8fdbb60be4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:47.232007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e36b0154-34b9-4982-ae1f-5daed7adb7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.491239 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:47.534578 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2963/5958] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:47.536537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:47.536828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:47.537106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:47.544621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:47.547650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:47.548350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:47.557038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:47.559546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.605668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:47.606929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.607553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:47.609365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:47.636264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2996/5959] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:47.637563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:47.642802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.683699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18a650-7a04-4f08-9bd5-c29b97936430 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:47.708252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:47.709403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:47.709403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:47.709806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:47.713761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.742535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:47.744312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:47.780251 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2964/5960] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:47.781804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:47.783961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.790883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2997/5961] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:47.791891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:47.794721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:47.865024 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:47.909298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d599-b75d-4d22-8c20-1421c07c579b service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:47.923640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:47.928184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:47.929824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:47.930034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:47.946033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84300847-f126-4bf3-b0b2-af1a5931b65e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:47.964671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:47.970124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:47.970922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1268604-5242-40dd-85ab-4e3c8880468a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:47.971840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1268604-5242-40dd-85ab-4e3c8880468a service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:47.974680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1268604-5242-40dd-85ab-4e3c8880468a service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:47.975246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1268604-5242-40dd-85ab-4e3c8880468a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:48.001341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1268604-5242-40dd-85ab-4e3c8880468a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:48.023138 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2998/5962] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:48.030369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1268604-5242-40dd-85ab-4e3c8880468a service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:48.074729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2965/5963] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:49.506112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:49.508367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:49.529345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543e251-d874-4ab5-baae-5a53fcc46208 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:49.541533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:49.542699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:49.543088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:49.543632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] PATH_INFO: `/v3/users/cf661e5f93d747d99a3b8fdbb60be4fd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:49.546211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf661e5f93d747d99a3b8fdbb60be4fd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:49.550665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:49.643044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf661e5f93d747d99a3b8fdbb60be4fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:49.643827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf661e5f93d747d99a3b8fdbb60be4fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:49.660036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf661e5f93d747d99a3b8fdbb60be4fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:49.660807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf661e5f93d747d99a3b8fdbb60be4fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:49.672982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf661e5f93d747d99a3b8fdbb60be4fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:49.698326 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 2999/5964] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:49 2022] DELETE /identity/v3/users/cf661e5f93d747d99a3b8fdbb60be4fd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:49.702713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:49.703244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:49.703353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:49.743282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:49.748995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:49.897179 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2966/5965] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:49.914220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:49.915732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:49.957321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:49.959453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:50.009277 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:50.038329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f7c7-9f88-4a8a-a8fa-b28883eae7ba admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:50.063546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:50.064292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:50.064517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:50.064803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:50.094683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:50.096108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:50.096845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b852-f644-4255-8733-bfe531b3d6b6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:50.121266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:50.122909 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3000/5966] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:09:50.123679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:50.125234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:50.125234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:50.133412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:50.288585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:50.290340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:50.302131 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2967/5967] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:09:50.366679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:50.370458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:50.405870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b38f-6ee2-4f73-88c8-2fbb6ecb833e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:50.432010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:50.433432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:50.433821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:50.434257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] PATH_INFO: `/v3/projects/6eae931461f14b97acbe24e1d543b681` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:50.435887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eae931461f14b97acbe24e1d543b681)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:50.439447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:50.575979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eae931461f14b97acbe24e1d543b681', 'request_id': 'req-e6237567-ba29-4b84-8496-aedf6b9084d7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.588504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eae931461f14b97acbe24e1d543b681', 'request_id': 'req-e6237567-ba29-4b84-8496-aedf6b9084d7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.597716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eae931461f14b97acbe24e1d543b681', 'request_id': 'req-e6237567-ba29-4b84-8496-aedf6b9084d7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.612631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] The token cache is being invalidate because project 6eae931461f14b97acbe24e1d543b681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:50.613006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.614519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.617652 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3001/5968] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:50 2022] DELETE /identity/v3/projects/6eae931461f14b97acbe24e1d543b681 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:50.621281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:50.641795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dfaf7-87f5-4f6b-b101-a103e14057ab service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:50.655573 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:50.722387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:50.723120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:50.723505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:50.723886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] PATH_INFO: `/v3/users/55a0f709ee9d48a68b165e8fd1e06e5f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:50.725673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a0f709ee9d48a68b165e8fd1e06e5f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:50.728822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:50.855624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a0f709ee9d48a68b165e8fd1e06e5f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.892921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a0f709ee9d48a68b165e8fd1e06e5f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.917640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a0f709ee9d48a68b165e8fd1e06e5f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.920737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:50.923382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:50.928246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a0f709ee9d48a68b165e8fd1e06e5f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.928949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e779d4b9-0df0-4bc3-a859-ade6e72c24fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a0f709ee9d48a68b165e8fd1e06e5f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:50.941997 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2968/5969] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:09:50 2022] DELETE /identity/v3/users/55a0f709ee9d48a68b165e8fd1e06e5f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:09:50.965835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237567-ba29-4b84-8496-aedf6b9084d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.093129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.094569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.095220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.095759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] PATH_INFO: `/v3/projects/64f3ec06b5ff4378af0dac5a986013f1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.098033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f3ec06b5ff4378af0dac5a986013f1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:51.103333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:51.215802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f3ec06b5ff4378af0dac5a986013f1', 'request_id': 'req-6375427a-a8f7-46da-be12-b6288aa039ef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:51.240592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f3ec06b5ff4378af0dac5a986013f1', 'request_id': 'req-6375427a-a8f7-46da-be12-b6288aa039ef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:51.250300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f3ec06b5ff4378af0dac5a986013f1', 'request_id': 'req-6375427a-a8f7-46da-be12-b6288aa039ef'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:51.251576 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:51.277558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] The token cache is being invalidate because project 64f3ec06b5ff4378af0dac5a986013f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:51.278667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:51.279521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6375427a-a8f7-46da-be12-b6288aa039ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:51.281535 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3002/5970] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:50 2022] DELETE /identity/v3/projects/64f3ec06b5ff4378af0dac5a986013f1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:51.286062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.286630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.286917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.310952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:51.312177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:51.407747 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2969/5971] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:51.411937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.412586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.413042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.436020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:51.438577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:51.455506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3003/5972] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:51.459576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:51.474455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807404a-ebee-4dc8-88dd-bd5125b1e3d0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.482808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.483760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.484211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.485312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.486246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:51.487249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:51.490594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:51.526957 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2970/5973] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:51.531257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:51.548622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40881285-fcaa-4473-8057-7bcf5fd7ac01 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.556370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.557924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.558711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.559207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.560162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:51.563583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:51.631787 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3004/5974] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:51 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:51.636107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:51.660659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f9d71-fde9-4d84-b816-aaf2feee04e4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.716151 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:51.802395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.803198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.803491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.803774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.804485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:51.806793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:51.844372 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2971/5975] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:51 2022] POST /identity/v3/users => generated 305 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:51.845674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:51.857444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fedaa9-c66b-4d94-bb1f-0a16bc9d1d58 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.862210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.862927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.863828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.864092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.864827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:51.866425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:51.887262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3005/5976] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:51.891797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:51.903574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50804f-aeb6-4b77-831f-796f7572ee20 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.909295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd221f0-929b-42e2-8e7b-f7f335363eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.910538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd221f0-929b-42e2-8e7b-f7f335363eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.911051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd221f0-929b-42e2-8e7b-f7f335363eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.911281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd221f0-929b-42e2-8e7b-f7f335363eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:51.912028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd221f0-929b-42e2-8e7b-f7f335363eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:51.914309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd221f0-929b-42e2-8e7b-f7f335363eaa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:51.938824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:51.948289 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2972/5977] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:51.955415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba5fa8-9de8-4ca8-bcaf-201b03d87ef0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:51.969557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:51.977531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:51.977989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:51.978356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] PATH_INFO: `/v3/projects/d8170a69c32c4b818692e7cf9af4e226/users/82dabe44a9eb4508a21e5d9a9c9f91cc/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:52.000681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8170a69c32c4b818692e7cf9af4e226, user_id=82dabe44a9eb4508a21e5d9a9c9f91cc, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:52.005444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:52.039612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:52.039908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:52.040045 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3006/5978] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:51 2022] PUT /identity/v3/projects/d8170a69c32c4b818692e7cf9af4e226/users/82dabe44a9eb4508a21e5d9a9c9f91cc/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:52.040267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:52.115878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] MFA Rules not processed for user `82dabe44a9eb4508a21e5d9a9c9f91cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:52.116788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:52.278274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2973/5979] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:52.287593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:52.427682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ede67-a698-4dcc-8643-546a26b033fb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:52.444404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:52.445302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:52.445529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:52.445807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:52.446590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:52.453155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:52.487403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:52.490186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:52.515133 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3007/5980] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:52 2022] POST /identity/v3/projects => generated 409 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:52.516050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:52.516269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb88a1a-a6fb-479b-b177-f3deacf77c87 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:52.674013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb0f3f-45f2-41cf-9587-05ee82729034 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:52.679780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:52.680621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:52.681027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:52.681962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:52.682936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:52.685081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:52.695001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:52.696706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:52.697381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:52.697764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] PATH_INFO: `/v3/projects/194077df26ea46b0ab1a1c2dbcd53c0b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:52.700626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194077df26ea46b0ab1a1c2dbcd53c0b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:52.703263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:52.731780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3008/5981] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:52 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:09:52.736160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:52.775070 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:52.788832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624929e2-509a-461e-9d21-a31916247e73 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:52.795967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:52.796985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:52.797271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:52.797548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:52.798288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:52.800012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:52.824643 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:52.836029 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3009/5982] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:52.840098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:52.882000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f06e-ba6b-4d7b-a0a4-57a785401b21 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:52.886822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194077df26ea46b0ab1a1c2dbcd53c0b', 'request_id': 'req-3ef2e731-03ec-4891-b5ba-d00123529690'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:52.893880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194077df26ea46b0ab1a1c2dbcd53c0b', 'request_id': 'req-3ef2e731-03ec-4891-b5ba-d00123529690'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:52.910684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194077df26ea46b0ab1a1c2dbcd53c0b', 'request_id': 'req-3ef2e731-03ec-4891-b5ba-d00123529690'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:52.995493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] The token cache is being invalidate because project 194077df26ea46b0ab1a1c2dbcd53c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:09:52.996613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:53.000606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ef2e731-03ec-4891-b5ba-d00123529690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:09:53.007012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2974/5983] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:09:52 2022] DELETE /identity/v3/projects/194077df26ea46b0ab1a1c2dbcd53c0b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:53.013961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d37dd0-c7fd-4fc2-8c73-9ecb5ad84c1a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.014562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d37dd0-c7fd-4fc2-8c73-9ecb5ad84c1a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.015038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d37dd0-c7fd-4fc2-8c73-9ecb5ad84c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.021837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.023237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.023523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.023798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] PATH_INFO: `/v3/projects/805e31bf606c494ba73b27c836009260/users/61307ffa4a43427ebdb61eaba0da6ab4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.091218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e31bf606c494ba73b27c836009260, user_id=61307ffa4a43427ebdb61eaba0da6ab4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:53.105003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:53.139907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-84d37dd0-c7fd-4fc2-8c73-9ecb5ad84c1a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:53.149663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-84d37dd0-c7fd-4fc2-8c73-9ecb5ad84c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:53.149989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3010/5984] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:52 2022] PUT /identity/v3/projects/805e31bf606c494ba73b27c836009260/users/61307ffa4a43427ebdb61eaba0da6ab4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:09:53.155681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:53.167787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:53.350983 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2975/5985] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:53.360239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.360795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.361243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.379119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda9bce-eda8-4abb-8c3c-92773bd23b90 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:53.392498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.393135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.393427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.393714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.394529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:53.396156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:53.415322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:53.416563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:53.429314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2976/5986] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:53.430723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:53.432272 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3011/5987] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:53.435333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:53.448341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ad548-ef39-4571-b046-0f4b2144ab1e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:53.448996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b2d63-0b88-498a-acae-409463c14da0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:53.455241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.456446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.456768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.457101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.457795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:09:53.458105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:53.459745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:53.462151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d09a-0b12-49af-84ce-56296407b76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.463174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d09a-0b12-49af-84ce-56296407b76b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.464721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d09a-0b12-49af-84ce-56296407b76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.465364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d09a-0b12-49af-84ce-56296407b76b admin admin] PATH_INFO: `/v3/projects/805e31bf606c494ba73b27c836009260/users/61307ffa4a43427ebdb61eaba0da6ab4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.475444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d09a-0b12-49af-84ce-56296407b76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e31bf606c494ba73b27c836009260, user_id=61307ffa4a43427ebdb61eaba0da6ab4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:53.478696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d09a-0b12-49af-84ce-56296407b76b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:53.506777 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3012/5988] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:53 2022] PUT /identity/v3/projects/805e31bf606c494ba73b27c836009260/users/61307ffa4a43427ebdb61eaba0da6ab4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:09:53.521205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.521513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.522427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.533778 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2977/5989] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:09:53.535488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:53.548112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b083e3-4315-4abe-8ce3-aefc614ebe14 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:53.580774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] MFA Rules not processed for user `61307ffa4a43427ebdb61eaba0da6ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:53.582155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:53.688556 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:53.691630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.692477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.692868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.693247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.694079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:53.700308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:53.742754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3013/5990] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:09:53.762548 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2978/5991] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:09:53 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:53.763426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:53.780281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37524a03-2622-4fd4-a032-1126575273b0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:53.845992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:53.849020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:53.897750 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:53.901150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acf487-8b91-4c82-afe4-d9ca68f97d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.901891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf487-8b91-4c82-afe4-d9ca68f97d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.902183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf487-8b91-4c82-afe4-d9ca68f97d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.902638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf487-8b91-4c82-afe4-d9ca68f97d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.903231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acf487-8b91-4c82-afe4-d9ca68f97d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:53.905225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acf487-8b91-4c82-afe4-d9ca68f97d94 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:53.947610 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3014/5992] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:09:53 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:09:53.948971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.949267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.949552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:53.975985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46382-c633-4c9b-a4b2-1ac268f5ab40 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:53.986517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:53.989311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:53.989635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:53.989931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:54.000099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] MFA Rules not processed for user `87be873dd7d6441d84380b227ec4f034`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:54.003001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:54.133636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:54.140469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:54.169036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3015/5993] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:54.169934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:54.170971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2979/5994] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:09:54.206059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b622dcc-5aa0-49a1-a203-468e1d25b329 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:54.224380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:54.225305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:54.225723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:54.225895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:54.227326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:54.229005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:54.259508 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3016/5995] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:54.260789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:54.287215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62aef-4de3-46e2-bf79-1ea579ddf326 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:54.313648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ed54-fc56-41e6-843c-994d06165f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:54.313648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ed54-fc56-41e6-843c-994d06165f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:54.313648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ed54-fc56-41e6-843c-994d06165f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:54.313648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ed54-fc56-41e6-843c-994d06165f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:54.314277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573ed54-fc56-41e6-843c-994d06165f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:54.318173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573ed54-fc56-41e6-843c-994d06165f94 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:54.337858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2980/5996] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:09:54.342111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:54.353340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a432-956c-4838-89c4-fed60b4039e3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:54.368487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:54.369333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:54.369627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:54.369908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] PATH_INFO: `/v3/projects/bf108d4b851945cbb06a407d2b36d3ba/users/de3fe97bb6ff4fe78d837a4502b3a4eb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:54.400301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf108d4b851945cbb06a407d2b36d3ba, user_id=de3fe97bb6ff4fe78d837a4502b3a4eb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:54.419931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:54.440446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3017/5997] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:09:54 2022] PUT /identity/v3/projects/bf108d4b851945cbb06a407d2b36d3ba/users/de3fe97bb6ff4fe78d837a4502b3a4eb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:09:54.553394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:54.553718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:54.554010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:54.610737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] MFA Rules not processed for user `de3fe97bb6ff4fe78d837a4502b3a4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:09:54.611877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:54.918569 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2981/5998] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:09:54.955196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:09:54.956967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:09:55.054248 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:09:55.107210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca4bd-371c-43ef-b482-aa7ea280a41b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:09:55.122218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4385fd-56a8-4b05-8845-8f1415d81263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:09:55.123225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4385fd-56a8-4b05-8845-8f1415d81263 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:09:55.123715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4385fd-56a8-4b05-8845-8f1415d81263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:09:55.126889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4385fd-56a8-4b05-8845-8f1415d81263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:09:55.170759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4385fd-56a8-4b05-8845-8f1415d81263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:09:55.175311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4385fd-56a8-4b05-8845-8f1415d81263 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:09:55.195614 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3018/5999] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:04.905107 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=76 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:05.021859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:05.148695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e46d-eefb-498f-b177-6137da72846e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:05.157541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:05.158369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:05.158685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:05.165162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] PATH_INFO: `/v3/users/82dabe44a9eb4508a21e5d9a9c9f91cc` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:05.170239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=82dabe44a9eb4508a21e5d9a9c9f91cc)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:05.172879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:05.186695 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:05.337045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82dabe44a9eb4508a21e5d9a9c9f91cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:05.439464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82dabe44a9eb4508a21e5d9a9c9f91cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:05.467185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82dabe44a9eb4508a21e5d9a9c9f91cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:05.491172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82dabe44a9eb4508a21e5d9a9c9f91cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:05.491962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82dabe44a9eb4508a21e5d9a9c9f91cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:05.506342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2982/6000] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:05 2022] DELETE /identity/v3/users/82dabe44a9eb4508a21e5d9a9c9f91cc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:05.507995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:05.509572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:05.509932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:05.558794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:05.560225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:05.730116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3019/6001] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:05.767357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:05.770748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:05.950835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e599-ffa5-47bd-a290-62b04c66d56e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:05.964471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:05.965261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:05.965670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:05.966418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:05.986467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:05.988138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:06.010402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2983/6002] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:07.904635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:07.906275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:07.926053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca07b7-47ca-4337-8b2b-e57882ac1838 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:07.943084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:07.944655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:07.944947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:07.945236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] PATH_INFO: `/v3/projects/d8170a69c32c4b818692e7cf9af4e226` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:07.955042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8170a69c32c4b818692e7cf9af4e226)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:07.957629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:08.045636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8170a69c32c4b818692e7cf9af4e226', 'request_id': 'req-f2c47ea9-c41c-4d98-b482-a11dacb97456'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.064735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8170a69c32c4b818692e7cf9af4e226', 'request_id': 'req-f2c47ea9-c41c-4d98-b482-a11dacb97456'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.075229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8170a69c32c4b818692e7cf9af4e226', 'request_id': 'req-f2c47ea9-c41c-4d98-b482-a11dacb97456'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.102398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] The token cache is being invalidate because project d8170a69c32c4b818692e7cf9af4e226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:10:08.103127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.103849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.108345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3020/6003] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:10:07 2022] DELETE /identity/v3/projects/d8170a69c32c4b818692e7cf9af4e226 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:08.114272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:08.127876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b03384-bfb9-4f88-8a9f-a2de1d42d5f7 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:08.157441 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:08.267433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:08.274954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:08.275322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:08.275612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] PATH_INFO: `/v3/users/61307ffa4a43427ebdb61eaba0da6ab4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:08.280339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61307ffa4a43427ebdb61eaba0da6ab4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:08.285458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:08.392206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61307ffa4a43427ebdb61eaba0da6ab4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.405660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61307ffa4a43427ebdb61eaba0da6ab4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.412929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61307ffa4a43427ebdb61eaba0da6ab4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.420626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61307ffa4a43427ebdb61eaba0da6ab4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.421783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0dca3610-b491-4f2f-9449-a7edda4e2b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61307ffa4a43427ebdb61eaba0da6ab4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.434591 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2984/6004] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:08 2022] DELETE /identity/v3/users/61307ffa4a43427ebdb61eaba0da6ab4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:08.639331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:08.641795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:08.662987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47ea9-c41c-4d98-b482-a11dacb97456 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:08.737035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:08.738544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:08.738811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:08.739089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] PATH_INFO: `/v3/projects/805e31bf606c494ba73b27c836009260` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:08.740600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805e31bf606c494ba73b27c836009260)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:08.742209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:08.779141 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:08.828222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805e31bf606c494ba73b27c836009260', 'request_id': 'req-76867635-bcc7-4a48-bf39-03ad5a377e33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.848293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805e31bf606c494ba73b27c836009260', 'request_id': 'req-76867635-bcc7-4a48-bf39-03ad5a377e33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.855710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805e31bf606c494ba73b27c836009260', 'request_id': 'req-76867635-bcc7-4a48-bf39-03ad5a377e33'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.868720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] The token cache is being invalidate because project 805e31bf606c494ba73b27c836009260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:10:08.869094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.869871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76867635-bcc7-4a48-bf39-03ad5a377e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:08.871554 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3021/6005] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:10:08 2022] DELETE /identity/v3/projects/805e31bf606c494ba73b27c836009260 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:08.876625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:08.877023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:08.877461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:08.903661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:08.905695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:09.007140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150014-5e78-4859-97e6-652e73384486 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.007641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150014-5e78-4859-97e6-652e73384486 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.007740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150014-5e78-4859-97e6-652e73384486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.025777 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2985/6006] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:09.042342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a7150014-5e78-4859-97e6-652e73384486 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:09.044381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a7150014-5e78-4859-97e6-652e73384486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:09.059380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3022/6007] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:09.063741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:09.074894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad81325-8bed-47a7-8861-ca195b46f4b5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:09.080384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:09.081133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.081426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.081709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.082484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:10:09.082822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:09.085054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:09.101480 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2986/6008] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:10:09.105437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7150014-5e78-4859-97e6-652e73384486 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:09.118432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7150014-5e78-4859-97e6-652e73384486 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:09.124771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:09.125751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.126204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.126689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.127619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:09.129962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:09.166066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3023/6009] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:10:09 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:09.170668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:09.183637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3ff8-cc4d-41b2-b333-af5d6ff9ff98 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:09.234961 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:09.277029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:09.278083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.279000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.279518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.288163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:09.301146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:09.373442 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2987/6010] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:10:09 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:10:09.379710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:09.394288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf4ea-2848-46e9-8e37-8ebc20a70fa0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:09.408755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:09.410223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.411417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.411658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.412844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:09.415315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:09.470845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3024/6011] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:09.477026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:09.493590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62280fde-f736-4cf1-a1c5-52dc9234cb71 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:09.499762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366d4eb-fbff-45a0-be00-15f8de7faff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:09.500752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366d4eb-fbff-45a0-be00-15f8de7faff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.501009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366d4eb-fbff-45a0-be00-15f8de7faff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.501242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366d4eb-fbff-45a0-be00-15f8de7faff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.502168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366d4eb-fbff-45a0-be00-15f8de7faff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:09.503911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366d4eb-fbff-45a0-be00-15f8de7faff1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:09.533698 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2988/6012] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:09.536654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:09.562094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a89172-3d3d-4f83-9764-8d5766610533 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:09.582345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:09.583442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.583828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.584214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] PATH_INFO: `/v3/projects/9d05070caae74fc28acc1dcfe8986421/users/0f39873307a145bd805e7e14d0f0245c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.610227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d05070caae74fc28acc1dcfe8986421, user_id=0f39873307a145bd805e7e14d0f0245c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:09.613672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:09.637528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3025/6013] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:10:09 2022] PUT /identity/v3/projects/9d05070caae74fc28acc1dcfe8986421/users/0f39873307a145bd805e7e14d0f0245c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:09.648754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:09.649116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:09.649405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:09.720378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] MFA Rules not processed for user `0f39873307a145bd805e7e14d0f0245c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:09.722256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:09.884102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2989/6014] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:09.888327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.031323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ee79-ad53-49b7-8ee1-603f68051c91 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:10.050284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:10.056004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.056686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.057182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.058242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:10.063364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:10.115046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3026/6015] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:10:09 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:10.119446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.132987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efbb31-5ce9-47fc-a832-d5cb95d0a28e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:10.244404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:10.245864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.246313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.246791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.247672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:10.250439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:10.278418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2990/6016] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:10:10 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:10.281916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.298065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd578d-6408-48a4-926a-5031ec90c5b5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:10.304339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:10.305456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.305910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.306357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.307297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:10.309407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:10.323331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3027/6017] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:10.327544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.340825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231bd6f-e52e-4360-a6f2-c177f9c8365f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:10.356969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:10.357919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.358213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.358661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] PATH_INFO: `/v3/projects/c98d0df2e8244528a1c3c81d43f646d0/users/cbbbba0f59744c9980d3df310c930b8e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.391172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98d0df2e8244528a1c3c81d43f646d0, user_id=cbbbba0f59744c9980d3df310c930b8e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:10.394954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:10.452289 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2991/6018] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:10:10 2022] PUT /identity/v3/projects/c98d0df2e8244528a1c3c81d43f646d0/users/cbbbba0f59744c9980d3df310c930b8e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:10.456391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.471625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e93eed-02c3-46c5-baf5-cc8677ca150f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:10.521592 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:10.620175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf67bd6-2c3a-46d2-9ed3-896cdf59baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:10.623054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf67bd6-2c3a-46d2-9ed3-896cdf59baff admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.623054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf67bd6-2c3a-46d2-9ed3-896cdf59baff admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.623054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf67bd6-2c3a-46d2-9ed3-896cdf59baff admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.623054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf67bd6-2c3a-46d2-9ed3-896cdf59baff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:10.624369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf67bd6-2c3a-46d2-9ed3-896cdf59baff admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:10.650267 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3028/6019] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:10.651041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.656739 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:10.673791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582c489-0ed0-444e-b5c1-484b0f412208 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:10.691931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:10.692813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.693103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.693388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] PATH_INFO: `/v3/projects/c98d0df2e8244528a1c3c81d43f646d0/users/cbbbba0f59744c9980d3df310c930b8e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.695613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98d0df2e8244528a1c3c81d43f646d0, user_id=cbbbba0f59744c9980d3df310c930b8e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:10.699665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:10.724283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2992/6020] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:10:10 2022] PUT /identity/v3/projects/c98d0df2e8244528a1c3c81d43f646d0/users/cbbbba0f59744c9980d3df310c930b8e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:10.736048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:10.736253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:10.736848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:10.770689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] MFA Rules not processed for user `cbbbba0f59744c9980d3df310c930b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:10.772053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:10.887706 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3029/6021] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:10.996659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:10.998481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:11.161329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790c455-f158-4620-92b7-86a70df0f438 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:11.178249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d4141-b29c-4fb9-a867-0783e888e81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:11.178890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d4141-b29c-4fb9-a867-0783e888e81c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:11.179180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d4141-b29c-4fb9-a867-0783e888e81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:11.179463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d4141-b29c-4fb9-a867-0783e888e81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:11.202057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d4141-b29c-4fb9-a867-0783e888e81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:11.203574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d4141-b29c-4fb9-a867-0783e888e81c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:11.225237 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2993/6022] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:16.683579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:16.880321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e087e6-35d4-4048-9b64-40e7ca6cae6d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:16.908551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:16.909515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:16.909804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:16.910085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] PATH_INFO: `/v3/users/0f39873307a145bd805e7e14d0f0245c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:16.915884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f39873307a145bd805e7e14d0f0245c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:16.918067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:17.057969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f39873307a145bd805e7e14d0f0245c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:17.059111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f39873307a145bd805e7e14d0f0245c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:17.060853 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:17.081646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f39873307a145bd805e7e14d0f0245c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:17.083366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f39873307a145bd805e7e14d0f0245c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:17.096050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f39873307a145bd805e7e14d0f0245c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:17.123770 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3030/6023] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:16 2022] DELETE /identity/v3/users/0f39873307a145bd805e7e14d0f0245c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:17.130671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:17.131247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:17.131247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:17.164138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:17.165397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:17.556384 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2994/6024] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:17.570527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:17.573210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:17.765687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ac1-4c03-4a55-927f-016d861dd495 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:17.777337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:17.778330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:17.778872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:17.779385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:17.808040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:17.813397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:17.831283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3031/6025] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:18.594180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:18.595895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:18.637853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f33b-7d48-4556-925f-9358e1dfac5d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:18.648268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:18.650217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:18.650820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:18.651414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] PATH_INFO: `/v3/projects/9d05070caae74fc28acc1dcfe8986421` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:18.653170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d05070caae74fc28acc1dcfe8986421)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:18.656133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:18.766973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d05070caae74fc28acc1dcfe8986421', 'request_id': 'req-4bf79388-3d99-498a-beb1-1eccac649e86'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:18.777870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d05070caae74fc28acc1dcfe8986421', 'request_id': 'req-4bf79388-3d99-498a-beb1-1eccac649e86'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:18.787804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d05070caae74fc28acc1dcfe8986421', 'request_id': 'req-4bf79388-3d99-498a-beb1-1eccac649e86'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:18.803900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] The token cache is being invalidate because project 9d05070caae74fc28acc1dcfe8986421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:10:18.804435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:18.806016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:18.826998 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2995/6026] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:10:18 2022] DELETE /identity/v3/projects/9d05070caae74fc28acc1dcfe8986421 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:18.832396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:18.861005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d84a7-421d-445d-8c3f-698ce25cbda6 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:19.091350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:19.094235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:19.097130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:19.097740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] PATH_INFO: `/v3/users/cbbbba0f59744c9980d3df310c930b8e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:19.101487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbbba0f59744c9980d3df310c930b8e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:19.108729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:19.222720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbbba0f59744c9980d3df310c930b8e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:19.223766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbbba0f59744c9980d3df310c930b8e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:19.242562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbbba0f59744c9980d3df310c930b8e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:19.243620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbbba0f59744c9980d3df310c930b8e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:19.249532 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:19.253815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dcbfa79-65b5-43c5-864c-77c993fa254d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbbba0f59744c9980d3df310c930b8e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:19.278877 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3032/6027] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:18 2022] DELETE /identity/v3/users/cbbbba0f59744c9980d3df310c930b8e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:19.871863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:19.873969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:19.897887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf79388-3d99-498a-beb1-1eccac649e86 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:19.956488 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:20.019643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:20.020901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:20.021361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:20.021802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] PATH_INFO: `/v3/projects/c98d0df2e8244528a1c3c81d43f646d0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:20.023457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98d0df2e8244528a1c3c81d43f646d0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:20.025541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:20.179564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98d0df2e8244528a1c3c81d43f646d0', 'request_id': 'req-ef3e96be-f577-4317-bebc-e6aaf6699f00'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:20.207298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98d0df2e8244528a1c3c81d43f646d0', 'request_id': 'req-ef3e96be-f577-4317-bebc-e6aaf6699f00'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:20.232367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98d0df2e8244528a1c3c81d43f646d0', 'request_id': 'req-ef3e96be-f577-4317-bebc-e6aaf6699f00'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:20.258826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] The token cache is being invalidate because project c98d0df2e8244528a1c3c81d43f646d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:10:20.259284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:20.260913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ef3e96be-f577-4317-bebc-e6aaf6699f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:20.267236 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2996/6028] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:10:19 2022] DELETE /identity/v3/projects/c98d0df2e8244528a1c3c81d43f646d0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:20.269305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:20.269820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:20.269942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:20.313455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:20.316023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:20.475711 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3033/6029] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:10:20.484845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:20.485157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:20.485555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:20.531499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:20.542720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:20.574609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2997/6030] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:20.578940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:20.592200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db845d6-e2db-4edf-8c03-96cd368411a6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:20.613430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:20.614446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:20.614767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:20.615050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:20.615796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:10:20.616110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:20.617734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:20.649462 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3034/6031] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:10:20.653769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:20.666828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a491-6a8c-4125-8722-96b5984b9d92 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:20.680899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:20.682195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:20.682670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:20.683101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:20.700198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:20.710449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:20.857791 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2998/6032] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:10:20 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:20.859119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:20.874647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e0d3e-3624-4c57-8415-f1e3b2179913 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:21.027973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:21.028676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.028966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.029246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.029958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:21.031955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:21.081086 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3035/6033] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:10:20 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:21.085017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:21.099623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23311-f725-4208-9515-ce8dbdc6197b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:21.110076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:21.112864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.115371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.115886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.117002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:21.121908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:21.147883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 2999/6034] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:21.151699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:21.173023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318be7-31ed-45ab-bf79-bd4e355003b8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:21.178432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3d453-c030-421f-bce7-b2cfaf6f5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:21.179246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3d453-c030-421f-bce7-b2cfaf6f5e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.179492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3d453-c030-421f-bce7-b2cfaf6f5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.179776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3d453-c030-421f-bce7-b2cfaf6f5e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.180521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3d453-c030-421f-bce7-b2cfaf6f5e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:21.182137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3d453-c030-421f-bce7-b2cfaf6f5e79 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:21.194173 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3036/6035] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:10:21.198586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:21.212047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daf3de-ea5c-4645-8df1-4b3c329c26cb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:21.246145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:21.255946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.256567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.257549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] PATH_INFO: `/v3/projects/7277836fe6ce454f822038b67db0ce67/users/57cfdfa4bc564a2786e1fac4e24f9ca3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.294018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7277836fe6ce454f822038b67db0ce67, user_id=57cfdfa4bc564a2786e1fac4e24f9ca3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:21.297641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:21.322077 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3000/6036] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:10:21 2022] PUT /identity/v3/projects/7277836fe6ce454f822038b67db0ce67/users/57cfdfa4bc564a2786e1fac4e24f9ca3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:21.334562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.335581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.336064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.388150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] MFA Rules not processed for user `57cfdfa4bc564a2786e1fac4e24f9ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:21.389451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:21.482676 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:21.526881 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3037/6037] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:21.539234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:21.541954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:21.717008 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:21.759573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05a9ef-4cd2-49f8-a8f8-8d121215cd10 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:21.764473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951744-c86b-4dc0-9fc5-6564ef7874ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:21.765419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951744-c86b-4dc0-9fc5-6564ef7874ec service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.766525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951744-c86b-4dc0-9fc5-6564ef7874ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.766525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951744-c86b-4dc0-9fc5-6564ef7874ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.779700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c951744-c86b-4dc0-9fc5-6564ef7874ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:21.781264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c951744-c86b-4dc0-9fc5-6564ef7874ec service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:21.796726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3001/6038] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:21.832802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:21.956956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3da8-1c1d-4801-9ef1-576ede933a4e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:21.975025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:21.975978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:21.976260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:21.976711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] PATH_INFO: `/v3/users/57cfdfa4bc564a2786e1fac4e24f9ca3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:21.978042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cfdfa4bc564a2786e1fac4e24f9ca3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:21.980023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:22.097487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cfdfa4bc564a2786e1fac4e24f9ca3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:22.098364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cfdfa4bc564a2786e1fac4e24f9ca3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:22.113327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cfdfa4bc564a2786e1fac4e24f9ca3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:22.114285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cfdfa4bc564a2786e1fac4e24f9ca3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:22.132484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cfdfa4bc564a2786e1fac4e24f9ca3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:22.194366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3038/6039] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:21 2022] DELETE /identity/v3/users/57cfdfa4bc564a2786e1fac4e24f9ca3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:22.198352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:22.199235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:22.199701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:22.240617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:22.244460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:22.367411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3002/6040] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:22.394525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:22.396895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:22.621540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8d5a-49bf-4c07-a10a-cb46e9aa2563 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:22.643872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409feeb-1df5-460b-99cf-473b97f41a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:22.649501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409feeb-1df5-460b-99cf-473b97f41a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:22.649792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409feeb-1df5-460b-99cf-473b97f41a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:22.651375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409feeb-1df5-460b-99cf-473b97f41a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:22.713664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409feeb-1df5-460b-99cf-473b97f41a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:22.715094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409feeb-1df5-460b-99cf-473b97f41a66 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:22.786349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3039/6041] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:24.480164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:24.481886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:24.500813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0344a-f5ca-4ae6-a249-d29f3ab29549 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:24.507885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:24.509131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:24.509719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:24.510166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] PATH_INFO: `/v3/projects/7277836fe6ce454f822038b67db0ce67` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:24.537834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7277836fe6ce454f822038b67db0ce67)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:24.544030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:24.648329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7277836fe6ce454f822038b67db0ce67', 'request_id': 'req-47a76f76-eee6-43b1-93bd-08dfb0705870'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:24.655731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7277836fe6ce454f822038b67db0ce67', 'request_id': 'req-47a76f76-eee6-43b1-93bd-08dfb0705870'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:24.680769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7277836fe6ce454f822038b67db0ce67', 'request_id': 'req-47a76f76-eee6-43b1-93bd-08dfb0705870'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:24.730213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] The token cache is being invalidate because project 7277836fe6ce454f822038b67db0ce67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:10:24.730535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:24.731198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-47a76f76-eee6-43b1-93bd-08dfb0705870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:24.736130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3003/6042] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:10:24 2022] DELETE /identity/v3/projects/7277836fe6ce454f822038b67db0ce67 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:24.738482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:24.739057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:24.739184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:24.755904 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:24.780406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:24.782928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:24.902478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3040/6043] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:24.910547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:24.912611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:24.912909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:24.978422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:24.979450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:25.025610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3004/6044] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:25.028250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:25.047494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cbdd2-8bd1-4f77-882b-20bea20fbbdf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:25.072125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:25.077575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.077867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.078149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.078930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:10:25.079243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:25.089319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:25.124256 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3041/6045] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:10:25.129287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:25.142017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6b5bf-87ee-4e01-b9a8-8527bae12fc5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:25.155314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:25.159347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.159640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.159923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.161056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:25.166250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:25.223003 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3005/6046] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:10:25 2022] POST /identity/v3/projects => generated 395 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:25.227435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:25.242194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e585efe-2235-43ba-8a57-0a84ccb74205 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:25.432614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:25.433312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.433600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.433881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.434623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:25.436771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:25.491572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3042/6047] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:10:25 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:25.500338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:25.514376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1c12-2322-4db1-9b74-90caf3c9db6a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:25.526648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:25.527402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.527696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.527966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.528869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:25.531947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:25.558375 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3006/6048] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:25.562267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:25.578153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0b3dc-8307-4b82-8cd5-ffe39f7aef69 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:25.592164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b4b3a-d629-4e23-b20f-7e4ced57a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:25.593244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4b3a-d629-4e23-b20f-7e4ced57a0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.593757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4b3a-d629-4e23-b20f-7e4ced57a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.596999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4b3a-d629-4e23-b20f-7e4ced57a0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.598650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b4b3a-d629-4e23-b20f-7e4ced57a0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:25.608894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b4b3a-d629-4e23-b20f-7e4ced57a0ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:25.639913 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3043/6049] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:25.643872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:25.656756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be303-51e7-491b-8839-ca14aa4e1d0a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:25.669682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:25.671018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.671307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.671588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] PATH_INFO: `/v3/projects/a63c816b992f4724b4dfdee437400edf/users/4e2be7e366f9451cbc3cca412725cd38/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.710451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63c816b992f4724b4dfdee437400edf, user_id=4e2be7e366f9451cbc3cca412725cd38, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:25.717481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:25.771510 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3007/6050] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:10:25 2022] PUT /identity/v3/projects/a63c816b992f4724b4dfdee437400edf/users/4e2be7e366f9451cbc3cca412725cd38/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:25.789289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:25.789806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:25.789901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:25.882924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] MFA Rules not processed for user `4e2be7e366f9451cbc3cca412725cd38`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:25.884200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:26.053247 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:26.059804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3044/6051] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:26.121795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:26.132144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:26.142143 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:26.247681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2165ce-6651-47c3-af98-f733c07ccb07 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:26.253165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9ec0b-80f0-4c89-b1fc-1fe3c5cf3b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:26.254599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ec0b-80f0-4c89-b1fc-1fe3c5cf3b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:26.256259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ec0b-80f0-4c89-b1fc-1fe3c5cf3b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:26.257018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ec0b-80f0-4c89-b1fc-1fe3c5cf3b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:26.273282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9ec0b-80f0-4c89-b1fc-1fe3c5cf3b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:26.275243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9ec0b-80f0-4c89-b1fc-1fe3c5cf3b87 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:26.293045 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3008/6052] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:26.557297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:26.558926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:26.751861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3390a1f-28d1-4461-851b-b0bb41c8df62 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:26.765962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:26.766965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:26.767318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:26.768357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] PATH_INFO: `/v3/users/de3fe97bb6ff4fe78d837a4502b3a4eb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:26.777653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3fe97bb6ff4fe78d837a4502b3a4eb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:26.781130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:26.919423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3fe97bb6ff4fe78d837a4502b3a4eb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:26.920304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3fe97bb6ff4fe78d837a4502b3a4eb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:26.954088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3fe97bb6ff4fe78d837a4502b3a4eb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:26.957344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3fe97bb6ff4fe78d837a4502b3a4eb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:26.973057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3fe97bb6ff4fe78d837a4502b3a4eb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:27.034838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3045/6053] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:26 2022] DELETE /identity/v3/users/de3fe97bb6ff4fe78d837a4502b3a4eb => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:27.039340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:27.039870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:27.039973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:27.092195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:27.094660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:27.213418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3009/6054] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:27.339578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:27.341253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:27.509162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f77e3-6a43-460e-816b-b3d10c672f67 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:27.527304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bba1f8-1a5f-4989-abdd-2131c5cb18fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:27.528431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bba1f8-1a5f-4989-abdd-2131c5cb18fd service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:27.528887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bba1f8-1a5f-4989-abdd-2131c5cb18fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:27.529329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bba1f8-1a5f-4989-abdd-2131c5cb18fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:27.552203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bba1f8-1a5f-4989-abdd-2131c5cb18fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:27.554133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bba1f8-1a5f-4989-abdd-2131c5cb18fd service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:27.567249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3046/6055] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:28.492042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:28.493728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:28.526856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eee3b-10dc-43f0-8292-5565f7ebc9b0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:28.537558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:28.538337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:28.538688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:28.538967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] PATH_INFO: `/v3/projects/bf108d4b851945cbb06a407d2b36d3ba` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:28.540938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf108d4b851945cbb06a407d2b36d3ba)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:28.544109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:28.707315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf108d4b851945cbb06a407d2b36d3ba', 'request_id': 'req-c4b96ff3-51ff-473e-801b-0423d406e694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:28.725092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf108d4b851945cbb06a407d2b36d3ba', 'request_id': 'req-c4b96ff3-51ff-473e-801b-0423d406e694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:28.756142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf108d4b851945cbb06a407d2b36d3ba', 'request_id': 'req-c4b96ff3-51ff-473e-801b-0423d406e694'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:28.777277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] The token cache is being invalidate because project bf108d4b851945cbb06a407d2b36d3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:10:28.777771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:28.779234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c4b96ff3-51ff-473e-801b-0423d406e694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:28.784107 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3010/6056] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:10:28 2022] DELETE /identity/v3/projects/bf108d4b851945cbb06a407d2b36d3ba => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:28.789006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:28.790230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:28.790746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:28.832024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:28.833526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:28.877734 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:28.965613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:28.966160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:28.966836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:28.980489 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3047/6057] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:28.996996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:28.999372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:29.016686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.032448 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3011/6058] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:29.082713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce88de-2b30-4dd1-8015-4e1cd8e31e64 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:29.096919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:29.099711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.101425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.102395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.107784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:10:29.110052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:29.113866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:29.137830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.156728 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3048/6059] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:10:29.160537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a353-caca-4914-b893-b6d0a4114910 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:29.166155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:29.167083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.167533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.168545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.169913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:29.172882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:29.231297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.243829 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3012/6060] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:10:29 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:29.245403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4990c6-07f9-4248-827a-49c31277febe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:29.413604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:29.414463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.414679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.414981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.419157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:29.423259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:29.479731 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3049/6061] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:10:29 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:10:29.484091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.490975 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:29.500283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586dc23-273e-4f18-a086-22f8bf08ecf2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:29.521398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:29.523023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.523491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.525638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.527115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:29.532419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:29.569801 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3013/6062] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:29.571664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.591176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734f8af-3dac-440e-b6d8-35ec9fcd45be admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:29.596554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab4eeb-a57e-4c49-b738-22bf29a2f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:29.597237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4eeb-a57e-4c49-b738-22bf29a2f0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.597523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4eeb-a57e-4c49-b738-22bf29a2f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.598064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4eeb-a57e-4c49-b738-22bf29a2f0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.598840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab4eeb-a57e-4c49-b738-22bf29a2f0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:29.600538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab4eeb-a57e-4c49-b738-22bf29a2f0f9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:29.612969 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3050/6063] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:10:29.617016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.628579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e227-576c-4fa1-bfa6-fd622b9f1c12 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:29.634690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:29.645996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.646580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.647063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] PATH_INFO: `/v3/projects/a0b84f50fa9c45dc8d34f881b97efac5/users/2e2d79ddf36e4dcba5418a7920e1a763/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.669153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b84f50fa9c45dc8d34f881b97efac5, user_id=2e2d79ddf36e4dcba5418a7920e1a763, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:29.672771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:29.718757 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3014/6064] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:10:29 2022] PUT /identity/v3/projects/a0b84f50fa9c45dc8d34f881b97efac5/users/2e2d79ddf36e4dcba5418a7920e1a763/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:29.725995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3a311-c3ff-4d8b-83bd-9861005380bb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:29.726375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3a311-c3ff-4d8b-83bd-9861005380bb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:29.726748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3a311-c3ff-4d8b-83bd-9861005380bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:29.774031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eff3a311-c3ff-4d8b-83bd-9861005380bb None None] MFA Rules not processed for user `2e2d79ddf36e4dcba5418a7920e1a763`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:29.776194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eff3a311-c3ff-4d8b-83bd-9861005380bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:29.926857 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3051/6065] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:29.958330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:29.961019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:30.108160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b893219-2b19-4459-852b-3ce4411d1571 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:30.115867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:30.116639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:30.116988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:30.117333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:30.136623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:30.138147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:30.159839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3015/6066] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:39.914047 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:40.154952 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:40.710358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:40.711586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:40.711900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:40.779978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:40.783378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:40.974314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3052/6067] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:10:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:41.001421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:41.003534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:41.243186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:41.260858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617c41-9f6c-4b54-a699-def58aab4512 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:41.287314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:41.289703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:41.300992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:41.302066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:41.308106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:41.392911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475470-4384-40f8-b45d-258024aef543 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:41.425392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68b0d1-4869-43bf-b08d-86fd6740798a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:41.426040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68b0d1-4869-43bf-b08d-86fd6740798a service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:41.426334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68b0d1-4869-43bf-b08d-86fd6740798a service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:41.434088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68b0d1-4869-43bf-b08d-86fd6740798a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:41.473899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68b0d1-4869-43bf-b08d-86fd6740798a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:41.475577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68b0d1-4869-43bf-b08d-86fd6740798a service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:41.535831 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3016/6068] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:10:41.682584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:41.682584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:41.735671 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3053/6069] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:47.108673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:47.109200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:47.109545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:47.171607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] MFA Rules not processed for user `87be873dd7d6441d84380b227ec4f034`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:47.177733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:47.334242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3017/6070] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:48.132897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:48.140297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:48.178398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995fb7-bf5f-46d1-91c5-e7ee0ba9759d service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:48.183838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:48.184831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:48.185366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:48.185893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:48.188820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:48.205907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:48.208075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:48.223739 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3054/6071] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:51.969270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:51.992965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788462-d1fd-4ffd-82b8-f7d9987670aa None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:52.013758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:52.014440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:52.014769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:52.019521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:52.034043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:52.315954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:52.317436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee758f-22ff-43bc-8b7a-120fd596c74c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:52.337516 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3018/6072] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:56.634343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:56.636781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:56.692499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e6a3b-71b9-451e-9dc9-bb62bbda622d service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:56.717075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:56.720495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:56.720969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:56.721316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] PATH_INFO: `/v3/users/d77f21b7666040b2bbbb460782a39e53` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:56.724946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77f21b7666040b2bbbb460782a39e53)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:56.733182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:56.941517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77f21b7666040b2bbbb460782a39e53'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:56.945605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77f21b7666040b2bbbb460782a39e53'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:56.979591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77f21b7666040b2bbbb460782a39e53'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:56.982163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77f21b7666040b2bbbb460782a39e53'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:57.002821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77f21b7666040b2bbbb460782a39e53'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:10:57.026544 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:57.047983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:57.050894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:57.051748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:57.064923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3055/6073] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:10:56 2022] DELETE /identity/v3/users/d77f21b7666040b2bbbb460782a39e53 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:10:57.090413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:10:57.093836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:57.132667 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:10:57.273870 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3019/6074] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:10:57.293726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:57.295618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:57.505352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd50fb-e916-44e3-b599-9f7d0117a2b6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:57.517031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:57.519841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:57.519841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:57.519841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:57.570302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:57.575104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:57.603944 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3056/6075] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:10:58.723757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:10:58.725204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:58.921141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6876b-a529-471a-ba8f-f15f916a8e0c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:10:58.932499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:10:58.933587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:10:58.933587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:10:58.933775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:10:58.951569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:10:59.192092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:10:59.193795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:10:59.225570 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3020/6076] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:00.689407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:00.690945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:00.710654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1358-41a5-453f-bc88-b7f961867b68 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:00.723901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:00.724834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:00.725154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:00.725443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] PATH_INFO: `/v3/projects/6840e4c4271d4c99851ca787b9c81698` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:00.726693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6840e4c4271d4c99851ca787b9c81698)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:00.736207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:00.850315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6840e4c4271d4c99851ca787b9c81698', 'request_id': 'req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:00.871020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6840e4c4271d4c99851ca787b9c81698', 'request_id': 'req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:00.886838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6840e4c4271d4c99851ca787b9c81698', 'request_id': 'req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:00.931263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] The token cache is being invalidate because project 6840e4c4271d4c99851ca787b9c81698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:00.931565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:00.932409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:00.937208 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3057/6077] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:00 2022] DELETE /identity/v3/projects/6840e4c4271d4c99851ca787b9c81698 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:00.938918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:00.957216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e41cd-a933-4237-bf5f-dfd86e71e41b service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:01.112081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:01.112904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:01.113200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:01.113452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] PATH_INFO: `/v3/users/d8c0f846c57a4dbd97db301d4898d4cc` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:01.120620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c0f846c57a4dbd97db301d4898d4cc)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:01.122886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:01.142191 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:01.298331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c0f846c57a4dbd97db301d4898d4cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:01.341245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c0f846c57a4dbd97db301d4898d4cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:01.368425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c0f846c57a4dbd97db301d4898d4cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:01.394994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c0f846c57a4dbd97db301d4898d4cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:01.395754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ce0c140-d213-486b-8ff9-4365511bd5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c0f846c57a4dbd97db301d4898d4cc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:01.403146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3021/6078] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:00 2022] DELETE /identity/v3/users/d8c0f846c57a4dbd97db301d4898d4cc => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:02.780319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:02.782353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:02.830794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00589-ef08-49b9-b1ed-d7ac4c3a80da admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:02.997218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:02.998256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:02.998609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:02.999070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] PATH_INFO: `/v3/projects/c0d05c02a25b45ec8d143f3f5448f0b6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:03.004126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d05c02a25b45ec8d143f3f5448f0b6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:03.006177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:03.105379 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:03.144087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'request_id': 'req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:03.160042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'request_id': 'req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:03.167138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d05c02a25b45ec8d143f3f5448f0b6', 'request_id': 'req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:03.202408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] The token cache is being invalidate because project c0d05c02a25b45ec8d143f3f5448f0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:03.202990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:03.203904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fed2a697-ad47-4c35-8d5f-4e27f8154ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:03.209134 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3058/6079] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:02 2022] DELETE /identity/v3/projects/c0d05c02a25b45ec8d143f3f5448f0b6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:03.213727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:03.214240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:03.214335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:03.263454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:03.267999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:03.465037 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3022/6080] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:03.466260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:03.466712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:03.467005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:03.508050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:03.509922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:03.538838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3059/6081] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:03.543581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:03.568267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4563-2d03-46f7-8583-abb64fab2e0c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:03.580631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:03.581427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:03.581598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:03.585362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:03.586767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:03.587519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:03.591096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:03.629170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:03.629975 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3023/6082] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:03.653564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3de12-3b2a-4ef0-92f9-f07b63232260 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:03.663481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:03.664296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:03.664691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:03.665079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:03.665914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:03.668040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:03.735963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3060/6083] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:03 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:03.740007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:03.760693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a3ef-5013-4e92-90d0-88135309c658 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:04.046188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:04.046188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:04.046188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:04.046188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:04.046757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:04.049285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:04.110590 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:04.123919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:04.134422 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3024/6084] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:03 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:04.139312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347fff2-14c9-4200-988d-0f3b91b7a37e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:04.173487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:04.182547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:04.202638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:04.203189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:04.214249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:04.216132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:04.256795 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3061/6085] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:04.261704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:04.307714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da684c-c3b9-4c04-9b82-9acb1d5203a4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:04.326960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae724b9-c28c-4cbf-a65c-bb0eaf4ecb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:04.329286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae724b9-c28c-4cbf-a65c-bb0eaf4ecb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:04.332168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae724b9-c28c-4cbf-a65c-bb0eaf4ecb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:04.332710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae724b9-c28c-4cbf-a65c-bb0eaf4ecb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:04.334328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae724b9-c28c-4cbf-a65c-bb0eaf4ecb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:04.342531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae724b9-c28c-4cbf-a65c-bb0eaf4ecb4f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:04.375196 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3025/6086] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:04.379183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:04.399069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13154-9c6e-43d0-9f99-9fb7da57f91c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:04.438882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:04.439817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:04.440110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:04.440388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] PATH_INFO: `/v3/projects/9c4c14ef970b47af9106e224ff5e8282/users/7be53f839e9c433c8cba00040420f003/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:04.507973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4c14ef970b47af9106e224ff5e8282, user_id=7be53f839e9c433c8cba00040420f003, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:04.509778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:04.587316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:04.587615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:04.587893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:04.588356 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3062/6087] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:04 2022] PUT /identity/v3/projects/9c4c14ef970b47af9106e224ff5e8282/users/7be53f839e9c433c8cba00040420f003/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:04.679266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] MFA Rules not processed for user `7be53f839e9c433c8cba00040420f003`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:04.684268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:04.842786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:04.845106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:04.953895 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3026/6088] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:05.031367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bdf6-3724-4c76-b16b-78ced3bec41e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:05.048507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:05.049189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:05.049480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:05.049764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:05.054143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:05.087851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:05.089682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90b27d-ed6c-4e5e-9e8d-d597b8f30a7d service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:05.101874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:05.103745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:05.132008 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3063/6089] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:05.323319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cbb3f-107f-4c76-83e1-f930ec87be09 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:05.334843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:05.335480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:05.336053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:05.336539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:05.369958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:05.372965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:05.393055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3027/6090] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:10.895018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:10.895565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:10.895820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:10.942837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:10.945998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:11.072465 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:11.129976 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3064/6091] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:11:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:11.147986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:11.149514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:11.369144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ba68-a9e8-40c8-b51c-ad92a82436a2 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:11.383069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7974ac-c05a-480b-9efb-160286b24fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:11.383679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7974ac-c05a-480b-9efb-160286b24fb8 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:11.383959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7974ac-c05a-480b-9efb-160286b24fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:11.384240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7974ac-c05a-480b-9efb-160286b24fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:11.402420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7974ac-c05a-480b-9efb-160286b24fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:11.404142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7974ac-c05a-480b-9efb-160286b24fb8 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:11.425539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3028/6092] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:11:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:11:12.367709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:12.403120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab9027-a21c-441c-8c57-6b9b77e69761 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:12.423465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:12.428436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:12.428853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:12.429140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:12.435434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:12.496293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:12.505405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:12.514912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27b6e-68e5-4abb-8c38-805215ce67ac None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:12.515486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27b6e-68e5-4abb-8c38-805215ce67ac None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:12.515486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27b6e-68e5-4abb-8c38-805215ce67ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:12.541172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3065/6093] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:12.569441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b9c27b6e-68e5-4abb-8c38-805215ce67ac None None] MFA Rules not processed for user `1dfed9df4c8a4de98a315124dc7cfe94`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:12.570794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b9c27b6e-68e5-4abb-8c38-805215ce67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:12.580954 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:12.735402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3029/6094] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:12.826095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:12.827619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:13.070552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedea12b-cd2e-4c65-9feb-a55ac9f82e61 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:13.091266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:13.092181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:13.092460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:13.094671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] PATH_INFO: `/v3/users/4e2be7e366f9451cbc3cca412725cd38` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:13.097237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2be7e366f9451cbc3cca412725cd38)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:13.105208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:13.258690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2be7e366f9451cbc3cca412725cd38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.263388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2be7e366f9451cbc3cca412725cd38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.311604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2be7e366f9451cbc3cca412725cd38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.314656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2be7e366f9451cbc3cca412725cd38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.351613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2be7e366f9451cbc3cca412725cd38'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:13.392599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3066/6095] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:12 2022] DELETE /identity/v3/users/4e2be7e366f9451cbc3cca412725cd38 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:13.397283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:13.397968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:13.398434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:13.436799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:13.440111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:13.638082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3030/6096] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:13.657366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:13.658917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:13.814305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4afb-51dc-4939-a7c3-2f6f3e366b4a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:13.827250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239b13-f6e5-43a3-b598-c7220c577cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:13.827951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239b13-f6e5-43a3-b598-c7220c577cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:13.828306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239b13-f6e5-43a3-b598-c7220c577cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:13.829148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239b13-f6e5-43a3-b598-c7220c577cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:13.851950 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:13.856970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239b13-f6e5-43a3-b598-c7220c577cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:13.861838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239b13-f6e5-43a3-b598-c7220c577cc7 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:13.887859 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3067/6097] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:14.634158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:14.635691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:14.661174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dcecb-3dfe-41dc-8ddf-394f28d835d3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:14.668099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:14.669922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:14.670584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:14.671132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] PATH_INFO: `/v3/projects/a63c816b992f4724b4dfdee437400edf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:14.673199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63c816b992f4724b4dfdee437400edf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:14.675649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:14.839951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63c816b992f4724b4dfdee437400edf', 'request_id': 'req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.853941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63c816b992f4724b4dfdee437400edf', 'request_id': 'req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.879522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63c816b992f4724b4dfdee437400edf', 'request_id': 'req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.897428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] The token cache is being invalidate because project a63c816b992f4724b4dfdee437400edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:14.897995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.901873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-59ee3b9a-03d8-4b49-ab51-5bdcc9241554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:14.904416 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3031/6098] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:14 2022] DELETE /identity/v3/projects/a63c816b992f4724b4dfdee437400edf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:14.910329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:14.910860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:14.910979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:14.986070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:14.990742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:15.139312 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3068/6099] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:15.148198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.148558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.148992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.209122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:15.211508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:15.224377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:15.226091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:15.239938 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3032/6100] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:15.240907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:15.253175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3679f61-3f66-4e14-93ac-713045f64723 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:15.259153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:15.260431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.260942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.261449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] PATH_INFO: `/v3/users/72be490a451b45eaa4879340a06b51f5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.264006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72be490a451b45eaa4879340a06b51f5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:15.272667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:15.274180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c0711-e7e3-4fd5-ace1-a89edb44cd75 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:15.285612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:15.286660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.287116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.287993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.293113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:15.293895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:15.295848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:15.348848 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3033/6101] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:15.350465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:15.373330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c58631-7527-480f-b992-b0435b9e939c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:15.374016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72be490a451b45eaa4879340a06b51f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:15.374870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72be490a451b45eaa4879340a06b51f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:15.393239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:15.394215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.394843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.395306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.396208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:15.398437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:15.408031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72be490a451b45eaa4879340a06b51f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:15.409370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72be490a451b45eaa4879340a06b51f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:15.429847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72be490a451b45eaa4879340a06b51f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:15.449213 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:15.461682 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3069/6102] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:15 2022] DELETE /identity/v3/users/72be490a451b45eaa4879340a06b51f5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:15.476567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3034/6103] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:15 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:15.477935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:15.479777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:15.661130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584361-624e-4cab-81c2-3c45010e0672 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:15.680551 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:15.797483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:15.798045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.798318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.798640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.799334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:15.801264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:15.877670 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3070/6104] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:15 2022] POST /identity/v3/users => generated 289 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:15.881634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:15.903919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc55a-cc81-4fda-b6bf-b363634999d7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:15.916209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:15.917126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.920332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.920861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.921870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:15.928771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:15.958309 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3035/6105] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:15.962175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:15.979668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97464b-730c-4f2b-ac6a-2ffef1b2f55d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:15.992945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339eeed-b73d-42fa-a422-b3f40c614ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:15.993713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339eeed-b73d-42fa-a422-b3f40c614ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:15.993975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339eeed-b73d-42fa-a422-b3f40c614ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:15.994254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339eeed-b73d-42fa-a422-b3f40c614ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:15.995139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339eeed-b73d-42fa-a422-b3f40c614ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:15.996748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339eeed-b73d-42fa-a422-b3f40c614ce0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:16.031373 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3071/6106] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:16.037861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:16.050951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2039b-bde8-4ffb-afd4-07cf2f130153 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:16.079940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:16.081183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:16.081762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:16.082215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] PATH_INFO: `/v3/projects/86ea906ce0b34445b7f9263a7ff85dbc/users/05b9dd6363f546b995c1e01bbbaa8a31/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:16.136136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ea906ce0b34445b7f9263a7ff85dbc, user_id=05b9dd6363f546b995c1e01bbbaa8a31, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:16.139155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:16.165622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3036/6107] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:16 2022] PUT /identity/v3/projects/86ea906ce0b34445b7f9263a7ff85dbc/users/05b9dd6363f546b995c1e01bbbaa8a31/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:16.177789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:16.187023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:16.187298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:16.287575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] MFA Rules not processed for user `05b9dd6363f546b995c1e01bbbaa8a31`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:16.289013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:16.480070 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3072/6108] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:16.643523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:16.645627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:16.844598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3229b-d287-460a-8d7d-bb5f120835c7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:16.867399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:16.868249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:16.868643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:16.869023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:16.905232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:16.909393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:16.949052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3037/6109] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:17.210983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:17.212989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:17.383641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64d7d9-4bc8-4c7a-9725-7d22e39186a9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:17.395638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:17.397114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:17.397507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:17.397716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] PATH_INFO: `/v3/projects/4dd89698401b4c6e92acfbdf600733cb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:17.400278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd89698401b4c6e92acfbdf600733cb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:17.402375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:17.460193 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:17.527630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd89698401b4c6e92acfbdf600733cb', 'request_id': 'req-87196c1e-def2-425a-bd0a-f8f1fa82731d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.544569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd89698401b4c6e92acfbdf600733cb', 'request_id': 'req-87196c1e-def2-425a-bd0a-f8f1fa82731d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.551625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd89698401b4c6e92acfbdf600733cb', 'request_id': 'req-87196c1e-def2-425a-bd0a-f8f1fa82731d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.574885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] The token cache is being invalidate because project 4dd89698401b4c6e92acfbdf600733cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:17.575481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.578896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.583698 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3073/6110] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:17 2022] DELETE /identity/v3/projects/4dd89698401b4c6e92acfbdf600733cb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:17.587559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:17.611880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32dd8-b47e-4adc-ada3-c37773a9e90d service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:17.740727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:17.742052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:17.742529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:17.742982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] PATH_INFO: `/v3/users/1df08e1a2bce4873a2df8b676f4290b4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:17.746982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df08e1a2bce4873a2df8b676f4290b4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:17.749090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:17.827275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:17.829499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:17.871108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196c1e-def2-425a-bd0a-f8f1fa82731d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:17.874964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df08e1a2bce4873a2df8b676f4290b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.889776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:17.890041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:17.890331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:17.891183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] PATH_INFO: `/v3/users/87da4de7bbfa4381af636c4b4ab8a9b0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:17.895381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87da4de7bbfa4381af636c4b4ab8a9b0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:17.897340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:17.930313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df08e1a2bce4873a2df8b676f4290b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.934930 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:17.958667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df08e1a2bce4873a2df8b676f4290b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.986564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df08e1a2bce4873a2df8b676f4290b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:17.988295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d34b0b4e-46b8-4086-86f2-b206627eb9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df08e1a2bce4873a2df8b676f4290b4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:18.035492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87da4de7bbfa4381af636c4b4ab8a9b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:18.036456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87da4de7bbfa4381af636c4b4ab8a9b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:18.059537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3038/6111] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:17 2022] DELETE /identity/v3/users/1df08e1a2bce4873a2df8b676f4290b4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:18.092535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87da4de7bbfa4381af636c4b4ab8a9b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:18.095397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87da4de7bbfa4381af636c4b4ab8a9b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:18.146804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87da4de7bbfa4381af636c4b4ab8a9b0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:18.190475 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3074/6112] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:17 2022] DELETE /identity/v3/users/87da4de7bbfa4381af636c4b4ab8a9b0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:18.191500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:18.192552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:18.193663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:18.252314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:18.253854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:18.406024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3039/6113] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:18.431032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:18.434032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:18.533765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c08846-628b-424f-8345-3afba4c74961 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:18.549414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec39f-6f7f-4577-a0d6-92076b9219da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:18.549414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec39f-6f7f-4577-a0d6-92076b9219da service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:18.549414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec39f-6f7f-4577-a0d6-92076b9219da service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:18.549414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec39f-6f7f-4577-a0d6-92076b9219da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:18.570641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec39f-6f7f-4577-a0d6-92076b9219da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:18.574473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec39f-6f7f-4577-a0d6-92076b9219da service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:18.592383 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3075/6114] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:19.364402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:19.366696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:19.412529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d18f1-6543-4baf-bb64-74ec39c9a6bc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:19.430932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:19.431962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:19.432350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:19.432708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] PATH_INFO: `/v3/projects/a13cbd01fad94de3a41f0f1176cc8fb2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:19.434768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13cbd01fad94de3a41f0f1176cc8fb2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:19.459357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:19.542393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13cbd01fad94de3a41f0f1176cc8fb2', 'request_id': 'req-7de35a52-b4d3-4900-b5cb-52b60c88066e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:19.550186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13cbd01fad94de3a41f0f1176cc8fb2', 'request_id': 'req-7de35a52-b4d3-4900-b5cb-52b60c88066e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:19.567959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13cbd01fad94de3a41f0f1176cc8fb2', 'request_id': 'req-7de35a52-b4d3-4900-b5cb-52b60c88066e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:19.584086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] The token cache is being invalidate because project a13cbd01fad94de3a41f0f1176cc8fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:19.584369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:19.586938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7de35a52-b4d3-4900-b5cb-52b60c88066e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:19.591967 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3040/6115] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:19 2022] DELETE /identity/v3/projects/a13cbd01fad94de3a41f0f1176cc8fb2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:19.598625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:19.599183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:19.599902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:19.622541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:19.623954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:19.650461 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:19.739647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3076/6116] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:19.747663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:19.747979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:19.748295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:19.779791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:19.782396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:19.793875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3041/6117] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:19.800058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:19.815994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3bd5d-3afa-4d32-98bd-53af09fa6ffc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:19.821927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:19.823029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:19.823400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:19.823972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:19.824868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:19.825879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:19.827224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:19.849447 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3077/6118] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:19.852047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:19.865572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fd421-ac73-42fe-85eb-b72ff8d032e9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:19.871458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:19.872309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:19.873366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:19.873705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:19.874743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:19.877975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:19.915632 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3042/6119] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:19 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:19.919933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:19.933029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64606bf3-b50a-434e-9fec-e8741e840ce5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:19.962484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:19.965752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.075117 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:20.101802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.106542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.107649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.107993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.109067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.117763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.171512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add701c9-9a60-4db2-9495-b5e129afbc08 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.192366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3078/6120] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:19 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:20.197267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.197740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.200673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.202792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.203525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] PATH_INFO: `/v3/projects/437e93c5840e496e806a4b70c428e94a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.207151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=437e93c5840e496e806a4b70c428e94a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.212439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.226026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e884ca7-614f-4c4a-b395-129948e3e3c5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.237582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.238283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.238597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.238878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.242716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.249538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.283887 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3079/6121] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:20.285417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.318508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ba9a-f3ba-42fa-99bc-6c066559b561 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.363571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437e93c5840e496e806a4b70c428e94a', 'request_id': 'req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:20.371813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437e93c5840e496e806a4b70c428e94a', 'request_id': 'req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:20.391993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437e93c5840e496e806a4b70c428e94a', 'request_id': 'req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:20.404811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] The token cache is being invalidate because project 437e93c5840e496e806a4b70c428e94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:20.405104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:20.405863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-733a7318-2c2f-4bf2-b0f4-5bc854c5a4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:20.407949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3043/6122] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:19 2022] DELETE /identity/v3/projects/437e93c5840e496e806a4b70c428e94a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:20.413442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365788f1-e19e-4515-82ac-e54835cada89 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.413724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365788f1-e19e-4515-82ac-e54835cada89 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.414643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365788f1-e19e-4515-82ac-e54835cada89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.436478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.437094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.438127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.438464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.439240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.441763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.456207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3080/6123] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:20.458740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.460680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.468376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-365788f1-e19e-4515-82ac-e54835cada89 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:20.472987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-365788f1-e19e-4515-82ac-e54835cada89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.480443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085f843-0a95-46d5-a867-1f53c1eb1bf1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.489239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf835e31-6a44-4f1d-a71e-ecfb39159a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.491409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835e31-6a44-4f1d-a71e-ecfb39159a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.491942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835e31-6a44-4f1d-a71e-ecfb39159a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.491942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835e31-6a44-4f1d-a71e-ecfb39159a6d admin admin] PATH_INFO: `/v3/projects/9b79eb0c0fcb477ca345b010c1403b45/users/97c3457aa35546e79c885aa76934ba6b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.494312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3044/6124] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:20.503821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4639-6363-410f-880b-27e2e6691513 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.503821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4639-6363-410f-880b-27e2e6691513 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.503821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4639-6363-410f-880b-27e2e6691513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.531873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-504e4639-6363-410f-880b-27e2e6691513 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:20.533132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-504e4639-6363-410f-880b-27e2e6691513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.535192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf835e31-6a44-4f1d-a71e-ecfb39159a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b79eb0c0fcb477ca345b010c1403b45, user_id=97c3457aa35546e79c885aa76934ba6b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.538931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf835e31-6a44-4f1d-a71e-ecfb39159a6d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.557773 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3045/6125] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:20.558860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e4639-6363-410f-880b-27e2e6691513 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.569827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e4639-6363-410f-880b-27e2e6691513 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.575672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3081/6126] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:20 2022] PUT /identity/v3/projects/9b79eb0c0fcb477ca345b010c1403b45/users/97c3457aa35546e79c885aa76934ba6b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:20.587691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83896a-f509-4021-b725-4a23613bfdbe None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.587985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83896a-f509-4021-b725-4a23613bfdbe None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.588311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83896a-f509-4021-b725-4a23613bfdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.596868 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:20.654754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.655760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7a83896a-f509-4021-b725-4a23613bfdbe None None] MFA Rules not processed for user `97c3457aa35546e79c885aa76934ba6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:20.656632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.657274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7a83896a-f509-4021-b725-4a23613bfdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.657711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.658275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.659379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:20.660026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.662018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.685378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3046/6127] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:20.690259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.701224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07a5e8-32d2-4068-9a96-56b15f1aac9d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.706615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.707331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.707623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.707897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.708578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.710956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.745178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3047/6128] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:20.750690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.806634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3082/6129] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:20.816146 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:20.820726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.821103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.821750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.867065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] MFA Rules not processed for user `97c3457aa35546e79c885aa76934ba6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:20.870294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:20.911832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5b2d-73e0-42e9-8bb0-b106b61806c4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:20.929036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:20.929866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:20.930225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:20.930606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:20.931394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:20.934255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:20.982906 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3048/6130] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:20.986296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:20.999689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef980c09-1c18-4dab-b7ee-aad0128dcb01 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.006956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.007825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.008083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.008338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.009158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.010558 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3083/6131] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:21.013211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.022729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.024217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:21.033728 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3049/6132] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:21.037857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.051162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699fca4-fc26-43b6-bb5d-fd7b4e2a7350 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.057554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.058664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.059171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.059664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.062596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.065458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.081177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3050/6133] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:21.085464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.101916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c896f-c675-440b-8b6e-8508f0ce8743 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.108559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3114d-bf17-426d-ad12-5af5d22a3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.110487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3114d-bf17-426d-ad12-5af5d22a3baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.110930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3114d-bf17-426d-ad12-5af5d22a3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.111393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3114d-bf17-426d-ad12-5af5d22a3baf admin admin] PATH_INFO: `/v3/projects/1c0d78de6bf94770aea43aacc39e20a0/users/52548f4c7e7d46268ac0117086f6caf5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.132493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3114d-bf17-426d-ad12-5af5d22a3baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0d78de6bf94770aea43aacc39e20a0, user_id=52548f4c7e7d46268ac0117086f6caf5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.137930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3114d-bf17-426d-ad12-5af5d22a3baf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.174428 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3051/6134] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:21 2022] PUT /identity/v3/projects/1c0d78de6bf94770aea43aacc39e20a0/users/52548f4c7e7d46268ac0117086f6caf5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:21.185558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.185855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.186187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.225672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] MFA Rules not processed for user `52548f4c7e7d46268ac0117086f6caf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:21.225672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:21.251656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a283c92-44ae-48e7-a0b3-ba633d3c94e3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.306156 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:21.337012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3052/6135] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:21.351654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.353231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:21.386376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c2274-c05c-4930-9c4d-dc9e83ef0812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.387385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c2274-c05c-4930-9c4d-dc9e83ef0812 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.387742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c2274-c05c-4930-9c4d-dc9e83ef0812 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.388071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c2274-c05c-4930-9c4d-dc9e83ef0812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.437423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea41556-dfbb-4670-8aba-88b23d382331 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.441563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.442420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.442755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.443405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.455976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.457449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.468276 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3053/6136] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:21.480378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c2274-c05c-4930-9c4d-dc9e83ef0812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.482224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c2274-c05c-4930-9c4d-dc9e83ef0812 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.496875 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3084/6137] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:21.529298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:21.536939 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:21.672103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d167aa-eae0-43f2-9e48-f24308c93d8d service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:21.679620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:21.680503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.680786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.685238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] PATH_INFO: `/v3/users/52548f4c7e7d46268ac0117086f6caf5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.686795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=52548f4c7e7d46268ac0117086f6caf5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:21.688804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:21.843140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52548f4c7e7d46268ac0117086f6caf5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:21.862312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52548f4c7e7d46268ac0117086f6caf5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:21.873539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52548f4c7e7d46268ac0117086f6caf5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:21.886168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52548f4c7e7d46268ac0117086f6caf5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:21.897341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52548f4c7e7d46268ac0117086f6caf5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:21.907461 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3054/6138] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:21 2022] DELETE /identity/v3/users/52548f4c7e7d46268ac0117086f6caf5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:21.912435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:21.912956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:21.913063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:21.954279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:21.957430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:22.146880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3085/6139] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:22.172190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:22.174453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:22.302375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71445a-dbda-4270-93fc-e5457ebbdabc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:22.311804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:22.313666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:22.314058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:22.314338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:22.326850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:22.328608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:22.341677 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3055/6140] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:22.780784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:22.841215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce274c6-6ace-4568-8e07-67bdc3ad062f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:22.862093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:22.868896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:22.869217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:22.869504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:22.873153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:22.917551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:22.921221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:22.969212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3086/6141] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:23.449998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:23.452146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:23.473861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7cf3-f167-4922-b18b-f5d5d6d4b83a service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:23.491691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:23.494047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:23.495758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:23.496206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] PATH_INFO: `/v3/projects/1c0d78de6bf94770aea43aacc39e20a0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:23.499194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0d78de6bf94770aea43aacc39e20a0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:23.504694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:23.567549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:23.569442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:23.582963 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:23.677655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0d78de6bf94770aea43aacc39e20a0', 'request_id': 'req-53ebcdc6-0aa1-4828-9116-1d318d7e7203'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:23.695709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0d78de6bf94770aea43aacc39e20a0', 'request_id': 'req-53ebcdc6-0aa1-4828-9116-1d318d7e7203'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:23.719565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0d78de6bf94770aea43aacc39e20a0', 'request_id': 'req-53ebcdc6-0aa1-4828-9116-1d318d7e7203'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:23.739343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] The token cache is being invalidate because project 1c0d78de6bf94770aea43aacc39e20a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:23.739779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:23.741338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53ebcdc6-0aa1-4828-9116-1d318d7e7203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:23.749074 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3056/6142] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:23 2022] DELETE /identity/v3/projects/1c0d78de6bf94770aea43aacc39e20a0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:23.749720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4008-32ec-4a50-ab70-5c5b7cebe79a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:23.751507 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:23.752994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4008-32ec-4a50-ab70-5c5b7cebe79a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:23.753376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4008-32ec-4a50-ab70-5c5b7cebe79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:23.812380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fc1f4008-32ec-4a50-ab70-5c5b7cebe79a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:23.813764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fc1f4008-32ec-4a50-ab70-5c5b7cebe79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:23.840343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa39-79a5-40f8-bcf9-4ff2c703957c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:23.978078 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3057/6143] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:23.986119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:23.986524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:23.986894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.007641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.008389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.008856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.009295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.012161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:24.014048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:24.015002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:24.026839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3058/6144] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:24.031534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.037126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.039288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.041351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b509-206d-4cbf-bb89-ac0068d766b3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.054873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.055849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.056383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.056668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.058309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:24.058775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.060857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.083176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3059/6145] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:11:24.086162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.087431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3087/6146] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:24.118977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a52f-3825-49b0-80eb-5b1eee884d38 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.134113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.134833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.135122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.135400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.139101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.141727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.178695 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3060/6147] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:24 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:24.182680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.204613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf63e4-7129-47bd-a812-b844ff33ff68 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.341123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.341824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.342110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.344967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.345768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.354935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.396861 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3088/6148] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:24 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:24.401098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.415371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05fd66-8081-4e6d-b11d-ebf83284f31f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.423060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.424137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.424500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.425111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.425658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.427563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.442396 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3061/6149] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:24.445827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.457174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758a01-3610-4836-b884-eb2716211ca5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.472763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1000-d510-4931-bf95-ec0a88193e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.473793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1000-d510-4931-bf95-ec0a88193e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.474235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1000-d510-4931-bf95-ec0a88193e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.474788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1000-d510-4931-bf95-ec0a88193e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.475613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1000-d510-4931-bf95-ec0a88193e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.477342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1000-d510-4931-bf95-ec0a88193e8a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.490042 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3089/6150] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:24.494313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.506285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fc8f8-f686-40ec-9078-b8e1b6831127 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.511331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.512300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.512654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.513041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] PATH_INFO: `/v3/projects/be7788789c834ed68d3ee056e7f0fd8b/users/9dcd1fafd49047e9b321a7a61f6b07a7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.538950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7788789c834ed68d3ee056e7f0fd8b, user_id=9dcd1fafd49047e9b321a7a61f6b07a7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.542983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.579357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3062/6151] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:24 2022] PUT /identity/v3/projects/be7788789c834ed68d3ee056e7f0fd8b/users/9dcd1fafd49047e9b321a7a61f6b07a7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:24.581360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.581578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.581869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.616686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] MFA Rules not processed for user `9dcd1fafd49047e9b321a7a61f6b07a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:24.618365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:24.693022 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:24.709699 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3090/6152] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:24.718150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:24.720357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:24.773295 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:24.816810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63c00-172f-4696-a6d3-d4d2b1a076e2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:24.839526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d15183-71f6-44fa-8063-14f94efe0450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:24.840592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15183-71f6-44fa-8063-14f94efe0450 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:24.841036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15183-71f6-44fa-8063-14f94efe0450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:24.841581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15183-71f6-44fa-8063-14f94efe0450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:24.874750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d15183-71f6-44fa-8063-14f94efe0450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:24.876407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d15183-71f6-44fa-8063-14f94efe0450 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:24.896965 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3063/6153] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:25.658391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:25.659973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:25.758319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8156-de6e-4fd8-bbfc-98cafd651063 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:25.764557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:25.765756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:25.766373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:25.767050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] PATH_INFO: `/v3/users/7be53f839e9c433c8cba00040420f003` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:25.768567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be53f839e9c433c8cba00040420f003)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:25.771172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:25.856269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be53f839e9c433c8cba00040420f003'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:25.857749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be53f839e9c433c8cba00040420f003'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:25.877468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be53f839e9c433c8cba00040420f003'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:25.878594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be53f839e9c433c8cba00040420f003'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:25.891761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be53f839e9c433c8cba00040420f003'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:25.919653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3091/6154] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:25 2022] DELETE /identity/v3/users/7be53f839e9c433c8cba00040420f003 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:25.926575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:25.927115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:25.927533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:25.952230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:25.954720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:26.129394 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3064/6155] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:26.145937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:26.147712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:26.250945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2c33-12bd-462e-a365-4f75a34224b2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:26.255207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56434d3-f41e-4f04-9b95-4b76698a624c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:26.255920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56434d3-f41e-4f04-9b95-4b76698a624c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:26.256346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56434d3-f41e-4f04-9b95-4b76698a624c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:26.256633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56434d3-f41e-4f04-9b95-4b76698a624c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:26.284015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56434d3-f41e-4f04-9b95-4b76698a624c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:26.286526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56434d3-f41e-4f04-9b95-4b76698a624c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:26.310197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3092/6156] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:26.660463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:26.661972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:26.696294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127654-19f6-4c42-b580-baf9030b586c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:26.717442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:26.718392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:26.718660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:26.718930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] PATH_INFO: `/v3/projects/9c4c14ef970b47af9106e224ff5e8282` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:26.720266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4c14ef970b47af9106e224ff5e8282)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:26.724858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:26.799278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4c14ef970b47af9106e224ff5e8282', 'request_id': 'req-4d066cc2-1909-4673-a8d2-3c43157868cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:26.805488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4c14ef970b47af9106e224ff5e8282', 'request_id': 'req-4d066cc2-1909-4673-a8d2-3c43157868cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:26.815932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4c14ef970b47af9106e224ff5e8282', 'request_id': 'req-4d066cc2-1909-4673-a8d2-3c43157868cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:26.835914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] The token cache is being invalidate because project 9c4c14ef970b47af9106e224ff5e8282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:26.836220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:26.839681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4d066cc2-1909-4673-a8d2-3c43157868cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:26.841626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3065/6157] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:26 2022] DELETE /identity/v3/projects/9c4c14ef970b47af9106e224ff5e8282 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:26.846672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:26.847739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:26.848298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:26.878183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:26.881070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:26.895956 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:26.987347 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3093/6158] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:27.088235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.088787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.088787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.112608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:27.113857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:27.123670 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3066/6159] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:27.128601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.141234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa73bfd-d52e-4909-b952-a8d1edc37e5c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:27.148143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:27.149057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.149442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.150077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.151069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:27.151539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:27.154555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:27.174645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.184859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e28f9e-7669-4dc3-98f3-15f1944b1862 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:27.185649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3094/6160] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:27.192217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:27.193286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.193830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.194355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.195384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:27.197914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:27.245022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.255502 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3067/6161] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:27 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:27.258250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484eae-7fd0-41aa-a924-17f7916ed609 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:27.350340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:27.351179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.351572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.351951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.352902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:27.355520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:27.392699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.393423 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3095/6162] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:27 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:27.407804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5927-d51f-4954-8e34-34fb4400160a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:27.414080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:27.415541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.417468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.418017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.418973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:27.421092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:27.436649 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3068/6163] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:27.440635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.456918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde095-7747-4ee9-a7e9-f0cc59c28b9a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:27.485460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4634-de60-4f21-b366-42e9adf0b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:27.486614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4634-de60-4f21-b366-42e9adf0b1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.487115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4634-de60-4f21-b366-42e9adf0b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.488686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4634-de60-4f21-b366-42e9adf0b1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.490804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4634-de60-4f21-b366-42e9adf0b1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:27.493336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4634-de60-4f21-b366-42e9adf0b1e4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:27.509887 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3096/6164] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:27.513884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.529758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbef50-a7d5-4216-9700-b4e0aa406b3f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:27.539197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:27.540116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.540404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.540685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] PATH_INFO: `/v3/projects/997d470fa4dd42c8b33cde781b79c671/users/f50b2f0c013345538d505d35cdcb5797/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.564461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997d470fa4dd42c8b33cde781b79c671, user_id=f50b2f0c013345538d505d35cdcb5797, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:27.568998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:27.572330 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:27.640198 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3069/6165] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:27 2022] PUT /identity/v3/projects/997d470fa4dd42c8b33cde781b79c671/users/f50b2f0c013345538d505d35cdcb5797/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:27.657354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:27.657598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:27.657853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:27.750795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] MFA Rules not processed for user `f50b2f0c013345538d505d35cdcb5797`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:27.752280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:27.899539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3097/6166] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:27.914064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:27.916116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:28.095490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d46710-bc55-40e8-9dfc-609cabe68a43 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:28.116109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c78e63-22e5-45b0-bd1d-263ea7f5699c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:28.117725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c78e63-22e5-45b0-bd1d-263ea7f5699c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:28.118266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c78e63-22e5-45b0-bd1d-263ea7f5699c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:28.118798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c78e63-22e5-45b0-bd1d-263ea7f5699c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:28.139304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c78e63-22e5-45b0-bd1d-263ea7f5699c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:28.144349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c78e63-22e5-45b0-bd1d-263ea7f5699c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:28.181918 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3070/6167] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:28.275704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:28.309591 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:28.443442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012f4bb-e09e-4b2e-a286-bee22338efae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:28.452595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:28.453912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:28.454568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:28.455134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] PATH_INFO: `/v3/users/f50b2f0c013345538d505d35cdcb5797` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:28.457212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50b2f0c013345538d505d35cdcb5797)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:28.459598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:28.565157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50b2f0c013345538d505d35cdcb5797'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:28.568033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50b2f0c013345538d505d35cdcb5797'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:28.607692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50b2f0c013345538d505d35cdcb5797'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:28.609727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50b2f0c013345538d505d35cdcb5797'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:28.643240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50b2f0c013345538d505d35cdcb5797'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:28.678194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:28.678367 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3098/6168] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:28 2022] DELETE /identity/v3/users/f50b2f0c013345538d505d35cdcb5797 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:28.678467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:28.678712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:28.729489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:28.731600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:28.849005 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3071/6169] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:28.875684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:28.878041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:29.019148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f36be-7073-4346-a263-da5cc00a9deb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:29.030293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd94e9-5a89-4831-9bd3-e9511e0eeaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:29.031664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd94e9-5a89-4831-9bd3-e9511e0eeaed service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:29.031949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd94e9-5a89-4831-9bd3-e9511e0eeaed service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:29.032228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd94e9-5a89-4831-9bd3-e9511e0eeaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:29.055373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd94e9-5a89-4831-9bd3-e9511e0eeaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:29.056829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd94e9-5a89-4831-9bd3-e9511e0eeaed service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:29.097232 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3099/6170] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:30.132093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:30.134910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:30.153215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0f12-e00d-450c-9fa2-9b3715e71244 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:30.163270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:30.164947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.165457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.166638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] PATH_INFO: `/v3/projects/997d470fa4dd42c8b33cde781b79c671` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.168737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997d470fa4dd42c8b33cde781b79c671)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:30.173167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:30.266416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997d470fa4dd42c8b33cde781b79c671', 'request_id': 'req-07685b9c-eb01-4bfc-a07f-b644c4387884'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:30.275651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997d470fa4dd42c8b33cde781b79c671', 'request_id': 'req-07685b9c-eb01-4bfc-a07f-b644c4387884'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:30.291296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997d470fa4dd42c8b33cde781b79c671', 'request_id': 'req-07685b9c-eb01-4bfc-a07f-b644c4387884'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:30.307977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] The token cache is being invalidate because project 997d470fa4dd42c8b33cde781b79c671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:30.308762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:30.309951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-07685b9c-eb01-4bfc-a07f-b644c4387884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:30.311974 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3072/6171] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:30 2022] DELETE /identity/v3/projects/997d470fa4dd42c8b33cde781b79c671 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:30.317098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.317988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.318555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.341940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:30.344145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:30.378612 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:30.432163 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3100/6172] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:30.440149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.440496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.440785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.469480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:30.470769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:30.483831 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3073/6173] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:30.489014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:30.500765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006f91-7c05-4011-a9da-a531e3b20be5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:30.506154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:30.507361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.508108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.508768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.509893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:30.510853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:30.512942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:30.534299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3101/6174] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:30.535096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:30.550585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9517191-6fea-48fd-8e65-77f672fdb0aa None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:30.567395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:30.568104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.568551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.568834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.570013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:30.573815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:30.588554 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:30.637413 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3074/6175] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:30 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:30.642468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:30.659320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5632fd-f75d-4916-9475-eeed0666d508 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:30.757672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:30.759236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.759946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.760511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.762936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:30.767275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:30.833036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3102/6176] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:30 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:30.837766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:30.888605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbe3d0-9f89-4f1a-b21e-3d54c1c24c03 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:30.903147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:30.904110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:30.904457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:30.904747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:30.905597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:30.910991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:30.959468 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3075/6177] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:30.964213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:31.001646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f83d24-acd3-4beb-a959-544836b877a0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:31.016816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334305a2-31e3-4bca-9e1a-71fdfd05f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:31.019185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334305a2-31e3-4bca-9e1a-71fdfd05f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:31.022760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334305a2-31e3-4bca-9e1a-71fdfd05f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:31.024321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334305a2-31e3-4bca-9e1a-71fdfd05f1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:31.026141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334305a2-31e3-4bca-9e1a-71fdfd05f1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:31.028533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334305a2-31e3-4bca-9e1a-71fdfd05f1bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:31.082405 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3103/6178] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:31.101265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:31.151482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b44ca-d882-4525-8d1a-75a899701a26 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:31.181513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:31.192696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:31.193023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:31.195668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] PATH_INFO: `/v3/projects/ba48f2abb72d424aa0faf72685ba95e2/users/2f2b5180ca344fe39ee19513554a6e88/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:31.263038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba48f2abb72d424aa0faf72685ba95e2, user_id=2f2b5180ca344fe39ee19513554a6e88, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:31.279564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:31.333857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3076/6179] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:31 2022] PUT /identity/v3/projects/ba48f2abb72d424aa0faf72685ba95e2/users/2f2b5180ca344fe39ee19513554a6e88/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:31.350647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:31.351748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:31.352668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:31.419338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] MFA Rules not processed for user `2f2b5180ca344fe39ee19513554a6e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:31.422542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:31.685337 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3104/6180] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:31.691430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:31.902022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1c25b-d789-4865-861c-fc756e04aa82 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:31.935293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:31.936156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:31.936480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:31.936897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:31.937718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:31.940947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:32.020518 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3077/6181] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:31 2022] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:32.021653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:32.036808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5bda-0343-45ad-a64b-95a57d69a29e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:32.145326 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:32.285435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:32.286543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:32.288187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:32.288574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:32.291027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:32.294056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:32.363038 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3105/6182] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:32 2022] POST /identity/v3/users => generated 299 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:32.364332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:32.380825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072d6d-edc4-4de3-a248-32af4fbdb84e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:32.395381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:32.404782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:32.425629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:32.426360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:32.426717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:32.428028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:32.429988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:32.444318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:32.450240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f5eb-4822-44b1-8a65-706688deb52a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:32.471687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:32.472895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:32.476009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:32.477266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] PATH_INFO: `/v3/users/2e2d79ddf36e4dcba5418a7920e1a763` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:32.479169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2d79ddf36e4dcba5418a7920e1a763)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:32.480741 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3078/6183] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:32.485254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:32.486579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:32.518830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5ef00-6b3a-40c3-ba6f-fe868209533f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:32.529811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:32.530844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:32.531166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:32.531455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] PATH_INFO: `/v3/projects/0f7612d806594748ad704d3d66b0b453/users/b24b8800de0a441a808d492d43285756/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:32.589038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7612d806594748ad704d3d66b0b453, user_id=b24b8800de0a441a808d492d43285756, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:32.592117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:32.618964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3079/6184] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:32 2022] PUT /identity/v3/projects/0f7612d806594748ad704d3d66b0b453/users/b24b8800de0a441a808d492d43285756/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:32.623869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:32.715122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2d79ddf36e4dcba5418a7920e1a763'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:32.716063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2d79ddf36e4dcba5418a7920e1a763'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:32.762381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2d79ddf36e4dcba5418a7920e1a763'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:32.765948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2d79ddf36e4dcba5418a7920e1a763'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:32.799406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ff5900a6-0882-49fa-9d5a-10f262568cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2d79ddf36e4dcba5418a7920e1a763'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:32.840873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7941e-2958-4a9e-bc33-20f59b1ab777 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:32.841144 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3106/6185] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:32 2022] DELETE /identity/v3/users/2e2d79ddf36e4dcba5418a7920e1a763 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:32.846508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:32.847098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:32.847511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:32.856718 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:32.910602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:32.923970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:32.991186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:32.992121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:32.992618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:32.993067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:32.994017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:32.996209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:33.031044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3080/6186] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:33.035187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:33.037318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:33.078200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcff12-b005-46ea-b291-726217f2a986 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:33.094192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b3a2f-e94a-45d9-b9c1-51e5dd396266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:33.095421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b3a2f-e94a-45d9-b9c1-51e5dd396266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.095868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b3a2f-e94a-45d9-b9c1-51e5dd396266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.096432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b3a2f-e94a-45d9-b9c1-51e5dd396266 admin admin] PATH_INFO: `/v3/projects/0f7612d806594748ad704d3d66b0b453/users/b24b8800de0a441a808d492d43285756/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.106781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b3a2f-e94a-45d9-b9c1-51e5dd396266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7612d806594748ad704d3d66b0b453, user_id=b24b8800de0a441a808d492d43285756, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:33.112911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b3a2f-e94a-45d9-b9c1-51e5dd396266 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:33.142981 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3081/6187] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:33 2022] PUT /identity/v3/projects/0f7612d806594748ad704d3d66b0b453/users/b24b8800de0a441a808d492d43285756/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:33.163265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.163874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.164573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.228646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] MFA Rules not processed for user `b24b8800de0a441a808d492d43285756`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:33.230795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:33.260965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3107/6188] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:33.299088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:33.302899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:33.363048 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3082/6189] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:33.377560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:33.381877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:33.388169 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:33.435909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4b70e-ae9e-4d55-9874-1ac587981e76 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:33.476605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da69c-5482-4284-a14a-4f727bfa2457 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:33.486447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:33.488144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.488766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.489518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.502871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:33.505338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:33.527106 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3083/6190] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:33.528486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:33.530175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:33.568575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:33.570555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.571008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.571804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.572508 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:33.641147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c724-d353-40fa-8ced-f93e58c6484c service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:33.652277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:33.653314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.653706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.654140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] PATH_INFO: `/v3/users/97c3457aa35546e79c885aa76934ba6b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.656904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c3457aa35546e79c885aa76934ba6b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:33.660610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:33.768447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:33.773304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:33.791373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c3457aa35546e79c885aa76934ba6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:33.825680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3108/6191] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:33.829614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:33.851971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c3457aa35546e79c885aa76934ba6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:33.861436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbcdba-026f-4c5e-bdc6-30af48badb6e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:33.877777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c3457aa35546e79c885aa76934ba6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:33.886853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:33.891493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.892353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.893781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] PATH_INFO: `/v3/users/2f2b5180ca344fe39ee19513554a6e88` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.900352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2b5180ca344fe39ee19513554a6e88)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:33.903516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:33.910218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c3457aa35546e79c885aa76934ba6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:33.911045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-323e8fd3-4683-4e7c-92ad-9b25912be78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c3457aa35546e79c885aa76934ba6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:33.925883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3084/6192] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:33 2022] DELETE /identity/v3/users/97c3457aa35546e79c885aa76934ba6b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:33.927704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:33.927994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:33.928283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:33.968509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:33.970051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.018283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2b5180ca344fe39ee19513554a6e88'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.021365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2b5180ca344fe39ee19513554a6e88'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.076314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2b5180ca344fe39ee19513554a6e88'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.080210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2b5180ca344fe39ee19513554a6e88'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.103789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0241cbe-2968-437c-996d-f4264e5fcf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2b5180ca344fe39ee19513554a6e88'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.158545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3109/6193] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:33 2022] DELETE /identity/v3/users/2f2b5180ca344fe39ee19513554a6e88 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:34.169262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.169602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.169835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.194288 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3085/6194] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:34.205670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.208709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.216086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:34.219066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.227006 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:34.312930 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:34.338103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eec4e-95bd-4823-bb04-44bcfafe3e79 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.421916 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3110/6195] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:34.423755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.433055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.460985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918525-494d-4d7e-82fd-501b7c4319fb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.470070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.471709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.471920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.472473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] PATH_INFO: `/v3/projects/a0b84f50fa9c45dc8d34f881b97efac5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.473922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b84f50fa9c45dc8d34f881b97efac5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.476412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:34.517346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.518169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.518445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.518768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.531228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.532678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:34.554623 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3086/6196] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:34.555620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.558700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b84f50fa9c45dc8d34f881b97efac5', 'request_id': 'req-aa3b6219-c96f-4e50-908f-d5e3afd068a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.578278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70918a5-dcec-47a3-9071-115faef3acbc service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.582842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b84f50fa9c45dc8d34f881b97efac5', 'request_id': 'req-aa3b6219-c96f-4e50-908f-d5e3afd068a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.591612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b84f50fa9c45dc8d34f881b97efac5', 'request_id': 'req-aa3b6219-c96f-4e50-908f-d5e3afd068a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.624796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] The token cache is being invalidate because project a0b84f50fa9c45dc8d34f881b97efac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:34.626377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.637357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa3b6219-c96f-4e50-908f-d5e3afd068a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:34.637357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3111/6197] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:34 2022] DELETE /identity/v3/projects/a0b84f50fa9c45dc8d34f881b97efac5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:34.642074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518701c-c16e-487c-8bc7-5e7a5115c1b2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.642614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518701c-c16e-487c-8bc7-5e7a5115c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.643939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518701c-c16e-487c-8bc7-5e7a5115c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.675671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e518701c-c16e-487c-8bc7-5e7a5115c1b2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:34.677643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e518701c-c16e-487c-8bc7-5e7a5115c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.723255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.725020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.726769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.727869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.732640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.800894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3112/6198] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:34.804750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.805048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.805337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.849397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:34.853065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:34.861927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.863714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:34.878476 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3087/6200] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:34.878698 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3113/6200] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:34.880678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.910721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715625-e99c-4f44-8145-c2f1c60e88b9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.922971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.923655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.923954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.924248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.925436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:34.925754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.927653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:34.949876 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3088/6201] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:34.954172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:34.968375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad99ac-6bd6-4255-af22-ac5ec8a1a009 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:34.979210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:34.980127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:34.980472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:34.980760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:34.981479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:34.986061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.001221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.003022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.029580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86d99-5d6e-40c7-b0a9-9c464af4a15a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.041832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.042878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.043119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.043414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] PATH_INFO: `/v3/projects/9b79eb0c0fcb477ca345b010c1403b45` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.045165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b79eb0c0fcb477ca345b010c1403b45)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.048248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.069981 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3114/6202] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:34 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:35.074319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.088780 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:35.169939 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:35.188448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b79eb0c0fcb477ca345b010c1403b45', 'request_id': 'req-156a7551-6314-4395-b098-b613dc9f4acb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.196576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b79eb0c0fcb477ca345b010c1403b45', 'request_id': 'req-156a7551-6314-4395-b098-b613dc9f4acb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.211038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b79eb0c0fcb477ca345b010c1403b45', 'request_id': 'req-156a7551-6314-4395-b098-b613dc9f4acb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.228622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] The token cache is being invalidate because project 9b79eb0c0fcb477ca345b010c1403b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:35.229072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.231374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-156a7551-6314-4395-b098-b613dc9f4acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.239281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3089/6203] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:35 2022] DELETE /identity/v3/projects/9b79eb0c0fcb477ca345b010c1403b45 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:35.244802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.245101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.245388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.267755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:35.269178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.281645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367c21-cdfa-43df-a287-1fdd600a9879 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.424677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f25e30-fdef-419e-8dd6-aa6e3414b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.425474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f25e30-fdef-419e-8dd6-aa6e3414b20c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.425772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f25e30-fdef-419e-8dd6-aa6e3414b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.426056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f25e30-fdef-419e-8dd6-aa6e3414b20c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.427422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f25e30-fdef-419e-8dd6-aa6e3414b20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.430136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f25e30-fdef-419e-8dd6-aa6e3414b20c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.472200 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3090/6204] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:35.472462 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3115/6205] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:35 2022] POST /identity/v3/users => generated 284 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:35.484003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.485653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.486757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.486757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.489519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.528355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312c112-0032-4bee-a7c4-f2dfd06803c5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.555930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:35.557078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.567291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.570802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.571736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.572039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.572911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.575718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.578782 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3116/6206] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:35.582975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.599878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6801cc-a5a3-49fe-8b36-56b93aec694c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.601140 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3091/6207] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:35.602225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.605875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.615835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.616528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.616819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.617134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.618112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:35.618893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.620320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.633483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c2fc-a0f6-4307-b71a-2be3a1854e5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.643252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.644451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.645119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.645482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] PATH_INFO: `/v3/projects/ba48f2abb72d424aa0faf72685ba95e2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.647963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba48f2abb72d424aa0faf72685ba95e2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.651486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.669970 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3117/6208] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:35.670890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.694351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31de12-e74c-43c3-bfb1-50effccb0df1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.712835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.713532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.713926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.714225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.715882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.717773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.741692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3118/6209] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:35.742552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.758377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba48f2abb72d424aa0faf72685ba95e2', 'request_id': 'req-a902594c-5cd0-4e3b-bffe-4401d8948155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.768084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba48f2abb72d424aa0faf72685ba95e2', 'request_id': 'req-a902594c-5cd0-4e3b-bffe-4401d8948155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.771915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db324-dae1-4f40-a807-c8f47a304365 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.780464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba48f2abb72d424aa0faf72685ba95e2', 'request_id': 'req-a902594c-5cd0-4e3b-bffe-4401d8948155'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.805587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] The token cache is being invalidate because project ba48f2abb72d424aa0faf72685ba95e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:35.805894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.806877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:35.809099 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3092/6210] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:35 2022] DELETE /identity/v3/projects/ba48f2abb72d424aa0faf72685ba95e2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:35.811174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.814817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:35.927206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.927464 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:35.927883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.928166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.928968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.929108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:35.931045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:35.962769 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:35.978041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902594c-5cd0-4e3b-bffe-4401d8948155 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:35.989230 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3119/6211] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:35 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:35.990733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:35.992062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:35.993816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:35.994634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:35.995087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] PATH_INFO: `/v3/projects/5efa5fe6cc304eb19dd8863ea2b10266/users/b0416602e28a4b2abd318c9b94db1d39/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:35.995620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:36.037381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efa5fe6cc304eb19dd8863ea2b10266, user_id=b0416602e28a4b2abd318c9b94db1d39, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.040270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.090690 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3093/6212] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:35 2022] PUT /identity/v3/projects/5efa5fe6cc304eb19dd8863ea2b10266/users/b0416602e28a4b2abd318c9b94db1d39/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:36.092061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:36.094967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:36.129411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13b71-13e0-4813-a120-0fd6d478cbae admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:36.212095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033149-705a-4791-bac2-7ba29d41ce1c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:36.222195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4596d9f-7db9-4f36-93cb-3041d6c10398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:36.223789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596d9f-7db9-4f36-93cb-3041d6c10398 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.223789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596d9f-7db9-4f36-93cb-3041d6c10398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.223789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596d9f-7db9-4f36-93cb-3041d6c10398 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.225263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4596d9f-7db9-4f36-93cb-3041d6c10398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.228652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4596d9f-7db9-4f36-93cb-3041d6c10398 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.259140 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3094/6213] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:36 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:36.260684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.260987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.261324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.265601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:36.266487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.266811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.267091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] PATH_INFO: `/v3/users/b24b8800de0a441a808d492d43285756` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.268440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24b8800de0a441a808d492d43285756)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.270464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.306257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] MFA Rules not processed for user `b0416602e28a4b2abd318c9b94db1d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:36.308245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:36.349509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24b8800de0a441a808d492d43285756'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:36.350349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24b8800de0a441a808d492d43285756'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:36.366761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24b8800de0a441a808d492d43285756'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:36.369674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24b8800de0a441a808d492d43285756'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:36.382786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24b8800de0a441a808d492d43285756'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:36.417419 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3120/6214] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:35 2022] DELETE /identity/v3/users/b24b8800de0a441a808d492d43285756 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:36.420825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:36.423136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:36.473425 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:36.490130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3095/6215] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:36.518185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:36.520627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:36.590427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67fa6-a97f-47ba-9aaa-749ca22f439c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:36.606333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:36.607947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.608878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.609420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.611697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.618471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.629962 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:36.650779 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3121/6216] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:36.652440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:36.657019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a806c7-915d-4df0-ab88-959dc5681bf7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:36.689959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284e96-ccac-498a-89e0-ac144f100ab4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:36.698759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:36.699586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.699977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.700362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.702841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.705271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.761332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3122/6217] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:36.766580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:36.784739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:36.785463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.786125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.787665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.795309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9266ff-951e-49f3-a03e-3742345d1715 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:36.811046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3e791-2cd3-48c0-af0b-b4a3596a67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:36.813143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e791-2cd3-48c0-af0b-b4a3596a67b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.813540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e791-2cd3-48c0-af0b-b4a3596a67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.813924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e791-2cd3-48c0-af0b-b4a3596a67b3 admin admin] PATH_INFO: `/v3/projects/4aaa9612ddfa4fbb91486bb3594006c5/users/1f61ab3fa75f437b8df5af9c8769a7f9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.862731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3e791-2cd3-48c0-af0b-b4a3596a67b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaa9612ddfa4fbb91486bb3594006c5, user_id=1f61ab3fa75f437b8df5af9c8769a7f9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.869688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3e791-2cd3-48c0-af0b-b4a3596a67b3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.913781 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3123/6218] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:36 2022] PUT /identity/v3/projects/4aaa9612ddfa4fbb91486bb3594006c5/users/1f61ab3fa75f437b8df5af9c8769a7f9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:36.918844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:36.919492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:36.919923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:36.949973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:36.967860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:36.985228 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3096/6219] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:36.986321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:36.987827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:36.991430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:36.992684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:37.044706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2989b-e3f8-4422-bf26-0cce82b93ee4 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:37.130711 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3124/6220] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:37.157799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:37.198068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:37.198609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.201325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.201592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] PATH_INFO: `/v3/projects/0f7612d806594748ad704d3d66b0b453` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.205120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7612d806594748ad704d3d66b0b453)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:37.209176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:37.284974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e3a4-5424-43a7-b1a2-01488fb365a2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:37.321154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7612d806594748ad704d3d66b0b453', 'request_id': 'req-8c5ba149-5a62-4905-a04e-5a9781d56885'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:37.324431 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:37.335163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7612d806594748ad704d3d66b0b453', 'request_id': 'req-8c5ba149-5a62-4905-a04e-5a9781d56885'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:37.356996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7612d806594748ad704d3d66b0b453', 'request_id': 'req-8c5ba149-5a62-4905-a04e-5a9781d56885'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:37.375419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] The token cache is being invalidate because project 0f7612d806594748ad704d3d66b0b453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:37.375710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:37.381362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8c5ba149-5a62-4905-a04e-5a9781d56885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:37.383563 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:37.390249 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3097/6221] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:36 2022] DELETE /identity/v3/projects/0f7612d806594748ad704d3d66b0b453 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:37.392289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5242c5-1e5e-43d1-9a8a-262bd660f26d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.392591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5242c5-1e5e-43d1-9a8a-262bd660f26d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.392869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5242c5-1e5e-43d1-9a8a-262bd660f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.416926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:37.418810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.419105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.420657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.425740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:37.442605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9e5242c5-1e5e-43d1-9a8a-262bd660f26d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:37.443864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e5242c5-1e5e-43d1-9a8a-262bd660f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:37.585467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3098/6222] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:37.587282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.587693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.587987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.612875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:37.615408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:37.620147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:37.622536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:37.628360 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3099/6223] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:37.633622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:37.647604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f2d2-fe21-426e-b631-fe0121e803d1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:37.652934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:37.653280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.653542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.653815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.654716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:37.655053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:37.657212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:37.659403 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3125/6224] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:37.674789 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3100/6225] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:37.675753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:37.688429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346df0-c8de-4c9a-8000-c39c5e69367b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:37.698516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:37.699915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.700372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.700884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.702871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:37.706205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:37.757203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:37.767672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3126/6226] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:37 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:37.769560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e262-95ad-41fa-9cd2-5c960f7cf009 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:37.866839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:37.867897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.868349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.868819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.871226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:37.873532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:37.908861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3101/6227] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:37 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:37.914378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:37.931954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd638339-fc16-44a5-b586-11a133737d10 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:37.938294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:37.939067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:37.939352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:37.939649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:37.940413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:37.943664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:37.982025 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3127/6228] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:37.986615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:38.024362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af864-1d2b-4202-b8f9-fb6cc82b562d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:38.024362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af6a1-6f05-46ab-8ee7-669cb992b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:38.024362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af6a1-6f05-46ab-8ee7-669cb992b63e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:38.024362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af6a1-6f05-46ab-8ee7-669cb992b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:38.025160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af6a1-6f05-46ab-8ee7-669cb992b63e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:38.026162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07af6a1-6f05-46ab-8ee7-669cb992b63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:38.029182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07af6a1-6f05-46ab-8ee7-669cb992b63e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:38.065693 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3102/6229] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:38.070199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:38.085984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982261a-0a11-477d-9db3-984268aa3158 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:38.097408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:38.101047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:38.101047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:38.101047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] PATH_INFO: `/v3/projects/801801f46890414cab7e04e5f4d4c183/users/3c1d2d98a432425fa4945e28e27f0da9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:38.136732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801801f46890414cab7e04e5f4d4c183, user_id=3c1d2d98a432425fa4945e28e27f0da9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:38.141762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:38.184892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3128/6230] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:38 2022] PUT /identity/v3/projects/801801f46890414cab7e04e5f4d4c183/users/3c1d2d98a432425fa4945e28e27f0da9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:38.193334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:38.193637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:38.193925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:38.268219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] MFA Rules not processed for user `3c1d2d98a432425fa4945e28e27f0da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:38.279403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:38.393019 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:38.539906 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3103/6231] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:38.544833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:38.672876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663cf2-81a3-435c-939f-241439069f72 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:38.681859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:38.682928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:38.683463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:38.685360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:38.686266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:38.689481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:38.784163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:38.786770 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3129/6232] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:38 2022] POST /identity/v3/projects => generated 389 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:38.803529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf4d6-23fa-41ec-8da1-813502803b3d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:38.977318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:38.979285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:38.981080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:38.982415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:38.985597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:38.987808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:39.068793 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3104/6233] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:38 2022] POST /identity/v3/users => generated 301 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:39.070230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:39.118234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321656fb-ed5f-49b4-8d19-f6c51b34bae2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:39.139845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:39.143017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.146435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.148095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.148999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:39.153470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:39.196934 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3130/6234] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:39.198890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:39.214912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a45e20-b2bc-4b32-8775-0815e34f15bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:39.238906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:39.242376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.247187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.247187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] PATH_INFO: `/v3/projects/9aed72ae6fe8461ab2fc5010847ac7be/users/66338fcee1e546a381bf357a286db23d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.287541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aed72ae6fe8461ab2fc5010847ac7be, user_id=66338fcee1e546a381bf357a286db23d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:39.297382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:39.337715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3105/6235] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:39 2022] PUT /identity/v3/projects/9aed72ae6fe8461ab2fc5010847ac7be/users/66338fcee1e546a381bf357a286db23d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:39.341807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:39.376599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649ddb-981b-4b06-b15d-d24fb0920abc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:39.385618 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:39.536652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10fcae-2b70-4667-810b-1be7612437bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:39.537755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fcae-2b70-4667-810b-1be7612437bd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.538447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fcae-2b70-4667-810b-1be7612437bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.539070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fcae-2b70-4667-810b-1be7612437bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.540030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10fcae-2b70-4667-810b-1be7612437bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:39.542909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10fcae-2b70-4667-810b-1be7612437bd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:39.575741 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3131/6236] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:39.579099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:39.600391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cebc8-29d5-4446-9e29-a80c88ecd29a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:39.612030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914fb94-7fa4-43d7-8fe7-b6c94b927fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:39.613212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914fb94-7fa4-43d7-8fe7-b6c94b927fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.616506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914fb94-7fa4-43d7-8fe7-b6c94b927fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.618543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914fb94-7fa4-43d7-8fe7-b6c94b927fd1 admin admin] PATH_INFO: `/v3/projects/9aed72ae6fe8461ab2fc5010847ac7be/users/66338fcee1e546a381bf357a286db23d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.628588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914fb94-7fa4-43d7-8fe7-b6c94b927fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aed72ae6fe8461ab2fc5010847ac7be, user_id=66338fcee1e546a381bf357a286db23d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:39.641576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914fb94-7fa4-43d7-8fe7-b6c94b927fd1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:39.684599 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3106/6237] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:39 2022] PUT /identity/v3/projects/9aed72ae6fe8461ab2fc5010847ac7be/users/66338fcee1e546a381bf357a286db23d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:39.695168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.696060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.696810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.781838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] MFA Rules not processed for user `66338fcee1e546a381bf357a286db23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:39.786551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:39.850518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:39.851116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:39.855433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:39.902090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:39.903859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:40.006268 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3107/6238] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:40.018333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3132/6239] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:40.023645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:40.026976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:40.029208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:40.030998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:40.158201 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:40.191084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f05470-ff36-4193-8b11-bedbfec354ef None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:40.211008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:40.211692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.211978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.212258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:40.225945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:40.231666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:40.255369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3133/6240] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:40.334146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469c66-07ce-4889-a657-c36f7c861021 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:40.352841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7948a-7774-49f6-9454-e9ef492a19d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:40.359732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7948a-7774-49f6-9454-e9ef492a19d7 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.359909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7948a-7774-49f6-9454-e9ef492a19d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.360190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7948a-7774-49f6-9454-e9ef492a19d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:40.389123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7948a-7774-49f6-9454-e9ef492a19d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:40.390897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7948a-7774-49f6-9454-e9ef492a19d7 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:40.422795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3108/6241] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:11:40.514682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:40.598544 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:40.683962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6badec-7194-4d51-89e0-1e7be7d1fcc7 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:40.708575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:40.710891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.712942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.714336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] PATH_INFO: `/v3/users/3c1d2d98a432425fa4945e28e27f0da9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:40.717368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1d2d98a432425fa4945e28e27f0da9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:40.722814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:40.875861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1d2d98a432425fa4945e28e27f0da9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.876786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1d2d98a432425fa4945e28e27f0da9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.912071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1d2d98a432425fa4945e28e27f0da9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.914214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1d2d98a432425fa4945e28e27f0da9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.938730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1d2d98a432425fa4945e28e27f0da9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:40.983549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3134/6242] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:40 2022] DELETE /identity/v3/users/3c1d2d98a432425fa4945e28e27f0da9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:40.984874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:40.985349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:40.985464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.035935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:41.041574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:41.235814 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3109/6243] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:11:41.297028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:41.298953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:41.538247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606bee-5259-4f61-a574-f293dcb68ef2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:41.554308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:41.555048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:41.555338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:41.555619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:41.607736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:41.609248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:41.656424 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3135/6244] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:43.534176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:43.536241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:43.569440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a08e3c-75ff-45fb-916f-9588322fcd87 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:43.589671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:43.590591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:43.591110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:43.591409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] PATH_INFO: `/v3/projects/801801f46890414cab7e04e5f4d4c183` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:43.593330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801801f46890414cab7e04e5f4d4c183)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:43.595305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:43.817567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801801f46890414cab7e04e5f4d4c183', 'request_id': 'req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:43.850373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801801f46890414cab7e04e5f4d4c183', 'request_id': 'req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:43.895024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801801f46890414cab7e04e5f4d4c183', 'request_id': 'req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:43.939573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] The token cache is being invalidate because project 801801f46890414cab7e04e5f4d4c183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:43.943520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:43.946009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:43.957986 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3110/6245] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:43 2022] DELETE /identity/v3/projects/801801f46890414cab7e04e5f4d4c183 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:43.961832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:43.979304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e308d-dfec-45ba-b14c-e126f8cd064c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:44.127758 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:44.150832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:44.151945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:44.152071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:44.152344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] PATH_INFO: `/v3/users/66338fcee1e546a381bf357a286db23d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:44.156517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66338fcee1e546a381bf357a286db23d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:44.159221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:44.304000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66338fcee1e546a381bf357a286db23d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:44.304688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66338fcee1e546a381bf357a286db23d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:44.352082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66338fcee1e546a381bf357a286db23d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:44.352880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66338fcee1e546a381bf357a286db23d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:44.371169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd022381-780f-49d7-8a32-33bca12e4e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66338fcee1e546a381bf357a286db23d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:44.402885 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3136/6246] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:43 2022] DELETE /identity/v3/users/66338fcee1e546a381bf357a286db23d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:46.188298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:46.190132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:46.240574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deef7a-86ac-4ee9-8a2a-9c2d5c4750c9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:46.455767 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:46.520751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:46.521953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:46.522403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:46.522863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] PATH_INFO: `/v3/projects/9aed72ae6fe8461ab2fc5010847ac7be` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:46.533346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aed72ae6fe8461ab2fc5010847ac7be)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:46.535855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:46.661883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aed72ae6fe8461ab2fc5010847ac7be', 'request_id': 'req-2b444fc0-0b81-4997-864a-cab567f43408'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:46.684259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aed72ae6fe8461ab2fc5010847ac7be', 'request_id': 'req-2b444fc0-0b81-4997-864a-cab567f43408'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:46.712945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aed72ae6fe8461ab2fc5010847ac7be', 'request_id': 'req-2b444fc0-0b81-4997-864a-cab567f43408'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:46.740140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] The token cache is being invalidate because project 9aed72ae6fe8461ab2fc5010847ac7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:46.740693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:46.745459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b444fc0-0b81-4997-864a-cab567f43408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:46.749696 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3111/6247] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:46 2022] DELETE /identity/v3/projects/9aed72ae6fe8461ab2fc5010847ac7be => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:46.754581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:46.755460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:46.755912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:46.788676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:46.790203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:46.869025 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3137/6248] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:46.877240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:46.877795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:46.878265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:46.907190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:46.908719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:46.922115 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3112/6249] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:46.925542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:46.942479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bd689-d83f-4805-b6eb-00f0ea8bd298 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:46.949800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:46.951127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:46.952772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:46.953225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:46.954145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:46.954789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:46.956743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:46.974099 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3138/6250] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:46.978384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:46.997206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcc78d-9a1f-4ac0-9ab0-d910482fb517 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:47.010707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:47.011401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.011681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.011956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.012670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:47.014711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:47.076311 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3113/6251] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:46 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:47.077387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:47.095013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8311-8ef9-4e27-9737-a6350ae75dbb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:47.205718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:47.209383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.209691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.209975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.210736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:47.214768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:47.236506 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:47.270676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3139/6252] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:47 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:47.271855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:47.306382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f4b9f-e0f2-40fa-8cb7-ec737f437cc8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:47.325590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:47.329322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.329821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.330334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.332627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:47.340025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:47.370177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3114/6253] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:47.372790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:47.386534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301c72e-2497-4f6d-b48a-c8224a616af2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:47.400873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c42d-e3cd-4670-84aa-ed29496b995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:47.401904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c42d-e3cd-4670-84aa-ed29496b995c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.402354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c42d-e3cd-4670-84aa-ed29496b995c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.403631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c42d-e3cd-4670-84aa-ed29496b995c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.404576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c42d-e3cd-4670-84aa-ed29496b995c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:47.408454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c42d-e3cd-4670-84aa-ed29496b995c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:47.435591 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3140/6254] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:47.438722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:47.457582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093278bb-0cee-4f8b-9d9a-8e8968105452 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:47.469937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:47.473116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.473472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.473761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] PATH_INFO: `/v3/projects/4438fc4f91a84665bfb7b57643e2695f/users/793f2d74d9194d57abe256b460935ef7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.515935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4438fc4f91a84665bfb7b57643e2695f, user_id=793f2d74d9194d57abe256b460935ef7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:47.520250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:47.557059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3115/6255] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:47 2022] PUT /identity/v3/projects/4438fc4f91a84665bfb7b57643e2695f/users/793f2d74d9194d57abe256b460935ef7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:11:47.558941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:47.559239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:47.559518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:47.630766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] MFA Rules not processed for user `793f2d74d9194d57abe256b460935ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:47.638079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:47.861490 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3141/6256] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:47.862163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:48.054643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e818b35-352c-4f44-b3c8-3ad2bccd42c1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:48.067744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:48.070657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.072025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.072535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.073433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:48.077992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:48.126091 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:48.189619 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3116/6257] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:47 2022] POST /identity/v3/projects => generated 377 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:48.192553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:48.212641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd4151-56a9-4e0c-91b6-4e08355571e8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:48.446197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:48.450049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.450413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.450683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.451360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:48.458989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:48.569395 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3142/6258] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:48 2022] POST /identity/v3/users => generated 289 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:48.573034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:48.586581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01edce-467a-4888-a8f8-38bec7cf5e17 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:48.602772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:48.603934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.604606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.604891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.605629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:48.607904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:48.660632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:48.668249 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3117/6259] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:48.672691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e842-36b7-4a13-bf83-cc8da97b13ac admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:48.689644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcfa86-f3cc-4b52-a2e6-bd6c8c65f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:48.690336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcfa86-f3cc-4b52-a2e6-bd6c8c65f79d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.690654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcfa86-f3cc-4b52-a2e6-bd6c8c65f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.690927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcfa86-f3cc-4b52-a2e6-bd6c8c65f79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.691660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcfa86-f3cc-4b52-a2e6-bd6c8c65f79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:48.708328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcfa86-f3cc-4b52-a2e6-bd6c8c65f79d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:48.745523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3143/6260] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:48.749400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:48.761203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f88fa-96cd-44df-979d-101eae2456fd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:48.780708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:48.781648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.781998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.782282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] PATH_INFO: `/v3/projects/195f56c9ba9a495681f824ec0d1fd4e2/users/532a1da3fb04401bb72a3069ac3b25ed/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.828072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195f56c9ba9a495681f824ec0d1fd4e2, user_id=532a1da3fb04401bb72a3069ac3b25ed, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:48.836688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:48.901987 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3118/6261] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:48 2022] PUT /identity/v3/projects/195f56c9ba9a495681f824ec0d1fd4e2/users/532a1da3fb04401bb72a3069ac3b25ed/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:48.904291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:48.904806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:48.904927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:48.991689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] MFA Rules not processed for user `532a1da3fb04401bb72a3069ac3b25ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:49.000219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:49.124239 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:49.196016 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3144/6262] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:49.200530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:49.386221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c5f9-99cd-4940-9008-2e1cb1fd7d70 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:49.407916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:49.408939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:49.409225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:49.409683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:49.410673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:49.419900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:49.496149 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3119/6263] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:49 2022] POST /identity/v3/projects => generated 377 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:49.500599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:49.519732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b30033-2c58-47df-9ede-68129a90b396 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:49.785135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:49.785842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:49.786128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:49.786411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:49.789756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:49.796422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:49.857377 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3145/6264] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:49 2022] POST /identity/v3/users => generated 295 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:49.859868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:49.879838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1499d-cae4-405a-9170-5b0c298b5b17 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:49.894267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:49.895425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:49.895787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:49.896058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:49.901567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:49.907628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:49.945020 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3120/6265] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:49.946541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:49.965563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44145c3-021f-4f20-929d-d901ff96f494 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:49.979100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:49.980698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:49.980996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:49.981280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] PATH_INFO: `/v3/projects/da669e935b1349188595e729f3bd7744/users/e1c5e76b1154496a9d6626e770f09ac5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:50.033389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da669e935b1349188595e729f3bd7744, user_id=e1c5e76b1154496a9d6626e770f09ac5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:50.042944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:50.075223 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3146/6266] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:49 2022] PUT /identity/v3/projects/da669e935b1349188595e729f3bd7744/users/e1c5e76b1154496a9d6626e770f09ac5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:50.079965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:50.096257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225831-dd51-4895-89ba-9eb853b6bfc3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:50.379132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:50.381118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:50.402301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:50.406851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:50.407147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:50.407433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:50.408196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:50.409847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:50.451873 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3121/6267] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:50.457287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:50.485749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346effa-38e1-41b1-87a8-190245a21631 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:50.493333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d0424-eec0-45c7-9e6c-4afa2ce61c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:50.495830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0424-eec0-45c7-9e6c-4afa2ce61c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:50.496141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0424-eec0-45c7-9e6c-4afa2ce61c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:50.496430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0424-eec0-45c7-9e6c-4afa2ce61c58 admin admin] PATH_INFO: `/v3/projects/da669e935b1349188595e729f3bd7744/users/e1c5e76b1154496a9d6626e770f09ac5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:50.505342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d0424-eec0-45c7-9e6c-4afa2ce61c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da669e935b1349188595e729f3bd7744, user_id=e1c5e76b1154496a9d6626e770f09ac5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:50.508301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d0424-eec0-45c7-9e6c-4afa2ce61c58 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:50.531986 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3122/6268] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:50 2022] PUT /identity/v3/projects/da669e935b1349188595e729f3bd7744/users/e1c5e76b1154496a9d6626e770f09ac5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:50.551012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:50.551898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:50.552254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:50.597335 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:50.607298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880917af-bab3-495c-b5ec-a090e51ce642 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:50.615391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] MFA Rules not processed for user `e1c5e76b1154496a9d6626e770f09ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:50.618099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:50.702924 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:50.725487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:50.730747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:50.733902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:50.734439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] PATH_INFO: `/v3/users/05b9dd6363f546b995c1e01bbbaa8a31` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:50.736842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b9dd6363f546b995c1e01bbbaa8a31)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:50.739110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:50.834823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b9dd6363f546b995c1e01bbbaa8a31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:50.835908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b9dd6363f546b995c1e01bbbaa8a31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:50.861995 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3123/6269] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:50.868406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:50.870287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:50.874846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b9dd6363f546b995c1e01bbbaa8a31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:50.878169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b9dd6363f546b995c1e01bbbaa8a31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:50.912707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3e78e6c5-4a95-42af-9200-eee8f028dfd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b9dd6363f546b995c1e01bbbaa8a31'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:50.953366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3147/6270] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:50 2022] DELETE /identity/v3/users/05b9dd6363f546b995c1e01bbbaa8a31 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:50.958058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:50.958457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:50.958786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:50.991599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:50.992761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:51.116505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0440fc0-7417-428e-b012-7e509cbb74f0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:51.140466 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3148/6271] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:51.207813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:51.209583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:51.309858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:51.319350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:51.319641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:51.319942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:51.325765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:51.400112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5e8f1-d6cc-4846-89c5-346c242bb13e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:51.414565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:51.415666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:51.416080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:51.416511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:51.429225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:51.431011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:51.432875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:51.434442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:51.449431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3124/6272] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:51.459643 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3149/6273] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:51.539988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:51.541370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:51.548990 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:51.567216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8ae5-f9a0-4638-98b2-d874bb9cc06f service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:51.580890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:51.581601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:51.581892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:51.582172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:51.584122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:51.736857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:51.739221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a647f-7fc6-4dac-ab4f-d9312e6deddc service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:51.757519 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3125/6274] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:51.889344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:51.891576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:51.928016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7a6a-5d4e-40a0-ba26-ba1a9d32f4c2 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:51.951598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:51.952945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:51.954199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:51.958234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] PATH_INFO: `/v3/projects/86ea906ce0b34445b7f9263a7ff85dbc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:51.965940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ea906ce0b34445b7f9263a7ff85dbc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:51.971103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:52.016615 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:52.268710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ea906ce0b34445b7f9263a7ff85dbc', 'request_id': 'req-01f5a717-32bb-4e71-a60a-6059e20bc6fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:52.309279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ea906ce0b34445b7f9263a7ff85dbc', 'request_id': 'req-01f5a717-32bb-4e71-a60a-6059e20bc6fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:52.362545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ea906ce0b34445b7f9263a7ff85dbc', 'request_id': 'req-01f5a717-32bb-4e71-a60a-6059e20bc6fd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:52.430299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] The token cache is being invalidate because project 86ea906ce0b34445b7f9263a7ff85dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:52.437413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:52.444030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01f5a717-32bb-4e71-a60a-6059e20bc6fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:52.465363 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3150/6275] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:51 2022] DELETE /identity/v3/projects/86ea906ce0b34445b7f9263a7ff85dbc => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:52.470454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:52.471361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:52.471847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:52.546099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:52.547385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:53.050342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3126/6276] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:53.062429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:53.065401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:53.066313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:53.110114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:53.116778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:53.139788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:53.144593 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3151/6277] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:53.161920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716752d-52f8-4e02-8f40-343983d0783c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:53.187596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:53.191264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:53.191550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:53.191840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:53.197334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:53.197714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:53.208331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:53.256809 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3127/6278] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:11:53.257875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:53.269708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fefe14-2ab7-4d10-8189-24bd24fe103a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:53.295829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:53.299715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:53.300311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:53.300821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:53.302060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:53.310274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:53.426199 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3152/6279] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:53 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:53.430153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:53.445155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207c88-fcc1-4aa6-a72e-aafd02f37fe4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:53.707349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:53.708040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:53.711603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:53.712270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:53.712619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:53.724330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:53.791494 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3128/6280] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:53 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:53.792723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:53.811115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8b69-9bfe-4726-8a11-f3b9fa58691d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:53.831345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:53.832885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:53.833499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:53.834728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:53.837340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:53.843989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:53.898164 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3153/6281] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:53.901283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:53.923112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8b698-6483-4d39-8b65-b169fc10cb2a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:53.942421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88593e-fb9e-4720-80c6-c0c73ce51f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:53.943720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88593e-fb9e-4720-80c6-c0c73ce51f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:53.946637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88593e-fb9e-4720-80c6-c0c73ce51f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:53.947134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88593e-fb9e-4720-80c6-c0c73ce51f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:53.948201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88593e-fb9e-4720-80c6-c0c73ce51f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:53.950157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88593e-fb9e-4720-80c6-c0c73ce51f36 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:53.992339 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3129/6282] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:53.996275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:54.012383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f939af-da8e-4f91-8353-935aa32cdf73 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:54.027164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:54.028600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:54.030610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:54.033284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] PATH_INFO: `/v3/projects/1ab2842ba96f496b8acc8723d351c99a/users/a6b96e1ecb874ba8b347943f735f6939/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:54.093007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab2842ba96f496b8acc8723d351c99a, user_id=a6b96e1ecb874ba8b347943f735f6939, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:54.096105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:54.145740 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3154/6283] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:53 2022] PUT /identity/v3/projects/1ab2842ba96f496b8acc8723d351c99a/users/a6b96e1ecb874ba8b347943f735f6939/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:54.162624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:54.162933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:54.163210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:54.256742 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:54.274267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:54.277010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:54.327797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] MFA Rules not processed for user `a6b96e1ecb874ba8b347943f735f6939`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:54.333731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:54.558208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e478ee-684d-4b90-a7cd-7767e199eabe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:54.576993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:54.579096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:54.579619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:54.581309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:54.592892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:54.638757 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3130/6284] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:54.659025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:54.679657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091ccb4-1cd3-4d02-93c6-83e09091696a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:54.690886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c2b6-b27c-46f5-91a0-dd4aaef02eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:54.694209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c2b6-b27c-46f5-91a0-dd4aaef02eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:54.694556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c2b6-b27c-46f5-91a0-dd4aaef02eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:54.694864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c2b6-b27c-46f5-91a0-dd4aaef02eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:54.722959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c2b6-b27c-46f5-91a0-dd4aaef02eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:54.726763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c2b6-b27c-46f5-91a0-dd4aaef02eb2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:54.765314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3131/6285] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:54.820788 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:54.894755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:54.896224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd034a-5f41-4600-a0ea-49fbcfade092 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:54.963357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3155/6286] 10.222.0.77 () {60 vars in 1396 bytes} [Mon Jul 11 15:11:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:55.085103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e2d75-9300-475e-833f-591197f160d7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:55.085402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e2d75-9300-475e-833f-591197f160d7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:55.085867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e2d75-9300-475e-833f-591197f160d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:55.185918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-104e2d75-9300-475e-833f-591197f160d7 None None] MFA Rules not processed for user `1f61ab3fa75f437b8df5af9c8769a7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:55.187217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-104e2d75-9300-475e-833f-591197f160d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:55.384554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3132/6287] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:55.399832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:55.400369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:55.400910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:55.494543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] MFA Rules not processed for user `1f61ab3fa75f437b8df5af9c8769a7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:55.506607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:55.565046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3156/6288] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:55.901040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e2d75-9300-475e-833f-591197f160d7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:56.019335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:56.020912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:56.140829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e2d75-9300-475e-833f-591197f160d7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:56.153873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:56.157555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:56.158028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:56.158478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] PATH_INFO: `/v3/users/a6b96e1ecb874ba8b347943f735f6939` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:56.162634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b96e1ecb874ba8b347943f735f6939)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:56.165808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:56.225605 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:56.295884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dcbd4-9fe6-4b05-bfe7-1231fed77ec9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:56.297799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b96e1ecb874ba8b347943f735f6939'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:56.309505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745db03-ed28-4a4b-8c98-7b4181deee5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:56.310198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745db03-ed28-4a4b-8c98-7b4181deee5d service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:56.310481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745db03-ed28-4a4b-8c98-7b4181deee5d service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:56.310837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745db03-ed28-4a4b-8c98-7b4181deee5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:56.337589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745db03-ed28-4a4b-8c98-7b4181deee5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:56.340587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745db03-ed28-4a4b-8c98-7b4181deee5d service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:56.343719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b96e1ecb874ba8b347943f735f6939'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:56.371196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b96e1ecb874ba8b347943f735f6939'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:56.383757 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3157/6289] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:11:56.391413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b96e1ecb874ba8b347943f735f6939'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:56.392533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b96e1ecb874ba8b347943f735f6939'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:56.423186 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3133/6290] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:11:55 2022] DELETE /identity/v3/users/a6b96e1ecb874ba8b347943f735f6939 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:56.429606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:56.430134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:56.430264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:56.492809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:56.499839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:56.662957 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3158/6291] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:56.677320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:56.678965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:56.844905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ba1b9-99d0-47db-9115-f0b97a5497f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:56.854326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba98c7-e2f3-4b55-9e05-f77d635bb12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:56.855141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba98c7-e2f3-4b55-9e05-f77d635bb12a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:56.855437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba98c7-e2f3-4b55-9e05-f77d635bb12a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:56.856272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba98c7-e2f3-4b55-9e05-f77d635bb12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:56.873945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba98c7-e2f3-4b55-9e05-f77d635bb12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:56.876782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba98c7-e2f3-4b55-9e05-f77d635bb12a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:56.891538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3134/6292] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:11:57.637292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:57.641906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:57.687150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae35da-0359-4107-a96d-d3855fbade49 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:57.709208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:57.710565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:57.711050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:57.711516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] PATH_INFO: `/v3/projects/1ab2842ba96f496b8acc8723d351c99a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:57.713284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab2842ba96f496b8acc8723d351c99a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:57.715421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:57.848650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab2842ba96f496b8acc8723d351c99a', 'request_id': 'req-ed013c35-8e89-4d9c-9740-7c392410a9ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:57.865915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab2842ba96f496b8acc8723d351c99a', 'request_id': 'req-ed013c35-8e89-4d9c-9740-7c392410a9ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:57.871057 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:57.874337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab2842ba96f496b8acc8723d351c99a', 'request_id': 'req-ed013c35-8e89-4d9c-9740-7c392410a9ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:57.924285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] The token cache is being invalidate because project 1ab2842ba96f496b8acc8723d351c99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:11:57.924664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:57.926211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed013c35-8e89-4d9c-9740-7c392410a9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:11:57.930629 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3159/6293] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:11:57 2022] DELETE /identity/v3/projects/1ab2842ba96f496b8acc8723d351c99a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:57.936526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:57.937081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:57.937184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:57.986210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:57.988332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:58.203402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3135/6294] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:58.210360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:58.210684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:58.210980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:58.273435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:58.274648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:58.326818 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3160/6295] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:58.328598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:58.363588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80879e9-0be6-42ed-abbc-519a2a3fc42a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:58.384986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:58.386522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:58.387082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:58.388902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:58.392433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:11:58.395288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:58.401448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:58.453467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:58.456737 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3136/6296] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:11:58.467231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d01b-4a80-4f10-893a-988c5cb1127e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:58.503356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:58.504200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:58.504496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:58.504777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:58.505492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:58.507470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:58.652400 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3161/6297] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:11:58 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:11:58.657072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:58.677952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f24a6-c56f-42cf-a0d8-a7b6273caa6d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:58.767742 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:11:59.020151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:59.020889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:59.021186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:59.021469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:59.040688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:59.058804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:59.142986 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3137/6298] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:11:58 2022] POST /identity/v3/users => generated 288 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:11:59.144608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:59.165576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400f08-c2a8-450a-b652-fb8d9a948eab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:59.179593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:59.180464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:59.180833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:59.181213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:59.182070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:59.183856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:59.269894 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3162/6299] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:11:59.271176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:59.290193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c25a27-9a1e-48ca-920b-557720209222 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:59.322267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5804847-46e1-4de7-bb31-b67b50689d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:59.327283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5804847-46e1-4de7-bb31-b67b50689d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:59.329813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5804847-46e1-4de7-bb31-b67b50689d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:59.332004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5804847-46e1-4de7-bb31-b67b50689d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:59.335059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5804847-46e1-4de7-bb31-b67b50689d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:59.347527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5804847-46e1-4de7-bb31-b67b50689d4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:59.408223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:59.410389 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3138/6300] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:11:59.440640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9947edf-6f3b-4857-8adb-6104e4984446 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:11:59.462887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:11:59.464050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:59.464444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:59.466480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] PATH_INFO: `/v3/projects/223790faaaee485189a345f5163818cc/users/e7ca21959e374cbbb3fa2ef0af660906/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:59.513490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223790faaaee485189a345f5163818cc, user_id=e7ca21959e374cbbb3fa2ef0af660906, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:11:59.517191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:11:59.554180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3163/6301] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:11:59 2022] PUT /identity/v3/projects/223790faaaee485189a345f5163818cc/users/e7ca21959e374cbbb3fa2ef0af660906/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:11:59.565639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:11:59.566084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:11:59.566478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:11:59.669280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] MFA Rules not processed for user `e7ca21959e374cbbb3fa2ef0af660906`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:11:59.674449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:11:59.919615 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3139/6302] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:11:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:11:59.964274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:11:59.967475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:00.054432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d848ee-1d0a-4265-be92-627b347dc3e5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:00.063576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:00.064812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:00.065400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:00.065948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:00.079154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:00.080964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:00.112450 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3164/6303] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:11:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:00.464509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:00.466212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:00.730991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:00.733496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:00.835389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04983-48a4-4d74-b5bc-840276bbb3eb None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:00.863754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:00.864590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:00.864897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:00.865182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:00.874179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:00.931682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:00.941500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd7b44-ec83-4452-82dd-e327c244e2fa service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:00.968427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd835-b664-43c7-ad49-cfcf38875cd7 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:00.980674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:00.981997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:00.983373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:00.984525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] PATH_INFO: `/v3/users/9dcd1fafd49047e9b321a7a61f6b07a7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:00.987368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcd1fafd49047e9b321a7a61f6b07a7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:00.994931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:01.000003 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3140/6304] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:01.084850 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:01.121255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcd1fafd49047e9b321a7a61f6b07a7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:01.122861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcd1fafd49047e9b321a7a61f6b07a7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:01.158581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcd1fafd49047e9b321a7a61f6b07a7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:01.159490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcd1fafd49047e9b321a7a61f6b07a7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:01.186045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcd1fafd49047e9b321a7a61f6b07a7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:01.221352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3165/6305] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:00 2022] DELETE /identity/v3/users/9dcd1fafd49047e9b321a7a61f6b07a7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:01.225620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:01.225921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:01.226210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:01.307996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:01.329186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:01.413320 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:01.709507 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3141/6306] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:01.884760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:01.886471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:02.135925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dde66-ec75-4bfc-b201-a1963008f36e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:02.159075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:02.159980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:02.160445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:02.166518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:02.190871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:02.200171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:02.240128 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3166/6307] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:04.513277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:04.515668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:04.540492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141773c-defc-40b1-9d7a-acf898167816 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:04.578395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:04.584480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:04.584774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:04.585059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] PATH_INFO: `/v3/users/793f2d74d9194d57abe256b460935ef7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:04.594758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=793f2d74d9194d57abe256b460935ef7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:04.602243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:04.731824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:04.733478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:04.781889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccefcd-7164-4664-a5fb-e73df3a45a4b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:04.813097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:04.813989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:04.814270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:04.814570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] PATH_INFO: `/v3/projects/be7788789c834ed68d3ee056e7f0fd8b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:04.827180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7788789c834ed68d3ee056e7f0fd8b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:04.829260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:04.937684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793f2d74d9194d57abe256b460935ef7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.017356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793f2d74d9194d57abe256b460935ef7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.065031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793f2d74d9194d57abe256b460935ef7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.094909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7788789c834ed68d3ee056e7f0fd8b', 'request_id': 'req-6c3d1517-119f-4523-9082-0d640578b5f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.110827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793f2d74d9194d57abe256b460935ef7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.111771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272ca199-c9a3-4719-a9c8-e24400b6f63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793f2d74d9194d57abe256b460935ef7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.119482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7788789c834ed68d3ee056e7f0fd8b', 'request_id': 'req-6c3d1517-119f-4523-9082-0d640578b5f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.131894 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3142/6308] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:04 2022] DELETE /identity/v3/users/793f2d74d9194d57abe256b460935ef7 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:05.137287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:05.138722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:05.139025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:05.142033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7788789c834ed68d3ee056e7f0fd8b', 'request_id': 'req-6c3d1517-119f-4523-9082-0d640578b5f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.179202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] The token cache is being invalidate because project be7788789c834ed68d3ee056e7f0fd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:05.179973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.180917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:05.199764 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3167/6309] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:04 2022] DELETE /identity/v3/projects/be7788789c834ed68d3ee056e7f0fd8b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:05.262555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:05.264691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:05.576820 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3143/6310] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:05.619214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:05.620683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:05.719058 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:05.796579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1517-119f-4523-9082-0d640578b5f9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:05.976291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:05.976973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:05.977257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:05.977529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:06.007885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:06.014582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:06.057130 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3168/6311] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:09.661275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:09.663572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:09.683973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e3f1e-de01-43ba-bc77-35b0d62040f7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:09.713058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:09.714098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:09.714903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:09.716979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] PATH_INFO: `/v3/projects/4438fc4f91a84665bfb7b57643e2695f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:09.720129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4438fc4f91a84665bfb7b57643e2695f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:09.727214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:09.837850 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:09.883802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4438fc4f91a84665bfb7b57643e2695f', 'request_id': 'req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:09.892440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4438fc4f91a84665bfb7b57643e2695f', 'request_id': 'req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:09.921960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4438fc4f91a84665bfb7b57643e2695f', 'request_id': 'req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:09.962411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] The token cache is being invalidate because project 4438fc4f91a84665bfb7b57643e2695f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:09.963090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:09.964285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:09.967414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3144/6312] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:09 2022] DELETE /identity/v3/projects/4438fc4f91a84665bfb7b57643e2695f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:09.971234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:09.981481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d8d6-9101-4d8b-8374-47f28f090251 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:10.177178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:10.177434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:10.177773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:10.178109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] PATH_INFO: `/v3/users/532a1da3fb04401bb72a3069ac3b25ed` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:10.186992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532a1da3fb04401bb72a3069ac3b25ed)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:10.189063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:10.329470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532a1da3fb04401bb72a3069ac3b25ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:10.330283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532a1da3fb04401bb72a3069ac3b25ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:10.353051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532a1da3fb04401bb72a3069ac3b25ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:10.353875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532a1da3fb04401bb72a3069ac3b25ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:10.378359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532a1da3fb04401bb72a3069ac3b25ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:10.421214 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3169/6313] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:09 2022] DELETE /identity/v3/users/532a1da3fb04401bb72a3069ac3b25ed => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:13.119394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:13.121735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:13.156153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7147da-0acd-480d-a0ac-2817bf9e7bc3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:13.400283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:13.401594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:13.403487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:13.404215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] PATH_INFO: `/v3/projects/195f56c9ba9a495681f824ec0d1fd4e2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:13.408424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195f56c9ba9a495681f824ec0d1fd4e2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:13.416354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:13.644784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195f56c9ba9a495681f824ec0d1fd4e2', 'request_id': 'req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:13.669225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195f56c9ba9a495681f824ec0d1fd4e2', 'request_id': 'req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:13.698327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195f56c9ba9a495681f824ec0d1fd4e2', 'request_id': 'req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:13.746034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] The token cache is being invalidate because project 195f56c9ba9a495681f824ec0d1fd4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:13.746342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:13.749611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:13.759745 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3145/6314] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:13 2022] DELETE /identity/v3/projects/195f56c9ba9a495681f824ec0d1fd4e2 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:13.760988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:13.762554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:13.788202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeece49-5868-421c-aa87-02991c3a3903 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:13.805153 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:13.988517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:13.993014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:13.994287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:13.995651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] PATH_INFO: `/v3/users/e1c5e76b1154496a9d6626e770f09ac5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:14.000344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c5e76b1154496a9d6626e770f09ac5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:14.005045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:14.222755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c5e76b1154496a9d6626e770f09ac5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:14.224846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c5e76b1154496a9d6626e770f09ac5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:14.272888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c5e76b1154496a9d6626e770f09ac5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:14.275558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c5e76b1154496a9d6626e770f09ac5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:14.294967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3304a9bf-b06e-4d93-a331-d39af90e93f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c5e76b1154496a9d6626e770f09ac5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:14.360300 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3170/6315] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:13 2022] DELETE /identity/v3/users/e1c5e76b1154496a9d6626e770f09ac5 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:15.609949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:15.611571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:15.655159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d232-43c7-4cd9-86fc-59a9ccd38bc1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:15.812057 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:15.860207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:15.861585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:15.864741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:15.865159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] PATH_INFO: `/v3/projects/da669e935b1349188595e729f3bd7744` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:15.870753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da669e935b1349188595e729f3bd7744)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:15.877466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:15.995822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da669e935b1349188595e729f3bd7744', 'request_id': 'req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:16.006094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da669e935b1349188595e729f3bd7744', 'request_id': 'req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:16.033780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da669e935b1349188595e729f3bd7744', 'request_id': 'req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:16.070387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] The token cache is being invalidate because project da669e935b1349188595e729f3bd7744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:16.071909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:16.074452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc6f015c-a411-43d0-8a1f-f91ebbfe6877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:16.080187 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3146/6316] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:15 2022] DELETE /identity/v3/projects/da669e935b1349188595e729f3bd7744 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:16.085984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.086625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.086625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.131987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:16.138846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:16.340061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3171/6317] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:16.349541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.349541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.349943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.437959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:16.441419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:16.484630 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3147/6318] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:12:16.491401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.523338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5e287-9f64-41ed-9bf5-a3053e3e84a0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:16.536851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:16.540212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.540514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.540809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.541568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:12:16.541881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:16.543539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:16.584460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3172/6319] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:12:16.586239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.601742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5cff-3432-4e01-a662-a529eb2b4ab9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:16.613509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b70f8f-c64b-46d6-b5ee-babcf25a370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:16.614192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70f8f-c64b-46d6-b5ee-babcf25a370b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.614467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70f8f-c64b-46d6-b5ee-babcf25a370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.614961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70f8f-c64b-46d6-b5ee-babcf25a370b admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.615859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b70f8f-c64b-46d6-b5ee-babcf25a370b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:16.622474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b70f8f-c64b-46d6-b5ee-babcf25a370b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:16.685766 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3148/6320] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:16.690015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.711692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540fbd1-74a1-4ba8-bb9b-1edf7735583c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:16.738161 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:16.745654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.745956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.746242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.783643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:16.784788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:16.807109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:16.808191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.808696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.809158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.810108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:16.812568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:16.843482 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3173/6321] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:16 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:16.845344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.858546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc650d2-b93f-49c3-9e3f-bf60830d1976 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:16.863953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:16.867366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.867907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.868444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.869841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:16.873057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:16.889020 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3174/6322] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:16.890207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.903257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3e883-0620-46ab-abc4-0f2e8ff65e9d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:16.915874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:16.916767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.917067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.917352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:16.918093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:16.918673 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3149/6323] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:12:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:12:16.920798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:16.932410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.933984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:16.954224 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3175/6324] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:16.954456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:16.979158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef218-c324-45bb-9583-108ed7e099a3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:16.989105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd51b2-40b3-4dfb-800a-7fea16cfecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:16.990584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd51b2-40b3-4dfb-800a-7fea16cfecd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:16.991075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd51b2-40b3-4dfb-800a-7fea16cfecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:16.991601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd51b2-40b3-4dfb-800a-7fea16cfecd5 admin admin] PATH_INFO: `/v3/projects/4b19c7b3fa854c51973ca864fe4dc78e/users/d808674c534544e5b5565b64114e85c4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:17.037990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd51b2-40b3-4dfb-800a-7fea16cfecd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b19c7b3fa854c51973ca864fe4dc78e, user_id=d808674c534544e5b5565b64114e85c4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:17.045278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd51b2-40b3-4dfb-800a-7fea16cfecd5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:17.100567 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:17.105633 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3176/6325] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:16 2022] PUT /identity/v3/projects/4b19c7b3fa854c51973ca864fe4dc78e/users/d808674c534544e5b5565b64114e85c4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:17.116753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:17.117326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:17.118192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:17.140614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a13d-5e18-4a07-b30a-0aff50d59847 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:17.185542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:17.187875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:17.251578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da374c-8887-47ff-a9b1-ce0c3015bc4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:17.254400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da374c-8887-47ff-a9b1-ce0c3015bc4a service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:17.254812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da374c-8887-47ff-a9b1-ce0c3015bc4a service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:17.255339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da374c-8887-47ff-a9b1-ce0c3015bc4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:17.326963 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3177/6326] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:17.337390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:17.341408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:17.423571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da374c-8887-47ff-a9b1-ce0c3015bc4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:17.425339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da374c-8887-47ff-a9b1-ce0c3015bc4a service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:17.440574 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3150/6327] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:12:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:12:17.462475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db13ee1-f55a-4c57-a663-56289adb226b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:17.469789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353c51-303b-4889-be59-cf1246c91811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:17.471078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353c51-303b-4889-be59-cf1246c91811 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:17.471378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353c51-303b-4889-be59-cf1246c91811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:17.471690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353c51-303b-4889-be59-cf1246c91811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:17.495354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09353c51-303b-4889-be59-cf1246c91811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:17.496823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09353c51-303b-4889-be59-cf1246c91811 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:17.527573 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3178/6328] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:18.337951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:18.338661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:18.338661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:18.362202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] MFA Rules not processed for user `1dfed9df4c8a4de98a315124dc7cfe94`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:18.363777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:18.461815 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3151/6329] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:19.098203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.098855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.099152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.107305 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:19.144607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] MFA Rules not processed for user `d808674c534544e5b5565b64114e85c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:19.147616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:19.253909 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3179/6330] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:19.258865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:19.272367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4fcc9-8fc7-4db4-b34b-b310a6df1a41 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:19.289343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:19.290027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.290319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.290668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.291321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:19.293275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:19.371776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3152/6331] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:19 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:19.376022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:19.393889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a183ffa-4f8c-4c8a-ad71-5181f6c5cd49 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:19.526000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:19.526921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.527243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.527530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.528234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:19.530934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:19.573840 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3180/6332] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:19 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:19.575067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:19.595092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78690-5a81-42c0-8c34-b22e70e2e5d5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:19.603962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:19.604656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.604948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.605284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.606029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:19.607987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:19.624472 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3153/6333] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:19.629641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:19.646841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e39af-1111-49e0-87b6-1b81afd1cd10 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:19.661924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:19.663000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.663290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.663562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] PATH_INFO: `/v3/projects/098230c1665a412a8814d883cc3bbd1f/users/9e80880dce6c4766b9ae277d88532507/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.708383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098230c1665a412a8814d883cc3bbd1f, user_id=9e80880dce6c4766b9ae277d88532507, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:19.716883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:19.754274 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3181/6334] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:19 2022] PUT /identity/v3/projects/098230c1665a412a8814d883cc3bbd1f/users/9e80880dce6c4766b9ae277d88532507/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:19.755722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:19.770952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a15a-f107-412c-b777-29fa6d513482 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:19.780164 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:19.865278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:19.865896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.866182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.866459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.867460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:19.869328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:19.905726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3154/6335] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:19.909348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:19.929990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada690e5-d594-4c2a-bba7-d72f5e5b5301 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:19.943930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:19.948665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:19.948958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:19.949240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] PATH_INFO: `/v3/projects/098230c1665a412a8814d883cc3bbd1f/users/9e80880dce6c4766b9ae277d88532507/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:19.955402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=098230c1665a412a8814d883cc3bbd1f, user_id=9e80880dce6c4766b9ae277d88532507, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:19.961265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:19.989257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3182/6336] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:19 2022] PUT /identity/v3/projects/098230c1665a412a8814d883cc3bbd1f/users/9e80880dce6c4766b9ae277d88532507/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:21.446887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:21.449762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:21.629263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c17a85-b26b-471d-a336-744915bf898f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:21.855690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:21.856603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:21.856995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:21.857379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:21.863011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:21.911447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:21.915722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352285-f894-4e31-9117-37b693f09da0 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:21.956753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3155/6337] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:22.079352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:22.104306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005601-cd8a-4bdc-ac04-ed072700ce0d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:22.115213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:22.116197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:22.116772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:22.117240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:22.120021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:22.144609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:22.152378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603786a-2fd4-4374-8e20-a81887bf0c7b service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:22.194932 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3183/6338] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:22.813921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:22.815087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:22.815636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:22.914242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] MFA Rules not processed for user `9e80880dce6c4766b9ae277d88532507`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:22.916077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:23.028719 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:23.143184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3156/6339] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:23.147884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:23.148363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:23.148634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:23.168651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] MFA Rules not processed for user `d808674c534544e5b5565b64114e85c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:23.170926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:23.233849 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:23.276715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3184/6340] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:12:23.289671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:23.291992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:23.314678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb812-99aa-4ce8-aa1e-018e94f6733c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:23.332172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced5bd5-4ac2-4feb-ad7c-51bc1ad1f136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:23.333208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5bd5-4ac2-4feb-ad7c-51bc1ad1f136 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:23.335272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5bd5-4ac2-4feb-ad7c-51bc1ad1f136 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:23.335902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5bd5-4ac2-4feb-ad7c-51bc1ad1f136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:23.350488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced5bd5-4ac2-4feb-ad7c-51bc1ad1f136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:23.353262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced5bd5-4ac2-4feb-ad7c-51bc1ad1f136 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:23.366235 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3157/6341] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:33.263656 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=11 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:33.360864 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=27 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:39.447343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:39.448978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:39.574181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc452422-2a8d-40e6-9079-d2d25cfc97b7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:39.579712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:39.580844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:39.581324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:39.581783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] PATH_INFO: `/v3/users/e7ca21959e374cbbb3fa2ef0af660906` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:39.583256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ca21959e374cbbb3fa2ef0af660906)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:39.585447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:39.664705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ca21959e374cbbb3fa2ef0af660906'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:39.666331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ca21959e374cbbb3fa2ef0af660906'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:39.685922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ca21959e374cbbb3fa2ef0af660906'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:39.692692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ca21959e374cbbb3fa2ef0af660906'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:39.720736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ca21959e374cbbb3fa2ef0af660906'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:39.744674 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3185/6342] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:39 2022] DELETE /identity/v3/users/e7ca21959e374cbbb3fa2ef0af660906 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:39.746839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:39.747660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:39.748154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:39.783838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:39.785116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:39.877592 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3158/6343] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:39.884124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:39.885586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:39.970256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7ca62-066f-4c65-bc70-0c1483a5b4c5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:39.975882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6796-820b-41ea-9d7f-bb521c4a9dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:39.976575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6796-820b-41ea-9d7f-bb521c4a9dfa service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:39.976862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6796-820b-41ea-9d7f-bb521c4a9dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:39.977144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6796-820b-41ea-9d7f-bb521c4a9dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:39.989929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a6796-820b-41ea-9d7f-bb521c4a9dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:39.991412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a6796-820b-41ea-9d7f-bb521c4a9dfa service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:40.003825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3186/6344] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:40.531962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:40.534354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:40.606116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab451d-b817-4677-b2f2-f3c817642831 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:40.628871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:40.631797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:40.632905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:40.633842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] PATH_INFO: `/v3/projects/223790faaaee485189a345f5163818cc` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:40.635546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223790faaaee485189a345f5163818cc)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:40.638901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:40.755973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223790faaaee485189a345f5163818cc', 'request_id': 'req-6d6b4351-394d-4e53-87d7-892da50d6a10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:40.804316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223790faaaee485189a345f5163818cc', 'request_id': 'req-6d6b4351-394d-4e53-87d7-892da50d6a10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:40.830658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223790faaaee485189a345f5163818cc', 'request_id': 'req-6d6b4351-394d-4e53-87d7-892da50d6a10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:40.867261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] The token cache is being invalidate because project 223790faaaee485189a345f5163818cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:40.867501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:40.869646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6d6b4351-394d-4e53-87d7-892da50d6a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:40.873151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3159/6345] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:40 2022] DELETE /identity/v3/projects/223790faaaee485189a345f5163818cc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:40.877712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:40.878238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:40.878332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:40.926475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:40.927935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:40.969217 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:41.086856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3187/6346] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:41.091845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.092146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.092447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.125202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:41.126381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:41.152105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3160/6347] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:41.153452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.170299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ce47b-ddb8-4c06-80c6-b49ed6f7c9c2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:41.179530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:41.180260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.180550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.180828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.181584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:12:41.181891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:41.183586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:41.215298 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3188/6348] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:12:41.216876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.233067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d1b-a834-44aa-a0d9-9a28d78a95e1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:41.239295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:41.240242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.240617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.241167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.242112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:41.244286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:41.279614 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3161/6349] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:41 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:41.284712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.298124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719202b7-9a7f-4e13-9c4a-432f95e475f3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:41.379617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:41.380580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.381518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.382131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.383645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:41.386665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:41.427188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.441228 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3189/6350] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:41 2022] POST /identity/v3/users => generated 280 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:41.444868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70c2b9-b623-4313-b7a1-9a1371ceae45 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:41.451690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:41.452839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.453490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.454092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.455094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:41.457686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:41.483576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.494659 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3162/6351] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:41.500441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9345cb-c6a4-4429-91f2-c51a18776693 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:41.505747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a60cab-811d-497b-bed0-d4832841b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:41.506799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a60cab-811d-497b-bed0-d4832841b2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.507654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a60cab-811d-497b-bed0-d4832841b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.508385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a60cab-811d-497b-bed0-d4832841b2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.518572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a60cab-811d-497b-bed0-d4832841b2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:41.520553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a60cab-811d-497b-bed0-d4832841b2dc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:41.539329 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3190/6352] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:41.542769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.569594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be3fe-3084-40d8-8da9-d5710b0ad908 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:41.577983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:41.580375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.580954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.581636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] PATH_INFO: `/v3/projects/8e4e666dc806489fbfc9f1125cd7b69c/users/a6df6a774d594432b1e4d4e89ebb4d75/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.608305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4e666dc806489fbfc9f1125cd7b69c, user_id=a6df6a774d594432b1e4d4e89ebb4d75, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:41.613351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:41.643723 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3163/6353] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:41 2022] PUT /identity/v3/projects/8e4e666dc806489fbfc9f1125cd7b69c/users/a6df6a774d594432b1e4d4e89ebb4d75/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:41.648356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:41.649386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:41.649874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:41.697006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] MFA Rules not processed for user `a6df6a774d594432b1e4d4e89ebb4d75`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:41.700410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:41.806748 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3191/6354] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:41.846924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:41.849442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:41.901072 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:42.000065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444026-88d9-4fd3-933f-3746b96fcfde admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:42.029850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:42.030617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:42.030905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:42.031181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:42.077649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:42.085053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:42.133356 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3164/6355] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:45.639205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:45.640655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:45.680873 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:45.800979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4440ab-9c98-4543-b657-e2fd0d4e6a25 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:45.805998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:45.807060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:45.807397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:45.807748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] PATH_INFO: `/v3/users/1f61ab3fa75f437b8df5af9c8769a7f9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:45.809080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f61ab3fa75f437b8df5af9c8769a7f9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:45.811594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:45.886334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f61ab3fa75f437b8df5af9c8769a7f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:45.887884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f61ab3fa75f437b8df5af9c8769a7f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:45.906627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f61ab3fa75f437b8df5af9c8769a7f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:45.919602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f61ab3fa75f437b8df5af9c8769a7f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:45.930359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f61ab3fa75f437b8df5af9c8769a7f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:45.966131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3192/6356] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:45 2022] DELETE /identity/v3/users/1f61ab3fa75f437b8df5af9c8769a7f9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:46.545683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:46.547834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:46.646736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417ae0-0dcb-4e58-8bf4-4dd4fc50dba7 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:46.669775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:46.671833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:46.803171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:46.804235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:46.804711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:46.805341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:46.813525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:46.841053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfbab0-968f-472d-88ef-c98edbc61ec2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:46.859801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:46.860697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:46.860979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:46.861253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] PATH_INFO: `/v3/projects/4aaa9612ddfa4fbb91486bb3594006c5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:46.862881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aaa9612ddfa4fbb91486bb3594006c5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:46.865228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:46.976300 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:46.984775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aaa9612ddfa4fbb91486bb3594006c5', 'request_id': 'req-1e697071-4f65-400c-ac63-206dedcedd50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:46.986702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:46.990845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae960b1-c9d8-4566-a1af-905ec3789e76 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:47.002231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aaa9612ddfa4fbb91486bb3594006c5', 'request_id': 'req-1e697071-4f65-400c-ac63-206dedcedd50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:47.010261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aaa9612ddfa4fbb91486bb3594006c5', 'request_id': 'req-1e697071-4f65-400c-ac63-206dedcedd50'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:47.035138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3165/6357] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:47.035654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] The token cache is being invalidate because project 4aaa9612ddfa4fbb91486bb3594006c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:47.035952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:47.036625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1e697071-4f65-400c-ac63-206dedcedd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:47.038354 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3193/6358] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:46 2022] DELETE /identity/v3/projects/4aaa9612ddfa4fbb91486bb3594006c5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:12:47.045975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:47.046699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:47.047885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:47.124142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:47.135652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:47.217676 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:47.324035 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3166/6359] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:47.327418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:47.327418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:47.327768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:47.358126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:47.360275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:47.403626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:47.403960 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3194/6360] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:47.418723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02e9a-c4fc-47f1-8c9c-f143b80369db None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:47.425723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:47.426898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:47.427462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:47.428110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:47.429380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:12:47.429885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:47.432411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:47.459833 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3167/6361] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:12:47.464279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:47.482812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44884a-bbd7-4fce-bac3-d7f6d8c73889 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:47.499843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:47.500677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:47.504447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:47.514197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:47.518906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:47.521106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:47.629578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3195/6362] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:47 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:47.631276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:47.650897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f1a9-6489-4771-a455-4acb0a15307d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:47.827924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:47.828686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:47.828987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:47.829326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:47.830357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:47.833384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:47.899135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3168/6363] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:47 2022] POST /identity/v3/users => generated 303 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:47.903910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:47.920035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340f910-d6f9-44e8-a454-d3fe1ce156a6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:47.933927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:47.941489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:47.943298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:47.943697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:47.944570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:47.948921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:47.982059 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3196/6364] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:47.983507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:47.999843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87616-d415-4bc4-a9bf-9d83dda107f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:48.026375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b54c9-a1cf-4f5c-a3a0-059175b9013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:48.027253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b54c9-a1cf-4f5c-a3a0-059175b9013e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:48.028129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b54c9-a1cf-4f5c-a3a0-059175b9013e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:48.028418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b54c9-a1cf-4f5c-a3a0-059175b9013e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:48.030804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b54c9-a1cf-4f5c-a3a0-059175b9013e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:48.036299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b54c9-a1cf-4f5c-a3a0-059175b9013e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:48.070121 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3169/6365] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:48.075180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:48.095704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ccd4-4916-4d95-b6e5-1684d92dcacb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:48.115247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:48.117003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:48.117611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:48.118200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] PATH_INFO: `/v3/projects/f4f35641eaf04b7c89e24aebeb84222d/users/be383233f10c45ed83035ac644478535/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:48.145530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f35641eaf04b7c89e24aebeb84222d, user_id=be383233f10c45ed83035ac644478535, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:48.148740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:48.174363 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3197/6366] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:48 2022] PUT /identity/v3/projects/f4f35641eaf04b7c89e24aebeb84222d/users/be383233f10c45ed83035ac644478535/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:48.179765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:48.180195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:48.180552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:48.223684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:48.225211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:48.381864 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3170/6367] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:48.397948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:48.404921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:48.523818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8449-5402-4e42-af39-790bc44948ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:48.531284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:48.532421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:48.533254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:48.533541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:48.559441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:48.561070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:48.572635 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3198/6368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:52.763955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:52.765393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:52.788200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f7e52-fdfb-45d6-a137-42540c33ad69 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:52.804821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:52.804821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:52.804821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:52.804821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] PATH_INFO: `/v3/users/1dfed9df4c8a4de98a315124dc7cfe94` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:52.805351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfed9df4c8a4de98a315124dc7cfe94)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:52.805351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:52.874823 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:52.899234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfed9df4c8a4de98a315124dc7cfe94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:52.924129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfed9df4c8a4de98a315124dc7cfe94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:52.938634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfed9df4c8a4de98a315124dc7cfe94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:52.959275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfed9df4c8a4de98a315124dc7cfe94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:52.959820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a63e212-98c3-47df-a416-9bbb9199807d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfed9df4c8a4de98a315124dc7cfe94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:52.969144 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3171/6369] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:52 2022] DELETE /identity/v3/users/1dfed9df4c8a4de98a315124dc7cfe94 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:53.388681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:53.402344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ac1f-15ce-453d-903c-6b0cb93cc203 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:53.522171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:53.523295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:53.523646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:53.523988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] PATH_INFO: `/v3/projects/bffd5bee345b414f82da18bece4d21e9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:53.525329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffd5bee345b414f82da18bece4d21e9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:53.527623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:53.537816 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:53.626196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffd5bee345b414f82da18bece4d21e9', 'request_id': 'req-72f97bf8-316d-40d7-b4a3-fa4968019754'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:53.648379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffd5bee345b414f82da18bece4d21e9', 'request_id': 'req-72f97bf8-316d-40d7-b4a3-fa4968019754'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:53.659354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffd5bee345b414f82da18bece4d21e9', 'request_id': 'req-72f97bf8-316d-40d7-b4a3-fa4968019754'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:53.685138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] The token cache is being invalidate because project bffd5bee345b414f82da18bece4d21e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:53.685987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:53.696999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-72f97bf8-316d-40d7-b4a3-fa4968019754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:53.707052 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3199/6370] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:53 2022] DELETE /identity/v3/projects/bffd5bee345b414f82da18bece4d21e9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:53.707832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:53.708237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:53.708522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:53.740222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:53.741503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:53.912536 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3172/6371] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:12:53.921093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:53.921455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:53.921746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:53.947616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:53.949224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:53.964075 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3200/6372] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:53.964720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:53.985250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704b4d0-8149-4138-bf7a-4113425d5d7a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:53.999268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:53.999982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.000258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.000541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.001299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:12:54.001615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:54.003302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:54.040613 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3173/6373] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:12:54.046051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:54.059533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f54196-73b6-4966-9f9e-47299bedd83c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:54.072671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:54.073998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.075579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.077103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.077971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:54.083147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:54.164002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:54.178248 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3201/6374] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:54 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:54.182771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcf14c-24b1-4144-8b9c-ed05c2f75817 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:54.386896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:54.387588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.387886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.388143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.388990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:54.391695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:54.443020 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3174/6375] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:54 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:12:54.447655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:54.467829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1f998-7184-4895-b2c8-c52fafacd481 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:54.495049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:54.495781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.496067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.496344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.497088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:54.498729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:54.526243 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3202/6376] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:12:54.530646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:54.553496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f2f5e-58cb-4777-b77b-241eb6b85e8c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:54.569404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb75ae-87c6-48d9-80ea-6d12423ca7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:54.570094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb75ae-87c6-48d9-80ea-6d12423ca7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.570391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb75ae-87c6-48d9-80ea-6d12423ca7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.570980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb75ae-87c6-48d9-80ea-6d12423ca7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.571749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb75ae-87c6-48d9-80ea-6d12423ca7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:54.573400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb75ae-87c6-48d9-80ea-6d12423ca7c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:54.594062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3175/6377] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:54.594761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:54.608826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d817b-f959-47d0-a421-6dd64131e6f4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:54.623746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:54.624685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.624971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.625249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] PATH_INFO: `/v3/projects/409820ad0842420fbadd97e3d0e93ad4/users/d7ab28495a114a358b9a9ee0a566cca7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.675012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=409820ad0842420fbadd97e3d0e93ad4, user_id=d7ab28495a114a358b9a9ee0a566cca7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:54.677711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:54.719719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3203/6378] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:54 2022] PUT /identity/v3/projects/409820ad0842420fbadd97e3d0e93ad4/users/d7ab28495a114a358b9a9ee0a566cca7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:12:54.723313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:54.723313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:54.723506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:54.898064 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:54.909232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] MFA Rules not processed for user `d7ab28495a114a358b9a9ee0a566cca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:54.912742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:55.061762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3176/6379] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:55.078007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:55.080151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:55.244794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1285-9621-4660-a721-2e3485493130 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:55.258087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb32c9e-889b-465a-aff0-fa47e27ec213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:55.258968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32c9e-889b-465a-aff0-fa47e27ec213 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:55.259417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32c9e-889b-465a-aff0-fa47e27ec213 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:55.259835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32c9e-889b-465a-aff0-fa47e27ec213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:55.279074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb32c9e-889b-465a-aff0-fa47e27ec213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:55.281039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb32c9e-889b-465a-aff0-fa47e27ec213 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:55.313414 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3204/6380] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:55.614198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:55.801070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5da1d-2776-404d-9c84-620c0ce5ae46 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:55.829291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:55.831028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:55.831616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:55.832121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] PATH_INFO: `/v3/users/d7ab28495a114a358b9a9ee0a566cca7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:55.837364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ab28495a114a358b9a9ee0a566cca7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:55.844453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:55.966392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ab28495a114a358b9a9ee0a566cca7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:56.003967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ab28495a114a358b9a9ee0a566cca7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:56.017567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ab28495a114a358b9a9ee0a566cca7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:56.040210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ab28495a114a358b9a9ee0a566cca7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:56.040995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ab28495a114a358b9a9ee0a566cca7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:56.072226 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3177/6381] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:12:55 2022] DELETE /identity/v3/users/d7ab28495a114a358b9a9ee0a566cca7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:56.079177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:56.079636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:56.079769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:56.122800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:56.126738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:56.182426 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:56.284156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3205/6382] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:12:56.303186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:56.304828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:56.360399 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:56.435934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de81c-be70-4252-af6a-c0037c99deda admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:56.445496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876d7ff-b5f8-4b62-8b28-437707a6d9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:56.446679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876d7ff-b5f8-4b62-8b28-437707a6d9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:56.448489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876d7ff-b5f8-4b62-8b28-437707a6d9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:56.449469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876d7ff-b5f8-4b62-8b28-437707a6d9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:56.474205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876d7ff-b5f8-4b62-8b28-437707a6d9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:56.475933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876d7ff-b5f8-4b62-8b28-437707a6d9c7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:56.507049 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3178/6383] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:12:58.346514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:58.348720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:58.371214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce21a9c-c84a-4853-99ca-e9614b8540ff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:58.382959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:58.384081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:58.386116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:58.386575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] PATH_INFO: `/v3/projects/409820ad0842420fbadd97e3d0e93ad4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:58.391248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409820ad0842420fbadd97e3d0e93ad4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:58.399786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:58.521463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409820ad0842420fbadd97e3d0e93ad4', 'request_id': 'req-53cb4e37-3cf7-4872-b09d-7e197b86f499'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:58.545773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409820ad0842420fbadd97e3d0e93ad4', 'request_id': 'req-53cb4e37-3cf7-4872-b09d-7e197b86f499'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:58.558128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409820ad0842420fbadd97e3d0e93ad4', 'request_id': 'req-53cb4e37-3cf7-4872-b09d-7e197b86f499'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:58.595290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] The token cache is being invalidate because project 409820ad0842420fbadd97e3d0e93ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:12:58.595593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:58.598891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53cb4e37-3cf7-4872-b09d-7e197b86f499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:12:58.609046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3206/6384] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:12:58 2022] DELETE /identity/v3/projects/409820ad0842420fbadd97e3d0e93ad4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:58.610121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:58.611322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:58.611704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:58.645613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:58.652811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:58.859539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3179/6385] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:12:58.869800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:58.870287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:58.870725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:58.914928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:58.916126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:58.930685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:58.936960 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3207/6386] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:58.949505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c7a27-b593-4f6a-b4e2-00e5b989fd7d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:58.959149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:58.959845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:58.960140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:58.960422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:58.961186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:12:58.961567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:58.963269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:59.001674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:59.007103 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3180/6387] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:12:59.013546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbfe7-8365-440a-b9e1-1a1097d462e6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:59.030195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:59.031306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:59.031746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:59.032172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:59.033051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:59.036103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:59.101242 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3208/6388] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:12:59 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:12:59.102625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:59.118838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797048e-85f6-48da-a6df-f65d05d50984 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:59.254175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:59.254898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:59.255190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:59.255478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:59.256198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:59.259089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:59.344362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:59.355494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c6e83-c676-4ae6-a69f-0b59f23c65e7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:59.361297 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3181/6389] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:12:59 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:12:59.385247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:59.388536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:59.389513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:59.391004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:59.391799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:59.393426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:59.468519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3209/6390] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:59.469827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:59.482823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea5acc-9466-41dd-8c18-526812287964 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:59.496890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88a1a-429f-4208-867f-52f90e36ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:59.497598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88a1a-429f-4208-867f-52f90e36ec97 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:59.498043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88a1a-429f-4208-867f-52f90e36ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:59.498338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88a1a-429f-4208-867f-52f90e36ec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:59.499258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb88a1a-429f-4208-867f-52f90e36ec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:59.502396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb88a1a-429f-4208-867f-52f90e36ec97 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:59.536028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:59.551598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3182/6391] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:12:59.553157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a7ed-4904-4560-83ba-773177599016 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:12:59.571764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:12:59.572911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:59.573347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:59.574336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] PATH_INFO: `/v3/projects/2faf1460654a42f69cda1dd62f685840/users/208630a7c636414992f21b76bf654831/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:59.609950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2faf1460654a42f69cda1dd62f685840, user_id=208630a7c636414992f21b76bf654831, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:12:59.612712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:12:59.662320 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3210/6392] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:12:59 2022] PUT /identity/v3/projects/2faf1460654a42f69cda1dd62f685840/users/208630a7c636414992f21b76bf654831/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:12:59.664225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c028c0-b88f-42ce-bbda-12a104fa6640 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:12:59.665218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c028c0-b88f-42ce-bbda-12a104fa6640 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:12:59.665714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c028c0-b88f-42ce-bbda-12a104fa6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:12:59.703714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-71c028c0-b88f-42ce-bbda-12a104fa6640 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:12:59.724209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-71c028c0-b88f-42ce-bbda-12a104fa6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:12:59.814795 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:12:59.905744 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3183/6393] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:12:59.983262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:12:59.985107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:00.104347 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:00.152845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce8405-7e52-4f9e-843d-9c5086df5153 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:00.166187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:00.167005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:00.167275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:00.168073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:00.213433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:00.221253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:00.259561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3211/6394] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:00.628340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:00.629354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:00.629884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:00.697984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] MFA Rules not processed for user `be383233f10c45ed83035ac644478535`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:00.700462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:00.886881 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3184/6395] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:00.890672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:00.892838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:00.918239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0cdc-a6cc-418a-975a-f4085f89c610 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:00.946126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:00.947111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:00.947542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:00.948151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:00.949629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:00.962813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:01.032333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3212/6396] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:00 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:01.034706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:01.056697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2ad2-c359-47b9-9937-9aabe4644018 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:01.310378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:01.311358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:01.311837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:01.312252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:01.313082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:01.317822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:01.367610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:01.371087 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3185/6397] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:01 2022] POST /identity/v3/users => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:01.380868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fa839-13e3-4702-835f-0b361059db43 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:01.412072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:01.413118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:01.413504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:01.413883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:01.414778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:01.416517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:01.469412 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3213/6398] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:13:01.470485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:01.494292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529f26-7122-490f-85f5-40bf5c50a056 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:01.509649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:01.510600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:01.511212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:01.511810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:01.512689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:01.524713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:01.556499 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3186/6399] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:01.557185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:01.575409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a744-e85a-4cf3-8e58-484399439e84 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:01.597902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a141-ac9c-4495-bcdb-3c283bfaf6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:01.599261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a141-ac9c-4495-bcdb-3c283bfaf6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:01.599767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a141-ac9c-4495-bcdb-3c283bfaf6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:01.600513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a141-ac9c-4495-bcdb-3c283bfaf6a4 admin admin] PATH_INFO: `/v3/projects/b28e10c0ca7f4844bcd2d1b3281323aa/users/c412ff7a1ed547df88f5840021a7c3b9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:01.641995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a141-ac9c-4495-bcdb-3c283bfaf6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28e10c0ca7f4844bcd2d1b3281323aa, user_id=c412ff7a1ed547df88f5840021a7c3b9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:01.649146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a141-ac9c-4495-bcdb-3c283bfaf6a4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:01.683825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3214/6400] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:01 2022] PUT /identity/v3/projects/b28e10c0ca7f4844bcd2d1b3281323aa/users/c412ff7a1ed547df88f5840021a7c3b9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:06.627333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:06.634794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:06.661141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac795bf-5b25-4315-85ff-7c9ad92bbc1a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:06.797088 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:06.870917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:06.872892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:06.887180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:06.887479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] PATH_INFO: `/v3/users/a6df6a774d594432b1e4d4e89ebb4d75` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:06.888964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6df6a774d594432b1e4d4e89ebb4d75)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:06.892608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:07.036948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6df6a774d594432b1e4d4e89ebb4d75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:07.094365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6df6a774d594432b1e4d4e89ebb4d75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:07.109647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6df6a774d594432b1e4d4e89ebb4d75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:07.131455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6df6a774d594432b1e4d4e89ebb4d75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:07.132158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6df6a774d594432b1e4d4e89ebb4d75'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:07.158971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3187/6401] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:13:06 2022] DELETE /identity/v3/users/a6df6a774d594432b1e4d4e89ebb4d75 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:07.162915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462e53-9a6e-4746-b9a2-b0e34ccbbd2a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:07.163361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462e53-9a6e-4746-b9a2-b0e34ccbbd2a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:07.163491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462e53-9a6e-4746-b9a2-b0e34ccbbd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:07.207162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-04462e53-9a6e-4746-b9a2-b0e34ccbbd2a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:07.208415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-04462e53-9a6e-4746-b9a2-b0e34ccbbd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:07.421090 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3215/6402] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:07.500141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:07.507507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:07.749464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a01b-58b8-4907-99b9-a8eb46763897 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:07.759963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:07.761068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:07.762128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:07.762664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:07.792486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:07.794239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:07.821837 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3188/6403] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:08.209682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6178f5-5fa0-48e1-9904-f76a876f5d73 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:08.210198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6178f5-5fa0-48e1-9904-f76a876f5d73 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:08.210305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6178f5-5fa0-48e1-9904-f76a876f5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:08.252419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8d6178f5-5fa0-48e1-9904-f76a876f5d73 None None] MFA Rules not processed for user `87be873dd7d6441d84380b227ec4f034`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:08.253681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8d6178f5-5fa0-48e1-9904-f76a876f5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:08.439748 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3216/6404] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:09.396748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:09.398314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:09.446744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb1fd8-820c-42bd-a59e-d5f16a8891b3 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:09.469155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:09.470188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:09.470839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:09.471667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] PATH_INFO: `/v3/projects/8e4e666dc806489fbfc9f1125cd7b69c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:09.477545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4e666dc806489fbfc9f1125cd7b69c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:09.482837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:09.677360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4e666dc806489fbfc9f1125cd7b69c', 'request_id': 'req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:09.698037 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:09.700351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4e666dc806489fbfc9f1125cd7b69c', 'request_id': 'req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:09.732042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4e666dc806489fbfc9f1125cd7b69c', 'request_id': 'req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:09.764604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] The token cache is being invalidate because project 8e4e666dc806489fbfc9f1125cd7b69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:13:09.767955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:09.770903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f83f6edd-3f14-45d4-861c-e3ae5fc20c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:09.777004 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3189/6405] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:13:09 2022] DELETE /identity/v3/projects/8e4e666dc806489fbfc9f1125cd7b69c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:09.781640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:09.782102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:09.782319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:09.847750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:09.852683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:09.985200 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:10.078799 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3217/6406] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:10.086628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:10.087262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:10.087979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:10.132903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:10.137120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:10.159907 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3190/6407] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:10.173770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:10.215989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e4c66-2b7b-45f3-a721-81f70f379bd5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:10.233296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:10.235918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:10.236414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:10.237670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:10.243188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:13:10.243736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:10.248494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:10.293120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3218/6408] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:13:10.295287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:10.322174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cea1cd-943f-42bd-be3a-1ea5d6fd5f6f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:10.343291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:10.344238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:10.344829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:10.345254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:10.347905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:10.355395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:10.425880 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3191/6409] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:10 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:10.426880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:10.454970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae3fc1-0d4e-4152-9b8a-a34abbbbae69 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:10.711318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:10.712036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:10.712317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:10.712590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:10.713304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:10.715361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:10.776214 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3219/6410] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:10 2022] POST /identity/v3/users => generated 279 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:13:10.781475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:10.801394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24bad-c8a3-494b-abcb-8f8a8738806c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:10.822130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:10.822977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:10.828569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:10.829062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:10.829994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:10.833936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:10.888707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:10.889741 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3192/6411] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:10.903160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09f58-1cfa-474c-9b53-e4aa466e15c8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:10.930350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab23c19-2be6-4025-9063-24217f46afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:10.938252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab23c19-2be6-4025-9063-24217f46afdd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:10.938947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab23c19-2be6-4025-9063-24217f46afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:10.939458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab23c19-2be6-4025-9063-24217f46afdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:10.941045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab23c19-2be6-4025-9063-24217f46afdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:10.942972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab23c19-2be6-4025-9063-24217f46afdd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:10.985078 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3220/6412] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:13:10.986200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:10.997893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067cd17-84e5-4504-90cb-50f108a43ecb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:11.061380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:11.062691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:11.069107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:11.069735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] PATH_INFO: `/v3/projects/4a53bf8210f74d0c87d8f39a9baaddbb/users/cfcb65b5b8ba47acbc658c51d03d8ce5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:11.139575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a53bf8210f74d0c87d8f39a9baaddbb, user_id=cfcb65b5b8ba47acbc658c51d03d8ce5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:11.142430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:11.180963 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3193/6413] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:10 2022] PUT /identity/v3/projects/4a53bf8210f74d0c87d8f39a9baaddbb/users/cfcb65b5b8ba47acbc658c51d03d8ce5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:11.193385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e441-6359-4aad-a3ff-1f73f185ead8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:11.193940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e441-6359-4aad-a3ff-1f73f185ead8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:11.194368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e441-6359-4aad-a3ff-1f73f185ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:11.248877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2ab3e441-6359-4aad-a3ff-1f73f185ead8 None None] MFA Rules not processed for user `cfcb65b5b8ba47acbc658c51d03d8ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:11.250109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2ab3e441-6359-4aad-a3ff-1f73f185ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:11.482293 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3221/6414] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:11.509287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:11.511626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:11.670762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7db34f-0114-40c3-81ac-fca6f4124594 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:11.701418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7377ef-6877-4af9-b755-091a34dbcf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:11.702032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7377ef-6877-4af9-b755-091a34dbcf81 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:11.704469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7377ef-6877-4af9-b755-091a34dbcf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:11.705524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7377ef-6877-4af9-b755-091a34dbcf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:11.732495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7377ef-6877-4af9-b755-091a34dbcf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:11.736338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7377ef-6877-4af9-b755-091a34dbcf81 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:11.780105 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3194/6415] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:15.452646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:15.453151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:15.453224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:15.543535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] MFA Rules not processed for user `208630a7c636414992f21b76bf654831`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:15.544808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:15.584908 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:15.752340 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3222/6416] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:15.759023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:15.759530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:15.759811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:15.796803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] MFA Rules not processed for user `208630a7c636414992f21b76bf654831`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:15.798262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:15.822488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3195/6417] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:15.833304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:15.834924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:16.198216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eddd95-483f-408b-a0d3-610f5a3e058b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:16.214083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624b11-2153-4e77-ac8b-08ab41488297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:16.215179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624b11-2153-4e77-ac8b-08ab41488297 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:16.215712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624b11-2153-4e77-ac8b-08ab41488297 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:16.216202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624b11-2153-4e77-ac8b-08ab41488297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:16.234682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7624b11-2153-4e77-ac8b-08ab41488297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:16.236654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7624b11-2153-4e77-ac8b-08ab41488297 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:16.257865 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3223/6418] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:17.100398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:17.101892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:17.273458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e54fe-959e-45d7-a664-428661a46b3b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:17.278692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:17.279588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:17.280025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:17.280449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:17.283887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:17.320428 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:17.364355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:17.366541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5f60b-9fdd-49d2-885c-a2fc00716b18 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:17.391657 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3196/6419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:17.964357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:17.964883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:17.964956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:18.067791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] MFA Rules not processed for user `c412ff7a1ed547df88f5840021a7c3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:18.069074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:18.290867 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3224/6420] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:18.297816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:18.298752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:18.299245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:18.332740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] MFA Rules not processed for user `be383233f10c45ed83035ac644478535`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:18.335643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:18.527345 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3197/6421] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:18.535160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:18.536743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:18.595340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1777-1f6d-4077-afa5-8dce9321e1f1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:18.606776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:18.607361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:18.607719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:18.607898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:18.611201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:18.663652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:18.669404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53ce06-81cf-43d0-b9f2-6219b9fac383 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:18.694208 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3225/6422] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:28.499901 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=38 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:28.685458 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:41.855633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:42.097277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb1c17-ed22-41f5-ba9e-5be61fc3ea86 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:42.104547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:42.105759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:42.106429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:42.106968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] PATH_INFO: `/v3/users/cfcb65b5b8ba47acbc658c51d03d8ce5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:42.108766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcb65b5b8ba47acbc658c51d03d8ce5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:42.111540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:42.236155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcb65b5b8ba47acbc658c51d03d8ce5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:42.283060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcb65b5b8ba47acbc658c51d03d8ce5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:42.304027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcb65b5b8ba47acbc658c51d03d8ce5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:42.330837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcb65b5b8ba47acbc658c51d03d8ce5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:42.331384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcb65b5b8ba47acbc658c51d03d8ce5'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:42.345844 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3198/6423] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:13:41 2022] DELETE /identity/v3/users/cfcb65b5b8ba47acbc658c51d03d8ce5 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:42.349928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f7dd6-6370-42dd-bc18-f1b6cd34ab39 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:42.350387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f7dd6-6370-42dd-bc18-f1b6cd34ab39 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:42.350465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f7dd6-6370-42dd-bc18-f1b6cd34ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:42.437636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-728f7dd6-6370-42dd-bc18-f1b6cd34ab39 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:42.440768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-728f7dd6-6370-42dd-bc18-f1b6cd34ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:42.606912 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3226/6424] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:42.781549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:42.783277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:42.939864 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:43.015791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccbcb0-23fd-473f-8f1a-796f59258d12 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:43.025271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:43.025960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:43.026253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:43.026561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:43.042314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:43.053746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:43.075338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3199/6425] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:43.394771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:43.395289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:43.395289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:43.404056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:43.405429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:43.422346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] MFA Rules not processed for user `87be873dd7d6441d84380b227ec4f034`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:43.425311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:43.510555 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3227/6426] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:43.579011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc2e9-aba1-44b5-8374-46b5100c5f37 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:43.594433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:43.595220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:43.597075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:43.597437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:43.607642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:43.750041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:43.758659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d38ba-d708-46be-b568-d571e7f28328 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:43.783398 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3200/6427] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:44.209899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:44.214351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:44.257668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3984c-4213-4844-aa3a-a567860df66b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:44.272691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:44.276955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:44.277249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:44.279580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] PATH_INFO: `/v3/projects/4a53bf8210f74d0c87d8f39a9baaddbb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:44.283782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a53bf8210f74d0c87d8f39a9baaddbb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:44.293880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:44.434761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a53bf8210f74d0c87d8f39a9baaddbb', 'request_id': 'req-238a387d-fdd9-486e-b6b2-626dbdfd6dca'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:44.464557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a53bf8210f74d0c87d8f39a9baaddbb', 'request_id': 'req-238a387d-fdd9-486e-b6b2-626dbdfd6dca'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:44.481126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a53bf8210f74d0c87d8f39a9baaddbb', 'request_id': 'req-238a387d-fdd9-486e-b6b2-626dbdfd6dca'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:44.519499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] The token cache is being invalidate because project 4a53bf8210f74d0c87d8f39a9baaddbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:13:44.533920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:44.535505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-238a387d-fdd9-486e-b6b2-626dbdfd6dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:44.540405 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3228/6428] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:13:44 2022] DELETE /identity/v3/projects/4a53bf8210f74d0c87d8f39a9baaddbb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:44.545405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:44.545866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:44.545964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:44.577375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:44.578913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:44.670100 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3201/6429] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:44.678609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:44.678990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:44.679349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:44.701743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:44.703207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:44.712693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3229/6430] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:44.716951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:44.746128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39a36-edd1-4610-b865-8459e97f80c6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:44.752501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:44.753712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:44.754096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:44.754473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:44.755736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:13:44.756146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:44.758152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:44.782686 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3202/6431] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:13:44.786990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:44.809296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2d895-51cd-4601-a4df-739757ffa38f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:44.815845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:44.816522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:44.816809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:44.817084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:44.817836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:44.821869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:44.838456 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:44.933583 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3230/6432] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:44 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:44.937663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:44.963913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2150c-0b85-4af9-87a7-803c06aca5c4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:44.969313 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:45.031915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:45.032752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:45.033048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:45.033330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:45.034408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:45.036547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:45.072347 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3203/6433] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:44 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:45.074978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:45.091812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70ff5-b3db-4578-b08e-77cd9d55a578 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:45.131664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:45.132336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:45.132503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:45.132785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:45.133523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:45.135222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:45.178116 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3231/6434] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:45.179205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:45.206181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3c7f0-68ae-49a7-ac1a-e175b0f4a346 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:45.221879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76d10c-d807-4170-a9b1-c31fe9e4e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:45.227269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d10c-d807-4170-a9b1-c31fe9e4e134 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:45.228350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d10c-d807-4170-a9b1-c31fe9e4e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:45.240873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d10c-d807-4170-a9b1-c31fe9e4e134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:45.242148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76d10c-d807-4170-a9b1-c31fe9e4e134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:45.251232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76d10c-d807-4170-a9b1-c31fe9e4e134 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:45.315679 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3204/6435] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:13:45.317355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:45.351273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b154e-280e-44b7-8060-cef432c031a0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:45.369684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:45.370925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:45.374406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:45.374904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] PATH_INFO: `/v3/projects/fd5d6ea3a2164936865e21b97ff8c7ad/users/21c8f51531c84c2d8897f1e4b0d48d11/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:45.430511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5d6ea3a2164936865e21b97ff8c7ad, user_id=21c8f51531c84c2d8897f1e4b0d48d11, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:45.434032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:45.458613 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3232/6436] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:45 2022] PUT /identity/v3/projects/fd5d6ea3a2164936865e21b97ff8c7ad/users/21c8f51531c84c2d8897f1e4b0d48d11/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:45.477139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:45.477521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:45.478699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:45.553890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] MFA Rules not processed for user `21c8f51531c84c2d8897f1e4b0d48d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:45.559976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:45.747267 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3205/6437] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:45.749196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:45.934136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d32ad-1a69-4083-9a4e-7872ca5e4e82 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:45.961395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:45.962404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:45.963021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:45.965937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:45.967097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:45.972737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.053721 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3233/6438] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:45 2022] POST /identity/v3/projects => generated 367 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:46.059456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:46.073335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490e4c-bc52-49e0-8603-cc06a3b40314 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:46.213554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:46.214263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.214627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.215033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.215768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:46.217984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.251563 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3206/6439] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:46 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:46.253171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:46.274069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65022df-1b09-452f-9c1f-12d4e68f171a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:46.286012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:46.286843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.287271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.287882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.288831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:46.291248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.324262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3234/6440] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:46.328292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:46.337565 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:46.351242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21a65-46d0-4015-9267-7a02e3cf54a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:46.356496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:46.358432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:46.379212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:46.380252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.380541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.380819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] PATH_INFO: `/v3/projects/ff168ff4ff574401ae014e581a41693c/users/45ee3ad619a64abd8effc7fb1e111027/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.382398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150471ad-5a69-4e06-8a26-31514900ac71 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:46.395997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:46.397463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.397751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.398030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] PATH_INFO: `/v3/users/d808674c534544e5b5565b64114e85c4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.399596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d808674c534544e5b5565b64114e85c4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:46.415819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.425676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff168ff4ff574401ae014e581a41693c, user_id=45ee3ad619a64abd8effc7fb1e111027, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:46.428539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.464916 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3207/6441] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:46 2022] PUT /identity/v3/projects/ff168ff4ff574401ae014e581a41693c/users/45ee3ad619a64abd8effc7fb1e111027/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:46.469372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:46.533428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd808674c534544e5b5565b64114e85c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:46.535082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd808674c534544e5b5565b64114e85c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:46.562802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd808674c534544e5b5565b64114e85c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:46.564826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd808674c534544e5b5565b64114e85c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:46.588050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd808674c534544e5b5565b64114e85c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:46.611598 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3235/6442] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:13:46 2022] DELETE /identity/v3/users/d808674c534544e5b5565b64114e85c4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:13:46.626762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65205346-0228-4138-998f-2e6fe6258586 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:46.767225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74adc7-2290-4672-8f7f-5c0deffae0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:46.769442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74adc7-2290-4672-8f7f-5c0deffae0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.770871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74adc7-2290-4672-8f7f-5c0deffae0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.771162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74adc7-2290-4672-8f7f-5c0deffae0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.771996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74adc7-2290-4672-8f7f-5c0deffae0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:46.777302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74adc7-2290-4672-8f7f-5c0deffae0c1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.807897 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3208/6443] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:46.809617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:46.813648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:46.849374 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:46.865655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266702-12c4-44a8-bebc-825851117319 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:46.875709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:46.879571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.880003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.880435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] PATH_INFO: `/v3/projects/ff168ff4ff574401ae014e581a41693c/users/45ee3ad619a64abd8effc7fb1e111027/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.887568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff168ff4ff574401ae014e581a41693c, user_id=45ee3ad619a64abd8effc7fb1e111027, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:46.892646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:46.928611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:46.928913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:46.929199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:46.930145 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3236/6444] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:46 2022] PUT /identity/v3/projects/ff168ff4ff574401ae014e581a41693c/users/45ee3ad619a64abd8effc7fb1e111027/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:46.962690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] MFA Rules not processed for user `45ee3ad619a64abd8effc7fb1e111027`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:46.964323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:47.038867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:47.041247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:47.139787 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3209/6445] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:47.150137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:47.151895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:47.174826 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:47.192619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f2d03-bf5e-464f-ab24-9c3542239e12 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:47.199271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:47.200738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:47.201165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:47.201873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] PATH_INFO: `/v3/projects/4b19c7b3fa854c51973ca864fe4dc78e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:47.203756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b19c7b3fa854c51973ca864fe4dc78e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:47.206190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:47.292183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddebda8-aff3-4096-97fc-790830256456 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:47.301985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b19c7b3fa854c51973ca864fe4dc78e', 'request_id': 'req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.316612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b19c7b3fa854c51973ca864fe4dc78e', 'request_id': 'req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.348164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b19c7b3fa854c51973ca864fe4dc78e', 'request_id': 'req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.384779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] The token cache is being invalidate because project 4b19c7b3fa854c51973ca864fe4dc78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:13:47.385081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.387039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.394534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3237/6446] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:13:47 2022] DELETE /identity/v3/projects/4b19c7b3fa854c51973ca864fe4dc78e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:47.398189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:47.402539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:47.457674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:47.458350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:47.458826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:47.459116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:47.461358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:47.545005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656eb5-68a9-4eaf-a5ed-73660bcb6741 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:47.558428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:47.559411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:47.560385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:47.560385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] PATH_INFO: `/v3/users/9e80880dce6c4766b9ae277d88532507` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:47.562244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e80880dce6c4766b9ae277d88532507)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:47.564811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:47.638196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:47.649677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:47.674629 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:47.679846 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3210/6447] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:47.738518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e80880dce6c4766b9ae277d88532507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.739455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e80880dce6c4766b9ae277d88532507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.779165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e80880dce6c4766b9ae277d88532507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.781365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e80880dce6c4766b9ae277d88532507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.808317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6f8cd9f1-4f33-45bd-bd95-fb7cad6e8536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e80880dce6c4766b9ae277d88532507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:47.846744 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3238/6448] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:13:47 2022] DELETE /identity/v3/users/9e80880dce6c4766b9ae277d88532507 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:48.529345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:48.552538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cf35-7abc-4229-a56b-cb599fce0028 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:48.702213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:48.705476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:48.705888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:48.706448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] PATH_INFO: `/v3/projects/098230c1665a412a8814d883cc3bbd1f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:48.708609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098230c1665a412a8814d883cc3bbd1f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:48.716938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:48.757771 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:48.819554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098230c1665a412a8814d883cc3bbd1f', 'request_id': 'req-8ca8bbfa-bae0-47b9-9822-082731866544'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:48.827181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098230c1665a412a8814d883cc3bbd1f', 'request_id': 'req-8ca8bbfa-bae0-47b9-9822-082731866544'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:48.843670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098230c1665a412a8814d883cc3bbd1f', 'request_id': 'req-8ca8bbfa-bae0-47b9-9822-082731866544'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:48.887992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] The token cache is being invalidate because project 098230c1665a412a8814d883cc3bbd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:13:48.889047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:48.890373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8ca8bbfa-bae0-47b9-9822-082731866544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:48.898829 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3211/6449] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:13:48 2022] DELETE /identity/v3/projects/098230c1665a412a8814d883cc3bbd1f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:48.904844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:48.905511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:48.905867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:48.936610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:48.938227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:49.224227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3239/6450] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:49.226135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:49.226801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:49.227195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:49.300007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:49.302969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:49.371741 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3212/6451] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:49.379678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:49.394174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbe5b-c898-40df-87c2-4f1f493a8de8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:49.411250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:49.411950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:49.412275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:49.424639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:49.427538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:13:49.427886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:49.435481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:49.501738 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3240/6452] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:13:49.506746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:49.521540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b0c1e-b5a6-495e-af36-ab2917646e57 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:49.545365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:49.546118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:49.546378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:49.557680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:49.558530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:49.560496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:49.664111 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3213/6453] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:49 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:49.665859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:49.678702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ee835-77cc-49c5-ad7b-82650c61d713 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:49.866844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:49.867783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:49.868214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:49.868878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:49.869687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:49.872010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:49.895075 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3241/6454] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:49 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:49.898887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:49.926332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fadf5-985b-49db-8b17-3b2ed94f49e6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:49.940274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:49.940959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:49.941248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:49.941881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:49.942616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:49.950478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:50.025027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:50.045331 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3214/6455] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:50.060570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c52a9-2acc-4137-adb3-7abe89fd94d9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:50.078997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373470ba-48bd-4a9b-a5b3-fbf02bc1d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:50.079705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373470ba-48bd-4a9b-a5b3-fbf02bc1d395 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:50.080112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373470ba-48bd-4a9b-a5b3-fbf02bc1d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:50.080262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373470ba-48bd-4a9b-a5b3-fbf02bc1d395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:50.081009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373470ba-48bd-4a9b-a5b3-fbf02bc1d395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:50.082652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373470ba-48bd-4a9b-a5b3-fbf02bc1d395 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:50.117058 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3242/6456] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:50.117651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:50.129926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a70d-0ee8-438f-bd0e-43ffd32fe9e2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:50.145092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:50.146007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:50.147082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:50.147378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] PATH_INFO: `/v3/projects/9cd183b1e6be46e8955c49f5e5adba5c/users/d1d3211e6ad0429e88e5bafbb9b644e9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:50.183422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd183b1e6be46e8955c49f5e5adba5c, user_id=d1d3211e6ad0429e88e5bafbb9b644e9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:50.186146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:50.220178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3215/6457] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:50 2022] PUT /identity/v3/projects/9cd183b1e6be46e8955c49f5e5adba5c/users/d1d3211e6ad0429e88e5bafbb9b644e9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:50.230352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:50.230800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:50.230957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:50.237968 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:50.275874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] MFA Rules not processed for user `d1d3211e6ad0429e88e5bafbb9b644e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:50.277186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:50.444129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3243/6458] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:50.461166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:50.465161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:50.593369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8f54-fe75-4987-8850-e22dbcbe2213 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:50.599837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06bcc6-4c44-4f67-8cc4-dbb1bbff333c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:50.600856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06bcc6-4c44-4f67-8cc4-dbb1bbff333c service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:50.601356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06bcc6-4c44-4f67-8cc4-dbb1bbff333c service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:50.601780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06bcc6-4c44-4f67-8cc4-dbb1bbff333c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:50.614488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06bcc6-4c44-4f67-8cc4-dbb1bbff333c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:50.616250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06bcc6-4c44-4f67-8cc4-dbb1bbff333c service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:50.651034 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3216/6459] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:50.815504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:50.817746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:50.953504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34494ae-7ca7-4d67-b9b3-e872622b7efe None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:50.958205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:50.959129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:50.959594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:50.960018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] PATH_INFO: `/v3/users/21c8f51531c84c2d8897f1e4b0d48d11` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:50.962595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c8f51531c84c2d8897f1e4b0d48d11)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:50.965659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:51.031688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c8f51531c84c2d8897f1e4b0d48d11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:51.033845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c8f51531c84c2d8897f1e4b0d48d11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:51.084563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c8f51531c84c2d8897f1e4b0d48d11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:51.087690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c8f51531c84c2d8897f1e4b0d48d11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:51.103942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c8f51531c84c2d8897f1e4b0d48d11'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:51.138428 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3244/6460] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:13:50 2022] DELETE /identity/v3/users/21c8f51531c84c2d8897f1e4b0d48d11 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:51.143848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:51.144436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:51.144724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:51.178673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:51.182443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:51.260545 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:51.295635 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3217/6461] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:51.353883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:51.355612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:51.390756 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:51.545719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03976ef-25e8-46a1-85b7-157a8ef6c4f0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:51.563820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:51.564584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:51.564877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:51.565164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:51.604257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:51.605932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:51.624362 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3245/6462] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:52.677746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:52.680206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:52.705329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d0c4-1146-4186-b43a-5102f85140af None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:52.718935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:52.722717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:52.726122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:52.730261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] PATH_INFO: `/v3/projects/fd5d6ea3a2164936865e21b97ff8c7ad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:52.734638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5d6ea3a2164936865e21b97ff8c7ad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:52.746693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:52.904461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5d6ea3a2164936865e21b97ff8c7ad', 'request_id': 'req-dec3b4db-4409-4ab1-b738-b1140452d23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:52.914057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5d6ea3a2164936865e21b97ff8c7ad', 'request_id': 'req-dec3b4db-4409-4ab1-b738-b1140452d23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:52.931477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5d6ea3a2164936865e21b97ff8c7ad', 'request_id': 'req-dec3b4db-4409-4ab1-b738-b1140452d23a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:52.955102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] The token cache is being invalidate because project fd5d6ea3a2164936865e21b97ff8c7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:13:52.955762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:52.956694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:52.959399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3218/6463] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:13:52 2022] DELETE /identity/v3/projects/fd5d6ea3a2164936865e21b97ff8c7ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:52.964240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:52.998523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60625c76-4679-4c61-8e2a-2b10fd9effcf service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:53.167874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:53.168990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:53.169462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:53.170090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] PATH_INFO: `/v3/users/45ee3ad619a64abd8effc7fb1e111027` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:53.172047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ee3ad619a64abd8effc7fb1e111027)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:53.176702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:53.325675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ee3ad619a64abd8effc7fb1e111027'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:53.333782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ee3ad619a64abd8effc7fb1e111027'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:53.349803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ee3ad619a64abd8effc7fb1e111027'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:53.350662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ee3ad619a64abd8effc7fb1e111027'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:53.376048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f719814-65a0-4ae0-9487-642ca8c5bb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ee3ad619a64abd8effc7fb1e111027'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:53.415821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3246/6464] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:13:52 2022] DELETE /identity/v3/users/45ee3ad619a64abd8effc7fb1e111027 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:13:54.440672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:54.442296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:54.471088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b4db-4409-4ab1-b738-b1140452d23a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:54.659530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:54.660545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:54.660936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:54.661316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] PATH_INFO: `/v3/projects/ff168ff4ff574401ae014e581a41693c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:54.665770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff168ff4ff574401ae014e581a41693c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:54.677987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:54.884685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff168ff4ff574401ae014e581a41693c', 'request_id': 'req-35152038-fb17-4c18-a65b-1565b3e4e7c1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:54.907192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff168ff4ff574401ae014e581a41693c', 'request_id': 'req-35152038-fb17-4c18-a65b-1565b3e4e7c1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:54.933659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff168ff4ff574401ae014e581a41693c', 'request_id': 'req-35152038-fb17-4c18-a65b-1565b3e4e7c1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:54.977111 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:54.992168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] The token cache is being invalidate because project ff168ff4ff574401ae014e581a41693c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:13:54.992503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:55.002046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-35152038-fb17-4c18-a65b-1565b3e4e7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:13:55.005455 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3219/6465] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:13:54 2022] DELETE /identity/v3/projects/ff168ff4ff574401ae014e581a41693c => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:55.014100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:55.016699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:55.016815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:55.109714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:55.118751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:55.243612 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:55.371174 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3247/6466] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:55.372526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:55.372819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:55.373096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:55.437122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:55.441883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:55.468259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3220/6467] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:55.474938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:55.496154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aee79-52d1-4e46-a9d4-12771b46b0e8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:55.512189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:55.513262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:55.513773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:55.514265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:55.516075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:13:55.516611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:55.518860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:55.557453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:55.566976 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3248/6468] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:13:55.570100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4bbaa-6d63-4b80-9c8d-9e3cc9871af5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:55.577346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:55.578774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:55.579382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:55.579897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:55.580873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:55.583889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:55.658371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:55.681989 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3221/6469] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:55 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:55.683675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc62e50-d664-40fe-bfcf-f76ff913e76d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:55.823014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:55.823550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:55.823840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:55.824123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:55.825845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:55.829931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:55.891730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:55.894258 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3249/6470] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:55 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:55.910374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356817a-d576-4264-9a86-ffe835137eb4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:55.925873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:55.927253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:55.928731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:55.929025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:55.932373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:55.936137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:55.998554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3222/6471] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:56.002703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:56.027566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb64e-2dd8-496b-9408-9c7d7a223a98 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:56.047585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f22fda-586d-462b-b0a0-4c544a68487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:56.048462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f22fda-586d-462b-b0a0-4c544a68487f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.048761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f22fda-586d-462b-b0a0-4c544a68487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.049040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f22fda-586d-462b-b0a0-4c544a68487f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.049787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f22fda-586d-462b-b0a0-4c544a68487f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:56.059291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f22fda-586d-462b-b0a0-4c544a68487f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:56.091709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3250/6472] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:56.094355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:56.129245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571269cc-7e68-4a06-a880-a342473c2aec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:56.152325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:56.160254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.160254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.160254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] PATH_INFO: `/v3/projects/7c2bfa62c6df4063b91180ce8ea487e1/users/7a0ab27d9a80444a870321d330c1416f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.190998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2bfa62c6df4063b91180ce8ea487e1, user_id=7a0ab27d9a80444a870321d330c1416f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:56.195143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:56.240378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3223/6473] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:56 2022] PUT /identity/v3/projects/7c2bfa62c6df4063b91180ce8ea487e1/users/7a0ab27d9a80444a870321d330c1416f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:56.240962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.241262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.244988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.312033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] MFA Rules not processed for user `7a0ab27d9a80444a870321d330c1416f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:56.315952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:56.481415 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3251/6474] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:56.485509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:56.590559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61301-27f4-47da-86a5-48a86592529b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:56.597774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:56.600905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.601389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.601830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.603304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:56.605451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:56.662308 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3224/6475] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:13:56 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:56.663377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:56.693927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e035-29d0-4008-89c9-829329e247d8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:56.801885 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:56.859030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:56.859732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.860017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.860304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.861008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:56.864509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:56.932962 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3252/6476] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:13:56 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:13:56.937368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:56.975745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eb0a8-07a6-4553-b6b4-1829f367d65e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:56.982137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:56.982939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:56.983366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:56.983658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:56.984413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:56.986551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:57.030138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3225/6477] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:57.034133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:57.048502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee53c0-c4a7-42fe-8386-af1630d5eab9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:57.056745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:57.057828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:57.058118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:57.058404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] PATH_INFO: `/v3/projects/7c64ef2aed1342438cc797d84336ac47/users/986e58277ab3410e865603aebde1bbf6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:57.112555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c64ef2aed1342438cc797d84336ac47, user_id=986e58277ab3410e865603aebde1bbf6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:57.121291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:57.149797 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3253/6478] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:57 2022] PUT /identity/v3/projects/7c64ef2aed1342438cc797d84336ac47/users/986e58277ab3410e865603aebde1bbf6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:57.154884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:57.176444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb450f-5fd7-4bb1-be55-6d6c2cfc48b7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:57.290792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63099-8bfc-4caa-b22e-0d2f8465b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:57.291485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63099-8bfc-4caa-b22e-0d2f8465b944 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:57.291774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63099-8bfc-4caa-b22e-0d2f8465b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:57.292183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63099-8bfc-4caa-b22e-0d2f8465b944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:57.292782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d63099-8bfc-4caa-b22e-0d2f8465b944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:57.295305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d63099-8bfc-4caa-b22e-0d2f8465b944 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:57.314061 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3226/6479] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:13:57.318193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:57.337130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66603-f839-4d9d-9030-551c50f4dea2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:57.353091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:57.354020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:57.354321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:57.354916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] PATH_INFO: `/v3/projects/7c64ef2aed1342438cc797d84336ac47/users/986e58277ab3410e865603aebde1bbf6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:57.357949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c64ef2aed1342438cc797d84336ac47, user_id=986e58277ab3410e865603aebde1bbf6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:57.360633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:57.400214 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3254/6480] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:13:57 2022] PUT /identity/v3/projects/7c64ef2aed1342438cc797d84336ac47/users/986e58277ab3410e865603aebde1bbf6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:13:57.402512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:57.402828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:57.403039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:57.414013 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:13:57.510962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] MFA Rules not processed for user `986e58277ab3410e865603aebde1bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:13:57.515606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:57.715514 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3227/6481] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:13:57.723136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:57.725196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:57.884182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a2d6c-58e9-40d5-b294-6aad807c0f88 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:57.889120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cacb0-e01b-4373-ba21-a82e10cd9d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:57.890437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cacb0-e01b-4373-ba21-a82e10cd9d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:57.894418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cacb0-e01b-4373-ba21-a82e10cd9d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:57.894770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cacb0-e01b-4373-ba21-a82e10cd9d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:57.913769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cacb0-e01b-4373-ba21-a82e10cd9d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:57.915934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cacb0-e01b-4373-ba21-a82e10cd9d21 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:57.929224 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3255/6482] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:13:58.037965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:13:58.041602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:13:58.103558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b18f2-7f29-4dec-acc8-429228f76eb5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:13:58.120018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:13:58.124021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:13:58.125160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:13:58.129260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:13:58.299072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:13:58.300542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:13:58.336617 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3228/6483] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:03.818421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c18ab-982c-4e28-b8b1-3f659f9d7a49 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:03.818991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c18ab-982c-4e28-b8b1-3f659f9d7a49 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:03.819105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c18ab-982c-4e28-b8b1-3f659f9d7a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:03.862864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-569c18ab-982c-4e28-b8b1-3f659f9d7a49 None None] MFA Rules not processed for user `208630a7c636414992f21b76bf654831`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:03.864124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-569c18ab-982c-4e28-b8b1-3f659f9d7a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:03.907017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:04.041778 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3256/6484] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:04.132932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386909-ca0e-48e2-8919-85dfceee0048 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:04.145135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:04.148081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:04.148661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:04.149706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] PATH_INFO: `/v3/users/7a0ab27d9a80444a870321d330c1416f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:04.152477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0ab27d9a80444a870321d330c1416f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:04.157305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:04.198736 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:04.247087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0ab27d9a80444a870321d330c1416f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:04.268107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0ab27d9a80444a870321d330c1416f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:04.281874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0ab27d9a80444a870321d330c1416f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:04.301599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0ab27d9a80444a870321d330c1416f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:04.301599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0ab27d9a80444a870321d330c1416f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:04.315305 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3229/6485] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:03 2022] DELETE /identity/v3/users/7a0ab27d9a80444a870321d330c1416f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:04.317748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:04.318045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:04.318332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:04.381391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:04.382786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:04.394313 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:04.492356 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3257/6486] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:04.535137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:04.536535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:04.665896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6e39-3287-414e-ac0f-b8c7422fafa7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:04.675591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:04.676330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:04.676692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:04.678329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:04.698041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:04.699689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:04.714832 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3230/6487] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:05.343913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:05.346759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:05.372422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db84eb-3883-4b10-9549-9a0b9b172259 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:05.380297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:05.381855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:05.382267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:05.382766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] PATH_INFO: `/v3/projects/7c2bfa62c6df4063b91180ce8ea487e1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:05.399678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2bfa62c6df4063b91180ce8ea487e1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:05.402721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:05.501488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2bfa62c6df4063b91180ce8ea487e1', 'request_id': 'req-50cf1195-2233-4b12-a424-26aa8c2dbc66'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.512356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2bfa62c6df4063b91180ce8ea487e1', 'request_id': 'req-50cf1195-2233-4b12-a424-26aa8c2dbc66'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.543906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2bfa62c6df4063b91180ce8ea487e1', 'request_id': 'req-50cf1195-2233-4b12-a424-26aa8c2dbc66'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.566793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] The token cache is being invalidate because project 7c2bfa62c6df4063b91180ce8ea487e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:05.567087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.568475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.572392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3258/6488] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:05 2022] DELETE /identity/v3/projects/7c2bfa62c6df4063b91180ce8ea487e1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:05.576430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:05.589804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa0fb6-1a4f-4ec4-9483-591582344691 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:05.749678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:05.751001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:05.751409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:05.751795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] PATH_INFO: `/v3/users/986e58277ab3410e865603aebde1bbf6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:05.753140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=986e58277ab3410e865603aebde1bbf6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:05.755750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:05.835415 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:05.839463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986e58277ab3410e865603aebde1bbf6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.861017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986e58277ab3410e865603aebde1bbf6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.881255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986e58277ab3410e865603aebde1bbf6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.906615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986e58277ab3410e865603aebde1bbf6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.907531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-449588f5-ba23-42ce-9959-b6c7638d5f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986e58277ab3410e865603aebde1bbf6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:05.924914 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3231/6489] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:05 2022] DELETE /identity/v3/users/986e58277ab3410e865603aebde1bbf6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:06.843716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:06.845200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:06.876910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1195-2233-4b12-a424-26aa8c2dbc66 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:07.059826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:07.060982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:07.061474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:07.061938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] PATH_INFO: `/v3/projects/7c64ef2aed1342438cc797d84336ac47` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:07.063905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c64ef2aed1342438cc797d84336ac47)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:07.069023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:07.163107 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:07.178796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c64ef2aed1342438cc797d84336ac47', 'request_id': 'req-804a20f0-56ef-4f85-bf75-8093f8c288b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:07.205393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c64ef2aed1342438cc797d84336ac47', 'request_id': 'req-804a20f0-56ef-4f85-bf75-8093f8c288b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:07.227646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c64ef2aed1342438cc797d84336ac47', 'request_id': 'req-804a20f0-56ef-4f85-bf75-8093f8c288b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:07.252118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] The token cache is being invalidate because project 7c64ef2aed1342438cc797d84336ac47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:07.252438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:07.255719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-804a20f0-56ef-4f85-bf75-8093f8c288b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:07.257751 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3259/6490] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:06 2022] DELETE /identity/v3/projects/7c64ef2aed1342438cc797d84336ac47 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:07.262399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:07.263663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:07.264155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:07.364498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:07.365864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:07.481762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3232/6491] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:07.489054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:07.489353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:07.489647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:07.533166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:07.534840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:07.556731 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3260/6492] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:07.564938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:07.581516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884d38-c52b-44ac-9935-da6acc333206 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:07.603971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:07.604817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:07.605207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:07.605606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:07.606779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:07.607192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:07.608942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:07.639039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:07.640048 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3233/6493] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:07.656919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e375-2768-4e16-a296-1327bd836c53 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:07.679923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:07.679923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:07.683353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:07.683353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:07.683353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:07.687834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:07.748446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3261/6494] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:07 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:14:07.752640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:07.800549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4c6d7-ec1c-4232-911c-8bf2d7202041 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:08.036582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:08.038364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:08.038364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:08.038691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:08.039443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:08.063254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:08.126638 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3234/6495] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:07 2022] POST /identity/v3/users => generated 300 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:08.126833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:08.151507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea5bd-7474-4be2-b7ef-4c7ce472b915 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:08.185893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:08.190320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:08.190724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:08.191014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:08.191809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:08.197878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:08.237664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:08.238881 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3262/6496] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:08.250772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4541d3-be32-4969-8bf7-f65f1b7b1e9c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:08.275936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0375-a452-4af1-b868-47f789f0ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:08.276565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0375-a452-4af1-b868-47f789f0ad2f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:08.276565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0375-a452-4af1-b868-47f789f0ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:08.276719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0375-a452-4af1-b868-47f789f0ad2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:08.277369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed0375-a452-4af1-b868-47f789f0ad2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:08.283112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed0375-a452-4af1-b868-47f789f0ad2f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:08.300764 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3235/6497] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:14:08.305960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:08.325072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf37e-9c87-40a8-baf4-bb1111191117 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:08.337779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:08.338987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:08.340400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:08.340752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] PATH_INFO: `/v3/projects/e1f347dc69cb44d99332acf54b50e7d2/users/2f480e5c1bd54ec9b16c8d2f45d3606f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:08.379847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f347dc69cb44d99332acf54b50e7d2, user_id=2f480e5c1bd54ec9b16c8d2f45d3606f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:08.392887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:08.459696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3263/6498] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:08 2022] PUT /identity/v3/projects/e1f347dc69cb44d99332acf54b50e7d2/users/2f480e5c1bd54ec9b16c8d2f45d3606f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:08.471218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbdbe7-cf1f-4665-a9f4-7b3d1c054715 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:08.471890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbdbe7-cf1f-4665-a9f4-7b3d1c054715 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:08.472371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbdbe7-cf1f-4665-a9f4-7b3d1c054715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:08.482872 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:08.583509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8ebbdbe7-cf1f-4665-a9f4-7b3d1c054715 None None] MFA Rules not processed for user `2f480e5c1bd54ec9b16c8d2f45d3606f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:08.587679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ebbdbe7-cf1f-4665-a9f4-7b3d1c054715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:08.901305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:08.901741 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3236/6499] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:09.107879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb947-57c5-4690-8c5a-b61ea7e6cb2d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.122426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.123128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.133909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.134436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.135123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:09.147479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:09.188364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.188654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.188938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.226032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3264/6500] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:08 2022] POST /identity/v3/projects => generated 399 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:14:09.229642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:09.257339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:09.265929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:09.345946 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:09.386416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453a1f-a769-414d-bf92-b30d1aed1f20 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.392348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.393180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.393580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.394237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.395344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:09.399264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:09.425079 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3237/6501] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:09.461700 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3265/6502] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:09 2022] POST /identity/v3/users => generated 306 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:14:09.465927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:09.487650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdb4b0-4dba-4dda-bc68-ef776951db42 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.504554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.505519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.505997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.506429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.507392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:09.509650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:09.521633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:09.523717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:09.528619 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3238/6503] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:09.529949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:09.573230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f8f5-3a42-4c86-b3ab-5c209ea13485 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.591454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.592472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.592665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.592942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] PATH_INFO: `/v3/projects/24d7911d7e9540479fa386d02aafedf3/users/4fe856c5540b461985c4d06f1f2b041a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.652369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d7911d7e9540479fa386d02aafedf3, user_id=4fe856c5540b461985c4d06f1f2b041a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:09.663280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:09.694415 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3239/6504] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:09 2022] PUT /identity/v3/projects/24d7911d7e9540479fa386d02aafedf3/users/4fe856c5540b461985c4d06f1f2b041a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:09.698845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:09.746548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e79c3-155f-4fec-a1a9-939a8c1a4533 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.847428 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:09.873523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013362a-8fca-46a6-bf47-340630b3c496 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.888034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.888667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.888959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.889242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.889987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:09.891647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:09.915164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.915839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.916133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.916416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.924870 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3240/6505] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:14:09.929169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:09.951433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da74c1-d06c-4ada-a3be-587151110bc3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:09.964859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dbccb-0065-4d04-b86f-edada558d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:09.965795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dbccb-0065-4d04-b86f-edada558d6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:09.966084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dbccb-0065-4d04-b86f-edada558d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:09.966366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dbccb-0065-4d04-b86f-edada558d6cd admin admin] PATH_INFO: `/v3/projects/24d7911d7e9540479fa386d02aafedf3/users/4fe856c5540b461985c4d06f1f2b041a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:09.972596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dbccb-0065-4d04-b86f-edada558d6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d7911d7e9540479fa386d02aafedf3, user_id=4fe856c5540b461985c4d06f1f2b041a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:09.975270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dbccb-0065-4d04-b86f-edada558d6cd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:10.006461 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3241/6506] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:09 2022] PUT /identity/v3/projects/24d7911d7e9540479fa386d02aafedf3/users/4fe856c5540b461985c4d06f1f2b041a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:10.018433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:10.018746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:10.019204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:10.049469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:10.056852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:10.071479 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3266/6507] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:14:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:14:10.083786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] MFA Rules not processed for user `4fe856c5540b461985c4d06f1f2b041a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:10.085208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:10.305535 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3242/6508] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:14:10.319875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:10.321830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:10.426237 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:10.603818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573644-a968-418d-9eef-5c03e751b853 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:10.795841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:10.796544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:10.796836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:10.797207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:10.869819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:10.878764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:10.936845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3267/6509] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:11.136723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:11.156144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734e11-4b1b-4be4-9c4f-e5aeacebbfc2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:11.174168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7f946-1749-47d9-977e-9dd619022432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:11.175923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f946-1749-47d9-977e-9dd619022432 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:11.181624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f946-1749-47d9-977e-9dd619022432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:11.181830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f946-1749-47d9-977e-9dd619022432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:11.500370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7f946-1749-47d9-977e-9dd619022432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:11.501885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7f946-1749-47d9-977e-9dd619022432 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:11.576195 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3243/6510] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:13.347954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:13.350193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:13.579661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673a4a-acbd-4e3b-9687-ac3892b517f7 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:13.586485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:13.587698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:13.587990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:13.588270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] PATH_INFO: `/v3/users/b0416602e28a4b2abd318c9b94db1d39` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:13.589505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0416602e28a4b2abd318c9b94db1d39)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:13.592499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:13.669049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0416602e28a4b2abd318c9b94db1d39'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:13.669884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0416602e28a4b2abd318c9b94db1d39'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:13.688099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0416602e28a4b2abd318c9b94db1d39'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:13.688962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0416602e28a4b2abd318c9b94db1d39'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:13.699462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0416602e28a4b2abd318c9b94db1d39'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:13.713517 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:13.720715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3268/6511] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:13 2022] DELETE /identity/v3/users/b0416602e28a4b2abd318c9b94db1d39 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:13.725079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035734-e438-4c50-a977-987ff9ced54c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:13.725666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035734-e438-4c50-a977-987ff9ced54c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:13.725666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035734-e438-4c50-a977-987ff9ced54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:13.751934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-11035734-e438-4c50-a977-987ff9ced54c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:13.754084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11035734-e438-4c50-a977-987ff9ced54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:13.830842 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:13.845732 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3244/6512] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:13.856718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:13.859450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:13.997986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bfccb-5aef-4da8-b98a-631f6ab6f1d4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:14.004447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec4c7-9158-4b08-8037-7d13b35772ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:14.006157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec4c7-9158-4b08-8037-7d13b35772ab service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:14.006700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec4c7-9158-4b08-8037-7d13b35772ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:14.007197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec4c7-9158-4b08-8037-7d13b35772ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:14.036118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdec4c7-9158-4b08-8037-7d13b35772ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:14.040258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdec4c7-9158-4b08-8037-7d13b35772ab service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:14.071161 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3269/6513] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:14.479545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035734-e438-4c50-a977-987ff9ced54c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:14.481310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11035734-e438-4c50-a977-987ff9ced54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:14.504326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035734-e438-4c50-a977-987ff9ced54c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:14.511505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:14.512402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:14.512691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:14.512970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] PATH_INFO: `/v3/projects/5efa5fe6cc304eb19dd8863ea2b10266` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:14.514388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efa5fe6cc304eb19dd8863ea2b10266)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:14.521971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:14.656713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efa5fe6cc304eb19dd8863ea2b10266', 'request_id': 'req-63f692d0-3426-47a7-a2b9-13f1e37f017b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:14.669443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efa5fe6cc304eb19dd8863ea2b10266', 'request_id': 'req-63f692d0-3426-47a7-a2b9-13f1e37f017b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:14.700896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efa5fe6cc304eb19dd8863ea2b10266', 'request_id': 'req-63f692d0-3426-47a7-a2b9-13f1e37f017b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:14.721808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] The token cache is being invalidate because project 5efa5fe6cc304eb19dd8863ea2b10266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:14.726157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:14.736965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63f692d0-3426-47a7-a2b9-13f1e37f017b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:14.740269 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3245/6514] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:14 2022] DELETE /identity/v3/projects/5efa5fe6cc304eb19dd8863ea2b10266 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:14.747177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:14.747691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:14.747803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:14.800929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:14.802968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:14.885773 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3270/6515] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:14.893991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:14.894583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:14.895035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:14.942613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:14.944433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:14.972612 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3246/6516] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:14.978449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.023030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11c18-ab2a-4c40-8b55-3818994612c1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:15.038208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:15.040087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.040371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.041563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.042262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:15.042599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:15.044235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:15.074347 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3271/6517] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:15.075853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.093792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba75796-edde-499d-be9c-d8ad9703d33b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:15.108510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:15.109192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.110243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.110611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.112125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:15.114110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:15.201919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3247/6518] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:15 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:15.203449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.233178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b04d7-b419-4238-bae3-556f79ae6a16 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:15.420687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:15.421819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.422154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.422544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.423450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:15.426274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:15.477562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3272/6519] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:15 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:15.482599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.511017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66e76-be87-4be7-b742-3673210b1020 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:15.519040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:15.520766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.521222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.521587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.523015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:15.526005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:15.544790 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3248/6520] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:15.549879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.593373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6a83c-ba84-4a7b-a444-cb132fd6be62 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:15.602071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e1bb6-e381-414c-8087-20379b2bf24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:15.606108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e1bb6-e381-414c-8087-20379b2bf24c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.606570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e1bb6-e381-414c-8087-20379b2bf24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.606957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e1bb6-e381-414c-8087-20379b2bf24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.607820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e1bb6-e381-414c-8087-20379b2bf24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:15.613290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e1bb6-e381-414c-8087-20379b2bf24c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:15.619593 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:15.638076 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3273/6521] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:15.639468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.655076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17707b4-3e91-45f9-929f-9e90d5bbfbd4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:15.662257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:15.664255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.664637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.665010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] PATH_INFO: `/v3/projects/7442df15fb424b45846593df7da7e9a1/users/66f2a8985a6b4bbd803980b032294ef1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.690241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7442df15fb424b45846593df7da7e9a1, user_id=66f2a8985a6b4bbd803980b032294ef1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:15.694237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:15.741124 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3249/6522] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:15 2022] PUT /identity/v3/projects/7442df15fb424b45846593df7da7e9a1/users/66f2a8985a6b4bbd803980b032294ef1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:15.758357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:15.759389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:15.760095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:15.837177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] MFA Rules not processed for user `66f2a8985a6b4bbd803980b032294ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:15.838716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:15.983067 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3274/6523] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:15.993654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:15.995818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:16.089312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c067540-7364-4f3a-ac27-4cfb77e324e6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:16.102976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:16.103715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:16.104007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:16.104285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:16.126213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:16.128186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:16.159646 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3250/6524] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:17.722301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:17.724647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:18.154384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e1a0-ec36-461c-b2ee-0e7d0c628836 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:18.187616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:18.188810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:18.189274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:18.189716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] PATH_INFO: `/v3/users/be383233f10c45ed83035ac644478535` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:18.193538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be383233f10c45ed83035ac644478535)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:18.196290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:18.338446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be383233f10c45ed83035ac644478535'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:18.339180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be383233f10c45ed83035ac644478535'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:18.375046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be383233f10c45ed83035ac644478535'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:18.375844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be383233f10c45ed83035ac644478535'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:18.392311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be383233f10c45ed83035ac644478535'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:18.425970 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3275/6525] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:17 2022] DELETE /identity/v3/users/be383233f10c45ed83035ac644478535 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:18.924357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:18.943247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982a7c5-d576-4639-86d2-2b707fba363a service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:19.080009 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:19.310434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:19.311114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:19.311407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:19.311691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] PATH_INFO: `/v3/projects/f4f35641eaf04b7c89e24aebeb84222d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:19.321467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f35641eaf04b7c89e24aebeb84222d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:19.328670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:19.495659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f35641eaf04b7c89e24aebeb84222d', 'request_id': 'req-4e7a2657-4574-43c2-b8f9-89bd024982fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:19.512846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f35641eaf04b7c89e24aebeb84222d', 'request_id': 'req-4e7a2657-4574-43c2-b8f9-89bd024982fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:19.556869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f35641eaf04b7c89e24aebeb84222d', 'request_id': 'req-4e7a2657-4574-43c2-b8f9-89bd024982fa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:19.579565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] The token cache is being invalidate because project f4f35641eaf04b7c89e24aebeb84222d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:19.579871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:19.581101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:19.589064 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3251/6526] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:18 2022] DELETE /identity/v3/projects/f4f35641eaf04b7c89e24aebeb84222d => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:19.589902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:19.592579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:19.617537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad455-3a6f-4034-a34b-2559664cbf0e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:19.635624 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:19.818269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:19.820806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:19.821347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:19.821847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] PATH_INFO: `/v3/users/c412ff7a1ed547df88f5840021a7c3b9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:19.835967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c412ff7a1ed547df88f5840021a7c3b9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:19.838220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:19.992563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c412ff7a1ed547df88f5840021a7c3b9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:19.993855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c412ff7a1ed547df88f5840021a7c3b9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:20.040282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c412ff7a1ed547df88f5840021a7c3b9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:20.042475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c412ff7a1ed547df88f5840021a7c3b9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:20.079665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4f8809be-0493-433d-aee2-446379b872e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c412ff7a1ed547df88f5840021a7c3b9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:20.116097 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3276/6527] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:19 2022] DELETE /identity/v3/users/c412ff7a1ed547df88f5840021a7c3b9 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:20.828640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:20.831073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:20.860719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a2657-4574-43c2-b8f9-89bd024982fa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:20.960182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:20.962451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:20.962451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:20.962451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] PATH_INFO: `/v3/projects/b28e10c0ca7f4844bcd2d1b3281323aa` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:20.964838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28e10c0ca7f4844bcd2d1b3281323aa)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:20.966967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:21.067592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28e10c0ca7f4844bcd2d1b3281323aa', 'request_id': 'req-33008b81-ba88-48fb-befc-39ab981730b1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:21.079126 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:21.085369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28e10c0ca7f4844bcd2d1b3281323aa', 'request_id': 'req-33008b81-ba88-48fb-befc-39ab981730b1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:21.106576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28e10c0ca7f4844bcd2d1b3281323aa', 'request_id': 'req-33008b81-ba88-48fb-befc-39ab981730b1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:21.129743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] The token cache is being invalidate because project b28e10c0ca7f4844bcd2d1b3281323aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:21.131254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:21.135515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-33008b81-ba88-48fb-befc-39ab981730b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:21.141676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3252/6528] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:20 2022] DELETE /identity/v3/projects/b28e10c0ca7f4844bcd2d1b3281323aa => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:21.149570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.150084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.150084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.178886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:21.180681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:21.301004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3277/6529] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:21.309765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.310288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.311049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.361252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:21.363848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:21.391092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3253/6530] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:21.392605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:21.405828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0abda-a142-4dfa-9896-da199b7cf90c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:21.418258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:21.419161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.419766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.420194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.423421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:21.423905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:21.425965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:21.457356 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3278/6531] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:14:21.462721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:21.477159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a535e-edde-4dd6-bd9e-55c4a963fb00 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:21.490523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:21.491367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.492326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.492722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.493525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:21.496891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:21.573182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:21.573759 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3254/6532] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:21 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:21.589507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954fe44-0eb8-493b-8b5f-823fcd409b26 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:21.609597 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:21.745690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:21.747379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.748736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.748736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.752531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:21.763093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:21.815259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:21.826592 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3279/6533] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:21 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:21.833195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1def59e-1412-453d-84b7-545ba8448d88 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:21.839058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:21.840571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.841723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.843216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.844199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:21.848616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:21.879185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3255/6534] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:21.885226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:21.903195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8af7d-282a-4420-8e46-31234bdc9c83 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:21.919202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407eb6-3628-4e01-913d-63d148f57c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:21.920151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407eb6-3628-4e01-913d-63d148f57c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.922793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407eb6-3628-4e01-913d-63d148f57c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.923408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407eb6-3628-4e01-913d-63d148f57c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:21.925878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22407eb6-3628-4e01-913d-63d148f57c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:21.931576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22407eb6-3628-4e01-913d-63d148f57c7b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:21.964665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:21.977063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3280/6535] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:21.979269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96882-7902-4647-902b-cbcf3d601ddb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:21.990806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:21.994855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:21.996921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:21.998456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] PATH_INFO: `/v3/projects/3c9da658b5fa4431882732073eb79f17/users/9ac8dd111bed4a51a19c945800c0452c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:22.017336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9da658b5fa4431882732073eb79f17, user_id=9ac8dd111bed4a51a19c945800c0452c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:22.021317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:22.079902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:22.080436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:22.081730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:22.083676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3256/6536] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:21 2022] PUT /identity/v3/projects/3c9da658b5fa4431882732073eb79f17/users/9ac8dd111bed4a51a19c945800c0452c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:22.156752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] MFA Rules not processed for user `9ac8dd111bed4a51a19c945800c0452c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:22.162478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:22.363959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:22.366445 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3281/6537] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:22.560031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24012-3f60-4621-8d1f-2bb0d00c38b9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:22.574484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:22.575504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:22.577138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:22.577577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:22.580662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:22.586115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:22.652999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:22.671485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3257/6538] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:22 2022] POST /identity/v3/projects => generated 387 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:22.673423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eb344-84f4-44b9-a17b-8cc39b2a8540 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:22.925633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:22.929170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:22.930140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:22.930456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:22.946305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:22.957973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:23.023205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:23.023792 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3282/6539] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:22 2022] POST /identity/v3/users => generated 300 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:23.036438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a7b6-b43c-42db-9b7d-acf56a1d09f8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:23.060124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:23.061741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:23.063100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:23.063100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:23.066050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:23.072883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:23.118108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:23.138639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3258/6540] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:23.143210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd792d5-12cc-4270-9380-ea2d1aed80d1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:23.158721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:23.159693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:23.159986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:23.161421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] PATH_INFO: `/v3/projects/9f79344a3a6245d6945496794360e0a8/users/fa4c89eef73f41ac83a6a76cafb3a351/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:23.178131 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:23.206374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f79344a3a6245d6945496794360e0a8, user_id=fa4c89eef73f41ac83a6a76cafb3a351, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:23.219464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:23.277488 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3283/6541] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:23 2022] PUT /identity/v3/projects/9f79344a3a6245d6945496794360e0a8/users/fa4c89eef73f41ac83a6a76cafb3a351/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:23.281632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:23.300451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3db88-e0c8-4565-a806-a6183245150a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:23.495306 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:23.515495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d04a3-806b-44b2-96dd-0954d6c5b072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:23.516356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d04a3-806b-44b2-96dd-0954d6c5b072 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:23.516817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d04a3-806b-44b2-96dd-0954d6c5b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:23.517243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d04a3-806b-44b2-96dd-0954d6c5b072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:23.518133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d04a3-806b-44b2-96dd-0954d6c5b072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:23.519945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d04a3-806b-44b2-96dd-0954d6c5b072 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:23.547145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:23.560692 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3259/6542] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:23.571478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01651-ec1b-4d11-b8da-5646aa88901f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:23.584223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:23.585961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:23.586659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:23.587084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] PATH_INFO: `/v3/projects/9f79344a3a6245d6945496794360e0a8/users/fa4c89eef73f41ac83a6a76cafb3a351/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:23.598951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f79344a3a6245d6945496794360e0a8, user_id=fa4c89eef73f41ac83a6a76cafb3a351, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:23.603247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:23.628707 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3284/6543] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:23 2022] PUT /identity/v3/projects/9f79344a3a6245d6945496794360e0a8/users/fa4c89eef73f41ac83a6a76cafb3a351/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:23.629911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:23.630356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:23.630806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:23.699424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] MFA Rules not processed for user `fa4c89eef73f41ac83a6a76cafb3a351`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:23.700786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:23.896956 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3260/6544] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:23.902073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:23.938929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f89d1a-3b10-4496-9887-b520df9755fe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:23.955962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:23.956957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:23.959149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:23.959598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:23.961070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:23.969675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:24.063348 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3285/6545] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:23 2022] POST /identity/v3/projects => generated 360 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:24.064739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:24.083638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684d457-c017-4c0e-932e-51c7ca5b5c5e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:24.246392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:24.248603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:24.275005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:24.276108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:24.276400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:24.276684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-313875918` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:24.280104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=00e5e0e7c8884ff89de6e5b726f69284, value=tempest-tag-313875918)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:24.282575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:24.405923 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-313875918. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:14:24.405923 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:14:24.405923 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:24.420538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3261/6546] 10.222.0.77 () {60 vars in 1329 bytes} [Mon Jul 11 15:14:24 2022] PUT /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-313875918 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Jul 11 15:14:24.425163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:24.447431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11b426-067e-443b-ad85-97bc16ad082f tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:24.455358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:24.458680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:24.458855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149184d0-7915-45f9-b531-71fc9b313fc3 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:24.459998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:24.460902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] PATH_INFO: `/v3/users/2f480e5c1bd54ec9b16c8d2f45d3606f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:24.463853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f480e5c1bd54ec9b16c8d2f45d3606f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:24.469291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:24.469524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:24.470230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:24.470536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:24.473200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-313875918` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:24.510059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=00e5e0e7c8884ff89de6e5b726f69284, value=tempest-tag-313875918)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:24.512506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:24.536620 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3262/6547] 10.222.0.77 () {58 vars in 1310 bytes} [Mon Jul 11 15:14:24 2022] GET /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-313875918 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:24.538075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:24.566050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f480e5c1bd54ec9b16c8d2f45d3606f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:24.567181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f480e5c1bd54ec9b16c8d2f45d3606f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:24.569360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ecadd-2726-4130-939c-ecc9e9c4efd8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:24.599268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f480e5c1bd54ec9b16c8d2f45d3606f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:24.600210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f480e5c1bd54ec9b16c8d2f45d3606f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:24.603422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:24.606182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:24.606486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:24.606813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:24.609227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1324b3b6-5294-4da8-83b2-2e1eda80a139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f480e5c1bd54ec9b16c8d2f45d3606f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:24.609778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=00e5e0e7c8884ff89de6e5b726f69284)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:24.614583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:24.619670 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:24.639730 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3286/6548] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:24 2022] DELETE /identity/v3/users/2f480e5c1bd54ec9b16c8d2f45d3606f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:24.644127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:24.644427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:24.644706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:24.691993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:24.693227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:24.733510 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:24.781338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3263/6549] 10.222.0.77 () {60 vars in 1264 bytes} [Mon Jul 11 15:14:24 2022] PUT /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags => generated 141 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:24.785452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:24.789097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:24.817843 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3287/6550] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:24.831796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f4a1-a63a-4963-ac6a-a1091b8b9cb8 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:24.890251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:24.892061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:25.007990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.010329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.010941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.011695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.029563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=00e5e0e7c8884ff89de6e5b726f69284)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.031897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.055634 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3264/6551] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 11 15:14:24 2022] GET /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags => generated 141 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:25.059351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:25.073135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0f5a9-fb28-49be-858f-a6155584f101 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.077390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.077996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.078285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.078640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.083931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5029f-c1a4-4ef5-9b75-43c2e6b2f8ca tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.099584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.100820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.101478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.102744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-1952345928` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.104783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=00e5e0e7c8884ff89de6e5b726f69284, value=tempest-tag-1952345928)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.109226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.110880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.112854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.140574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3288/6552] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:25.216598 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1952345928. To ensure interoperability, identifiers should be a valid uuid. Jul 11 15:14:25.216598 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 11 15:14:25.216598 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:25.223887 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3265/6553] 10.222.0.77 () {58 vars in 1316 bytes} [Mon Jul 11 15:14:25 2022] DELETE /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-1952345928 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:25.227736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:25.241282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda21a6-f9db-4f65-a12a-172dc1909a25 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.259318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.261080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.261520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.261952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-1952345928` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.293874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=00e5e0e7c8884ff89de6e5b726f69284, value=tempest-tag-1952345928)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.299402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Could not find project tag: tempest-tag-1952345928.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1952345928. Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 11 15:14:25.341202 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 11 15:14:25.342424 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:14:25.342424 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:14:25.342424 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 11 15:14:25.342424 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 11 15:14:25.342424 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1952345928. Jul 11 15:14:25.342424 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:25.348128 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3289/6554] 10.222.0.77 () {58 vars in 1313 bytes} [Mon Jul 11 15:14:25 2022] GET /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags/tempest-tag-1952345928 => generated 107 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:14:25.350229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:25.375899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f00c9-2ae5-4e10-b703-d9db3c8ac19d tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.388432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.391759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.392041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.392331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.399943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=00e5e0e7c8884ff89de6e5b726f69284)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.409137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.533816 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3266/6555] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 11 15:14:25 2022] DELETE /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:25.535166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:25.549216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c6ab-d10c-499c-9600-c9f497258dea tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.558626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.559834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.560501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.560891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.590194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=00e5e0e7c8884ff89de6e5b726f69284)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.598187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.638991 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3290/6556] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 11 15:14:25 2022] GET /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284/tags => generated 66 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 11 15:14:25.639629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:25.656523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f30a0-e4f5-44a4-b6bf-78a477fcffa0 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.682971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c89eef73f41ac83a6a76cafb3a351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f79344a3a6245d6945496794360e0a8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:25.687602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:25.688920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:25.689117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] PATH_INFO: `/v3/projects/00e5e0e7c8884ff89de6e5b726f69284` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:25.700974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=00e5e0e7c8884ff89de6e5b726f69284)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:25.709073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:25.843655 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:25.911867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:25.914640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:25.922176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e5e0e7c8884ff89de6e5b726f69284', 'request_id': 'req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:25.952124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93086922-acb3-4df7-9e81-475cad4a751a tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:25.981603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e5e0e7c8884ff89de6e5b726f69284', 'request_id': 'req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.017704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e5e0e7c8884ff89de6e5b726f69284', 'request_id': 'req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.076288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] The token cache is being invalidate because project 00e5e0e7c8884ff89de6e5b726f69284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:26.076609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.081853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.096590 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3267/6557] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:25 2022] DELETE /identity/v3/projects/00e5e0e7c8884ff89de6e5b726f69284 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:26.102859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:26.111548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:26.155586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:26.157416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:26.157945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:26.159498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] PATH_INFO: `/v3/projects/e1f347dc69cb44d99332acf54b50e7d2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:26.161949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f347dc69cb44d99332acf54b50e7d2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:26.166359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:26.276572 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:26.293427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f347dc69cb44d99332acf54b50e7d2', 'request_id': 'req-8285257e-670d-4ab6-b567-3a8a8aeecf8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.314542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f347dc69cb44d99332acf54b50e7d2', 'request_id': 'req-8285257e-670d-4ab6-b567-3a8a8aeecf8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.331520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f347dc69cb44d99332acf54b50e7d2', 'request_id': 'req-8285257e-670d-4ab6-b567-3a8a8aeecf8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.360974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] The token cache is being invalidate because project e1f347dc69cb44d99332acf54b50e7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:26.361372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.362067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.367119 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3291/6558] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:25 2022] DELETE /identity/v3/projects/e1f347dc69cb44d99332acf54b50e7d2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:26.367777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:26.369177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:26.377818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a984-5386-4f7e-8fac-14f09f5a6ab6 tempest-IdentityV3ProjectTagsTest-1133805755 tempest-IdentityV3ProjectTagsTest-1133805755-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:26.513104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285257e-670d-4ab6-b567-3a8a8aeecf8f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:26.518979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:26.520003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:26.520291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:26.520570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] PATH_INFO: `/v3/users/4fe856c5540b461985c4d06f1f2b041a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:26.522062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe856c5540b461985c4d06f1f2b041a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:26.525071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:26.547264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:26.548278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:26.548626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:26.548964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] PATH_INFO: `/v3/users/9ac8dd111bed4a51a19c945800c0452c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:26.550872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac8dd111bed4a51a19c945800c0452c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:26.556905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:26.639470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe856c5540b461985c4d06f1f2b041a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.642482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe856c5540b461985c4d06f1f2b041a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.676874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac8dd111bed4a51a19c945800c0452c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.683697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe856c5540b461985c4d06f1f2b041a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.684660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe856c5540b461985c4d06f1f2b041a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.708714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac8dd111bed4a51a19c945800c0452c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.712331 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:26.714269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe856c5540b461985c4d06f1f2b041a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.727532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac8dd111bed4a51a19c945800c0452c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.745396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac8dd111bed4a51a19c945800c0452c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.746179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3d8ead8b-026c-489f-a7bd-a57a9a5b36ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac8dd111bed4a51a19c945800c0452c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:26.760761 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3268/6559] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:26 2022] DELETE /identity/v3/users/9ac8dd111bed4a51a19c945800c0452c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:26.765314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:26.765677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:26.766215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:26.773587 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3292/6560] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:26 2022] DELETE /identity/v3/users/4fe856c5540b461985c4d06f1f2b041a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:26.790380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:26.791825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:26.889788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3269/6561] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:26.907137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:26.911906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:27.060991 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:27.107055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36f27-7c8e-49db-a17f-08f2be14c57d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:27.115480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c67cd-b817-474e-9041-1557680771e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:27.116153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c67cd-b817-474e-9041-1557680771e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:27.117107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c67cd-b817-474e-9041-1557680771e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:27.117366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c67cd-b817-474e-9041-1557680771e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:27.144006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c67cd-b817-474e-9041-1557680771e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:27.145621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c67cd-b817-474e-9041-1557680771e0 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:27.165854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3293/6562] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:27.707690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:27.709167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:27.741080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ac84-9a53-4bf5-be81-de0f3d2627f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:27.755150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:27.770319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:27.771038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:27.771480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] PATH_INFO: `/v3/projects/24d7911d7e9540479fa386d02aafedf3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:27.773637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d7911d7e9540479fa386d02aafedf3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:27.776762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:27.890357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d7911d7e9540479fa386d02aafedf3', 'request_id': 'req-004b7434-64b9-46f5-8a56-897e6aec5791'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:27.896139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d7911d7e9540479fa386d02aafedf3', 'request_id': 'req-004b7434-64b9-46f5-8a56-897e6aec5791'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:27.937361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d7911d7e9540479fa386d02aafedf3', 'request_id': 'req-004b7434-64b9-46f5-8a56-897e6aec5791'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:27.956169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] The token cache is being invalidate because project 24d7911d7e9540479fa386d02aafedf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:27.956725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:27.958802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-004b7434-64b9-46f5-8a56-897e6aec5791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:27.964176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3270/6563] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:27 2022] DELETE /identity/v3/projects/24d7911d7e9540479fa386d02aafedf3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:27.968979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:27.969506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:27.969611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:28.013337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:28.014591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:28.086401 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3294/6564] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:28.094186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:28.094537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:28.094791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:28.154896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:28.156703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:28.176919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3271/6565] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:28.181536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:28.197461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce29c74-dd59-464a-b1ea-e44719efe8cb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:28.209492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:28.211016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:28.211399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:28.211787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:28.212624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:28.214202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:28.219197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:28.258089 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3295/6566] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:28.258925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:28.281161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283142-bb14-4c4e-b52a-67a6c94f3c92 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:28.292737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:28.294209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:28.295037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:28.296087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:28.298143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:28.303467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:28.369315 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3272/6567] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:28 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:14:28.372899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:28.389832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d0ba6-0475-46b7-a3f1-492ee5c833d6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:28.515818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:28.518163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:28.750461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:28.750461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:28.750461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:28.750461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:28.760595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:28.760754 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:28.761216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:28.761338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbed3-29bd-4348-bc8a-12a68c43b409 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:28.761338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:28.761338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:28.761338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:28.761741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] PATH_INFO: `/v3/projects/3c9da658b5fa4431882732073eb79f17` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:28.761741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9da658b5fa4431882732073eb79f17)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:28.761741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:28.808752 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3296/6568] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:28 2022] POST /identity/v3/users => generated 292 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:28.810209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:28.853658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4e2e-ecd6-4e92-aac4-befe14b00bfb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:28.863845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9da658b5fa4431882732073eb79f17', 'request_id': 'req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:28.881235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9da658b5fa4431882732073eb79f17', 'request_id': 'req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:28.900003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9da658b5fa4431882732073eb79f17', 'request_id': 'req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:28.926916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] The token cache is being invalidate because project 3c9da658b5fa4431882732073eb79f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:28.926916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:28.927687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:28.935087 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3273/6569] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:28 2022] DELETE /identity/v3/projects/3c9da658b5fa4431882732073eb79f17 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:28.938843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:28.944262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:29.087716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7adb0-5fb5-4eb9-8c0c-b8eb1d17b498 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:29.093824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.094815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.095180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.095466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] PATH_INFO: `/v3/users/fa4c89eef73f41ac83a6a76cafb3a351` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.096716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4c89eef73f41ac83a6a76cafb3a351)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.099209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.099898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.100024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.100185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.100447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.102614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.106004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.107750 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:29.132977 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3297/6570] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:29.134897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:29.138093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:29.168158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d597e8-284d-4214-9ba3-a1f0a19a8675 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:29.173817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.177188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.177188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.177188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.177188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.177981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.199597 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3298/6571] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:29.199597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:29.232119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739cc43-ff69-4a3b-9d53-1743bdb0ca9a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:29.248666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.249576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.249857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.250243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] PATH_INFO: `/v3/projects/96d5749c9f154a85ae89e93b2483313c/users/f5ab333df34646e98131536b8a750682/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.250772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4c89eef73f41ac83a6a76cafb3a351'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.271947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d5749c9f154a85ae89e93b2483313c, user_id=f5ab333df34646e98131536b8a750682, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.275526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.277209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4c89eef73f41ac83a6a76cafb3a351'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.294044 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:29.296654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4c89eef73f41ac83a6a76cafb3a351'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.309726 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3299/6572] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:29 2022] PUT /identity/v3/projects/96d5749c9f154a85ae89e93b2483313c/users/f5ab333df34646e98131536b8a750682/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:29.310845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:29.321651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4c89eef73f41ac83a6a76cafb3a351'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.322355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb0a16e2-168a-4373-bb2e-4908824cd879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4c89eef73f41ac83a6a76cafb3a351'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.322993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:29.333424 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3274/6573] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:28 2022] DELETE /identity/v3/users/fa4c89eef73f41ac83a6a76cafb3a351 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:29.334969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.335885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.336265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.375728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] MFA Rules not processed for user `f5ab333df34646e98131536b8a750682`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:29.381125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:29.503876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e3fe-1a6e-47bd-8df6-8a03c4499303 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:29.511966 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3275/6574] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:29.516365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:29.518319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:29.637268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57170a23-4730-4d8b-ba4b-ba0985de8ba3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:29.645353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.646175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.646640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.647066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.648460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.651342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.715360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.715360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.715360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.715360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] PATH_INFO: `/v3/users/66f2a8985a6b4bbd803980b032294ef1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.717109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f2a8985a6b4bbd803980b032294ef1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.719076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.732823 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3276/6575] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:29 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:14:29.735947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:29.877911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f2a8985a6b4bbd803980b032294ef1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.882725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f2a8985a6b4bbd803980b032294ef1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.916588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f2a8985a6b4bbd803980b032294ef1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.917411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f2a8985a6b4bbd803980b032294ef1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.920386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d28184-93f7-487b-b4de-a1e55c7d8e44 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:29.925895 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:29.929568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deeee995-e34b-430a-a714-bb8f9f2b6f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f2a8985a6b4bbd803980b032294ef1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:29.942944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:29.947363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.947882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.948722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:29.951376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:29.951630 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3300/6576] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:29 2022] DELETE /identity/v3/users/66f2a8985a6b4bbd803980b032294ef1 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:29.968967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:29.978610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:29.979539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:29.980148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.003432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:30.004888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.021341 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:30.058279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3277/6577] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:29 2022] POST /identity/v3/users => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:30.066951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.069125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.091823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213922-7d95-453b-9558-8f1dc1722696 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.187245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.188414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.188703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.188983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] PATH_INFO: `/v3/projects/9f79344a3a6245d6945496794360e0a8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.191055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f79344a3a6245d6945496794360e0a8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.192756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.238807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3301/6578] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:30.239840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.243590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.253410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f79344a3a6245d6945496794360e0a8', 'request_id': 'req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:30.260368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f79344a3a6245d6945496794360e0a8', 'request_id': 'req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:30.272609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1d807-5fa1-48fc-b268-f52d91fa4a42 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.274778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f79344a3a6245d6945496794360e0a8', 'request_id': 'req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:30.292434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] The token cache is being invalidate because project 9f79344a3a6245d6945496794360e0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:30.292889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:30.293862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:30.298905 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3278/6579] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:30 2022] DELETE /identity/v3/projects/9f79344a3a6245d6945496794360e0a8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:30.299923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.301719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.374373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0ad2f-cee3-486b-84a0-5c0dbd9bdf9d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.380216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.381076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.381461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.381850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.384451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.423044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566f26d-9e9e-43a2-8285-d860a9410d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.427103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f26d-9e9e-43a2-8285-d860a9410d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.427521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f26d-9e9e-43a2-8285-d860a9410d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.427903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f26d-9e9e-43a2-8285-d860a9410d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.431147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566f26d-9e9e-43a2-8285-d860a9410d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.436939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566f26d-9e9e-43a2-8285-d860a9410d3c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.460890 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3302/6580] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:30.462456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.463016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.463401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.488038 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:30.512457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:30.513967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.536475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.538765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b0f7-87a5-4604-b97a-934e7762e141 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.543928 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3303/6581] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:30.544992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.547451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.561558 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3279/6582] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:30.563851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.566668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.567072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.574253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b0d0-1e5d-4d41-a388-6d4e7a9f11ae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.588617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.589694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.590788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.591185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] PATH_INFO: `/v3/projects/7d1699873d544a0ba2615e0a20067854/users/e82a4f5c874c4775bff4da223412abb0/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.614264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:30.615672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.637386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1699873d544a0ba2615e0a20067854, user_id=e82a4f5c874c4775bff4da223412abb0, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.639411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3280/6583] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:30.640100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.643444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.661862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554a67-28f2-4a9d-b7bd-35b813c3b245 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.663689 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3304/6584] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:30 2022] PUT /identity/v3/projects/7d1699873d544a0ba2615e0a20067854/users/e82a4f5c874c4775bff4da223412abb0/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:30.667532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.738813 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:30.752249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e9a90-adf5-4bdc-8ad2-99b864aa0a76 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.759406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.760307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.761427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.761715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.762901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.764961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.785847 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3305/6585] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:30.788236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.826704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a2b50-21c8-4db3-9f86-60994faf3381 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:30.839471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.842113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.843409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.843409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] PATH_INFO: `/v3/projects/7d1699873d544a0ba2615e0a20067854/users/e82a4f5c874c4775bff4da223412abb0/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.850514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1699873d544a0ba2615e0a20067854, user_id=e82a4f5c874c4775bff4da223412abb0, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.855291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.865007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:30.867344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:30.869731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:30.869731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:30.886727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:30.895319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:30.902054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:30.936235 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3306/6586] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:30 2022] PUT /identity/v3/projects/7d1699873d544a0ba2615e0a20067854/users/e82a4f5c874c4775bff4da223412abb0/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:30.940969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3281/6587] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:30.947554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.948078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:30.958807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:30.968707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51b0bb-5425-4d0a-b7e9-6632d32f1832 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.056777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e889-a80f-4f31-af46-b4b148fb1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.057689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e889-a80f-4f31-af46-b4b148fb1317 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.058152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e889-a80f-4f31-af46-b4b148fb1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.069143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e889-a80f-4f31-af46-b4b148fb1317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.072042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e889-a80f-4f31-af46-b4b148fb1317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.078877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e889-a80f-4f31-af46-b4b148fb1317 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.117963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287145b-2d81-4b25-a0cd-2567de3efcab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.123622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.124862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.124991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.125216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] PATH_INFO: `/v3/projects/7442df15fb424b45846593df7da7e9a1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.127176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7442df15fb424b45846593df7da7e9a1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.129434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.182596 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3282/6588] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:30 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:31.184368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608ee1-61c5-44f0-b944-befb233adde1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.186079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608ee1-61c5-44f0-b944-befb233adde1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.188269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608ee1-61c5-44f0-b944-befb233adde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.239915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7442df15fb424b45846593df7da7e9a1', 'request_id': 'req-8da28e9f-7b3a-4058-86e5-d173728c50c9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:31.266333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7442df15fb424b45846593df7da7e9a1', 'request_id': 'req-8da28e9f-7b3a-4058-86e5-d173728c50c9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:31.278278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7442df15fb424b45846593df7da7e9a1', 'request_id': 'req-8da28e9f-7b3a-4058-86e5-d173728c50c9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:31.295057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] The token cache is being invalidate because project 7442df15fb424b45846593df7da7e9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:31.295707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:31.296619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:31.298545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3307/6589] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:30 2022] DELETE /identity/v3/projects/7442df15fb424b45846593df7da7e9a1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:31.299562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.305130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:31.308205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4b608ee1-61c5-44f0-b944-befb233adde1 None None] MFA Rules not processed for user `e82a4f5c874c4775bff4da223412abb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:31.309275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b608ee1-61c5-44f0-b944-befb233adde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:31.401113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da28e9f-7b3a-4058-86e5-d173728c50c9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.407154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce69a-aed3-47b9-a50c-535ed02ff945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.417041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce69a-aed3-47b9-a50c-535ed02ff945 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.417041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce69a-aed3-47b9-a50c-535ed02ff945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.417041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce69a-aed3-47b9-a50c-535ed02ff945 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.417041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce69a-aed3-47b9-a50c-535ed02ff945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.417041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce69a-aed3-47b9-a50c-535ed02ff945 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.424929 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:31.447510 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3308/6590] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:31 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:31.450414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.450923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.451458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.455054 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:31.526903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:31.534801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:31.562027 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3309/6591] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:31.563156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.598869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0206-a706-4fec-9b8b-5ccba9f64632 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.607926 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3283/6592] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:31.613752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.614096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.614314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.631943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.635380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.635684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.635970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.636728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.653427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.678333 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3310/6593] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:31.685620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:31.686956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:31.687692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.690468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:31.717517 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3284/6594] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:31.723304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.753708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f950cc8-864a-421c-ab25-0a04ca7dc608 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.765344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.766525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.767869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.768300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.769194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.778859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.810109 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3285/6595] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:31.813199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.841056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db76108-38f0-43d2-b191-7a402df9aeed admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.851545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5922-fd63-4cf2-9274-945a803fb878 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.862048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.862048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.862365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.862469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.862469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.863007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.863007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.863007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.863007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:31.863007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.864710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.882513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.884672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.896670 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3286/6596] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:31.898160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.912645 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3311/6597] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:31.926977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:31.934568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18683-f2ba-4ece-8ae9-a6aafd17214f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.948385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935fa14-8c22-4c65-a9c5-c6018c648721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.952588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935fa14-8c22-4c65-a9c5-c6018c648721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.952881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935fa14-8c22-4c65-a9c5-c6018c648721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.953163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935fa14-8c22-4c65-a9c5-c6018c648721 admin admin] PATH_INFO: `/v3/projects/f91994ecd9a4400193caaadeb96f031c/users/07b33ed8d3e74339a4aecab98d83e800/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.974371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c9b6-844b-4436-a0f3-e4abf6abac67 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:31.989846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935fa14-8c22-4c65-a9c5-c6018c648721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91994ecd9a4400193caaadeb96f031c, user_id=07b33ed8d3e74339a4aecab98d83e800, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:31.992601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935fa14-8c22-4c65-a9c5-c6018c648721 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:31.996079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:31.996986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:31.997276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:31.997546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:31.998240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.004977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.052986 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3287/6598] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:31 2022] PUT /identity/v3/projects/f91994ecd9a4400193caaadeb96f031c/users/07b33ed8d3e74339a4aecab98d83e800/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:32.068643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.070710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.072645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.089843 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3312/6599] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:32.090752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.165187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] MFA Rules not processed for user `07b33ed8d3e74339a4aecab98d83e800`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:32.166796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:32.250741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ae1ec-e3f3-4dbb-9589-fa76e8514718 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.258996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.260043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.260573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.261070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.261986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.266312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.303311 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3288/6600] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:32.304306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.305690 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3313/6601] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:32 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:32.308227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.328701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c2e7e-7766-4a28-aeaa-ff420c628d7c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.342032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.342747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.343214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.343632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.344984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.347504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.409335 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3314/6602] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:32 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:32.412004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.413673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0bcbf-ee81-4764-b8d4-a97c3c3d0de7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.435673 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:32.473779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.474435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.474756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.475086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.477147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:32.505789 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:32.590146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6df01-86c9-4b59-8e2e-dc127dc8d8ba admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.602268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.603106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.603517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.607780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.614470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.616904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.663847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.663847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.665498 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3315/6603] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:32.666422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.705509 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3289/6604] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:32.708610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfce4d-60b7-4cc9-9db2-9dab3179bf88 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.716866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.737169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.746877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780484fc-dc0e-4905-848f-b823470ea0f6 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.747013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.747013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.747013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.747013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.748907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.771313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.772040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.772542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.773322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.775018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.776958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.803421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3290/6605] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:32.811490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.835818 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3316/6606] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:32 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:32.841520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:32.867027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66cef1-6370-49e4-b68c-45ec8c3448fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.881982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3813d6-38db-4334-a3d6-025c92b3de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.886087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3813d6-38db-4334-a3d6-025c92b3de25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.887326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3813d6-38db-4334-a3d6-025c92b3de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.887697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3813d6-38db-4334-a3d6-025c92b3de25 admin admin] PATH_INFO: `/v3/projects/3e2e64f940a648788b4ea09c87b0295b/users/62868be01f8e41f7b473831fe3b7a396/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.892178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349a74-104c-4964-8773-ebf80ffd36d3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:32.917151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:32.918595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:32.918896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:32.919213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:32.923351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.924993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.976938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3813d6-38db-4334-a3d6-025c92b3de25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2e64f940a648788b4ea09c87b0295b, user_id=62868be01f8e41f7b473831fe3b7a396, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:32.985139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3813d6-38db-4334-a3d6-025c92b3de25 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:32.990873 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3317/6607] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:32.992688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.033159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0af5e-71ba-47ed-97c5-88f8cde18465 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.053660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3291/6608] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:32 2022] PUT /identity/v3/projects/3e2e64f940a648788b4ea09c87b0295b/users/62868be01f8e41f7b473831fe3b7a396/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:33.070276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:33.072617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:33.072917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:33.229086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] MFA Rules not processed for user `62868be01f8e41f7b473831fe3b7a396`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:33.233106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:33.358564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:33.359493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:33.359780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:33.360057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] PATH_INFO: `/v3/projects/8eeea9109fc449ea8598dae05411d413/users/f12f3061fa3e47f7a0ff6fcc80fe073a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:33.418589 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3292/6609] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:33.419219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.424511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeea9109fc449ea8598dae05411d413, user_id=f12f3061fa3e47f7a0ff6fcc80fe073a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:33.437866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:33.440750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62d0f-9808-48df-8669-802d137d6ca8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.463761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:33.466146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:33.467319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:33.468219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:33.469810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:33.478729 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3318/6610] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:32 2022] PUT /identity/v3/projects/8eeea9109fc449ea8598dae05411d413/users/f12f3061fa3e47f7a0ff6fcc80fe073a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:33.479379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:33.480287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.486900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:33.554270 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3293/6611] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:33 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:33.555584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.593606 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:33.627325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7e600-1736-46ca-87f2-195eba0934c7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.649232 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:33.738457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:33.739641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:33.740006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:33.740358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] PATH_INFO: `/v3/users/f5ab333df34646e98131536b8a750682` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:33.741888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ab333df34646e98131536b8a750682)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:33.744268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:33.748272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8e57-a599-416e-9ecb-b1a7906ee3cf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.766835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:33.767533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:33.767819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:33.768096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:33.768841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:33.770466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:33.793378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3294/6612] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:33.793885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.819895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31898b8e-07cb-4d61-a305-f64c13991143 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.829647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:33.832260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:33.832608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:33.832822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:33.833522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:33.835531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:33.847997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ab333df34646e98131536b8a750682'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:33.849274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ab333df34646e98131536b8a750682'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:33.867439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ab333df34646e98131536b8a750682'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:33.868967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ab333df34646e98131536b8a750682'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:33.871397 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3295/6613] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:33 2022] POST /identity/v3/users => generated 293 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:33.872216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.879922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:33.880545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ab333df34646e98131536b8a750682'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:33.901702 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3319/6614] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:33 2022] DELETE /identity/v3/users/f5ab333df34646e98131536b8a750682 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:33.903175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:33.904974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:33.909158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5cf5b-ac7d-49ba-ad7e-6d0d085e8315 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.992583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc67-4af4-4ed7-a36d-eadcdabab9eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:33.998738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a909751-d70c-4be0-981f-c66c6c46e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:33.999706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a909751-d70c-4be0-981f-c66c6c46e777 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.000378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a909751-d70c-4be0-981f-c66c6c46e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.000882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a909751-d70c-4be0-981f-c66c6c46e777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.002649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a909751-d70c-4be0-981f-c66c6c46e777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.004732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a909751-d70c-4be0-981f-c66c6c46e777 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.018251 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3320/6615] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:34.020116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.020760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.021371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.043536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:34.045133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:34.056255 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3321/6616] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:34.057430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.074678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.075588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.075871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.076145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] PATH_INFO: `/v3/projects/8eeea9109fc449ea8598dae05411d413/users/f12f3061fa3e47f7a0ff6fcc80fe073a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.081425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeea9109fc449ea8598dae05411d413, user_id=f12f3061fa3e47f7a0ff6fcc80fe073a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.082366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef1a5a-4d43-4fb5-8d1d-5e4e96eb0a35 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.088455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde4cf2-98b0-4687-8497-3676f284acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.089667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4cf2-98b0-4687-8497-3676f284acc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.090179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4cf2-98b0-4687-8497-3676f284acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.090721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4cf2-98b0-4687-8497-3676f284acc8 admin admin] PATH_INFO: `/v3/projects/6bbfe8e4b51741709833b4afda4b6afe/users/00d7e34beca74f09a56a037b5c656685/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.091361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.112850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde4cf2-98b0-4687-8497-3676f284acc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbfe8e4b51741709833b4afda4b6afe, user_id=00d7e34beca74f09a56a037b5c656685, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.118097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde4cf2-98b0-4687-8497-3676f284acc8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.118385 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3296/6617] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:33 2022] PUT /identity/v3/projects/8eeea9109fc449ea8598dae05411d413/users/f12f3061fa3e47f7a0ff6fcc80fe073a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:34.119819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.125259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:34.139003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3322/6618] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:34 2022] PUT /identity/v3/projects/6bbfe8e4b51741709833b4afda4b6afe/users/00d7e34beca74f09a56a037b5c656685/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:34.140900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.141451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.141946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.166292 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:34.181305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] MFA Rules not processed for user `f12f3061fa3e47f7a0ff6fcc80fe073a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:34.183024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:34.272473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6a02-abc9-4505-9f95-4238c58746f1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.323734 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3323/6619] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:34.324615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.328401 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:34.356086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.356662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.356971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.357253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.435575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5b47-918c-46f4-bd4f-70447cbaf58e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.441043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.441741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.442028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.442310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.443154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.444800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.459978 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3324/6620] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:34.459978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.470271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dff4a-e9c2-466a-b71c-8d48203fd0ee admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.476411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.477191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.477551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.477897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.478921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.480605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.499983 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3325/6621] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:34 2022] POST /identity/v3/roles => generated 234 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:34.500901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.544625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1b32-dff9-4e0a-adee-29d8634814e6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.550437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.551785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.552271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.554685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] PATH_INFO: `/v3/projects/6bbfe8e4b51741709833b4afda4b6afe/users/00d7e34beca74f09a56a037b5c656685/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.557377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbfe8e4b51741709833b4afda4b6afe, user_id=00d7e34beca74f09a56a037b5c656685, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.562649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.586545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3326/6622] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:34 2022] PUT /identity/v3/projects/6bbfe8e4b51741709833b4afda4b6afe/users/00d7e34beca74f09a56a037b5c656685/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:34.586545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.594138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.595678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.638450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3297/6623] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:34.639346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:34.651087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:34.682769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e056d2-8f1f-4fa1-8bf1-f97b30886b2e service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.731752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6fc37-70f2-489f-82fc-cf7d15be709f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:34.745177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ae549-d49d-4917-a8a1-9d8c9c5ecd67 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.746014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ae549-d49d-4917-a8a1-9d8c9c5ecd67 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.746852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ae549-d49d-4917-a8a1-9d8c9c5ecd67 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.746852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ae549-d49d-4917-a8a1-9d8c9c5ecd67 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.747620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ae549-d49d-4917-a8a1-9d8c9c5ecd67 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.749636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ae549-d49d-4917-a8a1-9d8c9c5ecd67 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.774269 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:34.786610 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3327/6624] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:34 2022] POST /identity/v3/roles => generated 233 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:34.788737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.789253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.789633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.839757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:34.840937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:34.841322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:34.841717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] PATH_INFO: `/v3/users/d1d3211e6ad0429e88e5bafbb9b644e9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:34.843974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d3211e6ad0429e88e5bafbb9b644e9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:34.853518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:34.874769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] MFA Rules not processed for user `00d7e34beca74f09a56a037b5c656685`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:34.876050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:34.990843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d3211e6ad0429e88e5bafbb9b644e9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.077843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d3211e6ad0429e88e5bafbb9b644e9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.102328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d3211e6ad0429e88e5bafbb9b644e9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.131585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d3211e6ad0429e88e5bafbb9b644e9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.132742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2e5ae749-867c-4ffe-bdf4-98b70c2a50a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d3211e6ad0429e88e5bafbb9b644e9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.136936 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3328/6625] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:35.138846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:35.145629 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3298/6626] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:34 2022] DELETE /identity/v3/users/d1d3211e6ad0429e88e5bafbb9b644e9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:35.150008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:35.150308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:35.152068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:35.156484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ad45-7a0d-4c35-8960-9d49784bafab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:35.182912 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:35.198474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:35.199927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.336897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:35.337845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:35.338235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:35.338673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:35.340810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:35.342627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:35.362198 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3299/6627] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:35.363621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:35.365275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.382380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3329/6628] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:35 2022] POST /identity/v3/roles => generated 235 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:35.383477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:35.387412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.419567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4aba9-c376-4fd9-b6b4-23d7aea80f79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:35.436440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:35.437433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:35.437797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:35.438151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] PATH_INFO: `/v3/projects/96d5749c9f154a85ae89e93b2483313c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:35.447393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d5749c9f154a85ae89e93b2483313c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:35.449975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:35.510161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27eaa-21fd-46a8-b94a-cad9b2b52fec None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:35.520246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:35.521308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:35.521851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:35.522904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:35.528148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.561992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d5749c9f154a85ae89e93b2483313c', 'request_id': 'req-3fff78b9-1c49-47be-bc69-935daf90e8a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.582434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d5749c9f154a85ae89e93b2483313c', 'request_id': 'req-3fff78b9-1c49-47be-bc69-935daf90e8a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.591773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d5749c9f154a85ae89e93b2483313c', 'request_id': 'req-3fff78b9-1c49-47be-bc69-935daf90e8a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.608917 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:35.619500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] The token cache is being invalidate because project 96d5749c9f154a85ae89e93b2483313c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:35.619758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.620769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:35.623804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3330/6629] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:35 2022] DELETE /identity/v3/projects/96d5749c9f154a85ae89e93b2483313c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:35.624668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:35.626173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.704335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:35.710922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:35.723995 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3300/6630] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:35.725482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:35.727822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.747055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd738a0-446b-487b-8f73-dde41d68e615 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:35.785735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff78b9-1c49-47be-bc69-935daf90e8a2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:35.798974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:35.799798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:35.800191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:35.800574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:35.805303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:35.871286 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:35.885494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:35.886196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:35.886550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:35.887338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:35.888691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:35.890352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:35.928325 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3301/6631] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:14:35 2022] POST /identity/v3/domains => generated 276 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:35.930359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:35.935721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:36.020332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:36.021988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:36.041331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3331/6632] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:36.043565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:36.045988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:36.177047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb3bbc-1134-44e8-a3c5-247cc38bd7ca tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:36.201675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:36.202617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:36.202913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:36.203192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] PATH_INFO: `/v3/users/e82a4f5c874c4775bff4da223412abb0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:36.205878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82a4f5c874c4775bff4da223412abb0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:36.208015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:36.247312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae88a3-719e-499d-9b24-87c7fcd30097 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:36.330679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82a4f5c874c4775bff4da223412abb0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:36.362318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82a4f5c874c4775bff4da223412abb0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:36.391686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82a4f5c874c4775bff4da223412abb0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:36.415388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82a4f5c874c4775bff4da223412abb0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:36.416563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82a4f5c874c4775bff4da223412abb0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:36.428610 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3302/6633] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:35 2022] DELETE /identity/v3/users/e82a4f5c874c4775bff4da223412abb0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:36.435608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:36.445308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:36.458726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:36.460145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:36.460662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:36.461539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:36.464559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:36.500566 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:36.584101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:36.586488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:36.604746 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3332/6634] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:36.642732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2fad-63c8-49c4-833f-aa7a607a3d94 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:36.649581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:36.650395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:36.650723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:36.651992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:36.652393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:36.654407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:36.707983 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:36.841032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:36.844206 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3303/6635] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:36 2022] POST /identity/v3/projects => generated 400 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:37.008508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb77cc-b361-4134-a586-39800e46a39a service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:37.149586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:37.150610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.151089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.151550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/groups` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.153439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:37.156203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:37.170547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:37.172595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:37.196012 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3333/6636] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 11 15:14:36 2022] POST /identity/v3/groups => generated 301 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:37.197642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:37.209981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4c6b-9323-480b-9806-7058ef8e0b02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:37.215692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:37.216373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.216664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.216947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.217763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:37.222340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:37.244575 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3334/6637] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:37 2022] POST /identity/v3/roles => generated 233 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:37.249040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:37.279332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92ce38-dbb5-46cd-9843-e21a04259de5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:37.293673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:37.294643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.294936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.295218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.295937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:37.304521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:37.346193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3335/6638] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:37 2022] POST /identity/v3/users => generated 442 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:37.347342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:37.350114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:37.393442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a8fb-d09b-45a0-9827-8d123a560367 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:37.402215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:37.403447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.403883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.404311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] PATH_INFO: `/v3/projects/7d1699873d544a0ba2615e0a20067854` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.405730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1699873d544a0ba2615e0a20067854)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:37.408494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:37.449412 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:37.515418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338b0d-4cb1-4b56-80dd-5cc623f3e504 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:37.519813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1699873d544a0ba2615e0a20067854', 'request_id': 'req-441f8b3f-95d4-44b2-af98-e268caf2e7b3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.530604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1699873d544a0ba2615e0a20067854', 'request_id': 'req-441f8b3f-95d4-44b2-af98-e268caf2e7b3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.551067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1699873d544a0ba2615e0a20067854', 'request_id': 'req-441f8b3f-95d4-44b2-af98-e268caf2e7b3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.569418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] The token cache is being invalidate because project 7d1699873d544a0ba2615e0a20067854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:37.569712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.570841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.577660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3304/6639] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:37 2022] DELETE /identity/v3/projects/7d1699873d544a0ba2615e0a20067854 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:37.577660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:37.578528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:37.641298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:37.642161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.642462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.642743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] PATH_INFO: `/v3/projects/9cd183b1e6be46e8955c49f5e5adba5c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.644796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd183b1e6be46e8955c49f5e5adba5c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:37.646913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:37.729837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd183b1e6be46e8955c49f5e5adba5c', 'request_id': 'req-a6737e66-ff2e-40a7-b297-1c932e65f582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.731648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f8b3f-95d4-44b2-af98-e268caf2e7b3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:37.740668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd183b1e6be46e8955c49f5e5adba5c', 'request_id': 'req-a6737e66-ff2e-40a7-b297-1c932e65f582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.748122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd183b1e6be46e8955c49f5e5adba5c', 'request_id': 'req-a6737e66-ff2e-40a7-b297-1c932e65f582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.761397 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:37.761521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] The token cache is being invalidate because project 9cd183b1e6be46e8955c49f5e5adba5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:37.761877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.762511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a6737e66-ff2e-40a7-b297-1c932e65f582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:37.764370 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3336/6640] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:37 2022] DELETE /identity/v3/projects/9cd183b1e6be46e8955c49f5e5adba5c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:37.769415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018180-fd42-45e5-94e2-1e36228069b2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.769708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018180-fd42-45e5-94e2-1e36228069b2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.769986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018180-fd42-45e5-94e2-1e36228069b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.794487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-66018180-fd42-45e5-94e2-1e36228069b2 None None] MFA Rules not processed for user `208630a7c636414992f21b76bf654831`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:37.795812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-66018180-fd42-45e5-94e2-1e36228069b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:37.816776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:37.818510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.819080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.820485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.821594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:37.823053 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:37.823053 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:37.823053 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:37.825358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2c2b-fb50-4acc-a352-3563b5d4a140 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:37.852037 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3305/6641] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:37 2022] POST /identity/v3/roles => generated 270 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:37.853561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.853862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.854140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.867303 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3337/6642] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:37.877314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cc5fd-8476-4467-ba97-7caecd960f16 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:37.877602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cc5fd-8476-4467-ba97-7caecd960f16 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:37.877960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cc5fd-8476-4467-ba97-7caecd960f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:37.909752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4a1cc5fd-8476-4467-ba97-7caecd960f16 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:37.910655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:37.910997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4a1cc5fd-8476-4467-ba97-7caecd960f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:37.911848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:37.922706 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:38.056538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3306/6643] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:38.056538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.056538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:38.056538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fc528-e174-4763-baa8-2adafd1a0e23 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.161345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb347a35-822d-4d2f-a80c-1fdf549fc7ce tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.161345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb347a35-822d-4d2f-a80c-1fdf549fc7ce tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.161345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb347a35-822d-4d2f-a80c-1fdf549fc7ce tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.167530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb347a35-822d-4d2f-a80c-1fdf549fc7ce tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/a500b2e48afe4f88a38f2935e2c16ce4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.167530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb347a35-822d-4d2f-a80c-1fdf549fc7ce tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=a500b2e48afe4f88a38f2935e2c16ce4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.167530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb347a35-822d-4d2f-a80c-1fdf549fc7ce tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.169322 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3338/6644] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:38.169322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.169848 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3307/6645] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:37 2022] PUT /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/a500b2e48afe4f88a38f2935e2c16ce4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:38.170120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.170120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.170557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.170557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.170557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.171366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:38.171366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:38.171763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:38.171763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:38.222147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3339/6646] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:38.223191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.279475 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3308/6647] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:38.280400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.299148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955857bf-a039-417f-b94f-dadd5eb4093b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.311380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.312754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.312754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.313018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.313889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:38.314276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.316018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.324459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17f31d-60ac-4e3a-a328-ed233fb2d689 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.345121 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3309/6648] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:38.346796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.349181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.349498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.349863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.350679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.351714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Adding query filter params (scope.project.id=8bd0eb8beab04b86950450903b25c76a, user.id=bc7a166739e14e3699f95a53a072a2ec) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:38.352216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.354576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.399445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7ed3d-5866-4e58-aa3f-33cc68f6cd77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.408718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.409630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.409920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.410292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.411480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:38.412533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.414203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.447860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3310/6649] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:38.447860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.461848 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3340/6650] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:14:38 2022] GET /identity/v3/role_assignments?scope.project.id=8bd0eb8beab04b86950450903b25c76a&user.id=bc7a166739e14e3699f95a53a072a2ec&effective => generated 228 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:38.464699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.465706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd93562-4689-46c5-a4a5-1bba2b5dc421 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.471738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.471993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.472137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.472417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.473123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.475146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.500601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f39c-c9c9-4dc5-a24b-c5b24c0c32df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.502000 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:38.515323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.519386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.520235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.520235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.520765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.525018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.536814 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3311/6651] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:38 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:38.537633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.546340 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:38.574063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3341/6652] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:38 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:38.575116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.667337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeabd0a-dea6-45a9-b76a-cf400cc8c2a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.767686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721293e2-ebde-4f56-b863-c59bbec4c7d5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.783596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.784306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.784800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.785086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.786855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.789351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.821338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.822997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.823524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.824052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/a500b2e48afe4f88a38f2935e2c16ce4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.827454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=a500b2e48afe4f88a38f2935e2c16ce4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.839014 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3342/6653] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:38 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:38.840317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.843462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.853468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd53f7e-be15-4633-9476-dedfe488ccc1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:38.860918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:38.862769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:38.863301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:38.863840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:38.865365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:38.869070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role a500b2e48afe4f88a38f2935e2c16ce4 was removed from user bc7a166739e14e3699f95a53a072a2ec on project 8bd0eb8beab04b86950450903b25c76a. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:38.869372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:38.870363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:38.882769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:38.929750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3312/6654] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:14:38 2022] DELETE /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/a500b2e48afe4f88a38f2935e2c16ce4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:38.939016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.946741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:38.968374 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3343/6655] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:38 2022] POST /identity/v3/users => generated 281 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:38.969910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:38.978692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:38.997555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78233d-4d8c-4711-b292-b98272b4e34b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.073167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.074263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.075935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.076546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/a500b2e48afe4f88a38f2935e2c16ce4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.078939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a500b2e48afe4f88a38f2935e2c16ce4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.080333 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:39.080333 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:39.080333 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:39.081827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.107124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841b0f-c479-4419-be57-a89520e1e279 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.125239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.125946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.126236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.126559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.127472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.155857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.173276 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3313/6656] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:38 2022] GET /identity/v3/roles => generated 2319 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:39.173276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.173699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:39.193571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa53d9-c2c7-4e88-9b45-5140fec1bf0c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.198171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role a500b2e48afe4f88a38f2935e2c16ce4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:39.198476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:39.199183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:39.200696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.201513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.206906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.207008 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3344/6657] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:38 2022] DELETE /identity/v3/roles/a500b2e48afe4f88a38f2935e2c16ce4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:39.207085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.207172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.207248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.207248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.208613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:39.221245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3314/6658] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:39 2022] GET /identity/v3/roles => generated 2319 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:39.222224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.224379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:39.240137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520adeb-7147-47fa-98cc-137457ad6e10 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.247428 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:39.310653 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:39.367942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.368820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.379476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.379778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/32d5e3d0ebed48acb0e151f75b838a9d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.390100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=32d5e3d0ebed48acb0e151f75b838a9d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.392918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.403817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d7d73-4e30-4b7f-affd-755ee0a77d23 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.409581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.410890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.411181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.411466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.413413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.416210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.424049 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3315/6659] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:39 2022] PUT /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/32d5e3d0ebed48acb0e151f75b838a9d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:39.425494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.432683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:39.446997 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3345/6660] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:39 2022] GET /identity/v3/roles => generated 2319 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:39.454367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.484808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8673c-df6a-46ea-b0d4-931dbea754f5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.591887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa47d3-ce4c-41a0-b528-5fc8abbe129b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.604697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.605065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.605360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.607015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.608102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.611390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.635666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.636604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.637257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.637540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.638542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3316/6661] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:39 2022] GET /identity/v3/roles => generated 2319 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:39.644487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.645637 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:39.645637 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:39.645637 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:39.646449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.648553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.670528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183875e-c858-40e0-ae85-93e2017ecaaa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.680448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.681758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.681869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.682090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] PATH_INFO: `/v3/projects/d2140d79f2a74577804bc99c521f2903/users/a71d46dac31446a38a1d2d0bf7fd6756/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.702312 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3346/6662] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:39 2022] PUT /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 518 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:39.703432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.723195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2140d79f2a74577804bc99c521f2903, user_id=a71d46dac31446a38a1d2d0bf7fd6756, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.727370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:39.754310 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3317/6663] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:39 2022] PUT /identity/v3/projects/d2140d79f2a74577804bc99c521f2903/users/a71d46dac31446a38a1d2d0bf7fd6756/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:39.756073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:39.927392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928cc5-2992-417b-89e9-260568e41f7a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.957027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5ed1-2ae8-4b60-b9d7-4e8f8d3ab6a3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:39.965957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:39.965957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:39.965957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:39.966266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:39.967250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Adding query filter params (scope.project.id=8bd0eb8beab04b86950450903b25c76a, user.id=bc7a166739e14e3699f95a53a072a2ec) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:39.967817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:39.978663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be43e6f-e60f-4a18-8c46-b8400d8ff909 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.001310 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:40.010730 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:40.024800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.026113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.026113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.026337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] PATH_INFO: `/v3/projects/92d630a2064b47e6b66ec95ee040032d/users/bd5e0a6a777d44ccb0c6358d11dafe21/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.069672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d630a2064b47e6b66ec95ee040032d, user_id=bd5e0a6a777d44ccb0c6358d11dafe21, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.072305 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3318/6664] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:14:39 2022] GET /identity/v3/role_assignments?scope.project.id=8bd0eb8beab04b86950450903b25c76a&user.id=bc7a166739e14e3699f95a53a072a2ec&effective => generated 1061 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:40.073900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.074554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.075110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.087330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.126206 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3347/6665] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:39 2022] PUT /identity/v3/projects/92d630a2064b47e6b66ec95ee040032d/users/bd5e0a6a777d44ccb0c6358d11dafe21/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:40.127696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.146630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] MFA Rules not processed for user `a71d46dac31446a38a1d2d0bf7fd6756`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:40.148872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.259642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f74c8-0974-4b8d-aa5d-320a67f32145 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.265328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.266561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.267218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.268451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.271303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.272462 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:40.272462 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:40.272462 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:40.273537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d4f46-caac-4c49-8992-87cb37a8640e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.286172 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3348/6666] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:40 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:40.288811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.289435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.289931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.294779 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3319/6667] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:40.295703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.308956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f611e84-ef95-4858-a7a4-46cd3aee8b4e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.347420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] MFA Rules not processed for user `bd5e0a6a777d44ccb0c6358d11dafe21`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:40.349074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.396036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.396772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.397230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.397513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.398350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Adding query filter params (scope.project.id=8bd0eb8beab04b86950450903b25c76a, user.id=bc7a166739e14e3699f95a53a072a2ec) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:40.398693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.400573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.443433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3349/6668] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:40.443433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.474323 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3320/6669] 10.222.0.77 () {58 vars in 1355 bytes} [Mon Jul 11 15:14:40 2022] GET /identity/v3/role_assignments?scope.project.id=8bd0eb8beab04b86950450903b25c76a&user.id=bc7a166739e14e3699f95a53a072a2ec&effective => generated 577 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:40.479989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.492482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ab98-27ec-42f6-8cc3-567004bc0f3b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.497366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.498296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.498742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.499025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.500766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.501855 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:40.501855 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:40.501855 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:40.502724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.511990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0cb6-fe2e-452b-ad88-ecd1955e230b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.516919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.517659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.518016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.518372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.519198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.521139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.526525 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e.: keystone.exception.ImpliedRoleNotFound: 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e. Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = query.one() Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._iter().one() Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._only_one_row( Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:40.529239 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 11 15:14:40.530218 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 11 15:14:40.531115 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 11 15:14:40.531115 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 11 15:14:40.531115 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 11 15:14:40.531115 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e. Jul 11 15:14:40.531115 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:40.534853 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3321/6670] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:40 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 137 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:14:40.535756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.542081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.560737 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:40.575004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3350/6671] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:40 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:40.576005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.631901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a128-34e8-4e9d-be3d-b2bf45a208a4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.671752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a638d-60bf-4cb7-8d47-430130d32eda admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.677290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.678308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.678759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.679112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/32d5e3d0ebed48acb0e151f75b838a9d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.681662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=32d5e3d0ebed48acb0e151f75b838a9d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.685843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.695164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 32d5e3d0ebed48acb0e151f75b838a9d was removed from user bc7a166739e14e3699f95a53a072a2ec on project 8bd0eb8beab04b86950450903b25c76a. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:40.695519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:40.698841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:40.712379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.713043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.713569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.713856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.716383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.719686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3351/6672] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:14:40 2022] DELETE /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/32d5e3d0ebed48acb0e151f75b838a9d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:40.720558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.721961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.799565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.801567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.821003 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3322/6673] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:40.821909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.823258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.841355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad5d1e-1b72-416a-92d9-d664289066df service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.851958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7972e-bb00-4104-b3fb-75d058ff3e02 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.867312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.867917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.868205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.868660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.869300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.873380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.912246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.913520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.913850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.914180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.915012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.916680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.920893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3352/6674] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:40 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:40.922114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.924862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:40.939147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35076-0b2d-4384-97bc-d71fdb5d75ac admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.944562 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3323/6675] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:40 2022] POST /identity/v3/roles => generated 272 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:40.945254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.946196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.946626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.946903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] PATH_INFO: `/v3/users/bd5e0a6a777d44ccb0c6358d11dafe21` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.947497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.948134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5e0a6a777d44ccb0c6358d11dafe21)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.950362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.961584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d9f57-ce8a-4c73-8992-202ba61f1324 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:40.966822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:40.968486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:40.968772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:40.969048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:40.969786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:40.973409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:40.990488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3324/6676] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:40 2022] GET /identity/v3/roles => generated 2319 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:40.992114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:40.999739 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:41.004806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52095ac0-79a3-4e23-ad4f-a392786c7b72 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.011763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.012448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.012739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.013017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.014087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Adding query filter params (domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:41.014087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.015116 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:41.015116 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:41.015116 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:41.016022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:41.044138 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3325/6677] 10.222.0.77 () {58 vars in 1206 bytes} [Mon Jul 11 15:14:40 2022] GET /identity/v3/roles?domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a => generated 409 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:41.044941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.067894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5e0a6a777d44ccb0c6358d11dafe21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.068647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5e0a6a777d44ccb0c6358d11dafe21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.080848 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:41.082893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5e0a6a777d44ccb0c6358d11dafe21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.083779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5e0a6a777d44ccb0c6358d11dafe21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.091631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5e0a6a777d44ccb0c6358d11dafe21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.095103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077707a4-e9c0-442d-9b54-bef7983e8c3e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.101985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.102819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.103112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.103424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.104398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.106122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:41.123731 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3326/6678] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:41 2022] GET /identity/v3/roles => generated 2319 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:41.124415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.126318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:41.130217 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3353/6679] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:40 2022] DELETE /identity/v3/users/bd5e0a6a777d44ccb0c6358d11dafe21 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:41.133872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.143003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:41.145092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e8a9-d568-45bb-becf-d5fff0edc500 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.235318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.236325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.236841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.237226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/5fc7243af609462399332d6f7c5ce18e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.238761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5fc7243af609462399332d6f7c5ce18e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.239920 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:41.239920 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:41.239920 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:41.241757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:41.298416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 5fc7243af609462399332d6f7c5ce18e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:41.298938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.300285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e2610001-7a4c-49c7-88d8-d282a681c68e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:41.304588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3327/6680] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:41 2022] DELETE /identity/v3/roles/5fc7243af609462399332d6f7c5ce18e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:41.306593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.307063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.307817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.318893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8838ce-44fd-477f-af79-23f512419119 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.331368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:41.333193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:41.472211 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3328/6681] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:41.476204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.478510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:41.515124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.515509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.515638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.516003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] PATH_INFO: `/v3/projects/ef3c818f623f4a2aadf898becf74228d/users/2df2d62e8050483687b53f27ede3ce5b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.551901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3c818f623f4a2aadf898becf74228d, user_id=2df2d62e8050483687b53f27ede3ce5b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.554889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:41.586620 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3354/6682] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:41 2022] PUT /identity/v3/projects/ef3c818f623f4a2aadf898becf74228d/users/2df2d62e8050483687b53f27ede3ce5b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:41.586620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.586620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:41.647850 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:41.682710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b15067-2ff3-4f8b-a3d4-de53aeb60f10 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.683804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b56765-f200-41f6-9258-756c4aaead44 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.690232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.691304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.691856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.692316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.738885 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:41.780092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.781021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.781502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.781858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.782853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Adding query filter params (domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:41.783274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.785109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437933-8b7e-4607-aad7-92fb732b8946 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:41.795410 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3329/6683] 10.222.0.77 () {58 vars in 1206 bytes} [Mon Jul 11 15:14:41 2022] GET /identity/v3/roles?domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a => generated 148 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:41.796742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.797032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.797314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.832488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.832696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] MFA Rules not processed for user `2df2d62e8050483687b53f27ede3ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:41.833937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:41.836040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:41.865054 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3355/6684] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:41.866267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.901683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041ffe-ea53-4435-bf47-31bb9a7a105c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.908113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.909663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.909663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.910143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/5fc7243af609462399332d6f7c5ce18e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.923748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Could not find role: 5fc7243af609462399332d6f7c5ce18e.: keystone.exception.RoleNotFound: Could not find role: 5fc7243af609462399332d6f7c5ce18e. Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 11 15:14:41.936055 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:14:41.937149 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5fc7243af609462399332d6f7c5ce18e. Jul 11 15:14:41.938228 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:41.945178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3356/6685] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:41 2022] DELETE /identity/v3/roles/5fc7243af609462399332d6f7c5ce18e => generated 110 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:14:41.946357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:41.959378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d751-6bf2-4ea8-acb9-c9e07e694133 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:41.967176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:41.968408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:41.968877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:41.969442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:41.981014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:41.984992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.003141 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3330/6686] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:42.007830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.011410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:42.015736 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3357/6687] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:41 2022] PUT /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:42.019635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.061377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6892f-eebc-49cb-a6ff-c8f770bb83dc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:42.210764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1e991-408d-40a5-beab-0c4c1bd3c238 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:42.216167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:42.217247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:42.217954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:42.218388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:42.220545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, group_id=94ebc9627715488bb3379576a510eebe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:42.223425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.240184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3358/6688] 10.222.0.77 () {58 vars in 1364 bytes} [Mon Jul 11 15:14:42 2022] GET /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles => generated 408 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:42.245090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.269465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca600448-82cd-44fb-841c-49d8efce5717 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:42.276807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:42.280683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:42.281497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:42.282812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:42.288451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:42.295764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.313673 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3359/6689] 10.222.0.77 () {58 vars in 1464 bytes} [Mon Jul 11 15:14:42 2022] HEAD /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:42.317413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.318359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:42.331138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:42.332260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:42.332554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:42.334130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:42.341031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.344037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9b7dc-16a3-44f6-80df-ce6f321314df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:42.357315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:42.358406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:42.358764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:42.359051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:42.364631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:42.373083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.383139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 601483545e6b495299d0067a637842e8 was removed from group 94ebc9627715488bb3379576a510eebe on domain 4e4e6dc11ba540fd8f6fd35af255ff6a. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:42.383546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:42.385220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:42.420625 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3331/6690] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:42 2022] POST /identity/v3/projects => generated 377 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:42.421606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.429727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:42.454306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3360/6691] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:14:42 2022] DELETE /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:42.458549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.461509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:42.466772 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:42.610412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9424f6-9dd0-4e32-b9c8-4d54079f7dbc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:42.827822 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:42.836288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:42.836976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:42.837261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:42.837540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:42.839688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:42.856761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.877562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d5cd-925f-4004-8a62-b0b429b17e4b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:42.892555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:42.893469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:42.893754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:42.894031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:42.906372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bd0eb8beab04b86950450903b25c76a, group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:42.909393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:42.923889 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3332/6692] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:42 2022] POST /identity/v3/users => generated 295 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:42.924829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.927410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:42.950004 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3361/6693] 10.222.0.77 () {60 vars in 1485 bytes} [Mon Jul 11 15:14:42 2022] PUT /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:42.950910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:42.955238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a3c7c-bc70-471d-ade8-ea80845011c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.033381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea590bf-1053-4c92-b28c-fe7e5b136f06 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.040143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.040552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.040932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.042051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.043335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.045112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.068273 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3362/6694] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:42 2022] GET /identity/v3/roles => generated 2319 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:43.070772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.111751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.112804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.113362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.113855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] PATH_INFO: `/v3/projects/92d630a2064b47e6b66ec95ee040032d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.116396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d630a2064b47e6b66ec95ee040032d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.118713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.176443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931c21-aafb-422b-b7d0-46dee10e19b4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.188928 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:43.195635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d630a2064b47e6b66ec95ee040032d', 'request_id': 'req-7b54eb4c-f912-4dba-acec-52e2f9ded511'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:43.203783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d630a2064b47e6b66ec95ee040032d', 'request_id': 'req-7b54eb4c-f912-4dba-acec-52e2f9ded511'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:43.247883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d630a2064b47e6b66ec95ee040032d', 'request_id': 'req-7b54eb4c-f912-4dba-acec-52e2f9ded511'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:43.266269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] The token cache is being invalidate because project 92d630a2064b47e6b66ec95ee040032d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:43.266862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:43.268094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:43.296607 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3333/6695] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:42 2022] DELETE /identity/v3/projects/92d630a2064b47e6b66ec95ee040032d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:43.298972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8e33-b4d1-4db5-ac3e-ea674ad4f44d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.299987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8e33-b4d1-4db5-ac3e-ea674ad4f44d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.300289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8e33-b4d1-4db5-ac3e-ea674ad4f44d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.300644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8e33-b4d1-4db5-ac3e-ea674ad4f44d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.304615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8e33-b4d1-4db5-ac3e-ea674ad4f44d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_grants(project_id=8bd0eb8beab04b86950450903b25c76a, group_id=94ebc9627715488bb3379576a510eebe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.307758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8e33-b4d1-4db5-ac3e-ea674ad4f44d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.311661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.316680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:43.330161 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3363/6696] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:14:43 2022] GET /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles => generated 409 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:43.331964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.332437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.332815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.354936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:43.356695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:43.377731 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:43.435202 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3364/6697] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:43.435202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.435202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:43.449452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9704-dd4e-4e4f-bb8d-aac05b2fe1cb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.474699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434936-e230-4e5b-8ca2-ea795d9adbfa tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.474699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434936-e230-4e5b-8ca2-ea795d9adbfa tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.474699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434936-e230-4e5b-8ca2-ea795d9adbfa tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.476129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434936-e230-4e5b-8ca2-ea795d9adbfa tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/groups/94ebc9627715488bb3379576a510eebe/users/bc7a166739e14e3699f95a53a072a2ec` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.476129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434936-e230-4e5b-8ca2-ea795d9adbfa tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=94ebc9627715488bb3379576a510eebe, user_id=bc7a166739e14e3699f95a53a072a2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.481692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434936-e230-4e5b-8ca2-ea795d9adbfa tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.518259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54eb4c-f912-4dba-acec-52e2f9ded511 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.526965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3365/6698] 10.222.0.77 () {60 vars in 1359 bytes} [Mon Jul 11 15:14:43 2022] PUT /identity/v3/groups/94ebc9627715488bb3379576a510eebe/users/bc7a166739e14e3699f95a53a072a2ec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:43.528609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05a6c-84b2-4fd2-845e-0b5cbf64568c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.528901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05a6c-84b2-4fd2-845e-0b5cbf64568c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.529183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05a6c-84b2-4fd2-845e-0b5cbf64568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.574371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cdf05a6c-84b2-4fd2-845e-0b5cbf64568c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:43.575818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdf05a6c-84b2-4fd2-845e-0b5cbf64568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:43.615961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.617647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.618218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.618837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] PATH_INFO: `/v3/projects/032a3d8d7d9948ffb53bf496a426ffda/users/a5ab06b2fe2348aaa317517ab45aa25b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.635569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032a3d8d7d9948ffb53bf496a426ffda, user_id=a5ab06b2fe2348aaa317517ab45aa25b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.638912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.656089 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3366/6699] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:43.656089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.656089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.656089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.661500 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3334/6700] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:43 2022] PUT /identity/v3/projects/032a3d8d7d9948ffb53bf496a426ffda/users/a5ab06b2fe2348aaa317517ab45aa25b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:43.663470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.705037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] MFA Rules not processed for user `bc7a166739e14e3699f95a53a072a2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:43.706430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:43.753708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c521-c3b2-4832-b5d2-642f3a646672 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.760769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.761534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.761934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.762246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.763322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:14:43.763703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.765624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.773622 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:43.780931 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3335/6701] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:43.786211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.808239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25c911-9d10-454a-85d0-d8475193f2d8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.820252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.821096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.821483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.821856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.822723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.824456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.838337 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3336/6702] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:43 2022] GET /identity/v3/roles => generated 2319 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:43.841971 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:43.842810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.851052 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3367/6703] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:43.852186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.855346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339aa0a-cab5-44b8-8ea8-1b3d208ae2a4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.860718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089ee0c-231e-429d-817a-c24780af6a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.861597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089ee0c-231e-429d-817a-c24780af6a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.862162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089ee0c-231e-429d-817a-c24780af6a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.862537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089ee0c-231e-429d-817a-c24780af6a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.863877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089ee0c-231e-429d-817a-c24780af6a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.865410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089ee0c-231e-429d-817a-c24780af6a0c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.872557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475ef3-b9f6-48f8-a37f-95d235354a70 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:43.883680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:43.885506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.885795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.886074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] PATH_INFO: `/v3/projects/032a3d8d7d9948ffb53bf496a426ffda/users/a5ab06b2fe2348aaa317517ab45aa25b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.888979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032a3d8d7d9948ffb53bf496a426ffda, user_id=a5ab06b2fe2348aaa317517ab45aa25b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:43.891951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:43.909315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3368/6704] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:43 2022] PUT /identity/v3/projects/032a3d8d7d9948ffb53bf496a426ffda/users/a5ab06b2fe2348aaa317517ab45aa25b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:43.909315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:43.941211 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3337/6705] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:43 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:43.942821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:43.943019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:43.943308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:43.984653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] MFA Rules not processed for user `a5ab06b2fe2348aaa317517ab45aa25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:43.985909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:44.133348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108021-d868-4cfd-be59-18ab73344ae9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:44.289004 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3338/6706] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:44.289731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:44.290700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:44.290986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:44.291262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:44.295034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:44.298161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8bd0eb8beab04b86950450903b25c76a, group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:44.306748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:44.322929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3369/6707] 10.222.0.77 () {58 vars in 1467 bytes} [Mon Jul 11 15:14:43 2022] HEAD /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:44.323826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:44.333591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:44.456913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd7d3d-59ce-4af6-b723-6058dce2195a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:44.464412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:44.465905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:44.466488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:44.467285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:44.469771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:44.477998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943421e-50b5-40fd-b411-a05b9ff3e91b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:44.530324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:44.532722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:44.534425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:44.537225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:44.540252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:44.549754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:44.618762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3339/6708] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:44 2022] POST /identity/v3/users => generated 295 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:44.626513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:44.642227 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:44.657770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef740765-e78a-4920-bd10-ced98ac48bdc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:44.688694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:44.689807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:44.690099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:44.690380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:44.692637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:44.694687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:44.704265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8bd0eb8beab04b86950450903b25c76a, group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:44.707057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:44.726790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 601483545e6b495299d0067a637842e8 was removed from group 94ebc9627715488bb3379576a510eebe on project 8bd0eb8beab04b86950450903b25c76a. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:44.727089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:44.728667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:44.728797 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3370/6709] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:44.729555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:44.761076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10809d7d-f497-49f5-b4bb-67eda036c87e service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:44.779381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:44.780088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:44.780433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:44.794199 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3340/6710] 10.222.0.77 () {58 vars in 1469 bytes} [Mon Jul 11 15:14:44 2022] DELETE /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:44.798733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:44.799729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:44.801363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:44.804501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:44.805112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:44.847789 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:44.851686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3371/6711] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:44 2022] GET /identity/v3/roles => generated 2319 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:44.859241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:44.863984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:44.911608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6472f-e153-41c9-a286-69fed8edfae8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.025896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f629cf2-0951-4a3a-bc45-0e0bf9ec6988 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.068006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.072592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.073460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.074438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.075699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.077966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.088109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.090591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.102068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.103578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/groups/94ebc9627715488bb3379576a510eebe/users/bc7a166739e14e3699f95a53a072a2ec` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.111918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=94ebc9627715488bb3379576a510eebe, user_id=bc7a166739e14e3699f95a53a072a2ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.114885 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3372/6712] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:44 2022] GET /identity/v3/roles => generated 2319 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:45.116483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.121953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.143178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9c0a-83db-45f4-b9ba-7715db9b1ba3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.148191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc7a166739e14e3699f95a53a072a2ec'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:45.164145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425354c6-7e06-4ac9-aa2a-f39ef9139fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.165488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425354c6-7e06-4ac9-aa2a-f39ef9139fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.166189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425354c6-7e06-4ac9-aa2a-f39ef9139fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.166760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425354c6-7e06-4ac9-aa2a-f39ef9139fef admin admin] PATH_INFO: `/v3/projects/cd6e12c35a124266ba32e2a3c5a306c7/users/3fdf1208d2c34fd1b5a24c2ad4e063a2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.191444 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3341/6713] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 15:14:44 2022] DELETE /identity/v3/groups/94ebc9627715488bb3379576a510eebe/users/bc7a166739e14e3699f95a53a072a2ec => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:45.192625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.208778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425354c6-7e06-4ac9-aa2a-f39ef9139fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6e12c35a124266ba32e2a3c5a306c7, user_id=3fdf1208d2c34fd1b5a24c2ad4e063a2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.224875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425354c6-7e06-4ac9-aa2a-f39ef9139fef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.268463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3373/6714] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:45 2022] PUT /identity/v3/projects/cd6e12c35a124266ba32e2a3c5a306c7/users/3fdf1208d2c34fd1b5a24c2ad4e063a2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:45.268463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.268463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.269142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.316753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] MFA Rules not processed for user `3fdf1208d2c34fd1b5a24c2ad4e063a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:45.318588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:45.387133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04f7fc-2b4b-43bf-86ab-789ef4503d26 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.523325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.524211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.524507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.524696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3374/6715] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:45.524872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.526576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.535757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.537069 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:45.537069 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:45.537069 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:45.539050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.563470 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3342/6716] 10.222.0.77 () {60 vars in 1380 bytes} [Mon Jul 11 15:14:45 2022] PUT /identity/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:45.567634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.587421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bb9eb-0071-4c1c-a4d8-6c807bb4ad57 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.597566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.598722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.599170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.599605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.603705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=94ebc9627715488bb3379576a510eebe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.604908 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:45.604908 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:45.604908 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:45.607308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.647432 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3343/6717] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 11 15:14:45 2022] GET /identity/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles => generated 374 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:14:45.651909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.664850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3c5b-e155-4293-9086-918d160bf715 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.683916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.688337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.689910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.690852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.695485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.697331 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:45.697331 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:45.697331 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:45.702278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.714617 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:45.716447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3344/6718] 10.222.0.77 () {58 vars in 1362 bytes} [Mon Jul 11 15:14:45 2022] HEAD /identity/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:45.717765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.733227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691f77-4f0e-4b17-8b05-427b3770ec1b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.741904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.743080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.743370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.743796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.746131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=94ebc9627715488bb3379576a510eebe, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.748219 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:45.748219 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:45.748219 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:45.749204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.771041 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3345/6719] 10.222.0.77 () {58 vars in 1364 bytes} [Mon Jul 11 15:14:45 2022] DELETE /identity/v3/system/groups/94ebc9627715488bb3379576a510eebe/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:45.773447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.786530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03285-cd87-4fbf-a588-c1ca65ddc947 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.796704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f3cc4-bc3e-4629-831f-a74b75365e2c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:45.801400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.802091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.802385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.802681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.803451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.805299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:45.805517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.806280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:45.807272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:45.807272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:45.812036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:45.819354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:45.853173 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3346/6720] 10.222.0.77 () {60 vars in 1479 bytes} [Mon Jul 11 15:14:45 2022] PUT /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:45.857526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.864329 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3375/6721] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:14:45 2022] POST /identity/v3/projects => generated 393 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:45.865276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:45.917563 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:46.002952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4d53-5434-4844-af30-dc1eb366ab38 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.021530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.022802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.023098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.023352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.024047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.026432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.066708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc95aa-2279-43d7-aa36-f21ffa088431 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.068350 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3376/6722] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:14:45 2022] POST /identity/v3/users => generated 303 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:46.072781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.099412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01b646-f7e7-42a9-aadd-de5e37dfa720 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.110955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.111992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.112206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.112490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.113232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.118776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.145190 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3377/6723] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:46 2022] GET /identity/v3/roles => generated 2319 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:46.148610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.161401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18328aa0-114b-4c6a-b3a9-0f7a37e5d45c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.177164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.183938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.184245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.184533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] PATH_INFO: `/v3/projects/dabeab20d564412f85fa546f00b442df/users/e79c9cedb59948c286b3e7236e7cc864/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.220429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabeab20d564412f85fa546f00b442df, user_id=e79c9cedb59948c286b3e7236e7cc864, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.223125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.238571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.241512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.241958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.243228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.247443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, user_id=bc7a166739e14e3699f95a53a072a2ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.250089 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:46.250089 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:46.250089 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:46.255795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.266686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3378/6724] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:46 2022] PUT /identity/v3/projects/dabeab20d564412f85fa546f00b442df/users/e79c9cedb59948c286b3e7236e7cc864/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:46.271632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.301661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3347/6725] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Jul 11 15:14:45 2022] GET /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles => generated 407 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:46.305470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.324706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c945-3320-4d0b-8df5-961a9b2c46d5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.403366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac68b1a-b89b-444c-874f-03fb441fe323 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.420903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.421721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.422822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.423388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.425291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.428819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.450905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.452686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.453079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.453482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.454993 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3379/6726] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:46 2022] GET /identity/v3/roles => generated 2319 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:46.456472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.457611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.467474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.478775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81171-1c2a-4221-bcd9-bbce0dc283af admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.480585 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3348/6727] 10.222.0.77 () {58 vars in 1461 bytes} [Mon Jul 11 15:14:46 2022] HEAD /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:46.486391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.499961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68ef0-933e-4fc1-9d47-4fc9622bdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.501560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68ef0-933e-4fc1-9d47-4fc9622bdba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.501941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68ef0-933e-4fc1-9d47-4fc9622bdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.502316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68ef0-933e-4fc1-9d47-4fc9622bdba6 admin admin] PATH_INFO: `/v3/projects/dabeab20d564412f85fa546f00b442df/users/e79c9cedb59948c286b3e7236e7cc864/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.505574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68ef0-933e-4fc1-9d47-4fc9622bdba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabeab20d564412f85fa546f00b442df, user_id=e79c9cedb59948c286b3e7236e7cc864, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.515516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ba8e1-12d1-49b3-bd7a-0ef4dcad1d6d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.517199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68ef0-933e-4fc1-9d47-4fc9622bdba6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.527730 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:46.534310 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3380/6728] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:46 2022] PUT /identity/v3/projects/dabeab20d564412f85fa546f00b442df/users/e79c9cedb59948c286b3e7236e7cc864/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:46.543839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.543839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.543839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.544238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.546488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.547422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.550247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.550987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.552859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.572322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 601483545e6b495299d0067a637842e8 was removed from user bc7a166739e14e3699f95a53a072a2ec on domain 4e4e6dc11ba540fd8f6fd35af255ff6a. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:46.573057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:46.575529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:46.617858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3349/6729] 10.222.0.77 () {58 vars in 1463 bytes} [Mon Jul 11 15:14:46 2022] DELETE /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:46.624895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.626659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] MFA Rules not processed for user `e79c9cedb59948c286b3e7236e7cc864`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:14:46.627454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:46.628137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:46.693606 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:46.746092 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3381/6730] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:14:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:14:46.749957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635272a-909e-4ea0-b48d-11592b308898 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.758108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.759166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.759526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.759877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.761411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.762323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.763003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:46.765823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.800016 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3350/6731] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:14:46 2022] PUT /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:46.805795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:46.945859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2db7e0-32ce-4e12-a793-e3c076ad55fa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.950513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610720d6-f0b7-41ac-85e6-b28d11748e46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:46.958304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:46.959228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:46.959556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:46.959826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:46.961631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_grants(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:46.964343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:46.981091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3351/6732] 10.222.0.77 () {58 vars in 1364 bytes} [Mon Jul 11 15:14:46 2022] GET /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles => generated 408 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:46.985233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.000912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aebb2-74e5-45a0-b764-3bb9ed75551d tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.022914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.025852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.026170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.026462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.033757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.040649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.057172 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3352/6733] 10.222.0.77 () {58 vars in 1464 bytes} [Mon Jul 11 15:14:46 2022] HEAD /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:47.060945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.079333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9732c6-425b-4351-a0b4-5bdcd622f51a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.092872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.094963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.095257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.095541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.099495 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:47.099845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8bd0eb8beab04b86950450903b25c76a, user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.105630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.117548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.118228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.118536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.118825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.120030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 601483545e6b495299d0067a637842e8 was removed from user bc7a166739e14e3699f95a53a072a2ec on project 8bd0eb8beab04b86950450903b25c76a. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:47.120329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.121998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:47.123542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:47.153609 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3353/6734] 10.222.0.77 () {58 vars in 1466 bytes} [Mon Jul 11 15:14:47 2022] DELETE /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:47.158903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.160444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:47.323465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.325159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.374313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81b36-e8a7-4d2d-8c94-293c72b67ab6 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.375442 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3382/6735] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:47.395120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.395985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.396275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.398719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.404762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.407874 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:47.407874 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:47.407874 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:47.408852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.431078 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3354/6736] 10.222.0.77 () {60 vars in 1377 bytes} [Mon Jul 11 15:14:47 2022] PUT /identity/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:47.434911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.449804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb06ff-7713-4333-80f5-5e3d079b5e9e service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.465731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.466611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.466903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.467194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.468746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=bc7a166739e14e3699f95a53a072a2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.469884 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:47.469884 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:47.469884 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:47.470809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.487341 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3383/6737] 10.222.0.77 () {58 vars in 1259 bytes} [Mon Jul 11 15:14:47 2022] GET /identity/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles => generated 373 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:47.491582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.504843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cdc08-995d-4671-b0bf-a756aade5bb8 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.511737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.512841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.513235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.513618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.530937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.536313 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:47.536313 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:47.536313 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:47.539107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.546521 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3355/6738] 10.222.0.77 () {58 vars in 1359 bytes} [Mon Jul 11 15:14:47 2022] HEAD /identity/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:47.550428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.563595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf380c0-4ef4-40a6-aeea-cf92017ebb79 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.584835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.586924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.588558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.588950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.591250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=bc7a166739e14e3699f95a53a072a2ec, role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.597309 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:47.597309 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:47.597309 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:47.597309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.612603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3384/6739] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Jul 11 15:14:47 2022] DELETE /identity/v3/system/users/bc7a166739e14e3699f95a53a072a2ec/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:47.614181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.631429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9510f6-c903-4e91-971d-bdf87a236f8e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.639688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.640523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.641906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.642302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.643698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.649237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.686452 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3356/6740] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/roles => generated 270 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:47.691521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.718107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02d6a-142a-46fe-b4af-28223873119a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.733179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.735813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.736150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.736516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.739239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.747200 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:47.747200 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:47.747200 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:47.748405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.793040 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3385/6741] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/roles => generated 270 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:47.794846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.801100 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:47.811366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23754-0cca-41d8-bd9a-d128111bf6fc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:47.822433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:47.823681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:47.827895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:47.828918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/51175979f95346ba9f4e98b0f6a2c107` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:47.831744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f264310a1a8b4a849b4564a8519ab58a, implied_role_id=51175979f95346ba9f4e98b0f6a2c107)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:47.832970 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:47.832970 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:47.832970 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:47.837113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:47.903319 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3357/6742] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:47 2022] PUT /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/51175979f95346ba9f4e98b0f6a2c107 => generated 531 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:47.904850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:47.926578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f8ed5-f32e-434c-95b0-418b478d3bed tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.055529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.057504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:48.107876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.110750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.111142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.114845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.115850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.117556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.156384 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3386/6743] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:14:47 2022] POST /identity/v3/domains => generated 276 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:48.159460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.211113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7287-c3dd-4164-b5c9-40f9c2e47b2e tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.299579 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:48.304888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c327c6-423c-4778-9fc4-49a0a74f12e9 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.315765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.316892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.320371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.320635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.321430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.323542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.345008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.346184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.346473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.348904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.354999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:48.355095 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3387/6744] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:48 2022] POST /identity/v3/roles => generated 269 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:48.363040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.400335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54cc6-786a-47a5-9e2c-0b7052efbc36 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.418456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.419426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.420065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.420365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/2a40d7d9b96a45f582e1e88f1f44a868` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.423687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f264310a1a8b4a849b4564a8519ab58a, implied_role_id=2a40d7d9b96a45f582e1e88f1f44a868)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.425300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.476512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3388/6745] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:48 2022] PUT /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/2a40d7d9b96a45f582e1e88f1f44a868 => generated 530 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:48.477739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.524790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.527352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.548795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3358/6746] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:14:48.674107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fbf1f-486c-4699-8d31-c8d541ba11ab tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.701933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.701933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.705574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.706013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.715287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f264310a1a8b4a849b4564a8519ab58a, implied_role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.717977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:48.797989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3389/6747] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:48 2022] PUT /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/601483545e6b495299d0067a637842e8 => generated 524 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:48.799531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:48.819785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc1f6-b545-4d90-aade-8ff4b53f6fb6 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:48.911399 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:48.929127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:48.942371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:48.943051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:48.945906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/601483545e6b495299d0067a637842e8/implies/f264310a1a8b4a849b4564a8519ab58a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:48.950107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=601483545e6b495299d0067a637842e8, implied_role_id=f264310a1a8b4a849b4564a8519ab58a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:48.954267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] f264310a1a8b4a849b4564a8519ab58a cannot be an implied roles.: keystone.exception.InvalidImpliedRole: f264310a1a8b4a849b4564a8519ab58a cannot be an implied roles. Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 11 15:14:49.022432 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 11 15:14:49.023579 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:14:49.023579 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:14:49.023579 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 11 15:14:49.023579 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 11 15:14:49.023579 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: f264310a1a8b4a849b4564a8519ab58a cannot be an implied roles. Jul 11 15:14:49.023579 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:49.025897 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3359/6748] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:48 2022] PUT /identity/v3/roles/601483545e6b495299d0067a637842e8/implies/f264310a1a8b4a849b4564a8519ab58a => generated 116 bytes in 227 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:14:49.029072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:49.062835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab420be-e290-4b1c-b759-d5547a525340 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:49.083177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:49.084162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:49.084458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:49.084742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:49.095094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f264310a1a8b4a849b4564a8519ab58a, implied_role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:49.096770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:49.133268 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3390/6749] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:49 2022] DELETE /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/601483545e6b495299d0067a637842e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:49.138158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:49.157310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173b55-ec18-4bc0-ae81-f930b448d65b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:49.338330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:49.339348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:49.340182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:49.342684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/2a40d7d9b96a45f582e1e88f1f44a868` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:49.348638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f264310a1a8b4a849b4564a8519ab58a, implied_role_id=2a40d7d9b96a45f582e1e88f1f44a868)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:49.353766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:49.377525 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3360/6750] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:49 2022] DELETE /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/2a40d7d9b96a45f582e1e88f1f44a868 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:49.381202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:49.419429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f9484-c2de-4373-a020-c3720d00b438 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:49.492732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:49.494357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:49.494705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:49.494995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/2a40d7d9b96a45f582e1e88f1f44a868` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:49.496649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2a40d7d9b96a45f582e1e88f1f44a868)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:49.498829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:49.553871 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:49.558096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 2a40d7d9b96a45f582e1e88f1f44a868 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:49.559461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:49.561492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:49.572821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3391/6751] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:49 2022] DELETE /identity/v3/roles/2a40d7d9b96a45f582e1e88f1f44a868 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:49.577157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:49.579303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:49.604926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d195e-0e31-411e-bc86-df040c0c0459 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:49.658090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:49.659588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:49.860721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:49.861617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:49.861908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:49.862435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/9e35c16fc59e44ef897d75f76fad1c79` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:49.889265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9e35c16fc59e44ef897d75f76fad1c79)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:49.891914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:49.894618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22795a-5082-46fa-8a43-172d8a640a18 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:49.906629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:49.907560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:49.909698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:49.911704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:49.918929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:49.942908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:49.945125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.016623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.017248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.020746 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3361/6752] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:14:49 2022] PATCH /identity/v3/domains/9e35c16fc59e44ef897d75f76fad1c79 => generated 277 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:50.026703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:50.026703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:50.088815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:50.090961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:50.109988 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3392/6753] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:14:50.111667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:50.114628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:50.133218 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:50.215596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc416-fb89-427f-bd27-b876553d28b0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:50.225546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:50.226446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:50.228617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:50.229450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/9e35c16fc59e44ef897d75f76fad1c79` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:50.257832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9e35c16fc59e44ef897d75f76fad1c79)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:50.260913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:50.294731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02fcd8-a816-4bd0-9f4a-9390a61644af service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:50.330255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.342724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.385415 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:50.413047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:50.415994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:50.416293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:50.416579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:50.421166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:50.440885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79', 'request_id': 'req-709b3500-d331-4dc8-836b-6fe3198ebc05'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.449515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79', 'request_id': 'req-709b3500-d331-4dc8-836b-6fe3198ebc05'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.461795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79', 'request_id': 'req-709b3500-d331-4dc8-836b-6fe3198ebc05'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.478148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] The token cache is being invalidate because project 9e35c16fc59e44ef897d75f76fad1c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:50.478445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.479189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.489663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79', 'request_id': 'req-709b3500-d331-4dc8-836b-6fe3198ebc05'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.494977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79', 'request_id': 'req-709b3500-d331-4dc8-836b-6fe3198ebc05'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.495743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9e35c16fc59e44ef897d75f76fad1c79', 'request_id': 'req-709b3500-d331-4dc8-836b-6fe3198ebc05'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:50.503583 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3362/6754] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:14:50 2022] DELETE /identity/v3/domains/9e35c16fc59e44ef897d75f76fad1c79 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:50.505669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:50.508647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:50.509137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:50.510917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:50.521126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3393/6755] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:14:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:14:50.640746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3500-d331-4dc8-836b-6fe3198ebc05 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:50.660941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:50.664665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:50.664975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:50.665330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/51175979f95346ba9f4e98b0f6a2c107` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:50.669222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f264310a1a8b4a849b4564a8519ab58a, implied_role_id=51175979f95346ba9f4e98b0f6a2c107)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:50.675211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:50.721486 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3363/6756] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:50 2022] DELETE /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a/implies/51175979f95346ba9f4e98b0f6a2c107 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:50.726109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:50.742893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad04132-77ca-4a7e-b7bb-406904942687 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:50.968636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:50.969794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:50.970279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:50.970698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/51175979f95346ba9f4e98b0f6a2c107` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:50.981232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=51175979f95346ba9f4e98b0f6a2c107)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:50.983185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:51.067061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 51175979f95346ba9f4e98b0f6a2c107 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:51.067482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:51.068358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:51.074402 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3394/6757] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:50 2022] DELETE /identity/v3/roles/51175979f95346ba9f4e98b0f6a2c107 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:51.075703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:51.078033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:51.089315 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:51.099457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8725895-8cfe-4937-8c9c-dec1b5858741 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:51.257093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:51.258172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:51.258872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:51.259271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/f264310a1a8b4a849b4564a8519ab58a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:51.260642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f264310a1a8b4a849b4564a8519ab58a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:51.262576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:51.311301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role f264310a1a8b4a849b4564a8519ab58a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:51.311734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:51.312524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:51.324195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:51.324847 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3364/6758] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:51 2022] DELETE /identity/v3/roles/f264310a1a8b4a849b4564a8519ab58a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:51.372807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331fd65-9a23-4c94-8e17-a7bf0acc4573 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:51.560319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:51.561509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:51.562429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:51.562933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:51.564958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:51.566801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:51.568379 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:51.599435 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3395/6759] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:51 2022] PUT /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 518 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:51.614460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:51.616448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:51.640318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f845bc-fb63-4ddc-816d-cd1aecfe3001 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:51.809132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:51.810092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:51.827579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:51.827579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:51.827579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:51.827579 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:51.827579 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:51.827579 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:51.828310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:51.828310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:51.828310 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:51.828310 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:51.828310 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:51.828310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:51.841769 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3365/6760] 10.222.0.77 () {58 vars in 1344 bytes} [Mon Jul 11 15:14:51 2022] HEAD /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:51.845716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:51.858993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303837a-9f5f-410f-8364-6ebca34094fd tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:51.871928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:51.872895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:51.873193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:51.873589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:51.879306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:51.881534 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:51.881534 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:51.881534 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:51.882272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:51.898020 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3396/6761] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 15:14:51 2022] GET /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 518 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:51.899401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:51.923388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8cfb7-f1fa-46fb-ac7f-f9f3fcab5c46 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:51.955244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:51.965266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:51.965562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:51.965851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:51.986366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:51.988959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:52.010901 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3366/6762] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:51 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:52.011749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:52.052619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4fb78-a214-4b14-ac97-ee109f05436c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:52.199606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:52.201253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:52.201253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:52.201253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:52.209569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:52.211274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e.: keystone.exception.ImpliedRoleNotFound: 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e. Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = query.one() Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._iter().one() Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._only_one_row( Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:52.245294 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 11 15:14:52.246452 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 11 15:14:52.250893 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 11 15:14:52.250893 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e. Jul 11 15:14:52.250893 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:52.250893 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3397/6763] 10.222.0.77 () {58 vars in 1343 bytes} [Mon Jul 11 15:14:52 2022] GET /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 137 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 11 15:14:52.254207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:52.268239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208097-dfc9-4b09-8eb0-5372ee30a6d4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:52.273468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:52.275089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:52.275538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:52.275845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:52.277789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:52.279508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e.: keystone.exception.ImpliedRoleNotFound: 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e. Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = query.one() Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._iter().one() Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._only_one_row( Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:52.315533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 11 15:14:52.316675 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 11 15:14:52.317533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 11 15:14:52.317533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 11 15:14:52.317533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 11 15:14:52.317533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 32d5e3d0ebed48acb0e151f75b838a9d does not imply e29e3d1506a141468c4c400c2729bd2e. Jul 11 15:14:52.317533 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:14:52.322298 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3367/6764] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:52 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 137 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:14:52.323220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:52.342089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e31a3-b7d7-4103-8004-34889b7b33c4 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:52.347589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:52.348716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:52.349109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:52.349493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:52.352388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:52.354307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:52.401387 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3398/6765] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:52 2022] PUT /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 518 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:14:52.407823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:52.453242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df742fa-8f89-4746-87eb-68a6463c1954 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:52.554820 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:52.583510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:52.585005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:52.585296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:52.586703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:52.591774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=756aa19cc2f74278a7f4b90b2ad8f88a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:52.593455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:52.661979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3368/6766] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:52 2022] PUT /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a => generated 520 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:52.666277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:52.680032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57bae-673b-42a0-bc30-541d19bfe510 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:52.968395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:52.969360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:52.969650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:52.969939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:52.980602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=756aa19cc2f74278a7f4b90b2ad8f88a, implied_role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:52.992439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.078826 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3399/6767] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:52 2022] PUT /identity/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8 => generated 519 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:53.082872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.120408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e63f8d-7bec-409d-8bd9-a8929039852f tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:53.219092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:53.220113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.220254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.220587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.221248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:53.222899 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:53.222899 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:53.222899 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:53.223820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.254939 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3369/6768] 10.222.0.77 () {58 vars in 1151 bytes} [Mon Jul 11 15:14:53 2022] GET /identity/v3/role_inferences => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:53.259174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.278259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fefda-0e6f-4105-b1eb-18de2cb771f2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:53.316795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:53.323002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.323300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.323642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.333095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.335625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:53.338235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=756aa19cc2f74278a7f4b90b2ad8f88a, implied_role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:53.346226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.385581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3400/6769] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:53 2022] DELETE /identity/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:53.390083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.427251 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:53.525830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e2b11-d789-4c08-998b-febbaf6f609a tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:53.548166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9893-ebf5-4c25-ae24-9794aa85c5df tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:53.565507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:53.568220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.569191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.569634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.575763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=756aa19cc2f74278a7f4b90b2ad8f88a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:53.589002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.606401 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3401/6770] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:53 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:53.618554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.633121 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:53.672788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:53.673478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.673769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.674054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.683228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:53.761434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:53.763632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.781059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3370/6771] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:14:53.863134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29271d-4208-458f-ab75-d1fd72f8c99c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:53.903036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:53.906476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:53.908108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:53.908883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:53.912088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:53.914512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:53.938874 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3402/6772] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:53 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:53.955334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:53.979170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39912e75-0856-4538-9242-b5d37eb52641 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.129411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.130113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.130398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.130728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.132430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.134639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.162851 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3371/6773] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:53 2022] GET /identity/v3/roles => generated 2319 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:54.164479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.220703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7452c-34f8-4186-a944-4dc456dd3edf tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.252558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.255310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.258884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.259416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.261733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.268860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.322285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.323233 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3403/6774] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:14:54 2022] POST /identity/v3/roles => generated 234 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:54.338018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766856b-006d-419e-bbab-8899c3db1a07 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.359289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.360403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.360759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.361117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/b61a535c8f3d4d3192753d9228187d65` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.363636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:update_role(role_id=b61a535c8f3d4d3192753d9228187d65)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.364492 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:54.364492 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:54.364492 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:54.366161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.475253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3372/6775] 10.222.0.77 () {60 vars in 1242 bytes} [Mon Jul 11 15:14:54 2022] PATCH /identity/v3/roles/b61a535c8f3d4d3192753d9228187d65 => generated 238 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:54.478377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.493711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4659d5-1c1e-4a0a-9f28-893a29d4916c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.496188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.499545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:54.510104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.511508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.511877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.512246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/b61a535c8f3d4d3192753d9228187d65` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.542927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:get_role(role_id=b61a535c8f3d4d3192753d9228187d65)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.544682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.560060 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3404/6776] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:14:54 2022] GET /identity/v3/roles/b61a535c8f3d4d3192753d9228187d65 => generated 238 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:54.561113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.600280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ec001-dd9c-4562-9291-ef65282c0469 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.622524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.624175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.626200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.627378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.628452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.632918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.668887 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3405/6777] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:14:54 2022] GET /identity/v3/roles => generated 2548 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:14:54.671926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.700724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f6f0-921e-4165-9629-30b70042fea3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.715421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.716942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.722847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.723213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/b61a535c8f3d4d3192753d9228187d65` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.736018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b61a535c8f3d4d3192753d9228187d65)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.739934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.758219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36abe-ddfc-49d0-aa36-009587a3e76c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:54.766766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:54.767803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:54.768295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:54.768794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:54.772347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:54.905039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:54.907277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:54.939101 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3373/6778] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:14:54.952686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role b61a535c8f3d4d3192753d9228187d65 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:54.953515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:54.954303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:54.960011 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3406/6779] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:54 2022] DELETE /identity/v3/roles/b61a535c8f3d4d3192753d9228187d65 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:54.970219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:54.977451 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:54.989580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78153-a643-4f7f-9b6a-4f2628760503 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:55.217231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:55.219745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:55.222121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:55.222121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:55.227600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:55.234946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:55.339117 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3374/6780] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:54 2022] PUT /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 518 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:55.343129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:55.344822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:55.378915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a34f-0085-4101-8e54-9bc767903d41 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:55.462726 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:55.646334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:55.648139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:55.648583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:55.649040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:55.652449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=756aa19cc2f74278a7f4b90b2ad8f88a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:55.654284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:55.717561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3407/6781] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:55 2022] PUT /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a => generated 520 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:55.721350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:55.732965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0424-6a08-410c-851e-8935e5ec4d28 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:55.910590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:55.911622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:55.912505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:55.913148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:55.931427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=756aa19cc2f74278a7f4b90b2ad8f88a, implied_role_id=601483545e6b495299d0067a637842e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:55.933160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:56.028535 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3375/6782] 10.222.0.77 () {60 vars in 1362 bytes} [Mon Jul 11 15:14:55 2022] PUT /identity/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8 => generated 519 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:14:56.029624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:56.050552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c126a7-4d22-40e2-9a3c-ea88e392e97b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:56.194462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:56.194462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:56.194462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:56.195140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:56.201811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=756aa19cc2f74278a7f4b90b2ad8f88a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:56.203092 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:56.203092 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:14:56.203092 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:14:56.204002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:56.221440 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3408/6783] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 11 15:14:56 2022] GET /identity/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies => generated 488 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:56.224448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:56.239615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f6fb-c5c0-4731-99bd-3ca6e221a825 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:56.296289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:56.297189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:56.299864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:56.300896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:56.304835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:56.305896 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:14:56.305896 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:14:56.305896 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:14:56.306821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:56.358193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:56.358386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3376/6784] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 11 15:14:56 2022] GET /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies => generated 658 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:14:56.385279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea979-686c-4a27-98c5-7796eae3f16b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:56.391683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:56.393111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:56.393728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:56.394247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:56.405356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=756aa19cc2f74278a7f4b90b2ad8f88a, implied_role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:56.407434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:56.434225 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3409/6785] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:56 2022] DELETE /identity/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a/implies/601483545e6b495299d0067a637842e8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:14:56.438559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:56.465522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa68325-d6a9-4830-a879-686fa21c02b2 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:56.690090 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:56.723320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:56.728756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:56.730315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:56.731364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:56.737011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=756aa19cc2f74278a7f4b90b2ad8f88a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:56.752800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:56.803836 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3377/6786] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:56 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/756aa19cc2f74278a7f4b90b2ad8f88a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:56.808402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:56.820973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2282ad2-368e-4f37-9b92-fe851b30cb31 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:56.986415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:56.987677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:56.987850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:56.988311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:56.995141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=32d5e3d0ebed48acb0e151f75b838a9d, implied_role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:56.999927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:57.058317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:57.058317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:57.058651 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3410/6787] 10.222.0.77 () {58 vars in 1346 bytes} [Mon Jul 11 15:14:56 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d/implies/e29e3d1506a141468c4c400c2729bd2e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:57.065865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:57.189901 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:57.256568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b0ef-4b10-42a7-9c5d-f09dd011f778 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:57.268240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:57.269193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:57.269502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:57.269756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/9e35c16fc59e44ef897d75f76fad1c79` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:57.316823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Could not find domain: 9e35c16fc59e44ef897d75f76fad1c79.: keystone.exception.DomainNotFound: Could not find domain: 9e35c16fc59e44ef897d75f76fad1c79. Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9e35c16fc59e44ef897d75f76fad1c79. Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:14:57.345719 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:14:57.346975 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9e35c16fc59e44ef897d75f76fad1c79. Jul 11 15:14:57.348086 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:14:57.366724 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3411/6788] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:14:57 2022] PATCH /identity/v3/domains/9e35c16fc59e44ef897d75f76fad1c79 => generated 112 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:14:57.369054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:57.416412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996b3c-2b87-4b08-b155-aaeba80d57dc tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:57.436143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:57.437102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2ed3-060a-49b1-8ecb-adb062b478a7 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:57.455720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:57.457421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:57.458120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/users/bc7a166739e14e3699f95a53a072a2ec` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:57.461597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bc7a166739e14e3699f95a53a072a2ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:57.472194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:57.618510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7a166739e14e3699f95a53a072a2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:57.619384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7a166739e14e3699f95a53a072a2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:57.651425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7a166739e14e3699f95a53a072a2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:57.654182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7a166739e14e3699f95a53a072a2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:57.660708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:57.662608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:57.663433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:57.664144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:57.669681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:57.671898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7a166739e14e3699f95a53a072a2ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:57.721169 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3412/6789] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:57 2022] DELETE /identity/v3/users/bc7a166739e14e3699f95a53a072a2ec => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:57.731905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:57.732323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:57.737264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:57.739479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:57.764435 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3378/6790] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:14:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:14:57.979736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb518-e99a-410b-9b4d-177369ceb3c5 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:58.006865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:58.011115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:58.011420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:58.012663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/601483545e6b495299d0067a637842e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:58.027274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=601483545e6b495299d0067a637842e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:58.028973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:58.285098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 601483545e6b495299d0067a637842e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:58.285403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:58.294854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:58.306547 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3413/6791] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:14:57 2022] DELETE /identity/v3/roles/601483545e6b495299d0067a637842e8 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:58.310237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:58.333109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53338d-acf0-49b4-afb7-47c853a64768 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:58.601515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:58.603915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:58.604313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:58.604697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/groups/94ebc9627715488bb3379576a510eebe` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:58.606960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_group(group_id=94ebc9627715488bb3379576a510eebe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:58.611914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:58.676509 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:58.817842 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3379/6792] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:14:58 2022] DELETE /identity/v3/groups/94ebc9627715488bb3379576a510eebe => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:58.821874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:58.823545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:58.860129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c793-34b8-4618-836d-78f56d7d126b tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:58.873436 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:14:59.106370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:59.107571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:59.107862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:59.108147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/projects/8bd0eb8beab04b86950450903b25c76a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:59.114755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8bd0eb8beab04b86950450903b25c76a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:59.121883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:59.395621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd0eb8beab04b86950450903b25c76a', 'request_id': 'req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:59.423409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd0eb8beab04b86950450903b25c76a', 'request_id': 'req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:59.450083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd0eb8beab04b86950450903b25c76a', 'request_id': 'req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:59.508481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] The token cache is being invalidate because project 8bd0eb8beab04b86950450903b25c76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:14:59.508827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:59.509471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:59.511097 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3414/6793] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:14:58 2022] DELETE /identity/v3/projects/8bd0eb8beab04b86950450903b25c76a => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:14:59.515412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:14:59.519061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:14:59.553813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61171f86-42e8-4cb2-a6af-8c783273d9da tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:14:59.808567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:14:59.809526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:14:59.809631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:14:59.809873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:14:59.813138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:14:59.819559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:14:59.946702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:14:59.951504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.113543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.126745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.142403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:00.143052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3380/6794] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:14:59 2022] PATCH /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a => generated 277 bytes in 624 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:00.169991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1fc7c-72e1-4099-98e8-5bb81ea16f21 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:00.473752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:00.476672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:00.476883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:00.477179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:00.498389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4e4e6dc11ba540fd8f6fd35af255ff6a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:00.500550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:00.588529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.598955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.605370 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:00.703733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a', 'request_id': 'req-06d7d7ef-ebcf-4d91-adf8-27f83a096719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.723383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a', 'request_id': 'req-06d7d7ef-ebcf-4d91-adf8-27f83a096719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.736445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a', 'request_id': 'req-06d7d7ef-ebcf-4d91-adf8-27f83a096719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.769998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] The token cache is being invalidate because project 4e4e6dc11ba540fd8f6fd35af255ff6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:00.770588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.772237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.788753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a', 'request_id': 'req-06d7d7ef-ebcf-4d91-adf8-27f83a096719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.790403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a', 'request_id': 'req-06d7d7ef-ebcf-4d91-adf8-27f83a096719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.795996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4e4e6dc11ba540fd8f6fd35af255ff6a', 'request_id': 'req-06d7d7ef-ebcf-4d91-adf8-27f83a096719'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:00.805692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3415/6795] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:15:00 2022] DELETE /identity/v3/domains/4e4e6dc11ba540fd8f6fd35af255ff6a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:00.809591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:00.812451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:00.837010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ede9-9caf-4665-85de-3296f1c1b509 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:00.966967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:00.968009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:00.968317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:00.968595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:00.970567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=756aa19cc2f74278a7f4b90b2ad8f88a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:00.972358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:01.093310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 756aa19cc2f74278a7f4b90b2ad8f88a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:01.093622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:01.095183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:01.098316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3381/6796] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:00 2022] DELETE /identity/v3/roles/756aa19cc2f74278a7f4b90b2ad8f88a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:01.102638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:01.104738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:01.125109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d7ef-ebcf-4d91-adf8-27f83a096719 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:01.291473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:01.292882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:01.293181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:01.293471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/e29e3d1506a141468c4c400c2729bd2e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:01.295087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e29e3d1506a141468c4c400c2729bd2e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:01.296786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:01.385632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role e29e3d1506a141468c4c400c2729bd2e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:01.385826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:01.386594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:01.392871 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3416/6797] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:01 2022] DELETE /identity/v3/roles/e29e3d1506a141468c4c400c2729bd2e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:01.396553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:01.398028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:01.421301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8431-7596-452e-875a-7ed495d5df4c tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:01.445138 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:01.592814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12f3061fa3e47f7a0ff6fcc80fe073a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eeea9109fc449ea8598dae05411d413', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:01.594081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:01.595030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:01.595538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] PATH_INFO: `/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:01.600445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32d5e3d0ebed48acb0e151f75b838a9d)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:01.602277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:01.748424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invalidating the token cache because role 32d5e3d0ebed48acb0e151f75b838a9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:01.748707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:01.749432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-76d97546-2296-4a94-85da-8ebf1e1a0ba0 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:01.751347 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3382/6798] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:01 2022] DELETE /identity/v3/roles/32d5e3d0ebed48acb0e151f75b838a9d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:01.762802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:01.764858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:01.859328 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:01.929081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c27f3d-222e-467b-9eaf-f1052d7c7bf3 tempest-RolesV3TestJSON-1283029378 tempest-RolesV3TestJSON-1283029378-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:02.065059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:02.066277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:02.066622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:02.066966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] PATH_INFO: `/v3/users/07b33ed8d3e74339a4aecab98d83e800` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:02.069544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b33ed8d3e74339a4aecab98d83e800)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:02.072422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:02.211482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b33ed8d3e74339a4aecab98d83e800'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:02.212457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b33ed8d3e74339a4aecab98d83e800'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:02.239091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b33ed8d3e74339a4aecab98d83e800'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:02.240204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b33ed8d3e74339a4aecab98d83e800'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:02.254933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b33ed8d3e74339a4aecab98d83e800'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:02.283569 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3417/6799] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:01 2022] DELETE /identity/v3/users/07b33ed8d3e74339a4aecab98d83e800 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:02.285722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:02.286184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:02.286262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:02.315721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:02.317556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:02.418981 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3383/6800] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:02.441318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:02.444706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:02.625881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14102d-9706-46af-ad6a-92b39d29e331 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:02.631382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:02.632284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:02.632721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:02.633303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:02.653247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:02.655308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:02.687281 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3418/6801] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:03.511874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:03.513653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:03.532541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206d9db-4331-4e84-8dc7-2b9b5d3ec7d0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:03.545540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:03.545798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:03.547225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:03.547514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] PATH_INFO: `/v3/projects/f91994ecd9a4400193caaadeb96f031c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:03.551569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91994ecd9a4400193caaadeb96f031c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:03.554199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:03.666569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91994ecd9a4400193caaadeb96f031c', 'request_id': 'req-fe5710fa-27cc-410e-8cb7-297019a07764'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:03.685876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91994ecd9a4400193caaadeb96f031c', 'request_id': 'req-fe5710fa-27cc-410e-8cb7-297019a07764'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:03.697912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91994ecd9a4400193caaadeb96f031c', 'request_id': 'req-fe5710fa-27cc-410e-8cb7-297019a07764'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:03.763859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] The token cache is being invalidate because project f91994ecd9a4400193caaadeb96f031c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:03.766829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:03.769645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:03.778177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3384/6802] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:03 2022] DELETE /identity/v3/projects/f91994ecd9a4400193caaadeb96f031c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:03.781196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:03.818313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa8f6-29c8-442d-91b1-c8b3576dcaa0 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:03.873620 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:04.052086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:04.052086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:04.052086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:04.059120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] PATH_INFO: `/v3/users/f12f3061fa3e47f7a0ff6fcc80fe073a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:04.064412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12f3061fa3e47f7a0ff6fcc80fe073a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:04.068041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:04.227497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12f3061fa3e47f7a0ff6fcc80fe073a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.228213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12f3061fa3e47f7a0ff6fcc80fe073a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.256555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12f3061fa3e47f7a0ff6fcc80fe073a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.257349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12f3061fa3e47f7a0ff6fcc80fe073a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.277221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f64e3e4e-f177-4cf7-b605-dbb0837e6101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12f3061fa3e47f7a0ff6fcc80fe073a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.303535 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3419/6803] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:03 2022] DELETE /identity/v3/users/f12f3061fa3e47f7a0ff6fcc80fe073a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:04.542821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:04.545715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:04.561279 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:04.571775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5710fa-27cc-410e-8cb7-297019a07764 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:04.710387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:04.711477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:04.711869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:04.712251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] PATH_INFO: `/v3/users/a71d46dac31446a38a1d2d0bf7fd6756` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:04.716376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71d46dac31446a38a1d2d0bf7fd6756)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:04.718651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:04.844159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71d46dac31446a38a1d2d0bf7fd6756'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.886321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71d46dac31446a38a1d2d0bf7fd6756'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.904406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71d46dac31446a38a1d2d0bf7fd6756'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.926890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71d46dac31446a38a1d2d0bf7fd6756'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.928039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71d46dac31446a38a1d2d0bf7fd6756'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:04.940857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3385/6804] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:04 2022] DELETE /identity/v3/users/a71d46dac31446a38a1d2d0bf7fd6756 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:04.942659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb0b3-79ef-44a2-978e-70ac56b27b73 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:04.943688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb0b3-79ef-44a2-978e-70ac56b27b73 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:04.943812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb0b3-79ef-44a2-978e-70ac56b27b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:04.977023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-643eb0b3-79ef-44a2-978e-70ac56b27b73 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:04.978292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-643eb0b3-79ef-44a2-978e-70ac56b27b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:05.173536 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3420/6805] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:05.212225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:05.214256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:05.382002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db506abc-c414-4b9a-8d6a-073df3305117 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:05.397439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:05.398123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:05.398413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:05.398719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:05.427775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:05.429285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:05.455853 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3386/6806] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:05.868845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362b63-eb57-4635-8220-fa59d6be2cc4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:05.869437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362b63-eb57-4635-8220-fa59d6be2cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:05.869910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362b63-eb57-4635-8220-fa59d6be2cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:05.922115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4c362b63-eb57-4635-8220-fa59d6be2cc4 None None] MFA Rules not processed for user `3fdf1208d2c34fd1b5a24c2ad4e063a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:05.934119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4c362b63-eb57-4635-8220-fa59d6be2cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:06.088413 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:06.191348 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3421/6807] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:06.360638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:06.362754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:06.395305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495def4c-0028-494c-ae85-709fbebc71e9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:06.416553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:06.417384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:06.417676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:06.417960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] PATH_INFO: `/v3/projects/8eeea9109fc449ea8598dae05411d413` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:06.423451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeea9109fc449ea8598dae05411d413)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:06.425623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:06.486994 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:06.638979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeea9109fc449ea8598dae05411d413', 'request_id': 'req-84831732-5bf5-4f00-a50d-c52b163049ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:06.673301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeea9109fc449ea8598dae05411d413', 'request_id': 'req-84831732-5bf5-4f00-a50d-c52b163049ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:06.710365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeea9109fc449ea8598dae05411d413', 'request_id': 'req-84831732-5bf5-4f00-a50d-c52b163049ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:06.735663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] The token cache is being invalidate because project 8eeea9109fc449ea8598dae05411d413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:06.736081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:06.736851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-84831732-5bf5-4f00-a50d-c52b163049ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:06.742603 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3387/6808] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:06 2022] DELETE /identity/v3/projects/8eeea9109fc449ea8598dae05411d413 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:06.745088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:06.745370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:06.745648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:06.824718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:06.826142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:06.981941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3422/6809] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:06.989995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:06.990699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:06.992047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.039055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:07.070348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:07.080582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3388/6810] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:07.085090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.100086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826da01-11d4-4811-ac06-0b70d1131636 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.110954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.114976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.115555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.116075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.118254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:07.118978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.124259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:07.153262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3423/6811] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:07.156699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.175613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef3d58-ab9a-45dd-9451-926b0782f9c4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.184594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.185648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.186461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.192326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.194565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.197304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:07.262832 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3389/6812] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:07 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:07.266648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.285549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4540ba-7b8f-46cb-bdd5-ab25962ecb1d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.490857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.491716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.494669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.496694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.497545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.507125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:07.593649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3424/6813] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:07 2022] POST /identity/v3/users => generated 284 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:07.597537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.622042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103242f0-4726-4d90-ad4e-e85dd9fa0576 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.650802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.655136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.657267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.659975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.664362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.685410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:07.748763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3390/6814] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:07.752661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.776466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4f417-31e0-4298-818a-37142f0f90bb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.782649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.786552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:07.813507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.814200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.814487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.822838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.827632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.827856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:07.839390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b3124-a97e-4596-9713-558c5228bdec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.856521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.857405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.857764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.857969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] PATH_INFO: `/v3/projects/d2140d79f2a74577804bc99c521f2903` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.860874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2140d79f2a74577804bc99c521f2903)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.862861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:07.867899 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3425/6815] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:07.869678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:07.912988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea6ee9-6c88-4ac6-a5d1-8582c1f8f1ed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:07.930196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855449d-d769-45ee-9683-005d4837062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:07.935048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855449d-d769-45ee-9683-005d4837062b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:07.936271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855449d-d769-45ee-9683-005d4837062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:07.936778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855449d-d769-45ee-9683-005d4837062b admin admin] PATH_INFO: `/v3/projects/b0e3d040a61a4766a539ebece2856032/users/063caaa2df4c40c5807f3cad1f020aa6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:07.983420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855449d-d769-45ee-9683-005d4837062b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e3d040a61a4766a539ebece2856032, user_id=063caaa2df4c40c5807f3cad1f020aa6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:07.995606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855449d-d769-45ee-9683-005d4837062b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:08.002939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2140d79f2a74577804bc99c521f2903', 'request_id': 'req-b93b0470-3f69-4342-821d-1ac9b275f32d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.016480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2140d79f2a74577804bc99c521f2903', 'request_id': 'req-b93b0470-3f69-4342-821d-1ac9b275f32d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.037892 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3426/6816] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:07 2022] PUT /identity/v3/projects/b0e3d040a61a4766a539ebece2856032/users/063caaa2df4c40c5807f3cad1f020aa6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:08.050020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:08.050941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2140d79f2a74577804bc99c521f2903', 'request_id': 'req-b93b0470-3f69-4342-821d-1ac9b275f32d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.051183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:08.052888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:08.082185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] The token cache is being invalidate because project d2140d79f2a74577804bc99c521f2903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:08.082617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.083789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.117981 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3391/6817] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:07 2022] DELETE /identity/v3/projects/d2140d79f2a74577804bc99c521f2903 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:08.122687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:08.127395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:08.148866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] MFA Rules not processed for user `063caaa2df4c40c5807f3cad1f020aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:08.152845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:08.176646 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:08.339907 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:08.407832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0470-3f69-4342-821d-1ac9b275f32d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:08.433882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3427/6818] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:08.438749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:08.449405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:08.612198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:08.616965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:08.617257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:08.617543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] PATH_INFO: `/v3/users/2df2d62e8050483687b53f27ede3ce5b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:08.620889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df2d62e8050483687b53f27ede3ce5b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:08.622911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:08.718286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc391f5-84ec-49e1-8c39-7161c09a089a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:08.736945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:08.738410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:08.742075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:08.742383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:08.743289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:08.745727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:08.800916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df2d62e8050483687b53f27ede3ce5b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.822001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3428/6819] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:08 2022] POST /identity/v3/projects => generated 367 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:08.825247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:08.850301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df2d62e8050483687b53f27ede3ce5b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.898603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df2d62e8050483687b53f27ede3ce5b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.928840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df2d62e8050483687b53f27ede3ce5b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.929624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df2d62e8050483687b53f27ede3ce5b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:08.943502 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3392/6820] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:08 2022] DELETE /identity/v3/users/2df2d62e8050483687b53f27ede3ce5b => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:08.950473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd330451-a3a1-4a97-9417-6cafc627a1ab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:09.028111 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:09.108477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:09.109308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:09.110811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:09.112069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:09.114046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:09.123364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:09.187578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3429/6821] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:08 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:09.191370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:09.193761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:09.227680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489a08c-7344-45a9-98f9-3aa3b8b88e86 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:09.249291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:09.251000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:09.251568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:09.251864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:09.253743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:09.258364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:09.291521 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3393/6822] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:09.292820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:09.306203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48210e5-2291-455d-9564-ffe6a6173e58 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:09.323178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:09.324098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:09.324437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:09.324721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] PATH_INFO: `/v3/projects/a8c4159448004884a702e360354d8a4c/users/8cc364144ae748fa9a224618b0f48aa5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:09.343821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c4159448004884a702e360354d8a4c, user_id=8cc364144ae748fa9a224618b0f48aa5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:09.346513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:09.374729 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3430/6823] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:09 2022] PUT /identity/v3/projects/a8c4159448004884a702e360354d8a4c/users/8cc364144ae748fa9a224618b0f48aa5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:09.378360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:09.394366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38c0c8-2da1-4b0c-8480-12f14ccb7bad admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:09.575143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810a2e-0483-49bc-886f-a3a3b61e66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:09.576176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810a2e-0483-49bc-886f-a3a3b61e66b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:09.577154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810a2e-0483-49bc-886f-a3a3b61e66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:09.577445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810a2e-0483-49bc-886f-a3a3b61e66b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:09.581410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07810a2e-0483-49bc-886f-a3a3b61e66b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:09.583100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07810a2e-0483-49bc-886f-a3a3b61e66b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:09.615984 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3394/6824] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:09.619915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:09.632382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983678-0bf2-4f68-8698-a397edc81265 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:09.646830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:09.649756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:09.651034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:09.651422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] PATH_INFO: `/v3/projects/a8c4159448004884a702e360354d8a4c/users/8cc364144ae748fa9a224618b0f48aa5/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:09.656993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c4159448004884a702e360354d8a4c, user_id=8cc364144ae748fa9a224618b0f48aa5, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:09.663680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:09.722514 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3431/6825] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:09 2022] PUT /identity/v3/projects/a8c4159448004884a702e360354d8a4c/users/8cc364144ae748fa9a224618b0f48aa5/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:09.733380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:09.733943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:09.734457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:09.747666 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:09.838775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:09.840725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:09.855957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] MFA Rules not processed for user `8cc364144ae748fa9a224618b0f48aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:09.862393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:10.257628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a1681-1bdd-49e2-8b5f-d4381c5929ce admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:10.280361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:10.281279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:10.281781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:10.282065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] PATH_INFO: `/v3/projects/ef3c818f623f4a2aadf898becf74228d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:10.292126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3c818f623f4a2aadf898becf74228d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:10.300817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:10.310703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3395/6826] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 576 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:10.312796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:10.345529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc8b6-b264-4b71-871e-a3ae4a1179e7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:10.355442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:10.358398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:10.359256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:10.360903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:10.361633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:10.367611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:10.443268 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3396/6827] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:15:10 2022] POST /identity/v3/projects => generated 328 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:10.444530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:10.457850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3c818f623f4a2aadf898becf74228d', 'request_id': 'req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.482458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3c818f623f4a2aadf898becf74228d', 'request_id': 'req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.490041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3c818f623f4a2aadf898becf74228d', 'request_id': 'req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.516094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] The token cache is being invalidate because project ef3c818f623f4a2aadf898becf74228d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:10.516400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.518382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.523593 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3432/6828] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:09 2022] DELETE /identity/v3/projects/ef3c818f623f4a2aadf898becf74228d => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:10.528014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:10.529581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:10.583966 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:10.626506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa353ef-bb91-42a6-93cb-12f567d8d9f8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:10.701902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5ce0c-2261-4dd0-8fa3-b9a5507605ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:10.712885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:10.713130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:10.713405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:10.713584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] PATH_INFO: `/v3/users/a5ab06b2fe2348aaa317517ab45aa25b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:10.715394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ab06b2fe2348aaa317517ab45aa25b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:10.717141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:10.760723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:10.761423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:10.761716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:10.762004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:10.762751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:10.764691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:10.838135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3397/6829] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:10 2022] POST /identity/v3/users => generated 416 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:10.850708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:10.866387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:10.886816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ab06b2fe2348aaa317517ab45aa25b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.887785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ab06b2fe2348aaa317517ab45aa25b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.890335 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:10.906556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b3fa-20df-47e7-8a75-0ff310143bcf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:10.923975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:10.924675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:10.924973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:10.925257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:10.926576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:10.928816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:10.931176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ab06b2fe2348aaa317517ab45aa25b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.935848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ab06b2fe2348aaa317517ab45aa25b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.956190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ab06b2fe2348aaa317517ab45aa25b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:10.992699 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3433/6830] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:10 2022] DELETE /identity/v3/users/a5ab06b2fe2348aaa317517ab45aa25b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:10.997427 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3398/6831] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:10 2022] POST /identity/v3/roles => generated 244 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:10.999079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:11.003983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:11.165843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e54a7-7523-4982-a322-15b7af5500ec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:11.182914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:11.183652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:11.183949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:11.184235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:11.188241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:11.189939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:11.222754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3434/6832] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:10 2022] POST /identity/v3/roles => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:11.227685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:11.252131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f28e24-31e5-4718-a7a0-e9526b4b4555 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:11.260274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:11.261906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:11.262380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:11.262891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/33858227dece4d19959a4693d4dcd0ef/users/f8a5a9c9a8664b02ab5a548d78d3312a/roles/cd89498b8320447ca68f2db63485bb7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:11.357173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=33858227dece4d19959a4693d4dcd0ef, user_id=f8a5a9c9a8664b02ab5a548d78d3312a, role_id=cd89498b8320447ca68f2db63485bb7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:11.371206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:11.412093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3399/6833] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:11 2022] PUT /identity/v3/projects/33858227dece4d19959a4693d4dcd0ef/users/f8a5a9c9a8664b02ab5a548d78d3312a/roles/cd89498b8320447ca68f2db63485bb7b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:11.417231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:11.446057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcb228-0a0e-47b6-ac10-baf6fe218fa6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:11.620275 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:11.742849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121a8d-fd41-4ad1-8894-0e696e116d7c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:11.748692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121a8d-fd41-4ad1-8894-0e696e116d7c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:11.748692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121a8d-fd41-4ad1-8894-0e696e116d7c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:11.752297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121a8d-fd41-4ad1-8894-0e696e116d7c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/33858227dece4d19959a4693d4dcd0ef/users/f8a5a9c9a8664b02ab5a548d78d3312a/roles/07de58735d6546f0a283f706e29aca2d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:11.765064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121a8d-fd41-4ad1-8894-0e696e116d7c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=33858227dece4d19959a4693d4dcd0ef, user_id=f8a5a9c9a8664b02ab5a548d78d3312a, role_id=07de58735d6546f0a283f706e29aca2d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:11.768680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121a8d-fd41-4ad1-8894-0e696e116d7c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:11.817319 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3435/6834] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:11 2022] PUT /identity/v3/projects/33858227dece4d19959a4693d4dcd0ef/users/f8a5a9c9a8664b02ab5a548d78d3312a/roles/07de58735d6546f0a283f706e29aca2d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:11.822816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:11.857810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18da0f-771a-44e9-be4e-c505ef90d2fc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:12.041778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:12.044323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:12.045993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:12.046419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:12.056475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:12.057889 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:15:12.057889 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:15:12.057889 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:15:12.059430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:12.222989 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3400/6835] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:11 2022] GET /identity/v3/users => generated 8071 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:12.225424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4cdc1-65f7-484f-b852-2cb893bab76d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:12.225981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4cdc1-65f7-484f-b852-2cb893bab76d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:12.226425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4cdc1-65f7-484f-b852-2cb893bab76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:12.348052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:12.355672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:12.385526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fed4cdc1-65f7-484f-b852-2cb893bab76d None None] MFA Rules not processed for user `f8a5a9c9a8664b02ab5a548d78d3312a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:12.386804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fed4cdc1-65f7-484f-b852-2cb893bab76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:12.569901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53da7-a348-4b14-bc1d-efee9b8d0481 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:12.588665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:12.589867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:12.590222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:12.590598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] PATH_INFO: `/v3/projects/032a3d8d7d9948ffb53bf496a426ffda` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:12.592117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032a3d8d7d9948ffb53bf496a426ffda)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:12.594135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:12.636430 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3436/6836] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:12.638745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:12.639139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:12.639692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:12.685057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] MFA Rules not processed for user `f8a5a9c9a8664b02ab5a548d78d3312a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:12.687319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:12.736812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032a3d8d7d9948ffb53bf496a426ffda', 'request_id': 'req-216078f4-94f5-4f57-af9d-cb66dfde9052'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:12.751669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032a3d8d7d9948ffb53bf496a426ffda', 'request_id': 'req-216078f4-94f5-4f57-af9d-cb66dfde9052'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:12.761056 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:12.773856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032a3d8d7d9948ffb53bf496a426ffda', 'request_id': 'req-216078f4-94f5-4f57-af9d-cb66dfde9052'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:12.794677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] The token cache is being invalidate because project 032a3d8d7d9948ffb53bf496a426ffda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:12.795308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:12.796198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-216078f4-94f5-4f57-af9d-cb66dfde9052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:12.798465 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3401/6837] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:12 2022] DELETE /identity/v3/projects/032a3d8d7d9948ffb53bf496a426ffda => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:12.804209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c6ce-8b8e-46f4-90f6-fc023ba9cea7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:12.804752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c6ce-8b8e-46f4-90f6-fc023ba9cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:12.805238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c6ce-8b8e-46f4-90f6-fc023ba9cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:12.846267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-37c8c6ce-8b8e-46f4-90f6-fc023ba9cea7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:12.850605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37c8c6ce-8b8e-46f4-90f6-fc023ba9cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:12.885503 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3437/6838] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:12.891834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:12.914100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5d858-a2bf-44e8-b077-8583ca17b553 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:12.930513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a5a9c9a8664b02ab5a548d78d3312a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33858227dece4d19959a4693d4dcd0ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1784851785', 'tempest-NotDelegatedRole-1956016896'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:12.931562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:12.932064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:12.932555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:12.933530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: Authorizing `identity:create_trust()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:12.934967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.031448 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3402/6839] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:13.039198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.039503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.039772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.064355 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:13.088087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:13.088313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:13.105056 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3403/6840] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:13.108968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.128641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b530-01d0-4174-b623-3283d877ed96 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.148134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.148134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.148134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.148134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.148572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:13.148572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:13.148715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3438/6841] 10.222.0.77 () {60 vars in 1173 bytes} [Mon Jul 11 15:15:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:13.148828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.152177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.173537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3404/6842] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:13.180643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:13.181856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.216470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69b5e-855c-4f6b-a982-372863e130ed admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.231453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.232186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.232475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.232749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.233500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:13.240407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.346265 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3405/6843] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:13 2022] POST /identity/v3/projects => generated 397 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:13.354356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.446780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f5d1-194b-46b4-a87e-efa7b204e058 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.607243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26b72-8d21-4e86-a55c-998ab43c5af0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.622865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.623558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.623842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.624116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.624810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:13.626769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.655368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.658797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.660192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.662333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.663414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:13.665487 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:15:13.665487 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:15:13.665487 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:15:13.670626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.682624 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3406/6844] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:13 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:13.689849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.695786 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3439/6845] 10.222.0.77 () {58 vars in 1154 bytes} [Mon Jul 11 15:15:13 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:13.697020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.725440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3603-1a66-4827-9e46-4dfc965eeb19 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.747288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.747976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.748255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.748567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.749728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:13.751635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.798931 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3407/6846] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:13 2022] GET /identity/v3/roles => generated 1893 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:15:13.799963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.862819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41b30b-c51e-4cd6-93f1-a98386415e21 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.869877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.870773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.871139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.871487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.872348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:13.874304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:13.893412 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3408/6847] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:13 2022] GET /identity/v3/roles => generated 1893 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:13.894874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:13.916123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95b282-15aa-4f8a-a1f2-6adc2d5e0ad3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:13.923943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af89b9-148a-46a2-982b-ed7a569c45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:13.924977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af89b9-148a-46a2-982b-ed7a569c45db admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:13.925371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af89b9-148a-46a2-982b-ed7a569c45db admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:13.925751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af89b9-148a-46a2-982b-ed7a569c45db admin admin] PATH_INFO: `/v3/projects/30a896b98ab840f191cb95ad362ae25f/users/dcd92b18f9924ae493c9b6c0ac5d7aeb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:13.979247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99564614-1c48-4f62-b798-446bd125f1ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:14.001146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a5a9c9a8664b02ab5a548d78d3312a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33858227dece4d19959a4693d4dcd0ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1784851785', 'tempest-NotDelegatedRole-1956016896'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:14.002027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:14.002318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:14.002715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] PATH_INFO: `/v3/OS-TRUST/trusts/51e6894ba7ba4cbaa4ef48e88f150359` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:14.003806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af89b9-148a-46a2-982b-ed7a569c45db admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a896b98ab840f191cb95ad362ae25f, user_id=dcd92b18f9924ae493c9b6c0ac5d7aeb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:14.012925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af89b9-148a-46a2-982b-ed7a569c45db admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:14.028278 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:14.029696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: Authorizing `identity:delete_trust(trust_id=51e6894ba7ba4cbaa4ef48e88f150359)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:14.031284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:14.096878 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3409/6848] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:13 2022] PUT /identity/v3/projects/30a896b98ab840f191cb95ad362ae25f/users/dcd92b18f9924ae493c9b6c0ac5d7aeb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:14.111574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:14.112049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:14.112500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:14.144229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '51e6894ba7ba4cbaa4ef48e88f150359', 'request_id': 'req-11b37c79-a84d-42f9-9dcf-399795d59b43'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.145018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '51e6894ba7ba4cbaa4ef48e88f150359', 'request_id': 'req-11b37c79-a84d-42f9-9dcf-399795d59b43'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.166172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '51e6894ba7ba4cbaa4ef48e88f150359', 'request_id': 'req-11b37c79-a84d-42f9-9dcf-399795d59b43'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.173337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] MFA Rules not processed for user `dcd92b18f9924ae493c9b6c0ac5d7aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:14.173798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:14.181961 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3440/6849] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:15:13 2022] DELETE /identity/v3/OS-TRUST/trusts/51e6894ba7ba4cbaa4ef48e88f150359 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:14.187253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:14.190538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:14.218947 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:14.227850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b37c79-a84d-42f9-9dcf-399795d59b43 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:14.311666 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3410/6850] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:14.313089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:14.315233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:14.322414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a5a9c9a8664b02ab5a548d78d3312a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33858227dece4d19959a4693d4dcd0ef', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1784851785', 'tempest-NotDelegatedRole-1956016896'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:14.323728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:14.324033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:14.324320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] PATH_INFO: `/v3/OS-TRUST/trusts/51e6894ba7ba4cbaa4ef48e88f150359` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Could not find trust: 51e6894ba7ba4cbaa4ef48e88f150359.: keystone.exception.TrustNotFound: Could not find trust: 51e6894ba7ba4cbaa4ef48e88f150359. Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 11 15:15:14.390624 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 51e6894ba7ba4cbaa4ef48e88f150359. Jul 11 15:15:14.391671 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:14.394765 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3441/6851] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:14 2022] GET /identity/v3/OS-TRUST/trusts/51e6894ba7ba4cbaa4ef48e88f150359 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:14.399538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:14.401583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:14.431292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473fe51-00a4-4ad4-8a82-02db71b11033 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:14.436837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:14.439155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:14.439595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:14.440202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:14.463499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:14.466028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:14.480710 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3411/6852] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:14.495591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:14.499118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:14.597432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd8af-966d-477a-8e11-39b06639b801 tempest-TrustsV3TestJSON-998914953 tempest-user-1888240592] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:14.613033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:14.613917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:14.614201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:14.614576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/07de58735d6546f0a283f706e29aca2d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:14.619301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=07de58735d6546f0a283f706e29aca2d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:14.621705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:14.628819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78021a-81e4-4c13-ad68-ff7a1112eaf3 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:14.637044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:14.638962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:14.639252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:14.639537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] PATH_INFO: `/v3/users/208630a7c636414992f21b76bf654831` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:14.642119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208630a7c636414992f21b76bf654831)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:14.646941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:14.712701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 07de58735d6546f0a283f706e29aca2d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:14.713194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.714376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.717431 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3442/6853] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:14 2022] DELETE /identity/v3/roles/07de58735d6546f0a283f706e29aca2d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:14.722014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:14.724037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:14.728545 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:14.770210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208630a7c636414992f21b76bf654831'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.806689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208630a7c636414992f21b76bf654831'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.823239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208630a7c636414992f21b76bf654831'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.849353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208630a7c636414992f21b76bf654831'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.850168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208630a7c636414992f21b76bf654831'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:14.863234 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3412/6854] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:14 2022] DELETE /identity/v3/users/208630a7c636414992f21b76bf654831 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:14.949261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c6e8-7910-469c-8837-6d5fce9b09bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:14.980388 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:15.034833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:15.035720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:15.036009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:15.036760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/cd89498b8320447ca68f2db63485bb7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:15.039449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cd89498b8320447ca68f2db63485bb7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:15.040515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:15.107129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role cd89498b8320447ca68f2db63485bb7b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:15.107323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.109867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.118240 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3443/6855] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:14 2022] DELETE /identity/v3/roles/cd89498b8320447ca68f2db63485bb7b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:15.122085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:15.123541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:15.150906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3016649-be96-4e09-b47d-8fec036ee496 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:15.368690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:15.369607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:15.369899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:15.370184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users/f8a5a9c9a8664b02ab5a548d78d3312a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:15.374025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f8a5a9c9a8664b02ab5a548d78d3312a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:15.376329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:15.442610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:15.445196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:15.507820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a5a9c9a8664b02ab5a548d78d3312a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.556425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a5a9c9a8664b02ab5a548d78d3312a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.595611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a5a9c9a8664b02ab5a548d78d3312a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.616013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a5a9c9a8664b02ab5a548d78d3312a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.617924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a5a9c9a8664b02ab5a548d78d3312a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.644133 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3413/6856] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:15 2022] DELETE /identity/v3/users/f8a5a9c9a8664b02ab5a548d78d3312a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:15.645117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:15.648878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fed3f-6d9a-435d-bcae-1aea557ae988 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:15.649027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:15.731399 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:15.744271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:15.745333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:15.745912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:15.746208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] PATH_INFO: `/v3/projects/2faf1460654a42f69cda1dd62f685840` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:15.749937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2faf1460654a42f69cda1dd62f685840)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:15.753976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:15.823165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a4a0-4ce3-44d7-a479-2d5afcfa99bf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:15.840160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:15.842739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:15.843475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:15.844280 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:15.844415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/33858227dece4d19959a4693d4dcd0ef` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:15.848591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33858227dece4d19959a4693d4dcd0ef)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:15.854441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:15.872130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2faf1460654a42f69cda1dd62f685840', 'request_id': 'req-5f4ff82e-631f-4c49-8074-4c9460eb34fc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.899248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2faf1460654a42f69cda1dd62f685840', 'request_id': 'req-5f4ff82e-631f-4c49-8074-4c9460eb34fc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.918740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2faf1460654a42f69cda1dd62f685840', 'request_id': 'req-5f4ff82e-631f-4c49-8074-4c9460eb34fc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.934836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] The token cache is being invalidate because project 2faf1460654a42f69cda1dd62f685840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:15.935266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.936973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f4ff82e-631f-4c49-8074-4c9460eb34fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.944409 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3444/6857] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:15 2022] DELETE /identity/v3/projects/2faf1460654a42f69cda1dd62f685840 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:15.946214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0db44-ecb6-4066-8174-5b9f38a1e255 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:15.946707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0db44-ecb6-4066-8174-5b9f38a1e255 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:15.947068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0db44-ecb6-4066-8174-5b9f38a1e255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:15.969231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33858227dece4d19959a4693d4dcd0ef', 'request_id': 'req-03fd46c7-bd81-42b4-95a0-6a97e9408b07'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.969797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9aa0db44-ecb6-4066-8174-5b9f38a1e255 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:15.971192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9aa0db44-ecb6-4066-8174-5b9f38a1e255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:15.976916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33858227dece4d19959a4693d4dcd0ef', 'request_id': 'req-03fd46c7-bd81-42b4-95a0-6a97e9408b07'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:15.990088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33858227dece4d19959a4693d4dcd0ef', 'request_id': 'req-03fd46c7-bd81-42b4-95a0-6a97e9408b07'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:16.027422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] The token cache is being invalidate because project 33858227dece4d19959a4693d4dcd0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:16.027852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:16.028767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:16.031589 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3414/6858] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:15 2022] DELETE /identity/v3/projects/33858227dece4d19959a4693d4dcd0ef => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:16.039341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.041108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:16.165047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd46c7-bd81-42b4-95a0-6a97e9408b07 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.181798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.182471 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3445/6859] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:16.185606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.186002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.186168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.191122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.191423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.191930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.199468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.201449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.240292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:16.242891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:16.249824 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3415/6860] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/projects => generated 328 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:16.252255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.369930 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:16.403342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3446/6861] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:16.407713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.422104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a73cc-2170-413d-8ca7-1beabfaa4997 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.433281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.437220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.440615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534db16-3ea5-4e69-985a-c1a6bb8a6fbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.441027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.441346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.442139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:16.443053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.447413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.450671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.451564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.454882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.455276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.456017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.458759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.479306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3447/6862] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:16.483445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.495230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c808-901b-44bc-9a49-580b590a50e8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.502460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.503147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.503530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.503818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.504574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.507296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.516672 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3416/6863] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/users => generated 413 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:16.521787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.536149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3acd6-2d87-4349-a372-dcfae4ba1a51 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.550648 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3448/6864] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:16.553423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.556899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.557592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.557883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.558167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.558961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.562057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.593840 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3417/6865] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/roles => generated 244 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:16.597909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.605890 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:16.616508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a74054-0bfc-4c35-bb6d-2dfaa73d06ef tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.673084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31511-be48-48a1-865a-db2db6e4cbcf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.687303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.688002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.688440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.688746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.689424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.691398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.724432 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3449/6866] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:16.728539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.755448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067317-465d-498e-a119-ac6f28dc1ec0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.757874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.758709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.759001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.759286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.760238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.762006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.768472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.772239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.772685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.773290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.775528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.786521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.800756 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3450/6867] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:16 2022] GET /identity/v3/roles => generated 1893 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:16.806481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.812207 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3418/6868] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:16 2022] POST /identity/v3/roles => generated 247 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:16.827515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89fbc3-5b9a-4e30-8e6c-832134c1a5bb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.827717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.835506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.836482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.836840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.837215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.838017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.840453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.859785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf0ae-2757-4672-ac80-823fed808c9e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.867451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:16.868282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:16.868580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:16.868857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/20e56e31aff14155a554230fb322734c/users/a09cd630c3194fdfaa3061daef92a92c/roles/be46c9b4ed7c4b7ca7228dbf8918d1d9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:16.872758 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3451/6869] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:16 2022] GET /identity/v3/roles => generated 1893 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:16.873585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:16.904822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=20e56e31aff14155a554230fb322734c, user_id=a09cd630c3194fdfaa3061daef92a92c, role_id=be46c9b4ed7c4b7ca7228dbf8918d1d9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:16.907750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:16.932196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa563f-e567-49e1-b2f3-fbd17701267b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:16.936991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3419/6870] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:16 2022] PUT /identity/v3/projects/20e56e31aff14155a554230fb322734c/users/a09cd630c3194fdfaa3061daef92a92c/roles/be46c9b4ed7c4b7ca7228dbf8918d1d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:16.943438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:17.017071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd770a0-ef3f-4c3d-adaf-de16cd110dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.018894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd770a0-ef3f-4c3d-adaf-de16cd110dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.018894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd770a0-ef3f-4c3d-adaf-de16cd110dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.019584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd770a0-ef3f-4c3d-adaf-de16cd110dd1 admin admin] PATH_INFO: `/v3/projects/d8f27bc163be4940a5268ba14e3c287e/users/5bf2b0cddbc544dba7c32d102a9c9480/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.035321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd770a0-ef3f-4c3d-adaf-de16cd110dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f27bc163be4940a5268ba14e3c287e, user_id=5bf2b0cddbc544dba7c32d102a9c9480, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:17.039046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd770a0-ef3f-4c3d-adaf-de16cd110dd1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:17.075708 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3452/6871] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:16 2022] PUT /identity/v3/projects/d8f27bc163be4940a5268ba14e3c287e/users/5bf2b0cddbc544dba7c32d102a9c9480/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:17.078050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.078285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.078625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.092503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49844b-7e3c-45e7-a335-d4ee6ef4262e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:17.113775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] MFA Rules not processed for user `5bf2b0cddbc544dba7c32d102a9c9480`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:17.115940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:17.135226 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:17.168387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.169719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.170131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.170662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/20e56e31aff14155a554230fb322734c/users/a09cd630c3194fdfaa3061daef92a92c/roles/a0358e799e174bf383ffbce012813d30` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.174143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=20e56e31aff14155a554230fb322734c, user_id=a09cd630c3194fdfaa3061daef92a92c, role_id=a0358e799e174bf383ffbce012813d30)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:17.177744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:17.196365 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3420/6872] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:16 2022] PUT /identity/v3/projects/20e56e31aff14155a554230fb322734c/users/a09cd630c3194fdfaa3061daef92a92c/roles/a0358e799e174bf383ffbce012813d30 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:17.200408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:17.259066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3453/6873] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:17.274470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:17.276228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:17.293945 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:17.344003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436d191-cb8d-4fca-a90c-94ac96e5edfc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:17.351622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc355e3-5504-4bc0-a2ce-b6aeac7c2244 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.352679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc355e3-5504-4bc0-a2ce-b6aeac7c2244 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.353047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc355e3-5504-4bc0-a2ce-b6aeac7c2244 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.353404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc355e3-5504-4bc0-a2ce-b6aeac7c2244 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.356109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc355e3-5504-4bc0-a2ce-b6aeac7c2244 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:17.358798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc355e3-5504-4bc0-a2ce-b6aeac7c2244 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:17.443991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3421/6874] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:17 2022] GET /identity/v3/users => generated 8345 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:17.446182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a444-a8bb-491c-a896-4f70eac59287 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:17.450702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511798a-057b-4d19-bd63-a557867d7a99 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.451259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511798a-057b-4d19-bd63-a557867d7a99 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.451756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511798a-057b-4d19-bd63-a557867d7a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.499595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0511798a-057b-4d19-bd63-a557867d7a99 None None] MFA Rules not processed for user `a09cd630c3194fdfaa3061daef92a92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:17.500960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0511798a-057b-4d19-bd63-a557867d7a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:17.536808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.537478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.537763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.538038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.623183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3422/6875] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:17 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:17.626105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.626476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.626926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.675934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] MFA Rules not processed for user `a09cd630c3194fdfaa3061daef92a92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:17.680474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:17.694900 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3423/6876] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:17 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:17.695132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:17.695716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:17.698780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:17.715205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00866c63-ee39-41e8-b4e5-507bab05ed9e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:17.723178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3454/6877] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:15:17.735058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a09cd630c3194fdfaa3061daef92a92c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e56e31aff14155a554230fb322734c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1617667334', 'tempest-DelegatedRole-1371472510'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.735735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.736023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.736302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.738241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: Authorizing `identity:create_trust()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:17.740006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:17.829228 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:17.912044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3424/6878] 10.222.0.77 () {60 vars in 1173 bytes} [Mon Jul 11 15:15:17 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:17.912156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:17.931027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798609-5eac-4e27-9ff9-2b49e601ab67 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:17.936512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a09cd630c3194fdfaa3061daef92a92c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e56e31aff14155a554230fb322734c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1617667334', 'tempest-DelegatedRole-1371472510'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.937859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.937859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.938027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:17.938872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:17.941090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:17.950200 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3455/6879] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Jul 11 15:15:17 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=a09cd630c3194fdfaa3061daef92a92c => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:17.953764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:17.974082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c5c08-e15a-407b-b6ff-d358d8998b62 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:17.979978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a09cd630c3194fdfaa3061daef92a92c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e56e31aff14155a554230fb322734c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1617667334', 'tempest-DelegatedRole-1371472510'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:17.980980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:17.981613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:17.982031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] PATH_INFO: `/v3/OS-TRUST/trusts/c743cd2a9c714cb381952b77d2949f1c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:18.003996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: Authorizing `identity:delete_trust(trust_id=c743cd2a9c714cb381952b77d2949f1c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:18.006357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:18.047453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c743cd2a9c714cb381952b77d2949f1c', 'request_id': 'req-71f95461-3d4f-4f64-a73a-e96b7c51bd87'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.048559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c743cd2a9c714cb381952b77d2949f1c', 'request_id': 'req-71f95461-3d4f-4f64-a73a-e96b7c51bd87'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.049488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c743cd2a9c714cb381952b77d2949f1c', 'request_id': 'req-71f95461-3d4f-4f64-a73a-e96b7c51bd87'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.090278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3425/6880] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:15:17 2022] DELETE /identity/v3/OS-TRUST/trusts/c743cd2a9c714cb381952b77d2949f1c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:18.091215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:18.093042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:18.131024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaf6c9-ba2d-423b-93f9-e34ac0527872 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:18.135480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a09cd630c3194fdfaa3061daef92a92c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e56e31aff14155a554230fb322734c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1617667334', 'tempest-DelegatedRole-1371472510'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:18.136953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:18.137373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:18.137760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] PATH_INFO: `/v3/OS-TRUST/trusts/c743cd2a9c714cb381952b77d2949f1c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Could not find trust: c743cd2a9c714cb381952b77d2949f1c.: keystone.exception.TrustNotFound: Could not find trust: c743cd2a9c714cb381952b77d2949f1c. Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 11 15:15:18.158995 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c743cd2a9c714cb381952b77d2949f1c. Jul 11 15:15:18.160098 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:18.160833 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3456/6881] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:18 2022] GET /identity/v3/OS-TRUST/trusts/c743cd2a9c714cb381952b77d2949f1c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:18.167921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:18.171917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:18.206541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95461-3d4f-4f64-a73a-e96b7c51bd87 tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:18.218807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:18.220860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:18.221214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:18.221596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/a0358e799e174bf383ffbce012813d30` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:18.226248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a0358e799e174bf383ffbce012813d30)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:18.228807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:18.321149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role a0358e799e174bf383ffbce012813d30 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:18.321579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.322867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.325364 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3426/6882] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:18 2022] DELETE /identity/v3/roles/a0358e799e174bf383ffbce012813d30 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:18.329808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:18.332104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:18.367245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92419-4845-4f10-986a-3125628eb48f tempest-TrustsV3TestJSON-215943332 tempest-user-901885436] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:18.431822 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:18.538010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:18.539024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:18.539315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:18.539701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/be46c9b4ed7c4b7ca7228dbf8918d1d9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:18.542339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=be46c9b4ed7c4b7ca7228dbf8918d1d9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:18.545460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:18.657159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role be46c9b4ed7c4b7ca7228dbf8918d1d9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:18.657464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.665895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b7244b25-0a67-46c6-8b51-38c6f0aa8813 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:18.676386 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3457/6883] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:18 2022] DELETE /identity/v3/roles/be46c9b4ed7c4b7ca7228dbf8918d1d9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:18.678363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:18.704779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb7ca5-fe6f-482b-afba-c219497684bd tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:18.901401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:18.902231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:18.902548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:18.902842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users/a09cd630c3194fdfaa3061daef92a92c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:18.920373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a09cd630c3194fdfaa3061daef92a92c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:18.922393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:19.057914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.063414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.064284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.096800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:19.099302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.102464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09cd630c3194fdfaa3061daef92a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.103981 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:19.124696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09cd630c3194fdfaa3061daef92a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.135607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09cd630c3194fdfaa3061daef92a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.147219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09cd630c3194fdfaa3061daef92a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.148522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09cd630c3194fdfaa3061daef92a92c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.158552 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3427/6884] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:18 2022] DELETE /identity/v3/users/a09cd630c3194fdfaa3061daef92a92c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:19.163915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:19.165573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.204185 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3458/6885] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:19.205539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:19.207499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.228931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db143-4150-4f2a-805e-26216e79d86a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:19.265554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadafa01-ae8d-4447-b483-fe33cf91bd48 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:19.271704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:19.272706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.272998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.273277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] PATH_INFO: `/v3/users/5bf2b0cddbc544dba7c32d102a9c9480` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.274533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf2b0cddbc544dba7c32d102a9c9480)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:19.278206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:19.330176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:19.331492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.332187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.332838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/20e56e31aff14155a554230fb322734c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.334558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20e56e31aff14155a554230fb322734c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:19.337498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:19.342729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf2b0cddbc544dba7c32d102a9c9480'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.357381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf2b0cddbc544dba7c32d102a9c9480'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.366062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf2b0cddbc544dba7c32d102a9c9480'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.376662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf2b0cddbc544dba7c32d102a9c9480'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.377388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf2b0cddbc544dba7c32d102a9c9480'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.387328 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3428/6886] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:19 2022] DELETE /identity/v3/users/5bf2b0cddbc544dba7c32d102a9c9480 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:19.388455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:19.391340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.408150 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:19.434673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e56e31aff14155a554230fb322734c', 'request_id': 'req-1b51aacd-ceaa-493e-a587-340603c51181'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.454101 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:19.456070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e56e31aff14155a554230fb322734c', 'request_id': 'req-1b51aacd-ceaa-493e-a587-340603c51181'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.469446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e56e31aff14155a554230fb322734c', 'request_id': 'req-1b51aacd-ceaa-493e-a587-340603c51181'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.499947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ecdc2-9955-4a68-a2c0-a6f1d8c57d87 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:19.501522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] The token cache is being invalidate because project 20e56e31aff14155a554230fb322734c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:19.502072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.503036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1b51aacd-ceaa-493e-a587-340603c51181 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:19.505001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3459/6887] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:19 2022] DELETE /identity/v3/projects/20e56e31aff14155a554230fb322734c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:19.506586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.507178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.507394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.544588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:19.546147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.589566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:19.590581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.590871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.591149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.593681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.623610 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3460/6888] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:19.628090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:19.629318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.703965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3035b49-ec66-432c-9c98-41a398dd5089 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:19.709266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:19.709941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.710232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.710535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.711240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:19.713722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:19.718271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:19.720788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:19.736643 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3429/6889] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:15:19.737777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:19.739997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:19.760701 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3461/6890] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:15:19 2022] POST /identity/v3/projects => generated 329 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:19.764733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:19.856902 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:19.877368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b01f0-c6ab-47db-86bf-ebb80611b5cc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:19.907574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:19.908635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:19.909122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:19.909947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:19.912287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:19.914695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:19.915039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a4e9-886e-4db6-ab85-8c472befa16e service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:19.970530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3462/6891] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:19 2022] POST /identity/v3/users => generated 416 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:19.971738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:20.001759 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:20.024428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce051-eb36-4cd7-adbb-144baec4574c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:20.025016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:20.025695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.026088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.026384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:20.031940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:20.033316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.033642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.034008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:20.034876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:20.037653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:20.082102 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3463/6892] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:19 2022] POST /identity/v3/roles => generated 244 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:20.084711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:20.128457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18d4c2-f4c7-4f63-9fa4-40bccec0a603 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:20.144925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:20.151590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.152014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.152285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:20.153135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:20.154782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:20.194090 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3464/6893] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:20 2022] POST /identity/v3/roles => generated 247 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:20.196089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:20.235762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3eab7-5023-44bf-bd1b-a836823459cf tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:20.243259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:20.244722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:20.250180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:20.256321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.269221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.269616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/57126d6ed9c348169c6ebd38e348fc9f/users/01fefe4df5514a84bfe932e11a8ab113/roles/6c407d920cec4ae889b53a95eeb3727e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:20.299280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3430/6894] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:20.313762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=57126d6ed9c348169c6ebd38e348fc9f, user_id=01fefe4df5514a84bfe932e11a8ab113, role_id=6c407d920cec4ae889b53a95eeb3727e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:20.326859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:20.354253 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3465/6895] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:20 2022] PUT /identity/v3/projects/57126d6ed9c348169c6ebd38e348fc9f/users/01fefe4df5514a84bfe932e11a8ab113/roles/6c407d920cec4ae889b53a95eeb3727e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:20.358581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:20.374672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427a43b-00f1-4d44-83ba-5ffbd490ddab service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:20.540040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621900d-c047-484a-a1dd-d61f237852b7 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:20.541014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621900d-c047-484a-a1dd-d61f237852b7 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.541370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621900d-c047-484a-a1dd-d61f237852b7 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.541655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621900d-c047-484a-a1dd-d61f237852b7 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/57126d6ed9c348169c6ebd38e348fc9f/users/01fefe4df5514a84bfe932e11a8ab113/roles/c5077afb42fb46eca3d1a935e127f274` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:20.554785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621900d-c047-484a-a1dd-d61f237852b7 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=57126d6ed9c348169c6ebd38e348fc9f, user_id=01fefe4df5514a84bfe932e11a8ab113, role_id=c5077afb42fb46eca3d1a935e127f274)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:20.557473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621900d-c047-484a-a1dd-d61f237852b7 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:20.604507 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3431/6896] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:20 2022] PUT /identity/v3/projects/57126d6ed9c348169c6ebd38e348fc9f/users/01fefe4df5514a84bfe932e11a8ab113/roles/c5077afb42fb46eca3d1a935e127f274 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:20.608114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:20.623170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb23d-b7d8-4925-8596-87892cdb91ba tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:20.804880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74071f6-d4fa-4e1b-b6a0-8a724bf4db66 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:20.805926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74071f6-d4fa-4e1b-b6a0-8a724bf4db66 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.806094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74071f6-d4fa-4e1b-b6a0-8a724bf4db66 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.818053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74071f6-d4fa-4e1b-b6a0-8a724bf4db66 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:20.820387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74071f6-d4fa-4e1b-b6a0-8a724bf4db66 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:20.826987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74071f6-d4fa-4e1b-b6a0-8a724bf4db66 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:20.960490 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3466/6897] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:20 2022] GET /identity/v3/users => generated 8071 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:15:20.965490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:20.965788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:20.966074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:21.077945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] MFA Rules not processed for user `01fefe4df5514a84bfe932e11a8ab113`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:21.079231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:21.297087 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3432/6898] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:21.312639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:21.313190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:21.322106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:21.350398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:21.352272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:21.396444 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:21.413083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] MFA Rules not processed for user `01fefe4df5514a84bfe932e11a8ab113`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:21.418419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:21.438010 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3467/6899] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:21.443362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:21.465006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141696a-fe61-444f-9907-bb045a0213ff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:21.475864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:21.477403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:21.477403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:21.478389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:21.482314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:create_trust()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:21.485563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:21.534850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96429fbd-b65e-40ef-9d3f-e0cbbf542ec4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:21.542216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:21.543676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:21.544194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:21.544728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] PATH_INFO: `/v3/projects/d8f27bc163be4940a5268ba14e3c287e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:21.546525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f27bc163be4940a5268ba14e3c287e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:21.549115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:21.613161 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3468/6900] 10.222.0.77 () {60 vars in 1173 bytes} [Mon Jul 11 15:15:21 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:21.618641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:21.643640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580b41-94c7-4d34-85e6-7f8c2bebd7be tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:21.656018 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:21.658917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f27bc163be4940a5268ba14e3c287e', 'request_id': 'req-ae442fd4-7e07-4760-b237-ab0410a99315'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:21.669638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f27bc163be4940a5268ba14e3c287e', 'request_id': 'req-ae442fd4-7e07-4760-b237-ab0410a99315'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:21.688672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f27bc163be4940a5268ba14e3c287e', 'request_id': 'req-ae442fd4-7e07-4760-b237-ab0410a99315'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:21.724530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] The token cache is being invalidate because project d8f27bc163be4940a5268ba14e3c287e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:21.726626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:21.731748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae442fd4-7e07-4760-b237-ab0410a99315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:21.735262 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3433/6901] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:21 2022] DELETE /identity/v3/projects/d8f27bc163be4940a5268ba14e3c287e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:21.740241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:21.744273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:21.746089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:21.828560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:21.829699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:21.830132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:21.830610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:21.846596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:21.847970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:21.849409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:get_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:21.851116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:21.861247 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3469/6902] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:21 2022] GET /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c => generated 859 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:21.863061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:21.865109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:22.028327 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3434/6903] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:22.029425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.032069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:22.069061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c0ab-a217-4b1a-b526-d81b963b4578 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.084407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd3907-3919-4f83-bfc1-ac434121747f tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.085399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd3907-3919-4f83-bfc1-ac434121747f tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.085796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd3907-3919-4f83-bfc1-ac434121747f tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.086184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd3907-3919-4f83-bfc1-ac434121747f tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.103397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd3907-3919-4f83-bfc1-ac434121747f tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.105070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd3907-3919-4f83-bfc1-ac434121747f tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.124753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3435/6904] 10.222.0.77 () {58 vars in 1268 bytes} [Mon Jul 11 15:15:22 2022] GET /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles => generated 371 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:22.130871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.131966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.131966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.168886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:22.170314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:22.190518 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3436/6905] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:22.195700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.212959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbaebe-16d3-41ab-9c52-35149e843a15 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.222519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975d545-7a12-40c9-b037-04c05ed675a5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.234746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.235704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.236118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.236405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/6c407d920cec4ae889b53a95eeb3727e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.251447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c, role_id=6c407d920cec4ae889b53a95eeb3727e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.254189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.255329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.256205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.260957 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:22.261469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.261772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.271275 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3437/6906] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:15:22 2022] GET /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/6c407d920cec4ae889b53a95eeb3727e => generated 244 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:22.273396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.285047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:22.314484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.318462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.351548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850f83-185d-47f7-b7a2-2ffab0fe96ab tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.356072 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3470/6907] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:22.358858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.371359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.376353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.379281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.380434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.381316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:22.381641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.387019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9be64-ff38-4010-b1b4-801ef745280b service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.387987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.393145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.394357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.394846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.395833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/6c407d920cec4ae889b53a95eeb3727e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.422160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c, role_id=6c407d920cec4ae889b53a95eeb3727e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.423945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.427911 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3438/6908] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:22.433928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.451888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce5c5-36b4-484c-8377-f8fbe8b83f28 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.456063 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3471/6909] 10.222.0.77 () {58 vars in 1368 bytes} [Mon Jul 11 15:15:22 2022] HEAD /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/6c407d920cec4ae889b53a95eeb3727e => generated 0 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 11 15:15:22.462107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.472419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.473227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.473427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.473712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.474438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.476539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.485606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de4fb-5b91-4ec2-9c7e-2c5dbfe54c99 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.509062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.509567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.509749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.509998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/c5077afb42fb46eca3d1a935e127f274` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.524182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c, role_id=c5077afb42fb46eca3d1a935e127f274)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.525836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Could not find role: c5077afb42fb46eca3d1a935e127f274.: keystone.exception.RoleNotFound: Could not find role: c5077afb42fb46eca3d1a935e127f274. Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 11 15:15:22.546033 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:15:22.547471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c5077afb42fb46eca3d1a935e127f274. Jul 11 15:15:22.547471 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:22.548685 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3472/6910] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:15:22 2022] GET /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/c5077afb42fb46eca3d1a935e127f274 => generated 110 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:22.552748 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3439/6911] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:22 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:22.553358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.557057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.616619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfb36-b9a5-41e4-ad1a-1f2e99ce32d1 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.642962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a94cf-fd81-4f89-86d9-a517f78025e9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.650652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.651392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.651688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.651971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.653042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.655547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.697563 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3440/6912] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:22 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:22.708265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.724186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf12d3-4d7f-41ab-b454-1493922f635f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.733451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.734430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.734723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.735016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.735809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.737431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.767777 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3441/6913] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:22 2022] GET /identity/v3/roles => generated 1893 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:22.775905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.785352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042006b-ece9-44c3-81c6-a66a268b84e5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.788204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.789257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.790250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.790654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.790770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.791217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.791694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.792402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.793975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/c5077afb42fb46eca3d1a935e127f274` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.797792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.815604 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:22.815795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3442/6914] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:22 2022] GET /identity/v3/roles => generated 1893 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:15:22.816656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.828412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c, role_id=c5077afb42fb46eca3d1a935e127f274)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.830113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.830512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92d049-0a04-47f9-be76-0723a41c0f88 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.845767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64feb-9310-4e68-8e57-0304d796d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:22.847086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64feb-9310-4e68-8e57-0304d796d72d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.847896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64feb-9310-4e68-8e57-0304d796d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.848440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64feb-9310-4e68-8e57-0304d796d72d admin admin] PATH_INFO: `/v3/projects/d108eeb608e8482bb2aae392ebc04f5e/users/9ae8e53c8bcf4431921032191395bf86/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.881084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64feb-9310-4e68-8e57-0304d796d72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d108eeb608e8482bb2aae392ebc04f5e, user_id=9ae8e53c8bcf4431921032191395bf86, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Could not find role: c5077afb42fb46eca3d1a935e127f274.: keystone.exception.RoleNotFound: Could not find role: c5077afb42fb46eca3d1a935e127f274. Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 11 15:15:22.882286 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:15:22.883239 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c5077afb42fb46eca3d1a935e127f274. Jul 11 15:15:22.883239 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:22.885153 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3473/6915] 10.222.0.77 () {58 vars in 1368 bytes} [Mon Jul 11 15:15:22 2022] HEAD /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c/roles/c5077afb42fb46eca3d1a935e127f274 => generated 0 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 11 15:15:22.888420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64feb-9310-4e68-8e57-0304d796d72d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:22.891627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:22.907574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584e1dd-626f-4a2a-bfb4-09f165c85973 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:22.914316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3443/6916] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:22 2022] PUT /identity/v3/projects/d108eeb608e8482bb2aae392ebc04f5e/users/9ae8e53c8bcf4431921032191395bf86/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:22.920872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151630-813d-45b7-9be9-12bda801b826 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:22.921536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151630-813d-45b7-9be9-12bda801b826 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:22.922057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151630-813d-45b7-9be9-12bda801b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:22.971897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-08151630-813d-45b7-9be9-12bda801b826 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:22.975210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-08151630-813d-45b7-9be9-12bda801b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:23.049766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:23.050965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:23.051329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:23.052282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:23.067785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorizing `identity:delete_trust(trust_id=9f9ad798ed664f75bfc7fe2bd708f67c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:23.069869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:23.112100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9f9ad798ed664f75bfc7fe2bd708f67c', 'request_id': 'req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.113829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '9f9ad798ed664f75bfc7fe2bd708f67c', 'request_id': 'req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.134765 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3444/6917] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:23.148101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08151630-813d-45b7-9be9-12bda801b826 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:23.149535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-08151630-813d-45b7-9be9-12bda801b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:23.150579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9f9ad798ed664f75bfc7fe2bd708f67c', 'request_id': 'req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.166224 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3474/6918] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:15:22 2022] DELETE /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:23.172477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:23.173750 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:23.175977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:23.202629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0ed10-bd77-4548-9cc2-2ee4f985ebba tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:23.215716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01fefe4df5514a84bfe932e11a8ab113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57126d6ed9c348169c6ebd38e348fc9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1215339294', 'tempest-NotDelegatedRole-1574773772'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:23.218237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:23.218558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:23.220146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] PATH_INFO: `/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Could not find trust: 9f9ad798ed664f75bfc7fe2bd708f67c.: keystone.exception.TrustNotFound: Could not find trust: 9f9ad798ed664f75bfc7fe2bd708f67c. Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 11 15:15:23.251685 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 9f9ad798ed664f75bfc7fe2bd708f67c. Jul 11 15:15:23.252606 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:23.258105 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3475/6919] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:23 2022] GET /identity/v3/OS-TRUST/trusts/9f9ad798ed664f75bfc7fe2bd708f67c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:23.266069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:23.268268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:23.288089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08151630-813d-45b7-9be9-12bda801b826 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:23.295477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:23.295820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:23.296055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:23.296327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:23.317963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:23.329432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:23.352039 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3445/6920] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:23.437308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f3e83-8f53-457f-b77e-e9ed88d69970 tempest-TrustsV3TestJSON-2098957996 tempest-user-1399321458] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:23.442432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:23.443333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:23.443622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:23.443920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/c5077afb42fb46eca3d1a935e127f274` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:23.452763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5077afb42fb46eca3d1a935e127f274)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:23.454483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:23.537443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role c5077afb42fb46eca3d1a935e127f274 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:23.538123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.539153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.542574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3476/6921] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:23 2022] DELETE /identity/v3/roles/c5077afb42fb46eca3d1a935e127f274 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:23.546721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:23.566656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff8c5-af4f-4b94-8af7-01e01c86a4bd service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:23.795312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:23.801265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:23.801867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:23.802372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/6c407d920cec4ae889b53a95eeb3727e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:23.806417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c407d920cec4ae889b53a95eeb3727e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:23.808382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:23.922178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 6c407d920cec4ae889b53a95eeb3727e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:23.922548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.925295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:23.935616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:23.936441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3446/6922] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:23 2022] DELETE /identity/v3/roles/6c407d920cec4ae889b53a95eeb3727e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:23.948093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:23.971209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab161d-2b80-4bec-b66d-4d2fb5152388 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:24.035492 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:24.216659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:24.217561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:24.217860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:24.225073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users/01fefe4df5514a84bfe932e11a8ab113` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:24.233457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=01fefe4df5514a84bfe932e11a8ab113)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:24.235800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:24.389889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fefe4df5514a84bfe932e11a8ab113'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.390884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fefe4df5514a84bfe932e11a8ab113'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.409656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fefe4df5514a84bfe932e11a8ab113'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.411552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fefe4df5514a84bfe932e11a8ab113'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.424797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fefe4df5514a84bfe932e11a8ab113'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.472264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:24.473010 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3477/6923] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:23 2022] DELETE /identity/v3/users/01fefe4df5514a84bfe932e11a8ab113 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:24.474604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:24.522192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0e49-17fe-427d-b7fa-28acaff9dd01 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:24.680834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:24.682113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:24.682730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:24.683104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/57126d6ed9c348169c6ebd38e348fc9f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:24.684715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57126d6ed9c348169c6ebd38e348fc9f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:24.686798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:24.740750 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:24.811740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57126d6ed9c348169c6ebd38e348fc9f', 'request_id': 'req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.827184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57126d6ed9c348169c6ebd38e348fc9f', 'request_id': 'req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.850597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57126d6ed9c348169c6ebd38e348fc9f', 'request_id': 'req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.869188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] The token cache is being invalidate because project 57126d6ed9c348169c6ebd38e348fc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:24.869704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.871160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:24.874089 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3447/6924] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:24 2022] DELETE /identity/v3/projects/57126d6ed9c348169c6ebd38e348fc9f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:24.881602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:24.883504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:24.904733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc306-327c-4f1b-8995-ab5e0174b09b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.013436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.014581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.024075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:25.024612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:25.025513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:25.027675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:25.093715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3478/6925] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:15:24 2022] POST /identity/v3/projects => generated 329 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:25.097688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:25.099243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:25.119116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bd24-662a-4c3a-a8bd-e6d9363f0528 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.323538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.325983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.325983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:25.325983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:25.325983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:25.330635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:25.384941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:25.386475 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3448/6926] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:25 2022] POST /identity/v3/users => generated 413 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:25.400309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad058d-080b-474c-a0d8-15e7a7b574a9 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.405856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.406639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.406885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:25.407173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:25.407997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:25.410061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:25.433641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:25.455212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3479/6927] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:25 2022] POST /identity/v3/roles => generated 244 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:25.476718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7c59-4c95-4a4b-b0dd-55e3677cdb4a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.483303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.483832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.484250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:25.484396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:25.485803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:25.487479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:25.509599 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3449/6928] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:25 2022] POST /identity/v3/roles => generated 247 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:25.513534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:25.526099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b25609-4cf9-4dda-8f2a-174f0723c490 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.534866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.536731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.537227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:25.537741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/52d52e60d2ae493ab5259c3e36152327/users/43bbf9fb0a614d06a1e588cdeaffaefb/roles/96d95a2645f7495287fa8a4cc9c9cbe0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:25.557887 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:25.567973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52d52e60d2ae493ab5259c3e36152327, user_id=43bbf9fb0a614d06a1e588cdeaffaefb, role_id=96d95a2645f7495287fa8a4cc9c9cbe0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:25.572475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:25.594027 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3480/6929] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:25 2022] PUT /identity/v3/projects/52d52e60d2ae493ab5259c3e36152327/users/43bbf9fb0a614d06a1e588cdeaffaefb/roles/96d95a2645f7495287fa8a4cc9c9cbe0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:25.597939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:25.612610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f482c25-ee63-4ac9-9b5a-2ffc457ffdbc tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.707158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba48d6-a5e6-488d-9258-f51a1dda3b75 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.708986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba48d6-a5e6-488d-9258-f51a1dda3b75 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.709451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba48d6-a5e6-488d-9258-f51a1dda3b75 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:25.710019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba48d6-a5e6-488d-9258-f51a1dda3b75 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/52d52e60d2ae493ab5259c3e36152327/users/43bbf9fb0a614d06a1e588cdeaffaefb/roles/619f1731598646578c1cb528611430d9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:25.720441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba48d6-a5e6-488d-9258-f51a1dda3b75 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52d52e60d2ae493ab5259c3e36152327, user_id=43bbf9fb0a614d06a1e588cdeaffaefb, role_id=619f1731598646578c1cb528611430d9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:25.725211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba48d6-a5e6-488d-9258-f51a1dda3b75 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:25.751644 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3450/6930] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:25 2022] PUT /identity/v3/projects/52d52e60d2ae493ab5259c3e36152327/users/43bbf9fb0a614d06a1e588cdeaffaefb/roles/619f1731598646578c1cb528611430d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:25.755737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:25.775897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287369bb-8acd-4360-8fc5-6c454ee5de96 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:25.997048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3beb1-e64f-4703-b6c8-842175715a49 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:25.998609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3beb1-e64f-4703-b6c8-842175715a49 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:25.999188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3beb1-e64f-4703-b6c8-842175715a49 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:26.002104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3beb1-e64f-4703-b6c8-842175715a49 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:26.003306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3beb1-e64f-4703-b6c8-842175715a49 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:26.007235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3beb1-e64f-4703-b6c8-842175715a49 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:26.106191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:26.108902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:26.109321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:26.113828 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3481/6931] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:25 2022] GET /identity/v3/users => generated 8355 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:15:26.182596 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:26.208436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] MFA Rules not processed for user `43bbf9fb0a614d06a1e588cdeaffaefb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:26.210966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:26.376472 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3451/6932] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:26.390351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:26.390657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:26.391134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:26.439634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] MFA Rules not processed for user `43bbf9fb0a614d06a1e588cdeaffaefb`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:26.440885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:26.460281 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3482/6933] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:26.467025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:26.481999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f07e8-5ff1-490b-93dc-36540062131c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:26.513105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43bbf9fb0a614d06a1e588cdeaffaefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d52e60d2ae493ab5259c3e36152327', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1652593494', 'tempest-NotDelegatedRole-1237728181'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:26.513860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:26.514155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:26.514535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:26.515428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] RBAC: Authorizing `identity:create_trust()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:26.516617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 11 15:15:26.884255 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 11 15:15:26.885242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:26.886306 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3452/6934] 10.222.0.77 () {60 vars in 1173 bytes} [Mon Jul 11 15:15:26 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 419 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:15:26.890740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:26.920076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1a182-2b7f-4fd6-b3db-2adbf765eff9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:26.934163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:26.936333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:26.936650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:26.936934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/619f1731598646578c1cb528611430d9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:26.940876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=619f1731598646578c1cb528611430d9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:26.943855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:27.031677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 619f1731598646578c1cb528611430d9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:27.032328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.034392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.038611 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3483/6935] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:26 2022] DELETE /identity/v3/roles/619f1731598646578c1cb528611430d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:27.043280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:27.049501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:27.088320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc65d0-95f0-417a-993f-9e519d6b7cbe tempest-TrustsV3TestJSON-1363195180 tempest-user-667882094] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:27.296870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:27.298705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:27.300442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:27.300929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/96d95a2645f7495287fa8a4cc9c9cbe0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:27.308057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=96d95a2645f7495287fa8a4cc9c9cbe0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:27.312725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:27.395658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 96d95a2645f7495287fa8a4cc9c9cbe0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:27.396000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.397787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.403751 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3453/6936] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:27 2022] DELETE /identity/v3/roles/96d95a2645f7495287fa8a4cc9c9cbe0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:27.408286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:27.426772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a6a6b-22bb-4a2f-b80a-bbd3e0e3413f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:27.529141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:27.530611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:27.537446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:27.537975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users/43bbf9fb0a614d06a1e588cdeaffaefb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:27.539789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43bbf9fb0a614d06a1e588cdeaffaefb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:27.542009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:27.589763 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:27.610944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bbf9fb0a614d06a1e588cdeaffaefb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.611889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bbf9fb0a614d06a1e588cdeaffaefb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.691222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bbf9fb0a614d06a1e588cdeaffaefb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.693850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bbf9fb0a614d06a1e588cdeaffaefb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.720147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bbf9fb0a614d06a1e588cdeaffaefb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:27.762581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3484/6937] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:27 2022] DELETE /identity/v3/users/43bbf9fb0a614d06a1e588cdeaffaefb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:27.767664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:27.769494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:27.794673 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:27.814161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85acda-9340-47f5-b933-8eabdf5550ac tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:28.090315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:28.091928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:28.093993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:28.094300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/52d52e60d2ae493ab5259c3e36152327` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:28.097843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52d52e60d2ae493ab5259c3e36152327)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:28.104001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:28.239380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d52e60d2ae493ab5259c3e36152327', 'request_id': 'req-a5fb2a4f-8485-4912-a8db-945ee18692d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:28.258011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d52e60d2ae493ab5259c3e36152327', 'request_id': 'req-a5fb2a4f-8485-4912-a8db-945ee18692d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:28.279204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d52e60d2ae493ab5259c3e36152327', 'request_id': 'req-a5fb2a4f-8485-4912-a8db-945ee18692d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:28.305978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] The token cache is being invalidate because project 52d52e60d2ae493ab5259c3e36152327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:28.308347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:28.310873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:28.314657 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3454/6938] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:27 2022] DELETE /identity/v3/projects/52d52e60d2ae493ab5259c3e36152327 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:28.320999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:28.323142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:28.359427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5853-a363-4d2c-9bbe-474aca9d2a67 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:28.542799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:28.543652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:28.543971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:28.544247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:28.544956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:28.548662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:28.624358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:28.625635 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3485/6939] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:15:28 2022] POST /identity/v3/projects => generated 329 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:28.626434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:28.648439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb2a4f-8485-4912-a8db-945ee18692d6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:28.812411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:28.814166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:28.814676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:28.815113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:28.816018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:28.819312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:28.863298 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3455/6940] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:28 2022] POST /identity/v3/users => generated 416 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:28.864491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:28.883821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4407-6ee1-4cf0-8bfa-b5390b42aa6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:28.896344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:28.897224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:28.897520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:28.897804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:28.898756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:28.900835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:28.927207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3486/6941] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:28 2022] POST /identity/v3/roles => generated 244 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:28.928320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:28.964630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039843-acbc-4120-a64d-555f38439731 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:28.980533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:28.981305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:28.981576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:28.981864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:28.983245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:28.987406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:29.019420 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3456/6942] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:28 2022] POST /identity/v3/roles => generated 247 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:29.024520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:29.041734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e569-6482-48d5-b32e-85d19016d4fa tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:29.055471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:29.056454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:29.056747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:29.057027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/b6a18030aff0449994fe11bb4525b4c2/users/10ce2d83472d45fdae3749dfee647be1/roles/03c0e0b8f5e3469f8a39ecd946f69925` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:29.080067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b6a18030aff0449994fe11bb4525b4c2, user_id=10ce2d83472d45fdae3749dfee647be1, role_id=03c0e0b8f5e3469f8a39ecd946f69925)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:29.083573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:29.120233 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3487/6943] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:29 2022] PUT /identity/v3/projects/b6a18030aff0449994fe11bb4525b4c2/users/10ce2d83472d45fdae3749dfee647be1/roles/03c0e0b8f5e3469f8a39ecd946f69925 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:29.126307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:29.142090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb037db-f543-4155-ac3c-926aa711b8a6 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:29.157526 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:29.264023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dbde9-f8bf-4b4f-b4c0-d408b425174a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:29.265088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dbde9-f8bf-4b4f-b4c0-d408b425174a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:29.265384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dbde9-f8bf-4b4f-b4c0-d408b425174a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:29.265670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dbde9-f8bf-4b4f-b4c0-d408b425174a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/b6a18030aff0449994fe11bb4525b4c2/users/10ce2d83472d45fdae3749dfee647be1/roles/1b100d43e7b240f28fa39956ac825cb3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:29.271929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dbde9-f8bf-4b4f-b4c0-d408b425174a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b6a18030aff0449994fe11bb4525b4c2, user_id=10ce2d83472d45fdae3749dfee647be1, role_id=1b100d43e7b240f28fa39956ac825cb3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:29.274830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dbde9-f8bf-4b4f-b4c0-d408b425174a tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:29.300737 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3457/6944] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:29 2022] PUT /identity/v3/projects/b6a18030aff0449994fe11bb4525b4c2/users/10ce2d83472d45fdae3749dfee647be1/roles/1b100d43e7b240f28fa39956ac825cb3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:29.305552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:29.327550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e0106-fc89-4fc7-bf55-dde300ae5b6c tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:29.558565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cffef-2198-4ea1-aff8-efbf59037874 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:29.559012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cffef-2198-4ea1-aff8-efbf59037874 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:29.559362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cffef-2198-4ea1-aff8-efbf59037874 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:29.559864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cffef-2198-4ea1-aff8-efbf59037874 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:29.560902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cffef-2198-4ea1-aff8-efbf59037874 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:29.564882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cffef-2198-4ea1-aff8-efbf59037874 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:29.571612 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:29.631655 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3488/6945] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:29 2022] GET /identity/v3/users => generated 8358 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:29.633885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:29.634456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:29.635130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:29.718948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] MFA Rules not processed for user `10ce2d83472d45fdae3749dfee647be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:29.720573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:29.957488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3458/6946] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:29.967617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:29.967919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:29.968259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.018511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] MFA Rules not processed for user `10ce2d83472d45fdae3749dfee647be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:30.018511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:30.042372 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3489/6947] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:30.044678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.064166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569b595-3c24-47c0-bf8a-a23778014427 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.079165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.079840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.080129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.080412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.081168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:create_trust()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.090652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.281069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3459/6948] 10.222.0.77 () {60 vars in 1173 bytes} [Mon Jul 11 15:15:30 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:30.285186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.297979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22b499-ee5e-4a5c-972b-317b44ba9dde None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.309771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.311567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.311860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.312996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.328216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:get_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.334274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.363797 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3490/6949] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:30 2022] GET /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8 => generated 834 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:30.366820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.388425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a75a-b579-4b00-a867-ebf4b5740b26 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.403277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.404288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.409752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.410122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.427817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.429329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.455419 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:30.462868 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3460/6950] 10.222.0.77 () {58 vars in 1268 bytes} [Mon Jul 11 15:15:30 2022] GET /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles => generated 371 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:30.466937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.479223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e333cc-db2b-40bf-8229-e59fa992cc6b tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.491856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.492983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.493433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.493872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/03c0e0b8f5e3469f8a39ecd946f69925` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.527695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:get_role_for_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8, role_id=03c0e0b8f5e3469f8a39ecd946f69925)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.529205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.560497 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3491/6951] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:15:30 2022] GET /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/03c0e0b8f5e3469f8a39ecd946f69925 => generated 244 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:30.564911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.580485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18885-1cb2-4dbb-a07f-290c9c212a2d tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.589748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.590777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.591057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.591341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/03c0e0b8f5e3469f8a39ecd946f69925` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.606396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:get_role_for_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8, role_id=03c0e0b8f5e3469f8a39ecd946f69925)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.607891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.642805 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3461/6952] 10.222.0.77 () {58 vars in 1368 bytes} [Mon Jul 11 15:15:30 2022] HEAD /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/03c0e0b8f5e3469f8a39ecd946f69925 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:30.648570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.662200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94c7b-dbb9-4cd6-a19c-19ce538a82a7 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.675826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.678723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:30.693560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.694945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.695391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.695830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/1b100d43e7b240f28fa39956ac825cb3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.720717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:get_role_for_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8, role_id=1b100d43e7b240f28fa39956ac825cb3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.722206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Could not find role: 1b100d43e7b240f28fa39956ac825cb3.: keystone.exception.RoleNotFound: Could not find role: 1b100d43e7b240f28fa39956ac825cb3. Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 11 15:15:30.774700 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:15:30.775721 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1b100d43e7b240f28fa39956ac825cb3. Jul 11 15:15:30.775721 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:30.786151 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3492/6953] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:15:30 2022] GET /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/1b100d43e7b240f28fa39956ac825cb3 => generated 110 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:30.787403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.821359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262af62-6c59-4fbf-93f9-a8e79da31d12 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.840361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.841227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `HEAD` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.841519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.841807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/1b100d43e7b240f28fa39956ac825cb3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.866565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:get_role_for_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8, role_id=1b100d43e7b240f28fa39956ac825cb3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.874004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.899680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba71c-6660-4ca5-a606-a84a4e040c6e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.912829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.913835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.914189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.914580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] PATH_INFO: `/v3/users/dcd92b18f9924ae493c9b6c0ac5d7aeb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:30.919545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd92b18f9924ae493c9b6c0ac5d7aeb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:30.921622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Could not find role: 1b100d43e7b240f28fa39956ac825cb3.: keystone.exception.RoleNotFound: Could not find role: 1b100d43e7b240f28fa39956ac825cb3. Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 11 15:15:30.924511 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:15:30.925441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1b100d43e7b240f28fa39956ac825cb3. Jul 11 15:15:30.925441 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:30.925441 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3493/6954] 10.222.0.77 () {58 vars in 1368 bytes} [Mon Jul 11 15:15:30 2022] HEAD /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8/roles/1b100d43e7b240f28fa39956ac825cb3 => generated 0 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 11 15:15:30.940002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:30.969945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f16c-8f93-4fc1-adaf-8950ff962b3e tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:30.987222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:30.988106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:30.988358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:30.989191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:31.006078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorizing `identity:delete_trust(trust_id=569d9f09fdee4fd9a2de55abfd3d5ac8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:31.007929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:31.059597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '569d9f09fdee4fd9a2de55abfd3d5ac8', 'request_id': 'req-bfbfb15f-68ed-4a5d-a049-25ca385c348a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.060363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '569d9f09fdee4fd9a2de55abfd3d5ac8', 'request_id': 'req-bfbfb15f-68ed-4a5d-a049-25ca385c348a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.074445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd92b18f9924ae493c9b6c0ac5d7aeb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.077236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '569d9f09fdee4fd9a2de55abfd3d5ac8', 'request_id': 'req-bfbfb15f-68ed-4a5d-a049-25ca385c348a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.091112 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3494/6955] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:15:30 2022] DELETE /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:31.097659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:31.099837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:31.124234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd92b18f9924ae493c9b6c0ac5d7aeb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.144288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb15f-68ed-4a5d-a049-25ca385c348a tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:31.156506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd92b18f9924ae493c9b6c0ac5d7aeb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.167503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ce2d83472d45fdae3749dfee647be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a18030aff0449994fe11bb4525b4c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1069120048', 'tempest-DelegatedRole-1877966802'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:31.168363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:31.168652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:31.168950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] PATH_INFO: `/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:31.183806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd92b18f9924ae493c9b6c0ac5d7aeb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.185471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3fb93bd5-8c19-4a0b-98b4-5acc37979d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd92b18f9924ae493c9b6c0ac5d7aeb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.202268 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3462/6956] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:30 2022] DELETE /identity/v3/users/dcd92b18f9924ae493c9b6c0ac5d7aeb => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Could not find trust: 569d9f09fdee4fd9a2de55abfd3d5ac8.: keystone.exception.TrustNotFound: Could not find trust: 569d9f09fdee4fd9a2de55abfd3d5ac8. Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 11 15:15:31.206128 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 569d9f09fdee4fd9a2de55abfd3d5ac8. Jul 11 15:15:31.207822 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:15:31.208816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:31.209683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:31.210171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:31.216999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3495/6957] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:31 2022] GET /identity/v3/OS-TRUST/trusts/569d9f09fdee4fd9a2de55abfd3d5ac8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:31.221613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:31.226374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:31.271976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279718-55d7-403e-8424-3a0a919473a5 tempest-TrustsV3TestJSON-1511687072 tempest-user-1734769736] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:31.275506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:31.276765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:31.407204 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3463/6958] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:31.433980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:31.435194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:31.435585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:31.435972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/1b100d43e7b240f28fa39956ac825cb3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:31.437890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b100d43e7b240f28fa39956ac825cb3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:31.440052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:31.446514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:31.448945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:31.454667 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:31.551077 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:31.574219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 1b100d43e7b240f28fa39956ac825cb3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:31.576395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.588445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:31.594650 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3496/6959] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:31 2022] DELETE /identity/v3/roles/1b100d43e7b240f28fa39956ac825cb3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:31.606155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:31.611068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:31.697981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda188-1091-4d41-b62a-19d6d952e791 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:31.925403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541000-4d58-49f6-a04e-2051fda1a8d8 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:31.943816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:31.945237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:31.948168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:31.948168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/03c0e0b8f5e3469f8a39ecd946f69925` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:31.950993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=03c0e0b8f5e3469f8a39ecd946f69925)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:31.953320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:31.959266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:31.959950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:31.960240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:31.960521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:31.971552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:32.066178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 03c0e0b8f5e3469f8a39ecd946f69925 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:32.067154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.072950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.078936 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3497/6960] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:31 2022] DELETE /identity/v3/roles/03c0e0b8f5e3469f8a39ecd946f69925 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:32.084400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:32.088663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:32.218800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:32.225466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:32.245209 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3464/6961] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:32.341068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c1122-9bc9-4f6c-9ad9-cc3f98e5f4c2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:32.356756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:32.364727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:32.367183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:32.368304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users/10ce2d83472d45fdae3749dfee647be1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:32.374005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=10ce2d83472d45fdae3749dfee647be1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:32.381303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:32.515966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ce2d83472d45fdae3749dfee647be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.517537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ce2d83472d45fdae3749dfee647be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.565192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ce2d83472d45fdae3749dfee647be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.566346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ce2d83472d45fdae3749dfee647be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.569413 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:32.584660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ce2d83472d45fdae3749dfee647be1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:32.620668 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3498/6962] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:32 2022] DELETE /identity/v3/users/10ce2d83472d45fdae3749dfee647be1 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:32.624934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:32.653086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbad67-65b1-47cd-a4fc-07cee291b839 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:32.911674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:32.912778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:32.913185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:32.913740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/b6a18030aff0449994fe11bb4525b4c2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:32.917807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6a18030aff0449994fe11bb4525b4c2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:32.920168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:32.949608 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:33.005082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:33.006618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:33.045801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a18030aff0449994fe11bb4525b4c2', 'request_id': 'req-eff17cc2-4799-42d6-bbaa-3e46a8b03907'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.055694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a18030aff0449994fe11bb4525b4c2', 'request_id': 'req-eff17cc2-4799-42d6-bbaa-3e46a8b03907'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.073699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a18030aff0449994fe11bb4525b4c2', 'request_id': 'req-eff17cc2-4799-42d6-bbaa-3e46a8b03907'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.096407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] The token cache is being invalidate because project b6a18030aff0449994fe11bb4525b4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:33.096863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.099207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.106190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3465/6963] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:32 2022] DELETE /identity/v3/projects/b6a18030aff0449994fe11bb4525b4c2 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:33.109471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:33.112780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:33.241289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f971d1-0d78-453b-8b13-e54db55e8327 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:33.297079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff17cc2-4799-42d6-bbaa-3e46a8b03907 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:33.321454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:33.324526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.324993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.325656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.328148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:33.337151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:33.422316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3466/6964] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/projects => generated 328 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:33.423277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:33.433211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:33.438320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.438648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.438939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] PATH_INFO: `/v3/projects/30a896b98ab840f191cb95ad362ae25f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.443086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a896b98ab840f191cb95ad362ae25f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:33.450658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:33.587225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a896b98ab840f191cb95ad362ae25f', 'request_id': 'req-ce2f694a-7d1d-4360-bd58-08a8f6c11101'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.606027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1be1-b078-49d0-b0ab-97c4cb7fa7b5 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:33.609760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a896b98ab840f191cb95ad362ae25f', 'request_id': 'req-ce2f694a-7d1d-4360-bd58-08a8f6c11101'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.620579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a896b98ab840f191cb95ad362ae25f', 'request_id': 'req-ce2f694a-7d1d-4360-bd58-08a8f6c11101'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.645252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] The token cache is being invalidate because project 30a896b98ab840f191cb95ad362ae25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:33.645252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.645585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ce2f694a-7d1d-4360-bd58-08a8f6c11101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:33.647488 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3499/6965] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:33 2022] DELETE /identity/v3/projects/30a896b98ab840f191cb95ad362ae25f => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:33.652776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da499-8265-4143-a619-c5d0aaaaae58 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.653066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da499-8265-4143-a619-c5d0aaaaae58 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.653346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da499-8265-4143-a619-c5d0aaaaae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.659098 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:33.703699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-328da499-8265-4143-a619-c5d0aaaaae58 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:33.705147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-328da499-8265-4143-a619-c5d0aaaaae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:33.726114 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:33.775491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:33.779778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.783205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.783643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.784690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:33.787383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:33.837738 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3467/6966] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/users => generated 416 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:33.847827 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3500/6967] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:33.849864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:33.851646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:33.851807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.852077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.852363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.882681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d9c5-d758-4762-a31a-7a16dbbcc350 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:33.893493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:33.895451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:33.898670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:33.899482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.899890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.900288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.908052 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3501/6968] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:33.911100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:33.912923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:33.918108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:33.924464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b16de1-4a93-4c96-81fd-a20100c82659 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:33.931078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:33.932547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:33.932872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:33.933367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:33.934128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:33.934694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:33.936605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:33.963846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3502/6969] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:33.965804 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3468/6970] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/roles => generated 243 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:33.969839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:33.971541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.022544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de13e-1954-40cf-9a69-e31db47e831f tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.029382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cee764-34fa-4f89-8976-00c4e56fe794 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.035970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.037250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.038031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.038031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.039133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.041380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.045125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.045802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.046086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.046366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.047188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.050256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.081195 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3469/6971] 10.222.0.77 () {60 vars in 1142 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/roles => generated 247 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:34.082665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.130692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf693-ad6a-45d0-bd33-9cda5673c39e tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.141438 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3503/6972] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:34.146471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.328526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.330181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.330878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.331329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/b6141d140ee84a6199d373a4861e5d53/users/0be4ab8c99b2429da2b3e679cc04adb2/roles/22f072c63007403593027e74ddd58cc4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.340736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce572e-b7a0-4ef5-a26b-28daa0294e62 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.361793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.362864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.364021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.364310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.365366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.370291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.371483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b6141d140ee84a6199d373a4861e5d53, user_id=0be4ab8c99b2429da2b3e679cc04adb2, role_id=22f072c63007403593027e74ddd58cc4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.374429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.411179 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3470/6973] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:34 2022] PUT /identity/v3/projects/b6141d140ee84a6199d373a4861e5d53/users/0be4ab8c99b2429da2b3e679cc04adb2/roles/22f072c63007403593027e74ddd58cc4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:34.415478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.423156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3504/6974] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:34 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:34.426238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.452728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f322cf3-8585-4a9d-87f6-baf15c4996d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.563434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f143-d703-4856-85bc-47afe2f3fb9b tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.576558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.577491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.577795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.578069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/b6141d140ee84a6199d373a4861e5d53/users/0be4ab8c99b2429da2b3e679cc04adb2/roles/771ca315428a4bf8a707c63fa42edb70` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.585352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b6141d140ee84a6199d373a4861e5d53, user_id=0be4ab8c99b2429da2b3e679cc04adb2, role_id=771ca315428a4bf8a707c63fa42edb70)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.588230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.620017 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3471/6975] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:34 2022] PUT /identity/v3/projects/b6141d140ee84a6199d373a4861e5d53/users/0be4ab8c99b2429da2b3e679cc04adb2/roles/771ca315428a4bf8a707c63fa42edb70 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:34.621220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.628321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.630265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.631082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.632015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.633077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.635464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.648113 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:34.771323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3505/6976] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:34 2022] GET /identity/v3/roles => generated 1892 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:34.773621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:34.794903 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:34.816231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935747-22c1-47dd-b089-05e89e324008 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.846035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff93f4-c009-4caa-90b1-d612d569aab2 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:34.870840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f64cb0-0009-4cb8-a12a-7f8dfe7ed427 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:34.871669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f64cb0-0009-4cb8-a12a-7f8dfe7ed427 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.875780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f64cb0-0009-4cb8-a12a-7f8dfe7ed427 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.877726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f64cb0-0009-4cb8-a12a-7f8dfe7ed427 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:34.878717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f64cb0-0009-4cb8-a12a-7f8dfe7ed427 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:34.881325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f64cb0-0009-4cb8-a12a-7f8dfe7ed427 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:34.970212 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3472/6977] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:34 2022] GET /identity/v3/users => generated 8346 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:34.973241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16695b78-220d-4b31-a856-7d511d09132b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:34.973809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16695b78-220d-4b31-a856-7d511d09132b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:34.974200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16695b78-220d-4b31-a856-7d511d09132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.029392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:35.030092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.030382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.030696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.031438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:35.037739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-16695b78-220d-4b31-a856-7d511d09132b None None] MFA Rules not processed for user `0be4ab8c99b2429da2b3e679cc04adb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:35.039390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-16695b78-220d-4b31-a856-7d511d09132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:35.041476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:35.105931 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3506/6978] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:34 2022] GET /identity/v3/roles => generated 1892 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:35.113533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.135393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fe047-4cb4-4e8c-be97-e9e1413b260a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:35.148809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3105de-75c8-4892-806e-409102524b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:35.149713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3105de-75c8-4892-806e-409102524b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.150003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3105de-75c8-4892-806e-409102524b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.150284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3105de-75c8-4892-806e-409102524b6d admin admin] PATH_INFO: `/v3/projects/3679b71cd94f402a859118909bd7a6c8/users/ec4c77f30b214db293091ef9b4e1acf8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.152374 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3473/6979] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:34 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:35.165426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.166083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.166637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.212840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3105de-75c8-4892-806e-409102524b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3679b71cd94f402a859118909bd7a6c8, user_id=ec4c77f30b214db293091ef9b4e1acf8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:35.219190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] MFA Rules not processed for user `0be4ab8c99b2429da2b3e679cc04adb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:35.220527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:35.229737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3105de-75c8-4892-806e-409102524b6d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:35.255278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3474/6980] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:35.256707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.281531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3507/6981] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:35 2022] PUT /identity/v3/projects/3679b71cd94f402a859118909bd7a6c8/users/ec4c77f30b214db293091ef9b4e1acf8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:35.283189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.283488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.283770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.290192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d815cf-9378-4fbe-a110-7c998b83c528 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:35.337471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:35.343298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:35.437867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45559a5-b87f-4eed-a51b-d12070fe80c0 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:35.439351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45559a5-b87f-4eed-a51b-d12070fe80c0 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.439793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45559a5-b87f-4eed-a51b-d12070fe80c0 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.440247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45559a5-b87f-4eed-a51b-d12070fe80c0 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.442539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45559a5-b87f-4eed-a51b-d12070fe80c0 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:create_trust()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:35.445373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45559a5-b87f-4eed-a51b-d12070fe80c0 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:35.492460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3508/6982] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:35.504692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.505802 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:35.506203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:35.579904 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3475/6983] 10.222.0.77 () {60 vars in 1173 bytes} [Mon Jul 11 15:15:35 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:35.581323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b928-54ac-4b1a-b5ea-a68dd0110cae None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.581620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b928-54ac-4b1a-b5ea-a68dd0110cae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.581901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b928-54ac-4b1a-b5ea-a68dd0110cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.627687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82eef5-8d44-4ff1-8c63-7f52544bbd7b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:35.633237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:35.634997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.635520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.636002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.640219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6ff2b928-54ac-4b1a-b5ea-a68dd0110cae None None] MFA Rules not processed for user `9ae8e53c8bcf4431921032191395bf86`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:35.641433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6ff2b928-54ac-4b1a-b5ea-a68dd0110cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:35.655317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:35.657237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:35.671383 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3509/6984] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:35.673066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.688055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f1bed-20b8-4ea9-8b25-b04881c39a16 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:35.701615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:35.703066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.703551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.704051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.736171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:get_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:35.742137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:35.778156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3510/6985] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:35 2022] GET /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48 => generated 834 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:35.783650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.808959 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3476/6986] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:35.809165 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:35.818853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.819905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.821274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.822279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9590b-e1ae-4764-b1b9-3e247c134685 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:35.836078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:35.836751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:35.836911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:35.837203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:35.850020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:35.856155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] MFA Rules not processed for user `9ae8e53c8bcf4431921032191395bf86`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:35.857801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:35.875516 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3477/6987] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:35.884213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:35.911647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3511/6988] 10.222.0.77 () {58 vars in 1268 bytes} [Mon Jul 11 15:15:35 2022] GET /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles => generated 370 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:35.914876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.937610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:35.939415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:36.008661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75716cd5-cf72-43b4-bdc4-88876bd8fad2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.027083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.032787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.037807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.038941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/22f072c63007403593027e74ddd58cc4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.093694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48, role_id=22f072c63007403593027e74ddd58cc4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.123859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.152064 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3478/6989] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:15:35 2022] GET /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/22f072c63007403593027e74ddd58cc4 => generated 243 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:36.156501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:36.192748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f9f8-0fdf-451d-90c4-3153dedf91eb tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.216526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.217464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.217757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.218283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/22f072c63007403593027e74ddd58cc4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.239872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48, role_id=22f072c63007403593027e74ddd58cc4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.241775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.282214 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3479/6990] 10.222.0.77 () {58 vars in 1368 bytes} [Mon Jul 11 15:15:36 2022] HEAD /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/22f072c63007403593027e74ddd58cc4 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 11 15:15:36.283359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:36.329441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae8a2-58cc-48b8-82b1-a81d301421f1 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.354022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.354920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.355212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.355498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/771ca315428a4bf8a707c63fa42edb70` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.372488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc3fb1-5d7b-4c0b-aca7-86c364807981 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.398390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48, role_id=771ca315428a4bf8a707c63fa42edb70)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.399957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.415432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.416328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.416625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.416909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.444189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.449411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Could not find role: 771ca315428a4bf8a707c63fa42edb70.: keystone.exception.RoleNotFound: Could not find role: 771ca315428a4bf8a707c63fa42edb70. Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 11 15:15:36.467934 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:15:36.469468 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 771ca315428a4bf8a707c63fa42edb70. Jul 11 15:15:36.469468 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:36.475763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3480/6991] 10.222.0.77 () {58 vars in 1367 bytes} [Mon Jul 11 15:15:36 2022] GET /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/771ca315428a4bf8a707c63fa42edb70 => generated 110 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:36.479326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:36.480570 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3512/6992] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:15:36.500932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2470-7b66-4fe2-88c0-28e971fd884c tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.513254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.515295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `HEAD` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.515586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.516802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/771ca315428a4bf8a707c63fa42edb70` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.534688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48, role_id=771ca315428a4bf8a707c63fa42edb70)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.536598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Could not find role: 771ca315428a4bf8a707c63fa42edb70.: keystone.exception.RoleNotFound: Could not find role: 771ca315428a4bf8a707c63fa42edb70. Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 11 15:15:36.567326 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:15:36.568524 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 771ca315428a4bf8a707c63fa42edb70. Jul 11 15:15:36.568524 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:36.572491 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3481/6993] 10.222.0.77 () {58 vars in 1368 bytes} [Mon Jul 11 15:15:36 2022] HEAD /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48/roles/771ca315428a4bf8a707c63fa42edb70 => generated 0 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 11 15:15:36.576368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:36.604541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b434-a0aa-4e2a-ad35-5441e41e4339 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.620223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.621082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.621554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.621838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.639496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorizing `identity:delete_trust(trust_id=8fe3ba48b5564be9a9c4f3aba058fa48)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.641148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.674821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8fe3ba48b5564be9a9c4f3aba058fa48', 'request_id': 'req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:36.676202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8fe3ba48b5564be9a9c4f3aba058fa48', 'request_id': 'req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:36.697216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8fe3ba48b5564be9a9c4f3aba058fa48', 'request_id': 'req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:36.704583 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3513/6994] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 11 15:15:36 2022] DELETE /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:36.709922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:36.712509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:36.730622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9f5d-a597-4aeb-91a5-d2898e1ea936 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.740250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4ab8c99b2429da2b3e679cc04adb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6141d140ee84a6199d373a4861e5d53', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-706038283', 'tempest-NotDelegatedRole-1670134010'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.741548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.742177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.742819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] PATH_INFO: `/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Could not find trust: 8fe3ba48b5564be9a9c4f3aba058fa48.: keystone.exception.TrustNotFound: Could not find trust: 8fe3ba48b5564be9a9c4f3aba058fa48. Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 11 15:15:36.773696 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8fe3ba48b5564be9a9c4f3aba058fa48. Jul 11 15:15:36.774955 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:15:36.783883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3482/6995] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 11 15:15:36 2022] GET /identity/v3/OS-TRUST/trusts/8fe3ba48b5564be9a9c4f3aba058fa48 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:15:36.784898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:36.786401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:36.932407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27620-33d3-4497-94f9-f8e0d8c2cc7f tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:36.939875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:36.941262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:36.943508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:36.944011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/771ca315428a4bf8a707c63fa42edb70` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:36.946836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=771ca315428a4bf8a707c63fa42edb70)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:36.949007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:36.994953 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:37.019040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 771ca315428a4bf8a707c63fa42edb70 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:37.019434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.022349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.028034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3514/6996] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:36 2022] DELETE /identity/v3/roles/771ca315428a4bf8a707c63fa42edb70 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:37.032205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:37.034394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:37.064151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da0099-7bf8-4eeb-b33d-81420f431906 tempest-TrustsV3TestJSON-914961270 tempest-user-1964415158] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:37.140120 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:37.216730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:37.217996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:37.218548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:37.219262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/roles/22f072c63007403593027e74ddd58cc4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:37.221713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_role(role_id=22f072c63007403593027e74ddd58cc4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:37.224711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:37.291508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invalidating the token cache because role 22f072c63007403593027e74ddd58cc4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:37.292324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.293181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.295454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3483/6997] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:37 2022] DELETE /identity/v3/roles/22f072c63007403593027e74ddd58cc4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:37.299934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:37.329166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc951-1953-4934-bb16-f09a1b819468 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:37.569810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:37.572888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:37.573190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:37.573479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/users/0be4ab8c99b2429da2b3e679cc04adb2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:37.578794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0be4ab8c99b2429da2b3e679cc04adb2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:37.585496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:37.725583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be4ab8c99b2429da2b3e679cc04adb2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.726398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be4ab8c99b2429da2b3e679cc04adb2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.753914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be4ab8c99b2429da2b3e679cc04adb2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.754853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be4ab8c99b2429da2b3e679cc04adb2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.778517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be4ab8c99b2429da2b3e679cc04adb2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:37.804814 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3515/6998] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:37 2022] DELETE /identity/v3/users/0be4ab8c99b2429da2b3e679cc04adb2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:37.808658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:37.810239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:37.846765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669603ea-2fe1-46f3-a147-6d38ab340945 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:38.080509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cc364144ae748fa9a224618b0f48aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8c4159448004884a702e360354d8a4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:38.080864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:38.081154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:38.081442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] PATH_INFO: `/v3/projects/b6141d140ee84a6199d373a4861e5d53` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:38.085964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6141d140ee84a6199d373a4861e5d53)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:38.088444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:38.216227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6141d140ee84a6199d373a4861e5d53', 'request_id': 'req-22fcad46-4017-4296-b4a5-bf44f2fddf65'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.228300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6141d140ee84a6199d373a4861e5d53', 'request_id': 'req-22fcad46-4017-4296-b4a5-bf44f2fddf65'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.257357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6141d140ee84a6199d373a4861e5d53', 'request_id': 'req-22fcad46-4017-4296-b4a5-bf44f2fddf65'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.290855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] The token cache is being invalidate because project b6141d140ee84a6199d373a4861e5d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:38.293448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.296619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-22fcad46-4017-4296-b4a5-bf44f2fddf65 tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.308863 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3484/6999] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:37 2022] DELETE /identity/v3/projects/b6141d140ee84a6199d373a4861e5d53 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:38.310283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:38.312322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:38.439269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88fe71-63ac-4de6-8d79-0e3ea72aabec tempest-TrustsV3TestJSON-280244384 tempest-TrustsV3TestJSON-280244384-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:38.465400 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:38.524493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:38.526099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:38.528758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:38.529230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] PATH_INFO: `/v3/users/063caaa2df4c40c5807f3cad1f020aa6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:38.533230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063caaa2df4c40c5807f3cad1f020aa6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:38.541489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:38.662915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063caaa2df4c40c5807f3cad1f020aa6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.664087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063caaa2df4c40c5807f3cad1f020aa6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.688862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063caaa2df4c40c5807f3cad1f020aa6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.691378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063caaa2df4c40c5807f3cad1f020aa6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.710676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063caaa2df4c40c5807f3cad1f020aa6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:38.757502 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3516/7000] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:38 2022] DELETE /identity/v3/users/063caaa2df4c40c5807f3cad1f020aa6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:38.761823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:38.762121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:38.762407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:38.795621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:38.796879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:38.825909 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:38.940349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3485/7001] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:38.952067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:38.958824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:39.156597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf139-ba71-431c-89ef-fda8698baa00 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:39.173317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:39.175393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:39.176524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:39.177286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:39.207601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:39.209391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:39.230547 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3517/7002] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:40.092105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:40.101621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:40.136158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae5115-a866-4243-b206-6b98aba42ae4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:40.167763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:40.170609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:40.171931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:40.172794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] PATH_INFO: `/v3/projects/b0e3d040a61a4766a539ebece2856032` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:40.181914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e3d040a61a4766a539ebece2856032)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:40.190138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:40.379416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e3d040a61a4766a539ebece2856032', 'request_id': 'req-97e180de-f484-4061-9418-14340a761e37'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.405719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e3d040a61a4766a539ebece2856032', 'request_id': 'req-97e180de-f484-4061-9418-14340a761e37'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.443592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e3d040a61a4766a539ebece2856032', 'request_id': 'req-97e180de-f484-4061-9418-14340a761e37'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.495638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] The token cache is being invalidate because project b0e3d040a61a4766a539ebece2856032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:40.495950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.500494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.510667 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3486/7003] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:40 2022] DELETE /identity/v3/projects/b0e3d040a61a4766a539ebece2856032 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:40.514425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:40.547279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7d1e1-6044-4ba2-8195-0b3a021c1fff service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:40.685896 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:40.721091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:40.722005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:40.722292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:40.722632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] PATH_INFO: `/v3/users/8cc364144ae748fa9a224618b0f48aa5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:40.727993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc364144ae748fa9a224618b0f48aa5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:40.734346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:40.876033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc364144ae748fa9a224618b0f48aa5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.878467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc364144ae748fa9a224618b0f48aa5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.935745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc364144ae748fa9a224618b0f48aa5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.937868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc364144ae748fa9a224618b0f48aa5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:40.969675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e29b91f4-a3b3-466e-98c2-6322f294ab7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc364144ae748fa9a224618b0f48aa5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:41.020451 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3518/7004] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:40 2022] DELETE /identity/v3/users/8cc364144ae748fa9a224618b0f48aa5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:43.499243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:43.502130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:43.531081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e180de-f484-4061-9418-14340a761e37 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:43.713253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:43.714750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:43.721594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:43.723023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] PATH_INFO: `/v3/projects/a8c4159448004884a702e360354d8a4c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:43.726159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c4159448004884a702e360354d8a4c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:43.733336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:43.862047 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:43.882590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c4159448004884a702e360354d8a4c', 'request_id': 'req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:43.901830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c4159448004884a702e360354d8a4c', 'request_id': 'req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:43.925083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c4159448004884a702e360354d8a4c', 'request_id': 'req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:43.946187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] The token cache is being invalidate because project a8c4159448004884a702e360354d8a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:43.948813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:43.950300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fccfc8be-5fdb-4e43-8ca5-a490b904ef74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:43.953587 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3487/7005] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:43 2022] DELETE /identity/v3/projects/a8c4159448004884a702e360354d8a4c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:43.959130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:43.960478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:43.960970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.026649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:44.035760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:44.218599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3519/7006] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:44.226961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.227524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.227963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.268634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:44.270451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:44.309395 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3488/7007] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:44.313178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.325519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ccbe9-ed96-49d7-9d4f-51f2a39c49f3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.332129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.332954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.333247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.333529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.334275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:44.334704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.336351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.355115 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3520/7008] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:44.356220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.368679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191bcf-156a-400a-aac3-26a1558052ae None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.375816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.376748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.377187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.377635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.389723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.392320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.439817 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3489/7009] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:44 2022] POST /identity/v3/projects => generated 395 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:44.440971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.457878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142aa1-3aa5-45c6-81f0-5edf96440192 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.568629 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:44.602266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.603284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.603731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.605332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.606223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.608369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.654109 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3521/7010] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:44 2022] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:15:44.655488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.669195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a81b-a9e3-49ec-b964-1cfa3ac39cc9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.676357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.677246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.677691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.678137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.679280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.681536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.697753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3490/7011] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:44.699210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.714170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dcccb-87da-493d-bee3-91bc4fb3ed57 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.720874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.721856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.722807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.723468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] PATH_INFO: `/v3/projects/3d75ecc9f28d4201a97a672f2119a904/users/55468477e4284ab6a2b5d7f8846adccf/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.765188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d75ecc9f28d4201a97a672f2119a904, user_id=55468477e4284ab6a2b5d7f8846adccf, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.768659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.792138 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3522/7012] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:44 2022] PUT /identity/v3/projects/3d75ecc9f28d4201a97a672f2119a904/users/55468477e4284ab6a2b5d7f8846adccf/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:44.796424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.813102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4edfed-ef4f-4658-9316-dae468eb937e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.898112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903596-eae2-414b-aba7-06dfcb4eb288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.899109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903596-eae2-414b-aba7-06dfcb4eb288 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.899703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903596-eae2-414b-aba7-06dfcb4eb288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.900140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903596-eae2-414b-aba7-06dfcb4eb288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.901722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903596-eae2-414b-aba7-06dfcb4eb288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.903617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903596-eae2-414b-aba7-06dfcb4eb288 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.923346 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3491/7013] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:44.925152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:44.943206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888488ce-73af-4b86-b3ce-d7953685c5c5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:44.955378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:44.956552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.957155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.957590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] PATH_INFO: `/v3/projects/3d75ecc9f28d4201a97a672f2119a904/users/55468477e4284ab6a2b5d7f8846adccf/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:44.959917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d75ecc9f28d4201a97a672f2119a904, user_id=55468477e4284ab6a2b5d7f8846adccf, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:44.963365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:44.976872 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3523/7014] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:44 2022] PUT /identity/v3/projects/3d75ecc9f28d4201a97a672f2119a904/users/55468477e4284ab6a2b5d7f8846adccf/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:44.987767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:44.987767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:44.987767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:45.039012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] MFA Rules not processed for user `55468477e4284ab6a2b5d7f8846adccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:45.043272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:45.210935 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3492/7015] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:45.215755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:45.353707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152145-0d80-4289-b324-a9d2151a4392 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:45.363308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:45.363308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:45.363747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:45.363747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:45.364451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:45.366359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:45.426071 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3524/7016] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:45 2022] POST /identity/v3/projects => generated 395 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:45.432464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:45.453869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eaa5e-68b0-44e1-8315-fcdff176f1cc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:45.482458 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:45.690677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:45.695819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:45.697525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:45.698259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:45.699522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:45.707444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:45.797785 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3493/7017] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:45 2022] POST /identity/v3/users => generated 298 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:45.799136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:45.819289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb2576-5316-4d0a-91d9-6b9a788429f2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:45.825553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:45.826708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:45.827143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:45.827583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:45.829163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:45.831930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:45.861951 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3525/7018] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:45.863893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:45.905260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fa59-21c8-4c38-a8b3-674c704028e4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:45.931724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec76bc-d516-475e-9e19-ef5a71ca939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:45.932526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec76bc-d516-475e-9e19-ef5a71ca939c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:45.932884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec76bc-d516-475e-9e19-ef5a71ca939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:45.933231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec76bc-d516-475e-9e19-ef5a71ca939c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:45.934363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec76bc-d516-475e-9e19-ef5a71ca939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:45.936559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec76bc-d516-475e-9e19-ef5a71ca939c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:45.979045 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3494/7019] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:45.980063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:45.998169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33f4a9-7896-462d-bec3-14a2c48e07f3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:46.034093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:46.035242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:46.035633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:46.036010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] PATH_INFO: `/v3/projects/1502b4eaafed4729ae866663b3433d03/users/378e05d2a79346ae95007b69cb2193cf/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:46.088476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1502b4eaafed4729ae866663b3433d03, user_id=378e05d2a79346ae95007b69cb2193cf, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:46.094156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:46.124475 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3526/7020] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:45 2022] PUT /identity/v3/projects/1502b4eaafed4729ae866663b3433d03/users/378e05d2a79346ae95007b69cb2193cf/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:46.139167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:46.139793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:46.140309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:46.247154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] MFA Rules not processed for user `378e05d2a79346ae95007b69cb2193cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:46.250592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:46.540839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3495/7021] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:46.548041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:46.550187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:46.666899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1a5d-e65c-4091-b9d7-dfc6baa26bc3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:46.672385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed5aa4-a794-49db-bc1a-8b2feac7054e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:46.674540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed5aa4-a794-49db-bc1a-8b2feac7054e service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:46.675845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed5aa4-a794-49db-bc1a-8b2feac7054e service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:46.676203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed5aa4-a794-49db-bc1a-8b2feac7054e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:46.685845 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:46.828461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed5aa4-a794-49db-bc1a-8b2feac7054e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:46.830520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed5aa4-a794-49db-bc1a-8b2feac7054e service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:46.859437 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3527/7022] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:47.750259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:47.881108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e45735-af73-4641-a653-5f8bfaf31606 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:47.903880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:47.908361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:47.908711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:47.909008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] PATH_INFO: `/v3/users/55468477e4284ab6a2b5d7f8846adccf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:47.916074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55468477e4284ab6a2b5d7f8846adccf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:47.918060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:47.988156 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:48.025409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55468477e4284ab6a2b5d7f8846adccf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:48.055509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55468477e4284ab6a2b5d7f8846adccf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:48.080858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55468477e4284ab6a2b5d7f8846adccf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:48.117485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55468477e4284ab6a2b5d7f8846adccf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:48.118070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55468477e4284ab6a2b5d7f8846adccf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:48.130228 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3496/7023] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:47 2022] DELETE /identity/v3/users/55468477e4284ab6a2b5d7f8846adccf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:48.136167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:48.137453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:48.142171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:48.215943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:48.220810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:48.381857 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3528/7024] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:48.425043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:48.427285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:48.585898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa77b-c504-4bbf-b586-ad2357a64907 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:48.597455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:48.598354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:48.598734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:48.599065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:48.639873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:48.641878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:48.664964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3497/7025] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:50.525290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:50.526925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:50.551531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51518b-d34d-4ef6-829d-655b6ea6b427 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:50.585343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:50.589149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:50.590126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:50.591179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] PATH_INFO: `/v3/projects/3d75ecc9f28d4201a97a672f2119a904` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:50.594379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d75ecc9f28d4201a97a672f2119a904)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:50.600532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:50.716510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d75ecc9f28d4201a97a672f2119a904', 'request_id': 'req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:50.733187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d75ecc9f28d4201a97a672f2119a904', 'request_id': 'req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:50.781590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d75ecc9f28d4201a97a672f2119a904', 'request_id': 'req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:50.807047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] The token cache is being invalidate because project 3d75ecc9f28d4201a97a672f2119a904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:50.807594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:50.809143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:50.811833 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3529/7026] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:50 2022] DELETE /identity/v3/projects/3d75ecc9f28d4201a97a672f2119a904 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:50.815702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:50.836434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a889-721a-4d2e-8c48-eb831f6aa3f3 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:50.980711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:50.981880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:50.982375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:50.982855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] PATH_INFO: `/v3/users/378e05d2a79346ae95007b69cb2193cf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:50.984342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=378e05d2a79346ae95007b69cb2193cf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:50.987137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:51.133747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378e05d2a79346ae95007b69cb2193cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:51.135959 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:51.164463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378e05d2a79346ae95007b69cb2193cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:51.177919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378e05d2a79346ae95007b69cb2193cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:51.192586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378e05d2a79346ae95007b69cb2193cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:51.197820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378e05d2a79346ae95007b69cb2193cf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:51.210547 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3498/7027] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:50 2022] DELETE /identity/v3/users/378e05d2a79346ae95007b69cb2193cf => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:15:51.761540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:51.768016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:51.831018 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:51.897310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9d20b-3447-4e43-98fe-e5a7acd9dcf2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:51.908365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:51.912280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:52.031584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:52.032379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:52.032741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:52.034000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:52.038094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:52.190199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3738e9-1a89-4679-abf4-9270ae0e7e4c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:52.204240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:52.204919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:52.205215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:52.205497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:52.219602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:52.332357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:52.334360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:52.373825 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3530/7028] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:52.389872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:52.392054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b6d6-cc95-4df6-beda-b03fbd6dd644 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:52.434708 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3499/7029] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:15:52.689907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:52.692317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:52.730367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922a118-fafe-481a-9c98-4569252a10e6 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:52.754250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:52.755166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:52.755457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:52.755741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] PATH_INFO: `/v3/projects/1502b4eaafed4729ae866663b3433d03` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:52.768821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1502b4eaafed4729ae866663b3433d03)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:52.779912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:52.967334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1502b4eaafed4729ae866663b3433d03', 'request_id': 'req-14737d4d-fa16-4ac1-8933-2a3275a4f71a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:52.990124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1502b4eaafed4729ae866663b3433d03', 'request_id': 'req-14737d4d-fa16-4ac1-8933-2a3275a4f71a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:53.005748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1502b4eaafed4729ae866663b3433d03', 'request_id': 'req-14737d4d-fa16-4ac1-8933-2a3275a4f71a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:53.031669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] The token cache is being invalidate because project 1502b4eaafed4729ae866663b3433d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:53.031976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:53.035497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14737d4d-fa16-4ac1-8933-2a3275a4f71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:53.062082 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3531/7030] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:52 2022] DELETE /identity/v3/projects/1502b4eaafed4729ae866663b3433d03 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:53.068444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.068881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.069022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.102659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:53.103889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:53.269298 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3500/7031] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:53.271321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.271751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.272119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.302033 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:53.319297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:53.324138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:53.343623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3532/7032] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:15:53.348638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:53.363556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbc041-d7c2-45f4-94a3-fea464e49aee None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:53.374181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:53.376189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.376499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.376771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.378352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:15:53.378819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:53.381376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:53.404459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:53.412835 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3501/7033] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:15:53.417844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20429d-5bd1-4992-b82d-8080733be4a9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:53.423330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:53.424015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.424475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.424766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.425600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:53.427991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:53.500254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:53.508559 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:53.525027 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3533/7034] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:53 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:53.531307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a71c-6bfb-43fe-87c3-eafbef90776f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:53.671394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:53.672473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.672919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.673351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.674330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:53.677629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:53.716083 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3502/7035] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:53 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:53.716585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:53.727372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478dcc7-150d-48ad-82cb-dcd8dbb214ef admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:53.733268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:53.734170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.734690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.735150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.736162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:53.739473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:53.751711 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3534/7036] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:15:53.756577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:53.770124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d237-f0cb-4bfe-975f-94c608ee758d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:53.794678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:53.795654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:53.795948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:53.796226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] PATH_INFO: `/v3/projects/9a1084241e9346e88852a4c51b878f22/users/612e29973eb948a6b8ee8f17aa2718e7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:53.833822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1084241e9346e88852a4c51b878f22, user_id=612e29973eb948a6b8ee8f17aa2718e7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:53.841465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:53.875983 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3503/7037] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:53 2022] PUT /identity/v3/projects/9a1084241e9346e88852a4c51b878f22/users/612e29973eb948a6b8ee8f17aa2718e7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:53.880579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:53.900054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002a765-a67f-4a26-9127-ca860e3e6fb5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:54.081543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f31c27-876f-43db-b96b-7c488b50ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:54.082251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31c27-876f-43db-b96b-7c488b50ca70 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.082568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31c27-876f-43db-b96b-7c488b50ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.082856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f31c27-876f-43db-b96b-7c488b50ca70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.083609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31c27-876f-43db-b96b-7c488b50ca70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:54.085237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f31c27-876f-43db-b96b-7c488b50ca70 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:54.101194 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3535/7038] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:54.105442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:54.118427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f577-0a9b-42ee-8bf8-e8dd965c5f9a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:54.124040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:54.125208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.125573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.125923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] PATH_INFO: `/v3/projects/9a1084241e9346e88852a4c51b878f22/users/612e29973eb948a6b8ee8f17aa2718e7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.128104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1084241e9346e88852a4c51b878f22, user_id=612e29973eb948a6b8ee8f17aa2718e7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:54.131654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:54.154236 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3504/7039] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:54 2022] PUT /identity/v3/projects/9a1084241e9346e88852a4c51b878f22/users/612e29973eb948a6b8ee8f17aa2718e7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:54.155580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.155881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.156171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.213862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] MFA Rules not processed for user `612e29973eb948a6b8ee8f17aa2718e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:54.217138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:54.364171 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3536/7040] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:54.365870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:54.606205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a278c1-4511-4883-aa3c-142b2a8998b3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:54.625868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:54.626578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.626864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.630667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.631503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:54.633453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:54.710455 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3505/7041] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:54 2022] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:54.712110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:54.733788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d22514-28e8-45f5-bf33-43af7d254dfa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:54.810334 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:54.833676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:54.834715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.835260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.835695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.836591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:54.841164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:54.909768 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3537/7042] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:54 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:54.910466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:54.924791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b02f9-3217-4e36-9fdd-c63adcf9c79d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:54.931042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:54.931773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.932063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.932528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.933263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:54.935045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:54.951222 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3506/7043] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:15:54.952632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:54.963763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103782a1-1955-4bc2-89d5-a4464c75a60a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:54.968866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e406faf-6502-4b67-bc62-f8ec4b733201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:54.969735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406faf-6502-4b67-bc62-f8ec4b733201 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:54.970179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406faf-6502-4b67-bc62-f8ec4b733201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:54.970643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406faf-6502-4b67-bc62-f8ec4b733201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:54.971551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406faf-6502-4b67-bc62-f8ec4b733201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:54.973632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406faf-6502-4b67-bc62-f8ec4b733201 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:54.990761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:54.991432 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3538/7044] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:55.022021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd53b4f-8fc3-4bd7-b2e7-b5d7ee39c12a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:55.041613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:55.042876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:55.051654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:55.051925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] PATH_INFO: `/v3/projects/47e5e42ecf0f4d009d27dd3602d3c9ef/users/e5d1e310d42b4280a564991be1be75e8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:55.094836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e5e42ecf0f4d009d27dd3602d3c9ef, user_id=e5d1e310d42b4280a564991be1be75e8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:55.099507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:55.142589 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3507/7045] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:54 2022] PUT /identity/v3/projects/47e5e42ecf0f4d009d27dd3602d3c9ef/users/e5d1e310d42b4280a564991be1be75e8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:55.144656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cd93-224a-4d0a-9107-9b308b383183 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:55.145023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cd93-224a-4d0a-9107-9b308b383183 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:55.145892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cd93-224a-4d0a-9107-9b308b383183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:55.188161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c899cd93-224a-4d0a-9107-9b308b383183 None None] MFA Rules not processed for user `e5d1e310d42b4280a564991be1be75e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:55.189602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c899cd93-224a-4d0a-9107-9b308b383183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:55.310410 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3539/7046] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:55.331642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:55.333525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:55.341535 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:55.461753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0ab5-a6b8-471f-a92e-e3aeb294567d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:55.467134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:55.468235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:55.468692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:55.469062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:55.555106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:55.559218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:55.583772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:55.584071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:55.584573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:55.610022 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3508/7047] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:55.640595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] MFA Rules not processed for user `ec4c77f30b214db293091ef9b4e1acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:55.642301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:55.782304 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3540/7048] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:55.786702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:55.788211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:55.982129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addacb35-61ac-40aa-8afe-ad52274ec123 service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:55.992366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:55.994444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:55.995173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:55.996199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:55.997515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:56.001505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:56.080102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3509/7049] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:15:55 2022] POST /identity/v3/projects => generated 373 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:56.085053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:56.106331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8949-8619-49e6-ba25-4ed8427cf044 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:56.238608 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:56.276897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:56.280709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:56.281078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:56.281357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:56.282102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:56.284126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:56.349793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3541/7050] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:15:56 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:15:56.355070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:56.377019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8972ac-2ab8-44e4-8594-69a8743cb541 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:56.389486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:56.390231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:56.390650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:56.391031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:56.391876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:56.393660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:56.418033 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3510/7051] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:56.422257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:56.442935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0edd4-446c-45a8-9a65-12d21a06e644 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:56.457418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:56.458709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:56.460365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:56.462225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] PATH_INFO: `/v3/projects/d0afcecbc16b4eb1bb773a65607268dc/users/42d1104aa52d45348066a708bc77628b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:56.499996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0afcecbc16b4eb1bb773a65607268dc, user_id=42d1104aa52d45348066a708bc77628b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:56.505419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:56.524737 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3542/7052] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:56 2022] PUT /identity/v3/projects/d0afcecbc16b4eb1bb773a65607268dc/users/42d1104aa52d45348066a708bc77628b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:56.530043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:56.557206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a7c2-3505-413d-902a-8942d1604ccc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:56.624375 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:56.777050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:56.778073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:56.778577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:56.779007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:56.782219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:56.787446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:56.813130 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3511/7053] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:15:56.817486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:56.836732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4ac78-c2d9-43f3-b905-b644b789f38b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:56.848761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b627aff-eaf4-416b-a426-6d011b8bda97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:56.849673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b627aff-eaf4-416b-a426-6d011b8bda97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:56.849958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b627aff-eaf4-416b-a426-6d011b8bda97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:56.850237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b627aff-eaf4-416b-a426-6d011b8bda97 admin admin] PATH_INFO: `/v3/projects/d0afcecbc16b4eb1bb773a65607268dc/users/42d1104aa52d45348066a708bc77628b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:56.855327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b627aff-eaf4-416b-a426-6d011b8bda97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0afcecbc16b4eb1bb773a65607268dc, user_id=42d1104aa52d45348066a708bc77628b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:56.860919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b627aff-eaf4-416b-a426-6d011b8bda97 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:56.912511 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3543/7054] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:15:56 2022] PUT /identity/v3/projects/d0afcecbc16b4eb1bb773a65607268dc/users/42d1104aa52d45348066a708bc77628b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:57.107522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:57.125839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f707-d0dc-4325-a04b-1b836ca58391 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:57.221607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:57.224818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:57.225327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:57.226017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] PATH_INFO: `/v3/users/612e29973eb948a6b8ee8f17aa2718e7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:57.228310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=612e29973eb948a6b8ee8f17aa2718e7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:57.231952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:57.322254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612e29973eb948a6b8ee8f17aa2718e7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:57.343637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612e29973eb948a6b8ee8f17aa2718e7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:57.355537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612e29973eb948a6b8ee8f17aa2718e7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:57.368750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612e29973eb948a6b8ee8f17aa2718e7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:57.371978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612e29973eb948a6b8ee8f17aa2718e7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:57.396136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3512/7055] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:57 2022] DELETE /identity/v3/users/612e29973eb948a6b8ee8f17aa2718e7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:57.401646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:57.402071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:57.402071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:57.442548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:15:57.443417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:57.541040 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3544/7056] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:15:57.582676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:57.584184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:57.704723 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:57.734192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4893f-aff3-4742-b234-e0cd8a180f1f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:57.745116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:57.746179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:57.746566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:57.746927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:57.780446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:57.785930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:57.827263 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3513/7057] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:15:58.294475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:58.296969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:58.342386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8e1d-57c0-4a49-8058-876c05500805 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:58.366078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:58.367486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:58.368846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:58.369744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] PATH_INFO: `/v3/projects/9a1084241e9346e88852a4c51b878f22` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:58.379360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1084241e9346e88852a4c51b878f22)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:58.382018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:58.520431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1084241e9346e88852a4c51b878f22', 'request_id': 'req-f1d0b485-e135-48b8-8199-d9e4598fee36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.541401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1084241e9346e88852a4c51b878f22', 'request_id': 'req-f1d0b485-e135-48b8-8199-d9e4598fee36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.549060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1084241e9346e88852a4c51b878f22', 'request_id': 'req-f1d0b485-e135-48b8-8199-d9e4598fee36'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.580973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] The token cache is being invalidate because project 9a1084241e9346e88852a4c51b878f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:15:58.581829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.582852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.598014 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3545/7058] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:58 2022] DELETE /identity/v3/projects/9a1084241e9346e88852a4c51b878f22 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:58.601837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:58.613068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9cabd-1470-4673-84f4-d8ec1ef023ab service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:58.769273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:58.770622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:58.771073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:58.771510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] PATH_INFO: `/v3/users/e5d1e310d42b4280a564991be1be75e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:58.773650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d1e310d42b4280a564991be1be75e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:15:58.775555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:15:58.856552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d1e310d42b4280a564991be1be75e8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.887527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d1e310d42b4280a564991be1be75e8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.904155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d1e310d42b4280a564991be1be75e8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.927785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d1e310d42b4280a564991be1be75e8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.928423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d1e310d42b4280a564991be1be75e8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:15:58.948019 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3514/7059] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:15:58 2022] DELETE /identity/v3/users/e5d1e310d42b4280a564991be1be75e8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:15:59.300441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:59.302736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:59.392250 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:15:59.570881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b485-e135-48b8-8199-d9e4598fee36 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:15:59.672868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:15:59.674296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:59.751851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:15:59.754737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:15:59.758003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:15:59.758729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:15:59.765099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:15:59.977050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed24e02-1eec-480c-853b-f90681dcab41 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:00.016578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:00.017104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:00.018221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:00.022992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261fdb9-9eb0-46e6-b45d-430950672d90 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:00.023160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:00.024211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] PATH_INFO: `/v3/projects/47e5e42ecf0f4d009d27dd3602d3c9ef` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:00.027361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e5e42ecf0f4d009d27dd3602d3c9ef)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:00.036799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:00.076335 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:00.146433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3546/7060] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:15:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:16:00.246522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e5e42ecf0f4d009d27dd3602d3c9ef', 'request_id': 'req-6f3638ec-270e-43dc-a592-971188060c47'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:00.254802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e5e42ecf0f4d009d27dd3602d3c9ef', 'request_id': 'req-6f3638ec-270e-43dc-a592-971188060c47'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:00.271686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e5e42ecf0f4d009d27dd3602d3c9ef', 'request_id': 'req-6f3638ec-270e-43dc-a592-971188060c47'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:00.301505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] The token cache is being invalidate because project 47e5e42ecf0f4d009d27dd3602d3c9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:00.302997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:00.314028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f3638ec-270e-43dc-a592-971188060c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:00.320654 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3515/7061] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:15:59 2022] DELETE /identity/v3/projects/47e5e42ecf0f4d009d27dd3602d3c9ef => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:00.324781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:00.325318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:00.326305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:00.367726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:00.373918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:00.514354 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3547/7062] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:00.523411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:00.523707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:00.524661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:00.587578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:00.588944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:00.614914 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3516/7063] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:00.621597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:00.634277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9ebc4-1122-4332-948e-2420fbebdea9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:00.639662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:00.640360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:00.640649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:00.640934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:00.641709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:00.642133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:00.648313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:00.672490 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3548/7064] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:00.673651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:00.687164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f8f0-22de-4e5f-8097-eadbf38c0a97 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:00.703422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:00.704164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:00.704455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:00.704733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:00.705456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:00.707461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:00.778427 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3517/7065] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:00 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:00.779510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:00.795139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d2d8-1086-4319-ab5a-aa80e3c3bb99 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:00.816829 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:00.970522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:00.971302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:00.971782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:00.972145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:00.972858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:00.979537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:01.029180 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3549/7066] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:00 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:01.034525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:01.061018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6466e6-08ea-46cb-aa19-5322419f5c27 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:01.075388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:01.076107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:01.076399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:01.079604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:01.080392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:01.084340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:01.122849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3518/7067] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:01.127448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:01.147048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2a29-f25a-4423-b554-e427f0aff386 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:01.167248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:01.168237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:01.168524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:01.168807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] PATH_INFO: `/v3/projects/da0dbe88b27f4a76ba2e412e0ae744ab/users/03995f5ec35e4f6a98de63a3b1e8f96f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:01.219545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dbe88b27f4a76ba2e412e0ae744ab, user_id=03995f5ec35e4f6a98de63a3b1e8f96f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:01.228031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:01.261673 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3550/7068] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:01 2022] PUT /identity/v3/projects/da0dbe88b27f4a76ba2e412e0ae744ab/users/03995f5ec35e4f6a98de63a3b1e8f96f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:01.265292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:01.281580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddcb5e-5bfc-4041-8468-9012c1f6d6e9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:01.430900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994e05a-fe47-4b31-a87e-3ae7b4ab63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:01.430900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994e05a-fe47-4b31-a87e-3ae7b4ab63af admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:01.430900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994e05a-fe47-4b31-a87e-3ae7b4ab63af admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:01.431343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994e05a-fe47-4b31-a87e-3ae7b4ab63af admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:01.431817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994e05a-fe47-4b31-a87e-3ae7b4ab63af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:01.436005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994e05a-fe47-4b31-a87e-3ae7b4ab63af admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:01.468952 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3519/7069] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:16:01.473937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:01.496162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70055-7428-4a22-8f61-4be4f0fe1ebd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:01.509031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:01.509968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:01.510255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:01.510566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] PATH_INFO: `/v3/projects/da0dbe88b27f4a76ba2e412e0ae744ab/users/03995f5ec35e4f6a98de63a3b1e8f96f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:01.519968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dbe88b27f4a76ba2e412e0ae744ab, user_id=03995f5ec35e4f6a98de63a3b1e8f96f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:01.522683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:01.558433 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3551/7070] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:01 2022] PUT /identity/v3/projects/da0dbe88b27f4a76ba2e412e0ae744ab/users/03995f5ec35e4f6a98de63a3b1e8f96f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:01.568700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:01.568999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:01.569546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:01.656127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] MFA Rules not processed for user `03995f5ec35e4f6a98de63a3b1e8f96f`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:01.657674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:01.771567 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:01.840539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3520/7071] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:01.844250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:02.082055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1907b91-0876-4eb0-8ba5-06505c93eaff admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:02.103193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:02.103921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.104212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.104494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.105321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:02.107454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:02.186886 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3552/7072] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:01 2022] POST /identity/v3/projects => generated 381 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:02.191329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:02.206672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0c6f-2dbe-405e-9296-12ed36fa3fc2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:02.418406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:02.419120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.419408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.419685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.441068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:02.443121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:02.494251 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3521/7073] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:02 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:02.495678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:02.515734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f054-d14d-4a9c-b140-dcb5782d067f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:02.546677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:02.547604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.547965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.549516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.551201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:02.552882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:02.583216 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3553/7074] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:02.587112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:02.608748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a48785-3344-4c83-84fc-d31175d28851 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:02.625035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:02.626198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.631937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.633214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.635651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:02.639125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:02.687634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:02.690177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3522/7075] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:02.702477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:02.706673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:02.713520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef261949-74f5-44f2-baf9-2042818233b3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:02.745595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f53f6-3bb3-4b45-bae2-327ffca44045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:02.746752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f53f6-3bb3-4b45-bae2-327ffca44045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.747200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f53f6-3bb3-4b45-bae2-327ffca44045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.747927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f53f6-3bb3-4b45-bae2-327ffca44045 admin admin] PATH_INFO: `/v3/projects/750faf3ee9f0417fb87ad6b933396db4/users/d224ccc3da384927b360afbfb4cc5a69/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.770040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849a1b8-0609-4685-9d1e-ba67abfd95b5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:02.789897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:02.790819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.791107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.791384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] PATH_INFO: `/v3/users/87be873dd7d6441d84380b227ec4f034` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.792591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f53f6-3bb3-4b45-bae2-327ffca44045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750faf3ee9f0417fb87ad6b933396db4, user_id=d224ccc3da384927b360afbfb4cc5a69, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:02.793446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87be873dd7d6441d84380b227ec4f034)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:02.795332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f53f6-3bb3-4b45-bae2-327ffca44045 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:02.803229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:02.852310 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3554/7076] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:02 2022] PUT /identity/v3/projects/750faf3ee9f0417fb87ad6b933396db4/users/d224ccc3da384927b360afbfb4cc5a69/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:02.864875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:02.865419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:02.865904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:02.943177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87be873dd7d6441d84380b227ec4f034'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:02.949057 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:02.974253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] MFA Rules not processed for user `d224ccc3da384927b360afbfb4cc5a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:02.978935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87be873dd7d6441d84380b227ec4f034'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:02.984146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:03.000070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87be873dd7d6441d84380b227ec4f034'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:03.017642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87be873dd7d6441d84380b227ec4f034'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:03.021886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87be873dd7d6441d84380b227ec4f034'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:03.029242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3523/7077] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:02 2022] DELETE /identity/v3/users/87be873dd7d6441d84380b227ec4f034 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:03.170025 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3555/7078] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:16:03.178634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:03.180155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:03.329858 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:03.430026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455222a-13a2-4523-a7f9-6725cb42a880 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:03.441267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:03.442977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:03.443425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:03.443854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:03.447967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:03.649677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:03.654099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:03.716467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3524/7079] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:03.867740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:03.869895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:03.901234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:03.903345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:04.019354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746a388-1e37-4891-98d3-356cf357ba50 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:04.149425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37783a-7fc0-41c4-804e-76ab22acdbf5 service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:04.170981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:04.176203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.176520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.176805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] PATH_INFO: `/v3/projects/1c1544cf38cc455a923bb68928439743` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.179255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1544cf38cc455a923bb68928439743)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:04.181264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:04.212846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:04.213524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.213811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.214101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.217671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:04.256017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:04.257482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b8ad-a462-426f-83ec-4578a6da0d23 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:04.276832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1544cf38cc455a923bb68928439743', 'request_id': 'req-eed57436-2fbd-410e-b6be-800d54774166'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:04.285003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1544cf38cc455a923bb68928439743', 'request_id': 'req-eed57436-2fbd-410e-b6be-800d54774166'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:04.286251 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3556/7080] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:04.297762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1544cf38cc455a923bb68928439743', 'request_id': 'req-eed57436-2fbd-410e-b6be-800d54774166'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:04.317741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] The token cache is being invalidate because project 1c1544cf38cc455a923bb68928439743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:04.318046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:04.318752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:04.322857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3525/7081] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:03 2022] DELETE /identity/v3/projects/1c1544cf38cc455a923bb68928439743 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:04.326370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227ef0-a058-4636-9481-10d9bfbac6ca None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.326733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227ef0-a058-4636-9481-10d9bfbac6ca None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.327015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227ef0-a058-4636-9481-10d9bfbac6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.352959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:04.354625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:04.363839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-68227ef0-a058-4636-9481-10d9bfbac6ca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:04.365149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68227ef0-a058-4636-9481-10d9bfbac6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:04.370408 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:04.485873 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:04.490722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57436-2fbd-410e-b6be-800d54774166 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:04.510301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:04.511003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.511288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.511565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.512273 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3557/7082] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:04.517924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.518218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.519064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.521986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:04.583654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:04.585979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:04.587444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:04.587715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:04.612341 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3526/7083] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:16:04.630330 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3558/7084] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:04.632281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:04.648295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec388-2eb8-4d29-a019-c8716c4bec60 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:04.672600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:04.672600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.672600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.672600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.673060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:04.675871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:04.677787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:04.722664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:04.723436 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3527/7085] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:04.734368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5ec80-807c-481b-ba17-409392563f60 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:04.754738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:04.755632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:04.756103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:04.756735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:04.757634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:04.759925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:04.837406 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3559/7086] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:04 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:16:04.841992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:04.888082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b841a-6ba1-4b91-b3b8-32d65c46a90b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:04.963267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:04.969407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:05.127617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:05.132459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.133675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.133982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.135952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:05.142732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:05.223819 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3528/7087] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:04 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:05.226985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:05.234207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a930-4de0-4b6e-b2f9-e43dadac7d51 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:05.235427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:05.249611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:05.251618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.251920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.252206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] PATH_INFO: `/v3/users/03995f5ec35e4f6a98de63a3b1e8f96f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.255093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03995f5ec35e4f6a98de63a3b1e8f96f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:05.262900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:05.376999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03995f5ec35e4f6a98de63a3b1e8f96f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:05.377799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03995f5ec35e4f6a98de63a3b1e8f96f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:05.405272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03995f5ec35e4f6a98de63a3b1e8f96f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:05.406309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03995f5ec35e4f6a98de63a3b1e8f96f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:05.412592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7662-9077-44ce-a613-2fbf417a5be2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:05.420622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03995f5ec35e4f6a98de63a3b1e8f96f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:05.427354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:05.428702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.429000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.429416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.432041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:05.444572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3560/7088] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:04 2022] DELETE /identity/v3/users/03995f5ec35e4f6a98de63a3b1e8f96f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:05.445522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:05.451399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:05.483870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:05.485395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35954a-c2aa-4940-9370-5166dfb9946b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:05.510952 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3529/7089] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:05.513477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.513813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.514103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.557478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:05.558804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:05.596179 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:05.614086 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:05.657562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef4d7-06cf-4751-9114-9614246de3b3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:05.669843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:05.670758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.670879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.671159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.671940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:05.674591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:05.701388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3561/7090] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:05.702782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:05.718209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c0b1-7d0d-49f2-a882-c949494b0695 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:05.728597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3530/7091] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:05.735899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296804-deed-4de4-a957-c7ce5bd7eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:05.736587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296804-deed-4de4-a957-c7ce5bd7eee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.736935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296804-deed-4de4-a957-c7ce5bd7eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.737351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296804-deed-4de4-a957-c7ce5bd7eee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.738096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85296804-deed-4de4-a957-c7ce5bd7eee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:05.739743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85296804-deed-4de4-a957-c7ce5bd7eee4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:05.772184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3562/7092] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:16:05.778043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:05.790697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368ee6-afdc-4b7f-a935-a8469b178c13 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:05.806858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:05.807788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.808081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.809015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] PATH_INFO: `/v3/projects/22b32c130d2547519149383827ed1c4c/users/3a10dc703c4d442ea62abfddf18cf507/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.844941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b32c130d2547519149383827ed1c4c, user_id=3a10dc703c4d442ea62abfddf18cf507, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:05.849496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:05.913139 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3531/7093] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:05 2022] PUT /identity/v3/projects/22b32c130d2547519149383827ed1c4c/users/3a10dc703c4d442ea62abfddf18cf507/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:05.923853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:05.924582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:05.925110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:05.998188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:05.999971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:06.040306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:06.042884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:06.235729 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3563/7094] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:06.263900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1912b8-93a9-4c9e-987a-280501d6ce5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:06.269640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:06.282163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f658b1-a2c9-4dca-b8c8-9a05156ab153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:06.283125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f658b1-a2c9-4dca-b8c8-9a05156ab153 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:06.283276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f658b1-a2c9-4dca-b8c8-9a05156ab153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:06.283561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f658b1-a2c9-4dca-b8c8-9a05156ab153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:06.292048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fa02d-a4fb-42e4-82ff-5233c19f68ff None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:06.306249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500cc2d-1a1a-4bb7-b67d-d680f5f9e7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:06.306593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500cc2d-1a1a-4bb7-b67d-d680f5f9e7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:06.306831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500cc2d-1a1a-4bb7-b67d-d680f5f9e7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:06.307113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500cc2d-1a1a-4bb7-b67d-d680f5f9e7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:06.340024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f658b1-a2c9-4dca-b8c8-9a05156ab153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:06.343323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f658b1-a2c9-4dca-b8c8-9a05156ab153 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:06.354888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500cc2d-1a1a-4bb7-b67d-d680f5f9e7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:06.356580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500cc2d-1a1a-4bb7-b67d-d680f5f9e7e2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:06.386022 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3532/7095] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:16:06.387736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a356299-f499-44ae-99f0-3b619bdc5216 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:06.388030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a356299-f499-44ae-99f0-3b619bdc5216 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:06.388310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a356299-f499-44ae-99f0-3b619bdc5216 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:06.388878 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3564/7096] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:06.389699 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3533/7097] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:16:06.395615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:06.396067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:06.396455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:06.497722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:06.499238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:06.707750 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3565/7098] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:16:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:06.739858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a356299-f499-44ae-99f0-3b619bdc5216 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:06.742015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7a356299-f499-44ae-99f0-3b619bdc5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:06.788318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a356299-f499-44ae-99f0-3b619bdc5216 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:06.800016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:06.800741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:06.801022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:06.801496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:06.833445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:06.839768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:06.876219 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3534/7099] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:07.404102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:07.442012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d5c5f-ca0b-451a-bd19-022810e9002d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:07.453368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:07.454883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:07.455902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:07.456723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:07.461612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:07.544172 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:07.595554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:07.598377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:07.617965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3566/7100] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:10.084119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:10.088044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:10.113565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ed53-b61d-45d2-a9f7-a2357f9dd50e service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:10.126828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:10.128329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:10.128550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:10.129176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] PATH_INFO: `/v3/projects/da0dbe88b27f4a76ba2e412e0ae744ab` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:10.131973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0dbe88b27f4a76ba2e412e0ae744ab)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:10.136535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:10.324881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0dbe88b27f4a76ba2e412e0ae744ab', 'request_id': 'req-924210e8-2c56-4f4e-8b17-b28c8a37e465'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.337878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0dbe88b27f4a76ba2e412e0ae744ab', 'request_id': 'req-924210e8-2c56-4f4e-8b17-b28c8a37e465'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.370831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0dbe88b27f4a76ba2e412e0ae744ab', 'request_id': 'req-924210e8-2c56-4f4e-8b17-b28c8a37e465'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.402383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] The token cache is being invalidate because project da0dbe88b27f4a76ba2e412e0ae744ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:10.407349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.408123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-924210e8-2c56-4f4e-8b17-b28c8a37e465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.411321 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3535/7101] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:10 2022] DELETE /identity/v3/projects/da0dbe88b27f4a76ba2e412e0ae744ab => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:10.415356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:10.433743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c9418-5760-4028-9639-c5323467924e service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:10.591682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:10.592891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:10.595635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:10.596171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] PATH_INFO: `/v3/users/d224ccc3da384927b360afbfb4cc5a69` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:10.598389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d224ccc3da384927b360afbfb4cc5a69)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:10.606660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:10.755352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd224ccc3da384927b360afbfb4cc5a69'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.756278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd224ccc3da384927b360afbfb4cc5a69'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.787271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd224ccc3da384927b360afbfb4cc5a69'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.788263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd224ccc3da384927b360afbfb4cc5a69'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.804171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd224ccc3da384927b360afbfb4cc5a69'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:10.841344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3567/7102] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:10 2022] DELETE /identity/v3/users/d224ccc3da384927b360afbfb4cc5a69 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:12.886457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:12.887453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:12.887962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:12.905797 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:12.950948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] MFA Rules not processed for user `42d1104aa52d45348066a708bc77628b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:12.952886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:13.017833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:13.019654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:13.125093 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:13.147414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3536/7103] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:13.164983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72234df-ae57-43d4-bbbd-dfbe173f83a9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:13.166349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:13.168200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:13.178719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:13.179945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:13.180217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:13.180498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] PATH_INFO: `/v3/projects/750faf3ee9f0417fb87ad6b933396db4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:13.184193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750faf3ee9f0417fb87ad6b933396db4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:13.190183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:13.346024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750faf3ee9f0417fb87ad6b933396db4', 'request_id': 'req-e867f249-2402-4453-9b83-5f3eb02192e6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:13.364411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750faf3ee9f0417fb87ad6b933396db4', 'request_id': 'req-e867f249-2402-4453-9b83-5f3eb02192e6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:13.372630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750faf3ee9f0417fb87ad6b933396db4', 'request_id': 'req-e867f249-2402-4453-9b83-5f3eb02192e6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:13.389191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a49a-63de-40ba-bbef-0da177b7b5fc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:13.407939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] The token cache is being invalidate because project 750faf3ee9f0417fb87ad6b933396db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:13.408681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:13.409117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e867f249-2402-4453-9b83-5f3eb02192e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:13.417298 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3568/7104] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:13 2022] DELETE /identity/v3/projects/750faf3ee9f0417fb87ad6b933396db4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:13.421856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fdd8f-3792-435f-8dca-50b3f99ed9f3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:13.422619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fdd8f-3792-435f-8dca-50b3f99ed9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:13.424216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fdd8f-3792-435f-8dca-50b3f99ed9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:13.463139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-526fdd8f-3792-435f-8dca-50b3f99ed9f3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:13.464687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-526fdd8f-3792-435f-8dca-50b3f99ed9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:13.557187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:13.557958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:13.558625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:13.559027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:13.561750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:13.612272 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3569/7105] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:13.621114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:13.625182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:13.625763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:13.676515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:13.678659 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:13.681810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:13.745023 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3570/7106] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:13.749294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:13.798283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b789a2-e11e-4be6-94f0-d4d7ca30277f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:13.827778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:13.832132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:13.832424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:13.832699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:13.833446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:13.833753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:13.835408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:13.855944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:13.857602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:13.878025 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3571/7107] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:13.882310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:13.887595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3537/7108] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:13.923578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008dcc7-6366-42c7-8674-b4ed481ef213 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:13.938899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:13.940076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:13.940665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:13.940665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:13.941897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:13.954987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:14.038545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3572/7109] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:13 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:14.040932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:14.060809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12d74-e94b-400e-b82b-f65208adce95 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:14.258830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:14.259797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:14.260237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:14.260669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:14.261658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:14.265841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:14.345190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3538/7110] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:14 2022] POST /identity/v3/users => generated 300 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:14.345889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:14.372107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9268ce-cf8f-4072-86b7-59940a47b34f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:14.401416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:14.405895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:14.410671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:14.411534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:14.415462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:14.421834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:14.441200 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3573/7111] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:14.445858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:14.460275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd125-f3b8-4a7c-9591-71e39947a2dc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:14.467460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3f445-310b-4dfd-b358-dea5c1e0ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:14.468855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3f445-310b-4dfd-b358-dea5c1e0ac42 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:14.469290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3f445-310b-4dfd-b358-dea5c1e0ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:14.469711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3f445-310b-4dfd-b358-dea5c1e0ac42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:14.471940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3f445-310b-4dfd-b358-dea5c1e0ac42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:14.473727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3f445-310b-4dfd-b358-dea5c1e0ac42 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:14.487883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3539/7112] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:14.492001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:14.516672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baae1f-8c5c-4df6-b1cf-77b7a862f94f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:14.529488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:14.532547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:14.533023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:14.534074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] PATH_INFO: `/v3/projects/a2ea2799ec964c48aee9a5bcbce71204/users/fb90fa7d9ed24d20875c6c831277dedd/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:14.581187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ea2799ec964c48aee9a5bcbce71204, user_id=fb90fa7d9ed24d20875c6c831277dedd, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:14.589652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:14.598805 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:14.631845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3574/7113] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:14 2022] PUT /identity/v3/projects/a2ea2799ec964c48aee9a5bcbce71204/users/fb90fa7d9ed24d20875c6c831277dedd/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:14.642163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:14.642458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:14.643333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:14.741707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] MFA Rules not processed for user `fb90fa7d9ed24d20875c6c831277dedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:14.743028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:14.905824 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3540/7114] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:14.910242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:15.119960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe8e2-1a2a-4e01-9826-e7ccd44de2cc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:15.129948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:15.130716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:15.131000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:15.131274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:15.132752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:15.134849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:15.212088 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3575/7115] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:14 2022] POST /identity/v3/projects => generated 399 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:15.219324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:15.255611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f18608-63b8-438c-9c59-d820edd2f128 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:15.428966 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:15.576198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:15.577678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:15.577678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:15.577678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:15.578240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:15.583199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:15.634300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3541/7116] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:15 2022] POST /identity/v3/users => generated 306 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:15.635431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:15.657428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d665415-32ae-48bb-902d-8bfc5e7fd8d1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:15.693320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:15.698700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:15.698834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:15.699099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:15.700437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:15.711082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:15.770401 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3576/7117] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:15.772877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:15.787536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2024c99-25f9-470c-b919-f9de9b7c9c4c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:15.798897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:15.802356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:15.802674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:15.802978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] PATH_INFO: `/v3/projects/78d9e5c380454346b9da16777700a45f/users/33dd20f6a18b4d84b5d1f54aeeaf2a03/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:15.850477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d9e5c380454346b9da16777700a45f, user_id=33dd20f6a18b4d84b5d1f54aeeaf2a03, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:15.856692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:15.897712 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3542/7118] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:15 2022] PUT /identity/v3/projects/78d9e5c380454346b9da16777700a45f/users/33dd20f6a18b4d84b5d1f54aeeaf2a03/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:15.901774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:15.918606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e34d1d-653b-45e9-8bfd-e900704e6d12 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:16.058689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b53a6-cd78-4fea-a328-9f587b730740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:16.059394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b53a6-cd78-4fea-a328-9f587b730740 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:16.059721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b53a6-cd78-4fea-a328-9f587b730740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:16.060004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b53a6-cd78-4fea-a328-9f587b730740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:16.061253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b53a6-cd78-4fea-a328-9f587b730740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:16.066160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b53a6-cd78-4fea-a328-9f587b730740 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:16.101463 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3577/7119] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:16.102749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:16.118203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee5b60-1b80-4188-9b76-9c992c2ba1ee admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:16.137719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:16.139022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:16.140395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:16.141132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] PATH_INFO: `/v3/projects/78d9e5c380454346b9da16777700a45f/users/33dd20f6a18b4d84b5d1f54aeeaf2a03/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:16.143921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d9e5c380454346b9da16777700a45f, user_id=33dd20f6a18b4d84b5d1f54aeeaf2a03, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:16.151667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:16.167845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3543/7120] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:16 2022] PUT /identity/v3/projects/78d9e5c380454346b9da16777700a45f/users/33dd20f6a18b4d84b5d1f54aeeaf2a03/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:16.191195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3a52-a06c-4763-adea-85508dad419d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:16.191764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3a52-a06c-4763-adea-85508dad419d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:16.191764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3a52-a06c-4763-adea-85508dad419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:16.276631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-033d3a52-a06c-4763-adea-85508dad419d None None] MFA Rules not processed for user `33dd20f6a18b4d84b5d1f54aeeaf2a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:16.277821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-033d3a52-a06c-4763-adea-85508dad419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:16.401462 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:16.452604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3578/7121] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:16.477997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:16.480701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:16.682222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b1b9-cd75-4d97-bc5b-73b575ee8a5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:16.700225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:16.701840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:16.704465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:16.706003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:16.918429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:16.923492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:16.962835 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3544/7122] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:18.454066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3a52-a06c-4763-adea-85508dad419d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:18.456872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-033d3a52-a06c-4763-adea-85508dad419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:18.719652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3a52-a06c-4763-adea-85508dad419d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:18.756497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:18.758125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:18.784218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:18.785278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:18.785430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:18.804580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] PATH_INFO: `/v3/users/62868be01f8e41f7b473831fe3b7a396` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:18.813964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=62868be01f8e41f7b473831fe3b7a396)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:18.824869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:18.925388 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:18.967401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54961904-fce9-4eb8-a326-ee1e9a26f99d service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:18.974735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50da73-0740-4fd6-af92-09d7e0cfe297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:18.976008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50da73-0740-4fd6-af92-09d7e0cfe297 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:18.976640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50da73-0740-4fd6-af92-09d7e0cfe297 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:18.977425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50da73-0740-4fd6-af92-09d7e0cfe297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:18.990898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50da73-0740-4fd6-af92-09d7e0cfe297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:18.996690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50da73-0740-4fd6-af92-09d7e0cfe297 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:19.014414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62868be01f8e41f7b473831fe3b7a396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:19.015610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62868be01f8e41f7b473831fe3b7a396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:19.036799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3545/7123] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:19.040342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:19.040756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:19.042448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:19.068611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62868be01f8e41f7b473831fe3b7a396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:19.074732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62868be01f8e41f7b473831fe3b7a396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:19.085358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-551fe1af-fcea-4e59-8fd5-41b29e72adbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62868be01f8e41f7b473831fe3b7a396'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:19.109189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] MFA Rules not processed for user `ec4c77f30b214db293091ef9b4e1acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:19.110874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:19.122402 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3579/7124] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:18 2022] DELETE /identity/v3/users/62868be01f8e41f7b473831fe3b7a396 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:19.124587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:19.125173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:19.125898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:19.184711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:19.184711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:19.292772 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3546/7125] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:19.337561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3580/7126] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:19.406241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:19.408112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:19.440326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515659bc-ec8e-4452-a765-a841d870cc9c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:19.574709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:19.575706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:19.576172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:19.576598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:19.603410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:19.605169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:19.636496 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3547/7127] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:20.685898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:20.715226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588065-afc6-4433-8eae-aba5bf1aceec None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:20.724253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:20.724932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:20.725323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:20.725498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:20.727524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:20.737766 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:20.752990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:20.753983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:20.785822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3581/7128] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:21.752087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:21.754425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:21.785640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf028b-5c78-4665-94a4-92b543a24ee2 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:21.810311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:21.811434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:21.811905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:21.812357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] PATH_INFO: `/v3/projects/3e2e64f940a648788b4ea09c87b0295b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:21.813649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2e64f940a648788b4ea09c87b0295b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:21.815905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:21.918359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2e64f940a648788b4ea09c87b0295b', 'request_id': 'req-19cde15c-41f2-4384-99d0-57816fcbac16'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:21.927408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2e64f940a648788b4ea09c87b0295b', 'request_id': 'req-19cde15c-41f2-4384-99d0-57816fcbac16'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:21.937034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2e64f940a648788b4ea09c87b0295b', 'request_id': 'req-19cde15c-41f2-4384-99d0-57816fcbac16'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:21.968893 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:21.977022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] The token cache is being invalidate because project 3e2e64f940a648788b4ea09c87b0295b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:21.977709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:21.978615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19cde15c-41f2-4384-99d0-57816fcbac16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:21.980921 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3548/7129] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:21 2022] DELETE /identity/v3/projects/3e2e64f940a648788b4ea09c87b0295b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:21.987158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:22.006637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b32c9-0aaa-4df4-892a-cfd3e8a1fa7b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:22.238537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:22.240084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:22.240616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:22.241120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] PATH_INFO: `/v3/users/00d7e34beca74f09a56a037b5c656685` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:22.244533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d7e34beca74f09a56a037b5c656685)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:22.249392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:22.372523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d7e34beca74f09a56a037b5c656685'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:22.373674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d7e34beca74f09a56a037b5c656685'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:22.401515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d7e34beca74f09a56a037b5c656685'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:22.403036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d7e34beca74f09a56a037b5c656685'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:22.418867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d7e34beca74f09a56a037b5c656685'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:22.451381 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3582/7130] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:21 2022] DELETE /identity/v3/users/00d7e34beca74f09a56a037b5c656685 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:23.776335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:23.777119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:23.777801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:23.825303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] MFA Rules not processed for user `3a10dc703c4d442ea62abfddf18cf507`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:23.827399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:23.974466 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3549/7131] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:23.989479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:23.996621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:24.201002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca36c5-2b43-452b-b8ac-15680af21f23 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:24.214428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4089-bff8-44c2-99c7-a71dcfb4f0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:24.215397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4089-bff8-44c2-99c7-a71dcfb4f0cc service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:24.215855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4089-bff8-44c2-99c7-a71dcfb4f0cc service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:24.216212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4089-bff8-44c2-99c7-a71dcfb4f0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:24.234539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4089-bff8-44c2-99c7-a71dcfb4f0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:24.237970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4089-bff8-44c2-99c7-a71dcfb4f0cc service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:24.252408 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:24.265237 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3583/7132] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:25.059734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:25.061718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:25.216223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7ca8-c434-42f5-975a-956f974dd923 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:25.222272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:25.223571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:25.223999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:25.224286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] PATH_INFO: `/v3/projects/6bbfe8e4b51741709833b4afda4b6afe` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:25.246266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbfe8e4b51741709833b4afda4b6afe)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:25.249625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:25.348734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbfe8e4b51741709833b4afda4b6afe', 'request_id': 'req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:25.357887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbfe8e4b51741709833b4afda4b6afe', 'request_id': 'req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:25.378793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbfe8e4b51741709833b4afda4b6afe', 'request_id': 'req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:25.401019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] The token cache is being invalidate because project 6bbfe8e4b51741709833b4afda4b6afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:25.401882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:25.402904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8be4e047-a71f-4e8c-9af4-a9c2e1db9a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:25.410419 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3550/7133] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:25 2022] DELETE /identity/v3/projects/6bbfe8e4b51741709833b4afda4b6afe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:25.411793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:25.412300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:25.412403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:25.463370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:25.464662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:25.614430 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3584/7134] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:25.622455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:25.622785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:25.623067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:25.681455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:25.687579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:25.711070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:25.716196 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3551/7135] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:25.737193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f90c8b-abc2-460b-b184-c779d154f630 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:25.742723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:25.743420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:25.743710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:25.743992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:25.744731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:25.745346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:25.747195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:25.787558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:25.795163 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3585/7136] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:25.802173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4ddeb-6787-45db-9c1c-702adcf9cb8a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:25.822662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:25.824957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:25.825402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:25.825832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:25.826750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:25.829018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:25.853122 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:25.897824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:25.906994 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3552/7137] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:25 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:25.913381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29987c98-a972-4bdd-8814-6cfa7fef1092 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:26.049851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:26.050641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.051175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.051500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.052850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:26.057565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:26.102297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:26.102890 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3586/7138] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:25 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:16:26.122189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5898-6a59-45f9-99fa-bb44f4f47846 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:26.135272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:26.136025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.136364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.136682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.137500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:26.141950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:26.179430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:26.188833 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3553/7139] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:26.195704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984f641-e17c-448f-8af5-f9c038253ae6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:26.206858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78423d32-a72a-4a90-b527-cbd8395dea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:26.210015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78423d32-a72a-4a90-b527-cbd8395dea38 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.210557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78423d32-a72a-4a90-b527-cbd8395dea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.211094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78423d32-a72a-4a90-b527-cbd8395dea38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.213308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78423d32-a72a-4a90-b527-cbd8395dea38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:26.216419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78423d32-a72a-4a90-b527-cbd8395dea38 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:26.274666 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3587/7140] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:26.276743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:26.290762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d45e9-d700-4ca8-83b9-1758c33d8738 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:26.297514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:26.299303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.299607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.299895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] PATH_INFO: `/v3/projects/436b5dbc04d14639bf282be15f5b76f2/users/c65e8f152e854e2089c43020e660c0ac/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.336965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436b5dbc04d14639bf282be15f5b76f2, user_id=c65e8f152e854e2089c43020e660c0ac, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:26.346472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:26.385768 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3554/7141] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:26 2022] PUT /identity/v3/projects/436b5dbc04d14639bf282be15f5b76f2/users/c65e8f152e854e2089c43020e660c0ac/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:26.387643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.387944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.388232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.448199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] MFA Rules not processed for user `c65e8f152e854e2089c43020e660c0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:26.449877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:26.622419 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:26.696947 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3588/7142] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:26.715727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:26.931922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feb612-bf59-4fa7-bf21-2de88303ca17 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:26.943754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:26.944988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:26.947042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:26.947538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:26.954522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:26.956677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:26.996135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:26.998066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:27.020728 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3555/7143] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:26 2022] POST /identity/v3/projects => generated 383 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:27.021970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:27.120149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b0874-811a-46bd-9040-4e796ff3ea1d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:27.127186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:27.127940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.128239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.128518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.129455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:27.131512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:27.184661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17781abe-6e93-4fb7-a956-312cb29974dd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:27.211582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3556/7144] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:27 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:27.215160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:27.228854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee9c88-f4ad-4527-8f5e-ab8839c2402e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:27.235028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:27.235839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.236242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.236600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.238033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:27.239814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:27.253425 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3557/7145] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:16:27.257489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:27.320992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:27.321215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.321421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.321701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.323495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ade23-11e4-4934-8c22-2ed6dedafa72 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:27.323630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:27.341502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:27.342824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.343388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.343855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] PATH_INFO: `/v3/projects/1d540e30342446de969a0557ac238d13/users/7b49f304fea54d83913ca1350d96559b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.347590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:27.349191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:27.367681 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3589/7146] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:27.369855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d540e30342446de969a0557ac238d13, user_id=7b49f304fea54d83913ca1350d96559b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:27.372920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:27.376084 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:27.393239 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3558/7147] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:27 2022] PUT /identity/v3/projects/1d540e30342446de969a0557ac238d13/users/7b49f304fea54d83913ca1350d96559b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:27.396794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:27.418185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20adb8-3f5c-4476-98de-8329cf01440a service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:27.565848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b8d2-bc12-4b5e-b5c1-be29436a3995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:27.567169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b8d2-bc12-4b5e-b5c1-be29436a3995 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.567455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b8d2-bc12-4b5e-b5c1-be29436a3995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.568095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b8d2-bc12-4b5e-b5c1-be29436a3995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.569596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b8d2-bc12-4b5e-b5c1-be29436a3995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:27.571894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b8d2-bc12-4b5e-b5c1-be29436a3995 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:27.600581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3590/7148] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:27.604688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:27.619071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9176-f6fa-4311-9a23-3ddeb16cd678 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:27.624129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:27.625334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.625628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.625911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] PATH_INFO: `/v3/projects/1d540e30342446de969a0557ac238d13/users/7b49f304fea54d83913ca1350d96559b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.628774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d540e30342446de969a0557ac238d13, user_id=7b49f304fea54d83913ca1350d96559b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:27.631610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:27.645996 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3559/7149] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:27 2022] PUT /identity/v3/projects/1d540e30342446de969a0557ac238d13/users/7b49f304fea54d83913ca1350d96559b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:27.656550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:27.656847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:27.657140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:27.715036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] MFA Rules not processed for user `7b49f304fea54d83913ca1350d96559b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:27.716919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:27.786097 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:27.838585 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3591/7150] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:27.851947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:27.873411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:28.012919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdbc7-5f5f-468b-ace6-ea848711749d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:28.018522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:28.019441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:28.019888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:28.020353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:28.034743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:28.037512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:28.061541 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3560/7151] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:28.228326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:28.231595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:28.273597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58caf-950d-4d82-81d2-0ecb21be04e4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:28.281869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:28.282952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:28.283399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:28.284507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:28.369553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:28.372907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:28.390385 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3592/7152] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:28.559275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:28.561911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:28.719312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2516dd1-2886-48dd-b823-da8a5ce4f5bf service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:28.739826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:28.741694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:28.742001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:28.742447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:28.746123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:28.761650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:28.763817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:28.777022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:28.782826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:28.830451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3561/7153] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:28.886768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb135-cf68-4fb5-99ea-6d4871f272f8 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:28.894415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:28.895875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:28.896418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:28.896890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] PATH_INFO: `/v3/users/9ae8e53c8bcf4431921032191395bf86` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:28.898428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae8e53c8bcf4431921032191395bf86)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:28.900662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:28.982432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae8e53c8bcf4431921032191395bf86'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:28.982432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae8e53c8bcf4431921032191395bf86'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.001745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae8e53c8bcf4431921032191395bf86'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.003114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae8e53c8bcf4431921032191395bf86'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.014692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae8e53c8bcf4431921032191395bf86'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.019102 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:29.042246 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3593/7154] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:28 2022] DELETE /identity/v3/users/9ae8e53c8bcf4431921032191395bf86 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:29.238051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:29.239711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:29.397413 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:29.437306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9074-093c-46d5-af3e-f83ccc2050f7 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:29.558787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:29.560338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:29.662812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:29.669874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:29.670373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:29.672514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:29.677470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:29.708810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5684559-b06b-407a-a3c5-7cf07d4eb655 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:29.714963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:29.717722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458056d1-0bca-4f77-8de7-b74e1546e326 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:29.726642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:29.727617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:29.728229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:29.728510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] PATH_INFO: `/v3/projects/d108eeb608e8482bb2aae392ebc04f5e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:29.731864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d108eeb608e8482bb2aae392ebc04f5e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:29.733817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:29.758557 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3562/7155] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:29.837440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd108eeb608e8482bb2aae392ebc04f5e', 'request_id': 'req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.866383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd108eeb608e8482bb2aae392ebc04f5e', 'request_id': 'req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.884320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd108eeb608e8482bb2aae392ebc04f5e', 'request_id': 'req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.915526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] The token cache is being invalidate because project d108eeb608e8482bb2aae392ebc04f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:29.916824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.917877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:29.920563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3594/7156] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:29 2022] DELETE /identity/v3/projects/d108eeb608e8482bb2aae392ebc04f5e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:29.926577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149482a5-4faf-4ff5-a5cf-543cd7129240 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:29.926882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149482a5-4faf-4ff5-a5cf-543cd7129240 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:29.927172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149482a5-4faf-4ff5-a5cf-543cd7129240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:29.953097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-149482a5-4faf-4ff5-a5cf-543cd7129240 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:29.955797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-149482a5-4faf-4ff5-a5cf-543cd7129240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:30.039266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.040941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:30.080447 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3563/7157] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:30.089343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.090215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.090689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.134140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:30.136075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:30.137156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7f4d-a659-4c36-9e88-5a1722f0a98d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.141607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.142600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.142743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.143024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.145302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:30.152203 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3564/7158] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:30.156631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.164808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.166620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.178635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9bddd-e16e-47bb-9091-61065e30929e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.184302 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3595/7159] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:30.184631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.185735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.186030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.186310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.187408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:30.187726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.189934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.211858 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3565/7160] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:16:30.215949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.239724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87e014-29f8-478a-aa1e-71b6965c7a99 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.245645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2b244-40db-4e9c-912c-c21ecb783fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.246141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2b244-40db-4e9c-912c-c21ecb783fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.246514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2b244-40db-4e9c-912c-c21ecb783fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.246706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2b244-40db-4e9c-912c-c21ecb783fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.247422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2b244-40db-4e9c-912c-c21ecb783fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.249349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2b244-40db-4e9c-912c-c21ecb783fdb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.322292 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3596/7161] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:30 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:30.323507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.351552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.352730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.353174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.373224 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:30.374114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79efbbf-a0cf-4fe4-a158-a61750b84451 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.393568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] MFA Rules not processed for user `3a10dc703c4d442ea62abfddf18cf507`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:30.396108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:30.465082 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3597/7162] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:16:30.474923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.475614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.475902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.476184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.476967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.478811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.491527 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:30.510897 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3566/7163] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:30 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:30.513275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.525781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b0bf9-076c-4826-a698-f161d8436e72 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.533706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.535018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.547631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.548136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.550289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.552204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.585721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.585912 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3598/7164] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:30.598476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e521ff7-5a59-44ce-8c60-881eb52ffa0b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.612506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcce884-9d25-40aa-a710-6212501b66c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.614232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce884-9d25-40aa-a710-6212501b66c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.615607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce884-9d25-40aa-a710-6212501b66c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.616055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce884-9d25-40aa-a710-6212501b66c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.617123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcce884-9d25-40aa-a710-6212501b66c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.619836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcce884-9d25-40aa-a710-6212501b66c1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.653092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3567/7165] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:16:30.659948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.679692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1c991-f040-4c3c-b011-acfdbb980024 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:30.684863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:30.686059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.686447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.686883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] PATH_INFO: `/v3/projects/80340c48c45c4786a8ff67dd9efe0378/users/80acce1f0dc8425ba08b902b946d593e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.707783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80340c48c45c4786a8ff67dd9efe0378, user_id=80acce1f0dc8425ba08b902b946d593e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:30.714105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:30.746236 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3599/7166] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:30 2022] PUT /identity/v3/projects/80340c48c45c4786a8ff67dd9efe0378/users/80acce1f0dc8425ba08b902b946d593e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:30.748567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:30.749383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:30.749886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:30.794292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:30.797692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:30.936656 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3568/7167] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:30.957122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:30.959200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:31.091292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39603f74-8cf2-4877-a0b1-f2847494b3c8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:31.095557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9be08-ae78-4298-91e4-f1737a8fca4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:31.096484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9be08-ae78-4298-91e4-f1737a8fca4c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:31.096982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9be08-ae78-4298-91e4-f1737a8fca4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:31.097582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9be08-ae78-4298-91e4-f1737a8fca4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:31.112264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9be08-ae78-4298-91e4-f1737a8fca4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:31.114008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9be08-ae78-4298-91e4-f1737a8fca4c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:31.128204 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3600/7168] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:34.904402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:34.906376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:34.948371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7be54-532a-42fb-9a5b-86c9c28330cd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:34.961471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:34.962587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:34.963002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:34.963537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] PATH_INFO: `/v3/users/c65e8f152e854e2089c43020e660c0ac` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:34.967324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65e8f152e854e2089c43020e660c0ac)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:34.980012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:35.096272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65e8f152e854e2089c43020e660c0ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:35.128624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65e8f152e854e2089c43020e660c0ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:35.147577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65e8f152e854e2089c43020e660c0ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:35.171735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65e8f152e854e2089c43020e660c0ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:35.172515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65e8f152e854e2089c43020e660c0ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:35.190539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3569/7169] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:34 2022] DELETE /identity/v3/users/c65e8f152e854e2089c43020e660c0ac => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:35.196412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:35.196945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:35.197087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:35.251643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:35.255181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:35.461980 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3601/7170] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:35.508445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:35.510097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:35.633443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7dc02-f807-4909-8583-6de5c0e32a41 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:35.643556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:35.648663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:35.649206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:35.649666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:35.673260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:35.675466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:35.682639 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:35.695147 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3570/7171] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:37.650657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:37.652433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:37.684128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0637d-60fa-486d-99de-91944be9c79f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:37.703033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:37.703797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:37.704089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:37.704918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] PATH_INFO: `/v3/projects/436b5dbc04d14639bf282be15f5b76f2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:37.710411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=436b5dbc04d14639bf282be15f5b76f2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:37.714731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:37.742486 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:37.844028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436b5dbc04d14639bf282be15f5b76f2', 'request_id': 'req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:37.867405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436b5dbc04d14639bf282be15f5b76f2', 'request_id': 'req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:37.876015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436b5dbc04d14639bf282be15f5b76f2', 'request_id': 'req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:37.897350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] The token cache is being invalidate because project 436b5dbc04d14639bf282be15f5b76f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:37.897951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:37.899013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:37.904191 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3602/7172] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:37 2022] DELETE /identity/v3/projects/436b5dbc04d14639bf282be15f5b76f2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:37.905061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:37.933867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7729-3f65-4d8b-b61f-2c0c5a51bbb5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:38.089660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:38.090891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:38.091404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:38.092081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] PATH_INFO: `/v3/users/7b49f304fea54d83913ca1350d96559b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:38.093562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b49f304fea54d83913ca1350d96559b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:38.095952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:38.219084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b49f304fea54d83913ca1350d96559b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:38.256902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b49f304fea54d83913ca1350d96559b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:38.283819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b49f304fea54d83913ca1350d96559b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:38.308996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b49f304fea54d83913ca1350d96559b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:38.310735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b49f304fea54d83913ca1350d96559b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:38.322991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3571/7173] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:37 2022] DELETE /identity/v3/users/7b49f304fea54d83913ca1350d96559b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:39.403980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:39.408214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:39.437892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181ab4-c892-4d22-b020-ebcb4bc41b8a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:39.539069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:39.541435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:39.660050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:39.661069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:39.661360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:39.661639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] PATH_INFO: `/v3/projects/1d540e30342446de969a0557ac238d13` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:39.666720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d540e30342446de969a0557ac238d13)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:39.668835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:39.754367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4beb3-7406-4fde-b7b8-0a9870541dcb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:39.776332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:39.779631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:39.782798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:39.783410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:39.788027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:39.798945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d540e30342446de969a0557ac238d13', 'request_id': 'req-9eeefa87-582a-4c92-b33e-8f12194f1bf8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:39.827646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d540e30342446de969a0557ac238d13', 'request_id': 'req-9eeefa87-582a-4c92-b33e-8f12194f1bf8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:39.830727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:39.839067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6213de5-73fb-4661-9abd-97629bcaff7c service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:39.839833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d540e30342446de969a0557ac238d13', 'request_id': 'req-9eeefa87-582a-4c92-b33e-8f12194f1bf8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:39.880508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] The token cache is being invalidate because project 1d540e30342446de969a0557ac238d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:39.883732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:39.885826 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3572/7174] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:16:39.887417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:39.889262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3603/7175] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:39 2022] DELETE /identity/v3/projects/1d540e30342446de969a0557ac238d13 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:39.894946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af47ae-ec77-403b-ac5b-76178354c9fe None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:39.895378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af47ae-ec77-403b-ac5b-76178354c9fe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:39.895703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af47ae-ec77-403b-ac5b-76178354c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:39.953355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b0af47ae-ec77-403b-ac5b-76178354c9fe None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:39.957389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b0af47ae-ec77-403b-ac5b-76178354c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:39.970995 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:40.076811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.078607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:40.147915 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3573/7176] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:40.155658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.156001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.156233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.164771 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:40.207376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:40.211069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:40.232743 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3574/7177] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:40.236595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.244501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeefa87-582a-4c92-b33e-8f12194f1bf8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.256412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1ba84-3251-4249-9bc3-28bc69f0bbb5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.258942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.260048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.260644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.261083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] PATH_INFO: `/v3/users/fb90fa7d9ed24d20875c6c831277dedd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.262756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb90fa7d9ed24d20875c6c831277dedd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.264884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.271085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.271788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.272075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.272354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.273115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:40.273409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.279667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.302242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3575/7178] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:40.306366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.331207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab063af-b0b0-4c1c-b72a-53bd7dcf31a3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.346261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.346987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.347275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.347854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.348477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.350396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.357199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb90fa7d9ed24d20875c6c831277dedd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:40.358453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb90fa7d9ed24d20875c6c831277dedd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:40.387528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb90fa7d9ed24d20875c6c831277dedd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:40.388946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb90fa7d9ed24d20875c6c831277dedd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:40.405795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a31ce1e-72e5-4f75-a898-ec0cf7675bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb90fa7d9ed24d20875c6c831277dedd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:40.412811 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3576/7179] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:40 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:40.414710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.417851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:40.428653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3604/7180] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:40 2022] DELETE /identity/v3/users/fb90fa7d9ed24d20875c6c831277dedd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:40.432861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.433155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.433436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.469477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:40.470943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:40.530769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f3975-9349-4275-bf45-640e1b26c912 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.624473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3605/7181] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:16:40.638199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.639694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:40.688822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.691296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.693130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.693595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.696821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.703236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.735908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf3b6e-7fa8-4ae6-b1fe-39e79e932523 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.741404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.742313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.742716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.743117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.750478 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:40.754357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3577/7182] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:40 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:40.756969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.759782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.761373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.773477 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:40.776492 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3606/7183] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:40.783098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba9fa-8a76-48dd-b2fd-f44ea270c590 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.793234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.794161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.794755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.795178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.796186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.798904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.819572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.840453 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3578/7184] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:40.843438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63664-249f-437a-9608-341b3536d9ba service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.855584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f6de0-97c1-487b-8ca3-232773319629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.856149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f6de0-97c1-487b-8ca3-232773319629 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.857379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f6de0-97c1-487b-8ca3-232773319629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.857826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f6de0-97c1-487b-8ca3-232773319629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.858767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f6de0-97c1-487b-8ca3-232773319629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.860893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f6de0-97c1-487b-8ca3-232773319629 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.875001 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3607/7185] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:40.880049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:40.893807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbba0c-9888-434c-a5cc-1952d329f9c1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:40.899569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:40.901468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.901768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.902187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] PATH_INFO: `/v3/projects/ac9062a3455e4c3da9a334f7a30e902d/users/6acf1e4b3236443fb6dc2c60f92ebb12/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.933937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9062a3455e4c3da9a334f7a30e902d, user_id=6acf1e4b3236443fb6dc2c60f92ebb12, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:40.937035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:40.988238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:40.988563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:40.988846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:40.989175 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3579/7186] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:40 2022] PUT /identity/v3/projects/ac9062a3455e4c3da9a334f7a30e902d/users/6acf1e4b3236443fb6dc2c60f92ebb12/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:41.034853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] MFA Rules not processed for user `6acf1e4b3236443fb6dc2c60f92ebb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:41.037347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:41.227914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:41.258656 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3608/7187] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:41.434125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff366191-0213-4b41-937c-36ae94fd23de admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:41.446217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:41.447178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:41.447643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:41.448072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:41.449561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:41.452905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:41.507542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3580/7188] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:41 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:41.511393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:41.526179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdee36-7df3-430d-8cb0-14970dd51c86 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:41.625874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:41.629410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:41.630191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:41.630670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:41.631526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:41.633692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:41.669332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3609/7189] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:41 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:16:41.675656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:41.691514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7278dd-7431-44cc-82e9-e227e1f3b0f5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:41.711685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:41.713182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:41.714020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:41.714292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:41.715300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:41.718630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:41.740844 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3581/7190] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:41.745546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:41.772063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae83d7-e849-460e-8175-c0c8ef899fad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:41.783260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:41.784846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:41.785148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:41.785547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] PATH_INFO: `/v3/projects/d332f3d8473b4332984d39e03e6100cf/users/513fd8adf8a84d05ba81dd22919f93cb/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:41.864953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d332f3d8473b4332984d39e03e6100cf, user_id=513fd8adf8a84d05ba81dd22919f93cb, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:41.870083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:41.871377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:41.873433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:41.925488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3949-3bf3-4e78-9e4d-38ebad2a0ad7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:41.936988 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3610/7191] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:41 2022] PUT /identity/v3/projects/d332f3d8473b4332984d39e03e6100cf/users/513fd8adf8a84d05ba81dd22919f93cb/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:41.941193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:42.023641 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:42.050186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc8fa-78d6-4ace-91f7-8bf41a571230 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:42.059193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:42.060355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:42.060694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:42.061045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:42.061868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:42.064594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:42.070796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:42.071764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:42.072125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:42.072472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] PATH_INFO: `/v3/projects/a2ea2799ec964c48aee9a5bcbce71204` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:42.075991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ea2799ec964c48aee9a5bcbce71204)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:42.078561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3611/7192] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:42.082748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:42.083416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:42.104597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2526b-d887-41c7-aa7c-bd14ca052cd5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:42.117853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0920de-7c04-41e8-b8ab-d4290eed37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:42.120358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0920de-7c04-41e8-b8ab-d4290eed37d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:42.123081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0920de-7c04-41e8-b8ab-d4290eed37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:42.123645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0920de-7c04-41e8-b8ab-d4290eed37d5 admin admin] PATH_INFO: `/v3/projects/d332f3d8473b4332984d39e03e6100cf/users/513fd8adf8a84d05ba81dd22919f93cb/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:42.131150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0920de-7c04-41e8-b8ab-d4290eed37d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d332f3d8473b4332984d39e03e6100cf, user_id=513fd8adf8a84d05ba81dd22919f93cb, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:42.137381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0920de-7c04-41e8-b8ab-d4290eed37d5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:42.159649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3612/7193] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:42 2022] PUT /identity/v3/projects/d332f3d8473b4332984d39e03e6100cf/users/513fd8adf8a84d05ba81dd22919f93cb/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:42.170543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:42.170842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:42.171125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:42.180646 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:42.185335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ea2799ec964c48aee9a5bcbce71204', 'request_id': 'req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.202435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ea2799ec964c48aee9a5bcbce71204', 'request_id': 'req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.226215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ea2799ec964c48aee9a5bcbce71204', 'request_id': 'req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.230863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] MFA Rules not processed for user `513fd8adf8a84d05ba81dd22919f93cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:42.232980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:42.239874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] The token cache is being invalidate because project a2ea2799ec964c48aee9a5bcbce71204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:42.240236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.240995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.245707 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3582/7194] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:41 2022] DELETE /identity/v3/projects/a2ea2799ec964c48aee9a5bcbce71204 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:42.249507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:42.253512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:42.349179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3613/7195] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:16:42.357200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad8888-14a0-4ff2-899f-5e4adfbff0bd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:42.365875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:42.368094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:42.387738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:42.388636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:42.388926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:42.389207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] PATH_INFO: `/v3/users/33dd20f6a18b4d84b5d1f54aeeaf2a03` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:42.391102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33dd20f6a18b4d84b5d1f54aeeaf2a03)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:42.393149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:42.480966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e55dc8-b6bd-43e8-ab96-771020af485c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:42.489169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:42.489900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:42.490773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:42.491031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:42.495771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:42.497666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33dd20f6a18b4d84b5d1f54aeeaf2a03'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.523653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33dd20f6a18b4d84b5d1f54aeeaf2a03'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.545027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33dd20f6a18b4d84b5d1f54aeeaf2a03'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.577291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33dd20f6a18b4d84b5d1f54aeeaf2a03'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.578117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33dd20f6a18b4d84b5d1f54aeeaf2a03'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:42.586886 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3583/7196] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:42 2022] DELETE /identity/v3/users/33dd20f6a18b4d84b5d1f54aeeaf2a03 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:42.649833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:42.652049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bfdc3-d3f4-440d-9e4a-bd2ea0c16cc5 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:42.664139 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:42.676767 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3614/7197] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:43.177689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:43.179303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:43.323055 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:43.355193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150715-0da1-4206-8178-605f65bfc6dc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:43.363396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:43.366308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:43.366641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:43.366928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] PATH_INFO: `/v3/projects/78d9e5c380454346b9da16777700a45f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:43.373727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d9e5c380454346b9da16777700a45f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:43.375969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:43.488134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d9e5c380454346b9da16777700a45f', 'request_id': 'req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:43.504072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d9e5c380454346b9da16777700a45f', 'request_id': 'req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:43.535064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d9e5c380454346b9da16777700a45f', 'request_id': 'req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:43.548994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] The token cache is being invalidate because project 78d9e5c380454346b9da16777700a45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:43.549613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:43.550709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5d87eaaa-f246-4dd8-8dd4-fe8dbe00967e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:43.556432 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3584/7198] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:43 2022] DELETE /identity/v3/projects/78d9e5c380454346b9da16777700a45f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:43.557351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:43.557650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:43.557938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:43.612648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:43.617919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:43.777595 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3615/7199] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:43.786538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:43.787055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:43.787564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:43.848174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:43.849244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:43.888312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3585/7200] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:43.895301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:43.910198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4147ae-47f2-430a-8f9b-ad21e048825b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:43.923224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:43.923916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:43.924281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:43.925072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:43.925840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:43.926130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:43.928150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:43.963211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3616/7201] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:43.964442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:43.976238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5fe33-de0f-4715-a307-7b5f7191c958 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.001414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:44.002136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.002427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.002752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.003459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:44.005524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:44.084969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3586/7202] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:43 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:44.086169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:44.098403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e7f6-c7d8-450b-a5bf-3d2b884e9ce4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.228817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:44.229516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.229810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.230095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.230849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:44.232795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:44.278704 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3617/7203] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:44 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:44.279817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:44.297070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44c7a-608e-497e-88ca-46110fc2ab3e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.312706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:44.313952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.314254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.314552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.315297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:44.317086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:44.339077 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3587/7204] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:44.340299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:44.359110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fde4e-6dba-4d40-b96b-319329e0a436 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.367697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723ee0-1849-48ad-9f98-8463b2ca09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:44.368786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723ee0-1849-48ad-9f98-8463b2ca09da admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.369382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723ee0-1849-48ad-9f98-8463b2ca09da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.369713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723ee0-1849-48ad-9f98-8463b2ca09da admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.370858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7723ee0-1849-48ad-9f98-8463b2ca09da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:44.373129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7723ee0-1849-48ad-9f98-8463b2ca09da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:44.392452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3618/7205] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:44.393648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:44.410802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b9b59-91ca-4ce8-a038-9991ce47ebd2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.417579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:44.419136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.419136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.419346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] PATH_INFO: `/v3/projects/94a8b8d9f61f45448a6a0a033c234c0e/users/fdb58bfc9bb847b3b838b57577cc874a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.493546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a8b8d9f61f45448a6a0a033c234c0e, user_id=fdb58bfc9bb847b3b838b57577cc874a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:44.498204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:44.547437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3588/7206] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:44 2022] PUT /identity/v3/projects/94a8b8d9f61f45448a6a0a033c234c0e/users/fdb58bfc9bb847b3b838b57577cc874a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:44.558912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.559504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.559858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.635914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] MFA Rules not processed for user `fdb58bfc9bb847b3b838b57577cc874a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:44.638969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:44.786271 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:44.807147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3619/7207] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:44.819907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:44.822388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:44.876911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:44.879305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:44.937298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938281b-d9e4-481a-8949-34aa3a022b36 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.941804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:44.942548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:44.942846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:44.943121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:44.957255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:44.962340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:44.968390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcd707-9bde-47bc-b62c-e7c3ebd1e68b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:44.983935 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3589/7208] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:45.001021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:45.001992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:45.002357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:45.002758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:45.010453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:45.151542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:45.153308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef2b9f-06de-46ec-8037-d599077e9a34 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:45.172068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3620/7209] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:16:46.311205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:46.367825 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:46.446471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba673e2-a736-411e-935b-a9243823bce6 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:46.453440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:46.454449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:46.454809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:46.455084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] PATH_INFO: `/v3/users/fdb58bfc9bb847b3b838b57577cc874a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:46.456407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb58bfc9bb847b3b838b57577cc874a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:46.459266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:46.574407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb58bfc9bb847b3b838b57577cc874a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:46.615740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb58bfc9bb847b3b838b57577cc874a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:46.632419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb58bfc9bb847b3b838b57577cc874a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:46.654351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb58bfc9bb847b3b838b57577cc874a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:46.655170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b7b5302f-d726-4aab-b941-d7b2b5806832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb58bfc9bb847b3b838b57577cc874a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:46.672215 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3590/7210] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:46 2022] DELETE /identity/v3/users/fdb58bfc9bb847b3b838b57577cc874a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:46.676622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:46.677144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:46.677230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:46.712364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:46.715027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:46.802746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbccda3-90c0-4711-9f9a-c79e5378f77d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:46.803093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbccda3-90c0-4711-9f9a-c79e5378f77d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:46.803491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbccda3-90c0-4711-9f9a-c79e5378f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:46.954397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1bbccda3-90c0-4711-9f9a-c79e5378f77d None None] MFA Rules not processed for user `80acce1f0dc8425ba08b902b946d593e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:46.960824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1bbccda3-90c0-4711-9f9a-c79e5378f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:46.995705 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3621/7211] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:47.080190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:47.082135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:47.156273 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3591/7212] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:47.167088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:47.167467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:47.167827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:47.200782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] MFA Rules not processed for user `80acce1f0dc8425ba08b902b946d593e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:47.203681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:47.211057 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:47.223621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3592/7213] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:16:47.231309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846cbc-532f-4c87-b3c0-ed7c151c0275 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:47.234363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:47.238090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:47.247000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:47.247854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:47.247999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:47.248257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:47.271913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:47.273380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:47.280649 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:47.308829 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3622/7214] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:47.346536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82491b4-2d05-4a99-871a-1b2cd8bbeee2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:47.354689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a92c9-80c5-4d08-b93c-8ca768f23aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:47.355398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a92c9-80c5-4d08-b93c-8ca768f23aae service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:47.355690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a92c9-80c5-4d08-b93c-8ca768f23aae service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:47.355972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a92c9-80c5-4d08-b93c-8ca768f23aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:47.365819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a92c9-80c5-4d08-b93c-8ca768f23aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:47.367595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a92c9-80c5-4d08-b93c-8ca768f23aae service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:47.391032 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3593/7215] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:48.353343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:48.355375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:48.371755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd76cdf-20c4-4285-be64-a75a276f5e9f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:48.377779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:48.378738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:48.379016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:48.379352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] PATH_INFO: `/v3/projects/94a8b8d9f61f45448a6a0a033c234c0e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:48.381542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a8b8d9f61f45448a6a0a033c234c0e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:48.387783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:48.551201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a8b8d9f61f45448a6a0a033c234c0e', 'request_id': 'req-b47e8582-0f59-421a-b0d5-68e0f626cac8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:48.576820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a8b8d9f61f45448a6a0a033c234c0e', 'request_id': 'req-b47e8582-0f59-421a-b0d5-68e0f626cac8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:48.585298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a8b8d9f61f45448a6a0a033c234c0e', 'request_id': 'req-b47e8582-0f59-421a-b0d5-68e0f626cac8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:48.622033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] The token cache is being invalidate because project 94a8b8d9f61f45448a6a0a033c234c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:48.622375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:48.623697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b47e8582-0f59-421a-b0d5-68e0f626cac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:48.630317 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3623/7216] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:48 2022] DELETE /identity/v3/projects/94a8b8d9f61f45448a6a0a033c234c0e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:48.645340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:48.645919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:48.645919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:48.680853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:48.682100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:48.854061 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3594/7217] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:48.864449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:48.864751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:48.865039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:48.909960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:48.913426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:48.946584 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3624/7218] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:48.948625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:48.959083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1ec2a-13d9-474f-a736-1622d485df18 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:48.964873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:48.965825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:48.966272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:48.966742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:48.967649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:48.968898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:48.970049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:48.983828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3595/7219] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:48.988547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:49.006687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0cef-143a-4fa0-a420-8ef2f0235572 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:49.018249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:49.019798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:49.020666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:49.021082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:49.023714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:49.026541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:49.078997 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3625/7220] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:48 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:49.082996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:49.098076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac697-c697-4ea5-813e-e3d7432a355a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:49.216726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:49.217958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:49.220839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:49.223411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:49.224324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:49.228676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:49.287544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3596/7221] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:49 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:49.297214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:49.328951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a12f5-1a50-4d69-a78e-85fc2e2cfc9b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:49.351842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:49.352681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:49.356619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:49.357728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:49.359199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:49.361510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:49.393058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:49.396856 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3626/7222] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:49.410238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d149b44-1c73-4922-9d0c-2f03b44a6173 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:49.421773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532331cd-a54b-4c96-8c29-7f70532eff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:49.426435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532331cd-a54b-4c96-8c29-7f70532eff33 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:49.426804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532331cd-a54b-4c96-8c29-7f70532eff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:49.427979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532331cd-a54b-4c96-8c29-7f70532eff33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:49.430327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532331cd-a54b-4c96-8c29-7f70532eff33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:49.432207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532331cd-a54b-4c96-8c29-7f70532eff33 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:49.445891 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3597/7223] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:49.449882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:49.462281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b3099-ae86-47ba-89eb-1438c03b146d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:49.471461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:49.472465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:49.472831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:49.473238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] PATH_INFO: `/v3/projects/e5d3d419809946b09223fada670f0db5/users/fbf9da9f93d84eefb3cfc4e9bd0fd107/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:49.496846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d3d419809946b09223fada670f0db5, user_id=fbf9da9f93d84eefb3cfc4e9bd0fd107, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:49.500065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:49.536596 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3627/7224] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:49 2022] PUT /identity/v3/projects/e5d3d419809946b09223fada670f0db5/users/fbf9da9f93d84eefb3cfc4e9bd0fd107/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:49.538517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:49.538880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:49.539167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:49.631011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] MFA Rules not processed for user `fbf9da9f93d84eefb3cfc4e9bd0fd107`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:49.635138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:49.659220 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:49.826314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3598/7225] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:49.899970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:49.901780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:50.101446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1037f-4221-4f04-b566-712e96d85947 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:50.111265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f789e2-e71b-4b4b-8955-1612746ba64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:50.112820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f789e2-e71b-4b4b-8955-1612746ba64e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:50.113273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f789e2-e71b-4b4b-8955-1612746ba64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:50.113712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f789e2-e71b-4b4b-8955-1612746ba64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:50.139485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f789e2-e71b-4b4b-8955-1612746ba64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:50.141902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f789e2-e71b-4b4b-8955-1612746ba64e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:50.166784 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3628/7226] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:50.187036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:50.385334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86085ec-2dd7-4e56-9a83-c9b35dadf9cb None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:50.399588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:50.400903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:50.403033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:50.403617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] PATH_INFO: `/v3/users/fbf9da9f93d84eefb3cfc4e9bd0fd107` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:50.406262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf9da9f93d84eefb3cfc4e9bd0fd107)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:50.411674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:50.531015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf9da9f93d84eefb3cfc4e9bd0fd107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:50.576116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf9da9f93d84eefb3cfc4e9bd0fd107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:50.593852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf9da9f93d84eefb3cfc4e9bd0fd107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:50.614364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf9da9f93d84eefb3cfc4e9bd0fd107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:50.615434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf9da9f93d84eefb3cfc4e9bd0fd107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:50.626660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3599/7227] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:16:50 2022] DELETE /identity/v3/users/fbf9da9f93d84eefb3cfc4e9bd0fd107 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:50.631840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:50.632315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:50.632601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:50.673238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:50.677744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:50.691385 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:50.861200 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3629/7228] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:51.053469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:51.055811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:51.164476 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:51.268252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82200e61-7e8b-42c9-8816-bb5272c1d790 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:51.279442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37925d-7f3d-47f0-aa1b-7a18bc4bf9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:51.280284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37925d-7f3d-47f0-aa1b-7a18bc4bf9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:51.280680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37925d-7f3d-47f0-aa1b-7a18bc4bf9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:51.281227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37925d-7f3d-47f0-aa1b-7a18bc4bf9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:51.302923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37925d-7f3d-47f0-aa1b-7a18bc4bf9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:51.305444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37925d-7f3d-47f0-aa1b-7a18bc4bf9f4 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:51.317176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3600/7229] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:52.734247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:52.735807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:52.749633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9027a15-e822-4c05-aa95-53424a1c4ee2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:52.764074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:52.765080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:52.765435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:52.765785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] PATH_INFO: `/v3/projects/e5d3d419809946b09223fada670f0db5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:52.767843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d3d419809946b09223fada670f0db5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:52.769868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:52.829611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d3d419809946b09223fada670f0db5', 'request_id': 'req-956d0d16-3aef-4bf1-8967-331528edcdb1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:52.839778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d3d419809946b09223fada670f0db5', 'request_id': 'req-956d0d16-3aef-4bf1-8967-331528edcdb1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:52.846056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d3d419809946b09223fada670f0db5', 'request_id': 'req-956d0d16-3aef-4bf1-8967-331528edcdb1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:52.861382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] The token cache is being invalidate because project e5d3d419809946b09223fada670f0db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:16:52.861822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:52.862602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-956d0d16-3aef-4bf1-8967-331528edcdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:16:52.864422 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3630/7230] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:16:52 2022] DELETE /identity/v3/projects/e5d3d419809946b09223fada670f0db5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:52.869406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:52.870210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:52.870511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:52.889752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:52.890999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:52.960191 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3601/7231] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:16:52.969794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:52.970082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:52.970554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:52.990267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:52.991521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:52.999962 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3631/7232] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:53.004745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.020454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964ff6f-871d-4fc0-b86d-8b0ebc3fec39 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.032368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.033625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.034019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.035557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.038168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:16:53.038168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.040082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.058370 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3602/7233] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:16:53.059980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.078639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7870-4b7f-42f1-ab86-5439834ab984 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.089360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.092042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.092627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.093019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.094853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.097500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.164387 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3632/7234] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:53 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:53.165577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.197660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241691f-58d0-44ed-a9f7-e27b8ed9da11 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.268413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.269452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.269582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.269941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.270712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.273443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.296242 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3603/7235] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:53 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:16:53.300681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.314261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029e77-54a5-4a62-89de-19af0692d4ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.319329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.320320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.320766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.321202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.322283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.324126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.346370 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3633/7236] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:53.350671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.366053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acc597-efc2-4f5a-92b6-0a9cbe86b851 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.372526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0da5cd-9a3c-429f-9c7b-134c6972887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.373638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da5cd-9a3c-429f-9c7b-134c6972887c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.373923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da5cd-9a3c-429f-9c7b-134c6972887c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.374466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da5cd-9a3c-429f-9c7b-134c6972887c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.375953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0da5cd-9a3c-429f-9c7b-134c6972887c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.378389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0da5cd-9a3c-429f-9c7b-134c6972887c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.404778 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3604/7237] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:53.410434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.423906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac93a7e-ad3f-42e7-85e9-616c30c547aa admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.430350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.431599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.432076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.433215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] PATH_INFO: `/v3/projects/a6f028f51f144b0f89e385c212c05e1c/users/0aba61cfd00a4231b29f7eec36e38cbd/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.455655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f028f51f144b0f89e385c212c05e1c, user_id=0aba61cfd00a4231b29f7eec36e38cbd, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.459464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.481263 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3634/7238] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:53 2022] PUT /identity/v3/projects/a6f028f51f144b0f89e385c212c05e1c/users/0aba61cfd00a4231b29f7eec36e38cbd/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:53.492707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.493003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.493284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.523646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] MFA Rules not processed for user `0aba61cfd00a4231b29f7eec36e38cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:53.525034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:53.550079 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:53.629065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3605/7239] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:53.630126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.697187 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:53.774399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe808-4a18-448c-97bc-ef3ddd0f6cf1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:53.793705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:53.794392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:53.794704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:53.796061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:53.797140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:53.800705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:53.880120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3635/7240] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:16:53 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:16:53.884153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:53.906730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd96b1-46c8-49be-9624-4d36e08f2e61 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.084617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.085315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.085591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.085861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.086626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.088570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.123804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:54.137201 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3606/7241] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:16:53 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:16:54.142079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903b4ee-1359-460f-bbb0-98f8d2adadb8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.155577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.156385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.156781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.157129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.157946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.159738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.200505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:54.210380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3636/7242] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:54.213701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92442cb-3213-4253-bcf6-e8cdacd521fa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.227338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.228825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.228825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.229727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] PATH_INFO: `/v3/projects/ef1f2da0e2e14236a121c5b15f27c334/users/66aad8f6f9ba4285a961481df4adbfd4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.252517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1f2da0e2e14236a121c5b15f27c334, user_id=66aad8f6f9ba4285a961481df4adbfd4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.255721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.279586 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3607/7243] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:54 2022] PUT /identity/v3/projects/ef1f2da0e2e14236a121c5b15f27c334/users/66aad8f6f9ba4285a961481df4adbfd4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:16:54.284314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:54.300036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee09f1a-c092-4af0-9563-8415e777bf77 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.401830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d632ac2-a503-4499-94b5-39e39965af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.403570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d632ac2-a503-4499-94b5-39e39965af69 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.404087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d632ac2-a503-4499-94b5-39e39965af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.404604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d632ac2-a503-4499-94b5-39e39965af69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.406169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d632ac2-a503-4499-94b5-39e39965af69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.408592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d632ac2-a503-4499-94b5-39e39965af69 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.421701 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3637/7244] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:16:54.426204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:54.438758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54959a4-933d-456b-b0ac-2ffa47321c89 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.454266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.455408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.455794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.456172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] PATH_INFO: `/v3/projects/ef1f2da0e2e14236a121c5b15f27c334/users/66aad8f6f9ba4285a961481df4adbfd4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.458472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1f2da0e2e14236a121c5b15f27c334, user_id=66aad8f6f9ba4285a961481df4adbfd4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.461259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.483435 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3608/7245] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:16:54 2022] PUT /identity/v3/projects/ef1f2da0e2e14236a121c5b15f27c334/users/66aad8f6f9ba4285a961481df4adbfd4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:16:54.485903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.486320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.486570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.520036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] MFA Rules not processed for user `66aad8f6f9ba4285a961481df4adbfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:16:54.521370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:54.615953 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3638/7246] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:16:54.628424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:54.630305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:54.710960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208869a-fd82-458a-ba76-416cc24f25a6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.716553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.717641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.718174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.718794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.731497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.733550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.747531 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3609/7247] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:54.843998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:54.857691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56186eb-4d4d-4b38-838a-f699e127bcfb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:54.861823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7409c9-48de-48dc-b29f-bc924489f552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:54.862832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7409c9-48de-48dc-b29f-bc924489f552 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:54.863216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7409c9-48de-48dc-b29f-bc924489f552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:54.863573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7409c9-48de-48dc-b29f-bc924489f552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:54.894386 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:54.953357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7409c9-48de-48dc-b29f-bc924489f552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:54.955311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7409c9-48de-48dc-b29f-bc924489f552 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:54.967205 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3639/7248] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:16:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:16:58.074578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:16:58.076047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:58.102153 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:16:58.169762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8622-3925-4290-bca4-a451419bdc54 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:16:58.180916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:16:58.181598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:16:58.183384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:16:58.183742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:16:58.185927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:16:58.253161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:16:58.254790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:16:58.267361 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3610/7249] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:16:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:17:04.963169 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=16 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:06.855359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:06.857230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:06.857550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:06.889977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] MFA Rules not processed for user `80acce1f0dc8425ba08b902b946d593e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:06.891642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:06.966482 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3640/7250] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:07.927190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:07.932178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:08.148769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c976-9d21-4b33-875b-9056255c13de service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:08.153849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:08.154590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:08.154825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:08.155280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:08.156959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:08.173100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:08.174763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d7fc-5c5b-4a45-a75c-6a9fa46b12d8 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:08.207039 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3611/7251] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:09.400189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:09.531570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9836e7-c187-4872-8e00-1977bc4b69ee None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:09.538700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:09.539604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:09.539887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:09.540162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] PATH_INFO: `/v3/users/0aba61cfd00a4231b29f7eec36e38cbd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:09.543270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aba61cfd00a4231b29f7eec36e38cbd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:09.549395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:09.661061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aba61cfd00a4231b29f7eec36e38cbd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:09.662177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aba61cfd00a4231b29f7eec36e38cbd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:09.683208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aba61cfd00a4231b29f7eec36e38cbd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:09.684818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aba61cfd00a4231b29f7eec36e38cbd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:09.704595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aba61cfd00a4231b29f7eec36e38cbd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:09.777167 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3641/7252] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:17:09 2022] DELETE /identity/v3/users/0aba61cfd00a4231b29f7eec36e38cbd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:09.778833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232591-6af4-4591-af35-d58db712fb50 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:09.779258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232591-6af4-4591-af35-d58db712fb50 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:09.779571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232591-6af4-4591-af35-d58db712fb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:09.824895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-44232591-6af4-4591-af35-d58db712fb50 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:09.830835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-44232591-6af4-4591-af35-d58db712fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:10.004363 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:10.056171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:10.057920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:10.070992 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3612/7253] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:10.120701 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:10.170844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49cfbd-7127-4d05-ba99-e34eeb911d9b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:10.175730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:10.176417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:10.176855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:10.177144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:10.193603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:10.196599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:10.225406 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3642/7254] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:10.813730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232591-6af4-4591-af35-d58db712fb50 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:10.816940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-44232591-6af4-4591-af35-d58db712fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:10.895019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232591-6af4-4591-af35-d58db712fb50 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:10.905302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:10.910801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:10.911339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:10.911887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] PATH_INFO: `/v3/projects/a6f028f51f144b0f89e385c212c05e1c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:10.916244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f028f51f144b0f89e385c212c05e1c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:10.919838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:11.041059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f028f51f144b0f89e385c212c05e1c', 'request_id': 'req-377512d0-c7b2-4940-8bc0-ae0006fe9596'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.048768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f028f51f144b0f89e385c212c05e1c', 'request_id': 'req-377512d0-c7b2-4940-8bc0-ae0006fe9596'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.064388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f028f51f144b0f89e385c212c05e1c', 'request_id': 'req-377512d0-c7b2-4940-8bc0-ae0006fe9596'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.122182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] The token cache is being invalidate because project a6f028f51f144b0f89e385c212c05e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:17:11.123201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.125708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.136333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:11.152739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce7ae-6c02-4e54-8b3f-534bbbec93e8 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:11.167782 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3613/7255] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:17:10 2022] DELETE /identity/v3/projects/a6f028f51f144b0f89e385c212c05e1c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:11.316322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:11.318256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:11.319190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:11.319719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] PATH_INFO: `/v3/users/66aad8f6f9ba4285a961481df4adbfd4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:11.322488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66aad8f6f9ba4285a961481df4adbfd4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:11.326222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:11.412143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66aad8f6f9ba4285a961481df4adbfd4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.412858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66aad8f6f9ba4285a961481df4adbfd4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.428953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66aad8f6f9ba4285a961481df4adbfd4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.429698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66aad8f6f9ba4285a961481df4adbfd4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.440151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0c2543f4-423f-41df-a795-6a08269ce29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66aad8f6f9ba4285a961481df4adbfd4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:11.462906 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3643/7256] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:17:11 2022] DELETE /identity/v3/users/66aad8f6f9ba4285a961481df4adbfd4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:11.933324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:11.934917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:11.960204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377512d0-c7b2-4940-8bc0-ae0006fe9596 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:12.167705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:12.168676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:12.170422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:12.186005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] PATH_INFO: `/v3/projects/ef1f2da0e2e14236a121c5b15f27c334` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:12.190544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1f2da0e2e14236a121c5b15f27c334)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:12.195664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:12.338624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1f2da0e2e14236a121c5b15f27c334', 'request_id': 'req-8471e7fc-4df0-4476-86a5-9f9304722b6d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:12.350897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1f2da0e2e14236a121c5b15f27c334', 'request_id': 'req-8471e7fc-4df0-4476-86a5-9f9304722b6d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:12.357287 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:12.361753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1f2da0e2e14236a121c5b15f27c334', 'request_id': 'req-8471e7fc-4df0-4476-86a5-9f9304722b6d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:12.400828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] The token cache is being invalidate because project ef1f2da0e2e14236a121c5b15f27c334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:17:12.401228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:12.403499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8471e7fc-4df0-4476-86a5-9f9304722b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:12.414819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:12.415390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:12.415708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:12.421305 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3614/7257] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:17:11 2022] DELETE /identity/v3/projects/ef1f2da0e2e14236a121c5b15f27c334 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:12.448451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:12.450353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:12.553734 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:12.580648 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3644/7258] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:12.589167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:12.589568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:12.589977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:12.609474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:12.610912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:12.631709 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3615/7259] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:12.635760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:12.647638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad794-4f9d-403d-b8bf-9d9bd895f577 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:12.653189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:12.654284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:12.654410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:12.654941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:12.655695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:17:12.656235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:12.657850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:12.676518 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3645/7260] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:17:12.679158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:12.692645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01c52-4aeb-43dd-a9b8-b5f1f2a84d82 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:12.698371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:12.699322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:12.699621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:12.700130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:12.701145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:12.704487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:12.767334 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3616/7261] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:17:12 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:12.771679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:12.784519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ddfa-e8d7-4531-b91d-9cbb8a60ed70 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:12.921264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:12.922470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:12.922795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:12.926921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:12.927690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:12.929682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:12.984465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3646/7262] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:17:12 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:12.985641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:13.004575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2b3a-7bb4-43b0-a6f0-5ebc68d73407 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:13.012062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:13.013016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:13.013497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:13.014072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:13.015031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:13.017563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:13.035652 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3617/7263] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:13.036242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:13.074373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b64cd-115e-4bf2-b8a0-ac3be2656626 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:13.106828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358952-5eb0-40fc-a200-03685ebb0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:13.108094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358952-5eb0-40fc-a200-03685ebb0b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:13.108393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358952-5eb0-40fc-a200-03685ebb0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:13.108678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358952-5eb0-40fc-a200-03685ebb0b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:13.115452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358952-5eb0-40fc-a200-03685ebb0b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:13.118853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358952-5eb0-40fc-a200-03685ebb0b3f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:13.152176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3647/7264] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:13.156684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:13.169160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3720f-8b94-498e-a162-e2cb0dfa4dfa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:13.181400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:13.182808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:13.183287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:13.183723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] PATH_INFO: `/v3/projects/3eb7c1fca87d40cf982e8f3bf45fc220/users/a5430d43c704484f9c6449673f0cd0c3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:13.247937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb7c1fca87d40cf982e8f3bf45fc220, user_id=a5430d43c704484f9c6449673f0cd0c3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:13.251003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:13.276062 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3618/7265] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:13 2022] PUT /identity/v3/projects/3eb7c1fca87d40cf982e8f3bf45fc220/users/a5430d43c704484f9c6449673f0cd0c3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:13.287005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:13.287308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:13.287619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:13.342294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] MFA Rules not processed for user `a5430d43c704484f9c6449673f0cd0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:13.348305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:13.472324 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3648/7266] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:13.473015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:13.624999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d78f6-961f-4958-91ec-ea4b103ff382 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:13.631485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:13.632506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:13.633007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:13.633584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:13.634598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:13.639482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:13.706773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:13.722426 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3619/7267] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:17:13 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:17:13.724993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9d483-26fd-448c-9596-906cd600d843 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:13.836155 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:13.899319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:13.900618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:13.900966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:13.901256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:13.901968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:13.903933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:13.950966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3649/7268] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:17:13 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:13.956035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:13.991961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698e62-6601-4edd-bf89-df7717903551 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:14.001119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:14.001998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:14.002446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:14.002925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:14.003841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:14.007409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:14.021687 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3620/7269] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:17:14.025423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:14.038153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996126-2703-413c-b4ff-2ef2ab3b9de8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:14.087165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:14.094439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:14.095253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:14.095616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] PATH_INFO: `/v3/projects/d7135d3d2421430da4b4a5b2beedfdbd/users/0474a8db835d45b7a5fad8358fcc18a2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:14.145749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7135d3d2421430da4b4a5b2beedfdbd, user_id=0474a8db835d45b7a5fad8358fcc18a2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:14.149845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:14.176239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:14.179617 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3650/7270] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:14 2022] PUT /identity/v3/projects/d7135d3d2421430da4b4a5b2beedfdbd/users/0474a8db835d45b7a5fad8358fcc18a2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:14.191240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c10c5-fe66-4d80-9bdf-69b9686f642c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:14.321056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ee878-c38f-4baf-a517-cdae500999b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:14.322082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ee878-c38f-4baf-a517-cdae500999b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:14.322334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ee878-c38f-4baf-a517-cdae500999b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:14.322738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ee878-c38f-4baf-a517-cdae500999b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:14.341481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ee878-c38f-4baf-a517-cdae500999b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:14.343218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ee878-c38f-4baf-a517-cdae500999b1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:14.369538 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:14.389919 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3621/7271] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:14.391640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:14.406800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d06d7-789e-4b28-8d5c-1ca72e7958e3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:14.423318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:14.424423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:14.424719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:14.425002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] PATH_INFO: `/v3/projects/d7135d3d2421430da4b4a5b2beedfdbd/users/0474a8db835d45b7a5fad8358fcc18a2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:14.427466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7135d3d2421430da4b4a5b2beedfdbd, user_id=0474a8db835d45b7a5fad8358fcc18a2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:14.430336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:14.464090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:14.464090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:14.464090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:14.464459 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3651/7272] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:14 2022] PUT /identity/v3/projects/d7135d3d2421430da4b4a5b2beedfdbd/users/0474a8db835d45b7a5fad8358fcc18a2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:14.533369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] MFA Rules not processed for user `0474a8db835d45b7a5fad8358fcc18a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:14.534746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:14.666545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3622/7273] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:14.678228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:14.680994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:14.872081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eb126-4cca-468a-a540-4d9a82cfce5b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:14.879489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f57647-4189-44bf-a5fb-1d04603f368f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:14.880083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57647-4189-44bf-a5fb-1d04603f368f service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:14.880268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57647-4189-44bf-a5fb-1d04603f368f service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:14.880514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57647-4189-44bf-a5fb-1d04603f368f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:14.906580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57647-4189-44bf-a5fb-1d04603f368f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:14.908050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57647-4189-44bf-a5fb-1d04603f368f service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:14.935980 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3652/7274] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:15.790532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:15.935739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542a355-5888-46d9-b43b-0ca58c2e811d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:15.950068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:15.951238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:15.952747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:15.953131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] PATH_INFO: `/v3/users/a5430d43c704484f9c6449673f0cd0c3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:15.955492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5430d43c704484f9c6449673f0cd0c3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:15.959447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:16.059188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5430d43c704484f9c6449673f0cd0c3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:16.096656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5430d43c704484f9c6449673f0cd0c3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:16.113462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5430d43c704484f9c6449673f0cd0c3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:16.127497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5430d43c704484f9c6449673f0cd0c3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:16.128604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5430d43c704484f9c6449673f0cd0c3'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:16.148965 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3623/7275] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:17:15 2022] DELETE /identity/v3/users/a5430d43c704484f9c6449673f0cd0c3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:16.153740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:16.154286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:16.154286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:16.173659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:16.175015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:16.337242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:16.338705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:16.340605 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3653/7276] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:16.346447 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:16.424584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef967-0f34-45b5-b1d4-c5e02e6a9c91 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:16.429617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:16.430375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:16.430771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:16.431124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:16.470807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:16.474238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:16.485869 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3624/7277] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:17:17.084219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:17.088657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:17.101890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362129f-5a89-4488-862e-ec6aeae08f53 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:17.107425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:17.108505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:17.109392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:17.109833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] PATH_INFO: `/v3/projects/3eb7c1fca87d40cf982e8f3bf45fc220` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:17.111004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb7c1fca87d40cf982e8f3bf45fc220)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:17.113558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:17.209954 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:17.253251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb7c1fca87d40cf982e8f3bf45fc220', 'request_id': 'req-f8db2ed3-742e-4da1-b20f-c445639dd377'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.272161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb7c1fca87d40cf982e8f3bf45fc220', 'request_id': 'req-f8db2ed3-742e-4da1-b20f-c445639dd377'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.292371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb7c1fca87d40cf982e8f3bf45fc220', 'request_id': 'req-f8db2ed3-742e-4da1-b20f-c445639dd377'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.331591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] The token cache is being invalidate because project 3eb7c1fca87d40cf982e8f3bf45fc220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:17:17.332155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.356640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.367041 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3654/7278] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:17:17 2022] DELETE /identity/v3/projects/3eb7c1fca87d40cf982e8f3bf45fc220 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:17.371020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:17.382374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbdb8-0473-4869-a198-74690b3728e1 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:17.482828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:17.483740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:17.484029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:17.484489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] PATH_INFO: `/v3/users/0474a8db835d45b7a5fad8358fcc18a2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:17.485723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0474a8db835d45b7a5fad8358fcc18a2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:17.488717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:17.541717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0474a8db835d45b7a5fad8358fcc18a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.558845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0474a8db835d45b7a5fad8358fcc18a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.567725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0474a8db835d45b7a5fad8358fcc18a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.589070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0474a8db835d45b7a5fad8358fcc18a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.590046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db28ef02-2ed6-4d1f-9331-f3a04473a428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0474a8db835d45b7a5fad8358fcc18a2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:17.602350 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3625/7279] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:17:17 2022] DELETE /identity/v3/users/0474a8db835d45b7a5fad8358fcc18a2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:18.135682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:18.136963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:18.172692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2ed3-742e-4da1-b20f-c445639dd377 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:18.364526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:18.365358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.365653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.365936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] PATH_INFO: `/v3/projects/d7135d3d2421430da4b4a5b2beedfdbd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.367256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7135d3d2421430da4b4a5b2beedfdbd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:18.369190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:18.506462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7135d3d2421430da4b4a5b2beedfdbd', 'request_id': 'req-a676859a-cc06-4b92-8d2a-8f2c67fc0371'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:18.559162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7135d3d2421430da4b4a5b2beedfdbd', 'request_id': 'req-a676859a-cc06-4b92-8d2a-8f2c67fc0371'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:18.566752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7135d3d2421430da4b4a5b2beedfdbd', 'request_id': 'req-a676859a-cc06-4b92-8d2a-8f2c67fc0371'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:18.594488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] The token cache is being invalidate because project d7135d3d2421430da4b4a5b2beedfdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:17:18.594823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:18.596159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a676859a-cc06-4b92-8d2a-8f2c67fc0371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:18.601404 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3655/7280] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:17:18 2022] DELETE /identity/v3/projects/d7135d3d2421430da4b4a5b2beedfdbd => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:18.606606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.607005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.607005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.628345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:18.629676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:18.674652 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:18.793188 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3626/7281] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:17:18.803301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.803605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.803891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.827256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:18.828537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:18.856314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3656/7282] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:18.862225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:18.873864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f74de2-b6ad-409b-9347-58fd8d1c746d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:18.879870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:18.880559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.880846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.881422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.882210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:17:18.882811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:18.884611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:18.900208 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3627/7283] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:17:18.905029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:18.918984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb78d7-78a8-472a-919c-b45637e8e786 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:18.925272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:18.942935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:18.943577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:18.944180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:18.945143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:18.950298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.029622 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3657/7284] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:17:18 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:19.033646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:19.067057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb52cf-bb95-4012-aeae-970235bbd0a6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:19.177868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:19.179824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.180303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.180756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.182567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:19.184893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.218520 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3628/7285] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:17:19 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:19.223028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:19.236957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c236-70e2-4273-92f9-3b54d3cc5d24 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:19.255783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:19.256982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.260888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.261409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.262382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:19.265162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.279427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3658/7286] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:19.283798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:19.301554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cda026-5d3c-4a4e-982b-a50c283dcaaa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:19.319011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad332560-4153-44b0-9577-b19d8349ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:19.320662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad332560-4153-44b0-9577-b19d8349ad2a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.321241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad332560-4153-44b0-9577-b19d8349ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.322112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad332560-4153-44b0-9577-b19d8349ad2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.324702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad332560-4153-44b0-9577-b19d8349ad2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:19.330601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad332560-4153-44b0-9577-b19d8349ad2a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.355429 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3629/7287] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:19.359796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:19.372144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5642-2612-4c23-9b44-5869b5412720 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:19.386857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:19.387910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.388276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.388729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] PATH_INFO: `/v3/projects/8bc6bc5c605e4687a932fbfb16e9c92e/users/214749ec3604446093ab9aa375e72c76/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.401827 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:19.411057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc6bc5c605e4687a932fbfb16e9c92e, user_id=214749ec3604446093ab9aa375e72c76, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:19.416716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.451147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3659/7288] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:19 2022] PUT /identity/v3/projects/8bc6bc5c605e4687a932fbfb16e9c92e/users/214749ec3604446093ab9aa375e72c76/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:17:19.464994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.465312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.465573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.502630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] MFA Rules not processed for user `214749ec3604446093ab9aa375e72c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:19.503868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:19.584449 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3630/7289] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:19.588946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:19.669532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414396-d6e4-4f4c-9de1-7c2d0708c174 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:19.681873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:19.683098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.683530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.684003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.685079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:19.687460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.742468 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3660/7290] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:17:19 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:19.743820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:19.771336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653d08-ce37-4e94-9f6b-cd7bfc4137f4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:19.813680 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:19.918558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:19.919252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:19.919540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:19.919818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:19.920535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:19.922508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:19.980901 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3631/7291] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:17:19 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:19.982328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:20.002735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4ee2-8046-4277-b9f6-a9e411f6f846 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:20.020352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:20.021061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:20.021548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:20.021672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:20.024523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:20.027348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:20.051968 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3661/7292] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:20.056664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:20.073086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a17d5-e10f-4831-ba36-4aa627abf9d7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:20.097446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:20.098916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:20.099400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:20.099839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] PATH_INFO: `/v3/projects/f9a703823c684fbf8250bc82819596d9/users/bb3f16bdcb064d118b5f719b0364803a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:20.143511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a703823c684fbf8250bc82819596d9, user_id=bb3f16bdcb064d118b5f719b0364803a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:20.147768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:20.167249 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3632/7293] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:20 2022] PUT /identity/v3/projects/f9a703823c684fbf8250bc82819596d9/users/bb3f16bdcb064d118b5f719b0364803a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:20.170946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:20.183286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3a921-2392-493f-abe5-6e5eb125a949 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:20.270247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e165-bdda-4d54-8b97-813272468dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:20.271053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e165-bdda-4d54-8b97-813272468dac admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:20.271557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e165-bdda-4d54-8b97-813272468dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:20.272047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e165-bdda-4d54-8b97-813272468dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:20.272983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e165-bdda-4d54-8b97-813272468dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:20.274881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e165-bdda-4d54-8b97-813272468dac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:20.291867 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3662/7294] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:20.296732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:20.312868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f555d-d2b6-4a22-b887-9efe10059831 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:20.323466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:20.329451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:20.329824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:20.330184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] PATH_INFO: `/v3/projects/f9a703823c684fbf8250bc82819596d9/users/bb3f16bdcb064d118b5f719b0364803a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:20.355191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a703823c684fbf8250bc82819596d9, user_id=bb3f16bdcb064d118b5f719b0364803a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:20.364063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:20.393958 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3633/7295] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:20 2022] PUT /identity/v3/projects/f9a703823c684fbf8250bc82819596d9/users/bb3f16bdcb064d118b5f719b0364803a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:20.396377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:20.396900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:20.396988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:20.433410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] MFA Rules not processed for user `bb3f16bdcb064d118b5f719b0364803a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:20.434697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:20.528436 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:20.578635 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3663/7296] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:20.580365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:20.582071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:20.660367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0653068-1484-46f0-9815-b73a173eeda2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:20.664566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:20.665376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:20.665764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:20.666148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:20.777017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:20.778513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:20.789218 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3634/7297] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:21.756159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:21.757707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:22.010234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f17a6-7131-48a5-a870-9512e2532179 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:22.021232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:22.021923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:22.022209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:22.022505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:22.024376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:22.076537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:22.078251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:22.133123 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3664/7298] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:23.016688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:23.018144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:23.072678 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:23.110752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e8957-88bb-46d8-ae5b-02ca3c391c06 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:23.115081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:23.115863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:23.116288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:23.116576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:23.118737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:23.134425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:23.151382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:23.188400 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3635/7299] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:27.005682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:27.010244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:27.032803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd52f1-d2b2-4103-9cdf-c6ace3452216 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:27.044529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab05e8e-2e9b-4d9a-975c-2bbb45d60f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:27.050378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05e8e-2e9b-4d9a-975c-2bbb45d60f57 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:27.050893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05e8e-2e9b-4d9a-975c-2bbb45d60f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:27.053607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05e8e-2e9b-4d9a-975c-2bbb45d60f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:27.079225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab05e8e-2e9b-4d9a-975c-2bbb45d60f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:27.081068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab05e8e-2e9b-4d9a-975c-2bbb45d60f57 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:27.094275 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3665/7300] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:30.695463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:30.697016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:30.743027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883010-210a-42f3-ae23-2f825da8e1b5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:30.760498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:30.761458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:30.764049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:30.765614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:30.770931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:30.806522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:30.809090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:30.874396 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3636/7301] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:37.089734 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=48 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:38.546528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:38.547702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:38.548436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:38.585107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] MFA Rules not processed for user `3fdf1208d2c34fd1b5a24c2ad4e063a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:38.590361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:38.770706 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3666/7302] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:40.820186 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=20 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:43.452335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:43.454620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:43.638370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0247d2-f501-46e0-989d-4d386619ebf5 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:43.647567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:43.649544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:43.650085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:43.650710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] PATH_INFO: `/v3/users/80acce1f0dc8425ba08b902b946d593e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:43.652654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=80acce1f0dc8425ba08b902b946d593e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:43.655666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:43.866357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80acce1f0dc8425ba08b902b946d593e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:43.911199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80acce1f0dc8425ba08b902b946d593e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:43.940241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80acce1f0dc8425ba08b902b946d593e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:43.990156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80acce1f0dc8425ba08b902b946d593e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:43.994279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3564fb35-9b9f-47b2-88fb-bf5f1e5d9eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80acce1f0dc8425ba08b902b946d593e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:44.040756 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3637/7303] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:17:43 2022] DELETE /identity/v3/users/80acce1f0dc8425ba08b902b946d593e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:44.326926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:44.342172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968685d4-327c-4f7c-97f8-2ccc31e2600a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:44.504042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:44.504800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:44.505092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:44.505374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] PATH_INFO: `/v3/projects/80340c48c45c4786a8ff67dd9efe0378` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:44.506650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80340c48c45c4786a8ff67dd9efe0378)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:44.508580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:44.599301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80340c48c45c4786a8ff67dd9efe0378', 'request_id': 'req-d359c82f-eb6c-4b35-b8ca-d12634235f7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:44.620480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80340c48c45c4786a8ff67dd9efe0378', 'request_id': 'req-d359c82f-eb6c-4b35-b8ca-d12634235f7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:44.628547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80340c48c45c4786a8ff67dd9efe0378', 'request_id': 'req-d359c82f-eb6c-4b35-b8ca-d12634235f7d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:44.649975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] The token cache is being invalidate because project 80340c48c45c4786a8ff67dd9efe0378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:17:44.650279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:44.650983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d359c82f-eb6c-4b35-b8ca-d12634235f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:44.652568 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3667/7304] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:17:44 2022] DELETE /identity/v3/projects/80340c48c45c4786a8ff67dd9efe0378 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:44.658351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:44.658878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:44.659137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:44.710263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:44.711538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:44.805290 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3638/7305] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:44.813735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:44.814351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:44.814739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:44.857360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:44.871261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:44.897525 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3668/7306] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:44.898771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:44.912902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f50ba-923d-4c29-b8f2-0888c789b91e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:44.918308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:44.919113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:44.925210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:44.925637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:44.928005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:17:44.928639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:44.931755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:44.947943 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3639/7307] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:17:44.952244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:44.968486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092b362-3b0e-4924-bc34-0d9f1ef708d3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:44.973477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:44.974429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:44.974429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:44.974742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:44.975443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:44.977481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.046540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:45.054632 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3669/7308] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:17:44 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:45.056517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1024-7c3a-4d2b-86e0-d78164040747 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:45.064150 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:45.220604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:45.221326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.222877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.223375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.226031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:45.228734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.266588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3640/7309] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:17:45 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:45.270212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:45.285698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307f15-108e-459b-ad16-35715645c372 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:45.297367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:45.298065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.298355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.299555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.303662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:45.308051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.312385 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:45.334550 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3670/7310] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:45.339621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:45.355660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a79bf-6b4d-4e3f-8e8b-2d093357416c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:45.361864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f539-b5e6-4567-bb70-8e1dc3dfc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:45.362955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f539-b5e6-4567-bb70-8e1dc3dfc2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.363467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f539-b5e6-4567-bb70-8e1dc3dfc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.363966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f539-b5e6-4567-bb70-8e1dc3dfc2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.365243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f539-b5e6-4567-bb70-8e1dc3dfc2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:45.367882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f539-b5e6-4567-bb70-8e1dc3dfc2d0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.384444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:45.386508 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3641/7311] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:45.399249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14b427-1cf7-43d1-b5e7-c660f57146df admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:45.408056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:45.409049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.409700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.410188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] PATH_INFO: `/v3/projects/dd44f410d4cb476fbbfcf2c0c4254a4c/users/038dce0912714065a6068378a8593d9a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.434083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd44f410d4cb476fbbfcf2c0c4254a4c, user_id=038dce0912714065a6068378a8593d9a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:45.438656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.483650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe17bdd-ad61-45ce-9d4f-29573d270004 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.484105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe17bdd-ad61-45ce-9d4f-29573d270004 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.484480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe17bdd-ad61-45ce-9d4f-29573d270004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.485939 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3671/7312] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:45 2022] PUT /identity/v3/projects/dd44f410d4cb476fbbfcf2c0c4254a4c/users/038dce0912714065a6068378a8593d9a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:17:45.518518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6fe17bdd-ad61-45ce-9d4f-29573d270004 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:45.520170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6fe17bdd-ad61-45ce-9d4f-29573d270004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:45.606578 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3642/7313] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:45.612100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:45.613998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:45.734750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b35f1-2cf2-458a-928b-91e8793f27e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:45.765607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423afa8-573c-4549-87f3-ed5b0297d901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:45.766995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423afa8-573c-4549-87f3-ed5b0297d901 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:45.767491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423afa8-573c-4549-87f3-ed5b0297d901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:45.767975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423afa8-573c-4549-87f3-ed5b0297d901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:45.819340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423afa8-573c-4549-87f3-ed5b0297d901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:45.827273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423afa8-573c-4549-87f3-ed5b0297d901 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:45.856073 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3672/7314] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:17:53.427725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:53.428241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:53.428436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:53.477540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] MFA Rules not processed for user `3a10dc703c4d442ea62abfddf18cf507`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:53.487477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:53.691993 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3643/7315] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:55.845171 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:56.120157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:56.121035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:56.121433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:56.216144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] MFA Rules not processed for user `038dce0912714065a6068378a8593d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:56.217918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:56.349007 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3673/7316] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:56.349964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:56.351973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:56.399173 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:56.476139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49560-b082-4c9a-8ec1-704ac5f76db1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:56.483943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dafb80-17ad-4c36-b885-4782a9193082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:56.484905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dafb80-17ad-4c36-b885-4782a9193082 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:56.485298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dafb80-17ad-4c36-b885-4782a9193082 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:56.485763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dafb80-17ad-4c36-b885-4782a9193082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:56.498251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dafb80-17ad-4c36-b885-4782a9193082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:56.501155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dafb80-17ad-4c36-b885-4782a9193082 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:56.525113 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3644/7317] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:56.704691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:56.707937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:56.748035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4ce80-c221-480a-9970-9a38368c0753 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:56.767446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:56.768349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:56.768637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:56.768919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] PATH_INFO: `/v3/users/89f81b82fd254c14a71b470a8a01e857` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:56.774387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f81b82fd254c14a71b470a8a01e857)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:56.777871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:56.874315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f81b82fd254c14a71b470a8a01e857'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:56.875339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f81b82fd254c14a71b470a8a01e857'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:56.923972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f81b82fd254c14a71b470a8a01e857'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:56.924710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f81b82fd254c14a71b470a8a01e857'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:56.933434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f81b82fd254c14a71b470a8a01e857'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:56.961154 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3674/7318] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:17:56 2022] DELETE /identity/v3/users/89f81b82fd254c14a71b470a8a01e857 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:56.963784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:56.964085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:56.964537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:56.987110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:56.988546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:57.096351 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3645/7319] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:57.110511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:57.113530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:57.380727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ba703-20c4-4b03-a9bb-95d027f2de25 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:57.392783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:57.398133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:57.398643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:57.399196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:57.477491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:57.479633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:57.482401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:57.490695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:57.535055 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3675/7320] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:57.729996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46386d4b-2e77-4f6e-9f38-7ffc2a7231fe None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:57.743546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:57.744220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:57.744530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:57.744809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:57.750398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:57.896257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:57.898511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634fea7-55a9-4c5a-abfa-f071abfcfa6a service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:57.920834 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3646/7321] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:17:57.962607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:57.964785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:57.982979 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:58.014419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ab38e-8065-4c82-8752-8b797fa9442a service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:58.030828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:58.033945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.037816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.038172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] PATH_INFO: `/v3/projects/cbac9797d5744dc9b1f5680f643ecb0f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.043574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbac9797d5744dc9b1f5680f643ecb0f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:58.047212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:58.173492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbac9797d5744dc9b1f5680f643ecb0f', 'request_id': 'req-645aa132-01ef-4157-895d-bb625ac5c0d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:58.186245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbac9797d5744dc9b1f5680f643ecb0f', 'request_id': 'req-645aa132-01ef-4157-895d-bb625ac5c0d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:58.197423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbac9797d5744dc9b1f5680f643ecb0f', 'request_id': 'req-645aa132-01ef-4157-895d-bb625ac5c0d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:58.213252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] The token cache is being invalidate because project cbac9797d5744dc9b1f5680f643ecb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:17:58.213598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:58.214315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-645aa132-01ef-4157-895d-bb625ac5c0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:17:58.217062 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3676/7322] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:17:57 2022] DELETE /identity/v3/projects/cbac9797d5744dc9b1f5680f643ecb0f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:58.222126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.222707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.223219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.244191 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:17:58.265379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:58.271362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:58.430979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3647/7323] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:17:58.439474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.439969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.440331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.472508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:58.474585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:58.488256 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3677/7324] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:58.496268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:58.505697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ea4f-8f6b-448e-beb1-6c3376048adf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:58.512476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:58.514043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.514555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.514827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.515881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:17:58.516500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:58.519165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:58.537060 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3648/7325] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:17:58.543074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:58.556329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9a453-61a2-4be8-8507-6781e8207866 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:58.564745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:58.565918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.566483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.567085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.568266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:58.571271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:58.607563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3678/7326] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:17:58 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:58.611681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:58.636743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019434-ec8f-42d6-baa3-6d7c5f82cf98 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:58.789230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:58.790324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.790324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.790622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.796861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:58.799727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:58.874053 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3649/7327] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:17:58 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:17:58.885061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:58.903337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefd9f2-17a1-4319-89e1-ac34e630f952 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:58.923855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:58.925619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:58.925914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:58.926331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:58.927128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:58.930683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:58.971772 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3679/7328] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:17:58.976355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:58.994175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7278-86b0-4b5a-8fa4-932919040ddd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:59.003885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaf98a-ee92-4e0e-aadb-68ddcda97c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:59.005157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf98a-ee92-4e0e-aadb-68ddcda97c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:59.005682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf98a-ee92-4e0e-aadb-68ddcda97c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:59.007020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf98a-ee92-4e0e-aadb-68ddcda97c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:59.008067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaf98a-ee92-4e0e-aadb-68ddcda97c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:59.010137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaf98a-ee92-4e0e-aadb-68ddcda97c3f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:59.059201 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3650/7329] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:17:59.063489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:59.085171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8815133-7c6f-4577-976c-e705e3431a5c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:59.107509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:59.107509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:59.107509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:59.107509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] PATH_INFO: `/v3/projects/51b6de01779e46aaa4e17a5a8b0c1087/users/e83ef7a969b941789086bdf66674c602/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:59.139060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b6de01779e46aaa4e17a5a8b0c1087, user_id=e83ef7a969b941789086bdf66674c602, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:59.145711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:59.188920 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3680/7330] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:17:59 2022] PUT /identity/v3/projects/51b6de01779e46aaa4e17a5a8b0c1087/users/e83ef7a969b941789086bdf66674c602/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:17:59.191831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:59.193260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:59.194045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:59.276003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] MFA Rules not processed for user `e83ef7a969b941789086bdf66674c602`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:17:59.279430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:59.475026 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3651/7331] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:17:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:17:59.484203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:17:59.486180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:17:59.618370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471756cb-9000-4b08-b7a4-a03ab9e0ec98 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:17:59.631435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:17:59.631911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:17:59.632269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:17:59.632707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:17:59.647545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:17:59.649158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:17:59.668933 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3681/7332] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:17:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:06.149043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:06.151777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:06.157758 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:06.282875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586824c-a038-4972-89ad-98a13b56db02 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:06.295437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:06.297128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:06.297506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:06.297891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] PATH_INFO: `/v3/users/038dce0912714065a6068378a8593d9a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:06.299244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038dce0912714065a6068378a8593d9a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:06.301886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:06.372269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038dce0912714065a6068378a8593d9a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.387942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038dce0912714065a6068378a8593d9a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.397211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038dce0912714065a6068378a8593d9a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.412079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038dce0912714065a6068378a8593d9a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.414187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-eee18458-3725-4774-b207-d69cce3eef19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038dce0912714065a6068378a8593d9a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.440279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3652/7333] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:06 2022] DELETE /identity/v3/users/038dce0912714065a6068378a8593d9a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:06.676246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:06.707962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e249-5639-46f8-b6ee-c317aeff3ab2 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:06.752238 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:06.800228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:06.801237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:06.801625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:06.802006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] PATH_INFO: `/v3/projects/dd44f410d4cb476fbbfcf2c0c4254a4c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:06.803522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd44f410d4cb476fbbfcf2c0c4254a4c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:06.805815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:06.863883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd44f410d4cb476fbbfcf2c0c4254a4c', 'request_id': 'req-a50344ba-7c15-4339-bdc9-ae1a46e2b109'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.874192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd44f410d4cb476fbbfcf2c0c4254a4c', 'request_id': 'req-a50344ba-7c15-4339-bdc9-ae1a46e2b109'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.883463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd44f410d4cb476fbbfcf2c0c4254a4c', 'request_id': 'req-a50344ba-7c15-4339-bdc9-ae1a46e2b109'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.897035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] The token cache is being invalidate because project dd44f410d4cb476fbbfcf2c0c4254a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:06.897576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.898593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a50344ba-7c15-4339-bdc9-ae1a46e2b109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:06.900987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3682/7334] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:06 2022] DELETE /identity/v3/projects/dd44f410d4cb476fbbfcf2c0c4254a4c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:06.905813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:06.906375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:06.907000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:06.934234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:06.936611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:07.026544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3653/7335] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:07.032904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.033206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.033493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.074929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:07.076239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:07.085129 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3683/7336] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:07.090724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.113481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caee15-b13c-4d0f-bba9-502aa17c031a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.118834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.119524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.119811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.120092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.120842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:07.121153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.123416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.138629 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3654/7337] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:18:07.142872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.155156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93800-7aa8-4904-ae94-63b067aae8ab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.176196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.176893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.177185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.177544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.178166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.180194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.262530 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3684/7338] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:07.266031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.281602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9339b-cb94-4e38-82ab-85f992cc2732 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.288975 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:07.421877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.422617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.422913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.423192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.424114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.425827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.472675 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3655/7339] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:07 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:07.476581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.507913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61930-c41c-4cff-90a2-6317b9d3e213 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.522437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.523169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.523460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.524085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.524846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.526480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.551177 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3685/7340] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:07.555095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.573354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d691-94b5-4770-a3d4-6a893175085a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.580905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94660a5-13aa-48cb-ac74-0940ab3a0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.581606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94660a5-13aa-48cb-ac74-0940ab3a0805 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.582428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94660a5-13aa-48cb-ac74-0940ab3a0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.582807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94660a5-13aa-48cb-ac74-0940ab3a0805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.583564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94660a5-13aa-48cb-ac74-0940ab3a0805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.585261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94660a5-13aa-48cb-ac74-0940ab3a0805 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.613476 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3656/7341] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:07.617706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.631587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55c9a-596a-4bc3-8a8a-b5cc355f38bf admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.636662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.639202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.639202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.639202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] PATH_INFO: `/v3/projects/a74ce7c429614bc2ae5846ac4dbea8e8/users/9e6e427d6093411aad6cd6d664e9b7fc/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.658775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74ce7c429614bc2ae5846ac4dbea8e8, user_id=9e6e427d6093411aad6cd6d664e9b7fc, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.662016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.681149 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3686/7342] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:07 2022] PUT /identity/v3/projects/a74ce7c429614bc2ae5846ac4dbea8e8/users/9e6e427d6093411aad6cd6d664e9b7fc/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:07.687319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.688224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.688583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.721925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:07.727085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:07.833243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3657/7343] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:07.845873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:07.847797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:07.930376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f056d-685a-4c12-9358-888ac7b4481c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:07.936647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe33edb-4111-4cf2-a59b-2c0f5ee1e240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:07.937559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe33edb-4111-4cf2-a59b-2c0f5ee1e240 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:07.938736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe33edb-4111-4cf2-a59b-2c0f5ee1e240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:07.939174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe33edb-4111-4cf2-a59b-2c0f5ee1e240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:07.950880 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:07.956959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe33edb-4111-4cf2-a59b-2c0f5ee1e240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:07.959626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe33edb-4111-4cf2-a59b-2c0f5ee1e240 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:07.983369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3687/7344] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:08.594980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:08.598142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:08.646354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9be02e-a3e4-4c3e-bb06-2cef197a94ba None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:08.681705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:08.682715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:08.682922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:08.683202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] PATH_INFO: `/v3/users/214749ec3604446093ab9aa375e72c76` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:08.689605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214749ec3604446093ab9aa375e72c76)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:08.695227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:08.821011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214749ec3604446093ab9aa375e72c76'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:08.835501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214749ec3604446093ab9aa375e72c76'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:08.852998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214749ec3604446093ab9aa375e72c76'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:08.867692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214749ec3604446093ab9aa375e72c76'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:08.871098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214749ec3604446093ab9aa375e72c76'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:08.879879 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:08.889991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3658/7345] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:08 2022] DELETE /identity/v3/users/214749ec3604446093ab9aa375e72c76 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:08.895710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:08.896638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:08.897121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:08.920771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:08.922853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:09.034034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3688/7346] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:09.043477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:09.045863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:09.126390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f4d59-bfa1-4958-8f3b-98880017a737 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:09.131569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:09.132296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:09.132636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:09.133313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:09.143447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:09.144909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:09.157932 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3659/7347] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:09.612800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:09.614269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:09.658807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83beeab-1b89-4357-8d9b-9a61e23b5b63 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:09.675757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:09.676660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:09.676946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:09.677226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] PATH_INFO: `/v3/projects/8bc6bc5c605e4687a932fbfb16e9c92e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:09.686069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc6bc5c605e4687a932fbfb16e9c92e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:09.688498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:09.799912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc6bc5c605e4687a932fbfb16e9c92e', 'request_id': 'req-4e55115e-067c-4325-b9b3-432aebc68548'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:09.826786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc6bc5c605e4687a932fbfb16e9c92e', 'request_id': 'req-4e55115e-067c-4325-b9b3-432aebc68548'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:09.836668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc6bc5c605e4687a932fbfb16e9c92e', 'request_id': 'req-4e55115e-067c-4325-b9b3-432aebc68548'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:09.866003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] The token cache is being invalidate because project 8bc6bc5c605e4687a932fbfb16e9c92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:09.866337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:09.867613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:09.870760 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3689/7348] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:09 2022] DELETE /identity/v3/projects/8bc6bc5c605e4687a932fbfb16e9c92e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:09.874119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:09.918868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf28c8-b945-4091-ba2f-1f92422f4f93 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:10.034271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:10.035205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:10.035503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:10.035768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] PATH_INFO: `/v3/users/bb3f16bdcb064d118b5f719b0364803a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:10.038405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3f16bdcb064d118b5f719b0364803a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:10.040621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:10.148775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3f16bdcb064d118b5f719b0364803a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:10.181717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3f16bdcb064d118b5f719b0364803a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:10.201763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3f16bdcb064d118b5f719b0364803a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:10.218706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3f16bdcb064d118b5f719b0364803a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:10.219496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-04949844-a037-4da8-885f-49f8a18f59d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3f16bdcb064d118b5f719b0364803a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:10.227342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3660/7349] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:09 2022] DELETE /identity/v3/users/bb3f16bdcb064d118b5f719b0364803a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:10.799809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:10.803225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:10.851816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55115e-067c-4325-b9b3-432aebc68548 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:11.032367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:11.034274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:11.034787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:11.035387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] PATH_INFO: `/v3/projects/f9a703823c684fbf8250bc82819596d9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:11.040687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a703823c684fbf8250bc82819596d9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:11.045433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:11.089264 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:11.195340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a703823c684fbf8250bc82819596d9', 'request_id': 'req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:11.217930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a703823c684fbf8250bc82819596d9', 'request_id': 'req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:11.226948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a703823c684fbf8250bc82819596d9', 'request_id': 'req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:11.253862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] The token cache is being invalidate because project f9a703823c684fbf8250bc82819596d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:11.257166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:11.259635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe888a2b-88a1-40c6-8ca7-b6ee37e448ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:11.263852 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3690/7350] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:10 2022] DELETE /identity/v3/projects/f9a703823c684fbf8250bc82819596d9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:11.276221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:11.276793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:11.276793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:11.307469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:11.308769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:11.327281 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:11.437804 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3661/7351] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:11.445778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:11.446608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:11.447509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:11.557092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:11.558452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:11.578653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3691/7352] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:11.583294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:11.609316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90865a15-3180-48c5-a725-86d44827b8ce None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:11.614291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:11.615004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:11.615364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:11.615647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:11.616392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:11.616697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:11.618343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:11.651377 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3662/7353] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:18:11.656431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:11.669851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d536-1bb4-4a8e-a2b6-bb2eed5d7d50 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:11.691783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:11.692676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:11.692962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:11.693687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:11.694277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:11.700576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:11.763563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3692/7354] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:11 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:11.767866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:11.785031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef227a0-b647-4bdf-8619-7319bbc6d7ec admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.117258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.118122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.118723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.119011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.119842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.121958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.163590 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3663/7355] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:11 2022] POST /identity/v3/users => generated 297 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:12.167557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.183146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9a37-d61e-4582-9910-77f73f014a44 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.195941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.196944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.197387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.197831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.198761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.202224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.237159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3693/7356] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:12.238943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.254049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3bf87-8985-4741-a6f8-47a65f33b7eb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.260374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d7519-1401-493f-bf5d-07a6188da712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.261267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7519-1401-493f-bf5d-07a6188da712 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.261546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7519-1401-493f-bf5d-07a6188da712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.262302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7519-1401-493f-bf5d-07a6188da712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.262698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d7519-1401-493f-bf5d-07a6188da712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.264480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d7519-1401-493f-bf5d-07a6188da712 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.278487 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3664/7357] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:12.283000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.295092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1f760-8769-4b2f-a731-5c3149a0da6d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.300919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.302148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.302676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.303118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] PATH_INFO: `/v3/projects/c4d8831b897f4f9e98403149e9c918ed/users/e0f86170b74b4c13baed7cfb8da79ecb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.325572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d8831b897f4f9e98403149e9c918ed, user_id=e0f86170b74b4c13baed7cfb8da79ecb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.328975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.348913 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3694/7358] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:12 2022] PUT /identity/v3/projects/c4d8831b897f4f9e98403149e9c918ed/users/e0f86170b74b4c13baed7cfb8da79ecb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:12.359948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.360244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.360527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.401570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] MFA Rules not processed for user `e0f86170b74b4c13baed7cfb8da79ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:12.402884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:12.478441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3665/7359] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:12.483928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.573488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21483b8-925b-4677-a09a-1a0ebb3a7c40 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.578726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.579414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.579702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.579982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.580735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.582747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.670131 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3695/7360] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:12 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:12.674078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.695898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87022858-29ed-4747-99a0-d953d24956f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.711292 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:12.838745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.839604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.840004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.840361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.841815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.843932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.899102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3666/7361] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:12 2022] POST /identity/v3/users => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:12.903196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.918968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df0c11-f898-44c5-ae99-3be30baa11d4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:12.931238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:12.931947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:12.932234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:12.932518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:12.933263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:12.935802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:12.966620 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3696/7362] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:12.967855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:12.993372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa660cc-dc05-48a5-a7b5-680088473463 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:13.015283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:13.016485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:13.016935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:13.017390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] PATH_INFO: `/v3/projects/bfca5b3cc626426ebcda8f5c0dabadc3/users/7cdb992796da4dc0b5766f455e44828d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:13.118181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfca5b3cc626426ebcda8f5c0dabadc3, user_id=7cdb992796da4dc0b5766f455e44828d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:13.120969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:13.166608 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3667/7363] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:12 2022] PUT /identity/v3/projects/bfca5b3cc626426ebcda8f5c0dabadc3/users/7cdb992796da4dc0b5766f455e44828d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:13.170361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:13.185887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d810b-9174-4b43-b5de-cae69332a283 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:13.217128 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:13.371651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ac9ce-129c-4bd4-9e0b-592a5a8dc54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:13.372898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac9ce-129c-4bd4-9e0b-592a5a8dc54d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:13.373193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac9ce-129c-4bd4-9e0b-592a5a8dc54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:13.373481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac9ce-129c-4bd4-9e0b-592a5a8dc54d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:13.374220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac9ce-129c-4bd4-9e0b-592a5a8dc54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:13.381782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac9ce-129c-4bd4-9e0b-592a5a8dc54d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:13.443821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3697/7364] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:13.445009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:13.462394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217dd26-ffff-416a-9bf7-9270e2809f01 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:13.491837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:13.491837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:13.491837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:13.491837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] PATH_INFO: `/v3/projects/bfca5b3cc626426ebcda8f5c0dabadc3/users/7cdb992796da4dc0b5766f455e44828d/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:13.506112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfca5b3cc626426ebcda8f5c0dabadc3, user_id=7cdb992796da4dc0b5766f455e44828d, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:13.509594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:13.537805 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3668/7365] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:13 2022] PUT /identity/v3/projects/bfca5b3cc626426ebcda8f5c0dabadc3/users/7cdb992796da4dc0b5766f455e44828d/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:13.555563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:13.555877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:13.556128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:13.629694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] MFA Rules not processed for user `7cdb992796da4dc0b5766f455e44828d`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:13.630981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:13.796627 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3698/7366] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:13.805032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:13.806826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:13.923623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec233b91-19ad-4b72-8441-775c53fe447d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:13.930325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58699ec9-801d-4bc7-8d98-eb998550cc17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:13.932243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58699ec9-801d-4bc7-8d98-eb998550cc17 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:13.932706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58699ec9-801d-4bc7-8d98-eb998550cc17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:13.933213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58699ec9-801d-4bc7-8d98-eb998550cc17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:13.958986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58699ec9-801d-4bc7-8d98-eb998550cc17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:13.960986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58699ec9-801d-4bc7-8d98-eb998550cc17 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:14.000947 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3669/7367] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:14.084558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:14.105189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ad97f-7b1a-43dd-a1ab-4a4f68a195a1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:14.115518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:14.124666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:14.130322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:14.132033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:14.296390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:14.297849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:14.314236 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3699/7368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:16.394316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cf394-aa8c-4cac-8518-0c5dd7738734 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:16.396375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cf394-aa8c-4cac-8518-0c5dd7738734 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:16.396853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cf394-aa8c-4cac-8518-0c5dd7738734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:16.461702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-be5cf394-aa8c-4cac-8518-0c5dd7738734 None None] MFA Rules not processed for user `9e6e427d6093411aad6cd6d664e9b7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:16.463483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-be5cf394-aa8c-4cac-8518-0c5dd7738734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:16.650980 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:16.672387 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3670/7369] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:16.681349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:16.683443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:16.794220 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:16.884659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9d79-052c-4fca-a0de-bd472a5cac58 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:16.902043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:16.904281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:16.904576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:16.904862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:16.929103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:16.931421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:16.960153 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3700/7370] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:18.466371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b68642-54f1-4f71-a1a4-34ce72e68088 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:18.467035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b68642-54f1-4f71-a1a4-34ce72e68088 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:18.467035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b68642-54f1-4f71-a1a4-34ce72e68088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:18.501105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-14b68642-54f1-4f71-a1a4-34ce72e68088 None None] MFA Rules not processed for user `9e6e427d6093411aad6cd6d664e9b7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:18.501105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14b68642-54f1-4f71-a1a4-34ce72e68088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:18.521917 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3671/7371] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:23.772640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:23.928122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858162-e82d-455c-a7f5-43a5dc11e736 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:23.936894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:23.937805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:23.938090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:23.938367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] PATH_INFO: `/v3/users/e0f86170b74b4c13baed7cfb8da79ecb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:23.939619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f86170b74b4c13baed7cfb8da79ecb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:23.941770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:24.045103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f86170b74b4c13baed7cfb8da79ecb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:24.046142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f86170b74b4c13baed7cfb8da79ecb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:24.081949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f86170b74b4c13baed7cfb8da79ecb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:24.082738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f86170b74b4c13baed7cfb8da79ecb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:24.094854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f86170b74b4c13baed7cfb8da79ecb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:24.131093 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3701/7372] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:23 2022] DELETE /identity/v3/users/e0f86170b74b4c13baed7cfb8da79ecb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:24.135404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:24.136701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:24.137345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:24.164400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:24.165855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:24.259012 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3672/7373] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:24.268960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:24.270618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:24.330946 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:24.391809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f3cee-a7aa-4acf-82d1-817f78c3144d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:24.398013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:24.398700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:24.399176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:24.399467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:24.414024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:24.415998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:24.430853 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3702/7374] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:25.113251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:25.114820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:25.134606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e648c-0917-4157-a94e-9c139fc05b33 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:25.148074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:25.149114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:25.149408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:25.149691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] PATH_INFO: `/v3/projects/c4d8831b897f4f9e98403149e9c918ed` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:25.150964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d8831b897f4f9e98403149e9c918ed)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:25.157240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:25.284407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d8831b897f4f9e98403149e9c918ed', 'request_id': 'req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.305401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d8831b897f4f9e98403149e9c918ed', 'request_id': 'req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.317845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d8831b897f4f9e98403149e9c918ed', 'request_id': 'req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.348857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] The token cache is being invalidate because project c4d8831b897f4f9e98403149e9c918ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:25.350001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.350981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.353076 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3673/7375] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:25 2022] DELETE /identity/v3/projects/c4d8831b897f4f9e98403149e9c918ed => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:25.357720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:25.371440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2c5f-8835-40c7-b8bc-4b4ace1ef49d service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:25.454107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:25.455539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:25.456034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:25.456534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] PATH_INFO: `/v3/users/7cdb992796da4dc0b5766f455e44828d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:25.458622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdb992796da4dc0b5766f455e44828d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:25.461768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:25.541323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdb992796da4dc0b5766f455e44828d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.541998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdb992796da4dc0b5766f455e44828d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.568685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdb992796da4dc0b5766f455e44828d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.569659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdb992796da4dc0b5766f455e44828d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.580873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ced4b3aa-0447-4b8d-b825-d22e238a9ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdb992796da4dc0b5766f455e44828d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:25.598880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3703/7376] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:25 2022] DELETE /identity/v3/users/7cdb992796da4dc0b5766f455e44828d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:25.948147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:25.950058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:25.966860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e1de-8c9c-44fd-bf06-58c5ea7f3555 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.045528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.046650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.047419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.048004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] PATH_INFO: `/v3/projects/bfca5b3cc626426ebcda8f5c0dabadc3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.049742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfca5b3cc626426ebcda8f5c0dabadc3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.052113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.068908 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:26.111765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfca5b3cc626426ebcda8f5c0dabadc3', 'request_id': 'req-41974f5d-2e4d-4c48-8646-dfef08ff3014'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.117655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfca5b3cc626426ebcda8f5c0dabadc3', 'request_id': 'req-41974f5d-2e4d-4c48-8646-dfef08ff3014'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.125446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfca5b3cc626426ebcda8f5c0dabadc3', 'request_id': 'req-41974f5d-2e4d-4c48-8646-dfef08ff3014'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.139347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] The token cache is being invalidate because project bfca5b3cc626426ebcda8f5c0dabadc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:26.139638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.140508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-41974f5d-2e4d-4c48-8646-dfef08ff3014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.142437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3674/7377] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:25 2022] DELETE /identity/v3/projects/bfca5b3cc626426ebcda8f5c0dabadc3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:26.147914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.148424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.148787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.171589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:26.172942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:26.230673 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:26.250940 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3704/7378] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:26.265939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.266514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.266667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.286427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:26.287629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:26.297241 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3675/7379] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:26.301402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.313076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb2bd-cbee-414b-9a94-19be2afcf3c1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.318933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.319998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.320415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.320805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.321639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:26.322168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.325072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.341770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.348408 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3705/7380] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:18:26.352199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695ee0b-c6a0-4f6b-8670-1a2773e999f8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.357976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.358876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.359269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.359645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.360447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.362481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.423666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.430165 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3676/7381] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:26.438072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c20bf-878c-4ecc-b9d4-7d52378a2cb1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.520272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.520968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.521260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.521547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.522292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.524265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.557718 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3706/7382] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:26.562259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.575670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06091b-7188-4225-9dca-fa8730467eca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.581753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.582881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.583406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.583915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.584889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.586838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.600908 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3677/7383] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:18:26.605059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.627921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95207-c514-4f56-b597-7f92eb718630 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.643589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.643589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.643589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.643589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.644523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.644523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.669803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.671827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:26.684903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3707/7384] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:26.693692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7494-fd94-41af-9146-957c9a5ddc6b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.694096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.698711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.699747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.700035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.700634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] PATH_INFO: `/v3/users/e83ef7a969b941789086bdf66674c602` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.702046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83ef7a969b941789086bdf66674c602)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.704117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.709984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630526-f12b-49b6-bcdf-d91f6dda9099 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:26.725532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d3292-ac65-4277-852e-62525bf35b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:26.727611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3292-ac65-4277-852e-62525bf35b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.728671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3292-ac65-4277-852e-62525bf35b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.730474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3292-ac65-4277-852e-62525bf35b90 admin admin] PATH_INFO: `/v3/projects/4567c027f1c8499fa05b8906f835c21e/users/1a94557eff07472a94d30a7e00e66cd9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.754845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d3292-ac65-4277-852e-62525bf35b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4567c027f1c8499fa05b8906f835c21e, user_id=1a94557eff07472a94d30a7e00e66cd9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:26.759220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d3292-ac65-4277-852e-62525bf35b90 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:26.784532 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3708/7385] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:26 2022] PUT /identity/v3/projects/4567c027f1c8499fa05b8906f835c21e/users/1a94557eff07472a94d30a7e00e66cd9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:26.803542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83ef7a969b941789086bdf66674c602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.808248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.808552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.808872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.824079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83ef7a969b941789086bdf66674c602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.841611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83ef7a969b941789086bdf66674c602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.856648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] MFA Rules not processed for user `1a94557eff07472a94d30a7e00e66cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:26.858145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83ef7a969b941789086bdf66674c602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.858351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:26.858934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cff49fa8-e20e-4f14-92e5-636a2f48e123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83ef7a969b941789086bdf66674c602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:26.875813 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3678/7386] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:26 2022] DELETE /identity/v3/users/e83ef7a969b941789086bdf66674c602 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:26.881975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:26.882279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:26.882734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:26.928349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:26.930152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:26.966910 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3709/7387] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:26.971090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:26.972699 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:26.973586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:27.005319 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:27.011225 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3679/7388] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:27.019379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.021269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:27.075886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe92c6a-c112-492e-ad84-64b9d7aa3a31 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.082078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.082799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.083201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.083502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.084208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.086160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.119184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3710/7389] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:26 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:27.122770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.162221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80949-5424-4856-b3a2-faad47065e93 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.223844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5502-b131-4fc5-9194-26a6655a041e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.235316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.236485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.237043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.238705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.240882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.245389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.272161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.273162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.273924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.274302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.287829 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3711/7390] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:27 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:18:27.291432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.298578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.301047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.305005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d629a2-23fc-4683-b0ad-2b8f80a0cac6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.310957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.312052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.312591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.313269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.314283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.316506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.328253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3680/7391] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:18:27.330645 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3712/7392] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:27.334253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.350924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617fcc3-0eb0-4230-a10d-20a4f4c33476 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.370704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.372007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.372280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.372638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] PATH_INFO: `/v3/projects/ff43b1a6de6a4a9eae8cfc89d01a9b43/users/17fd1007673d4c44ad1c49e94a6d3d68/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.394129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff43b1a6de6a4a9eae8cfc89d01a9b43, user_id=17fd1007673d4c44ad1c49e94a6d3d68, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.397531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.418276 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3681/7393] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:27 2022] PUT /identity/v3/projects/ff43b1a6de6a4a9eae8cfc89d01a9b43/users/17fd1007673d4c44ad1c49e94a6d3d68/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:18:27.422225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.434384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41537-1d6f-4e2a-af2f-a6199d3b1be4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.499729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2419f-ea55-448d-91b1-9704c092fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.500459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2419f-ea55-448d-91b1-9704c092fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.500984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2419f-ea55-448d-91b1-9704c092fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.501409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2419f-ea55-448d-91b1-9704c092fc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.502233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2419f-ea55-448d-91b1-9704c092fc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.504413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2419f-ea55-448d-91b1-9704c092fc0b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.536243 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3713/7394] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:18:27.537165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.575166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e364943-9232-4cc2-9915-e64a2e15d758 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.581936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.582955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.583247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.583527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] PATH_INFO: `/v3/projects/ff43b1a6de6a4a9eae8cfc89d01a9b43/users/17fd1007673d4c44ad1c49e94a6d3d68/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.585686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff43b1a6de6a4a9eae8cfc89d01a9b43, user_id=17fd1007673d4c44ad1c49e94a6d3d68, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.588729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.601890 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3682/7395] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:27 2022] PUT /identity/v3/projects/ff43b1a6de6a4a9eae8cfc89d01a9b43/users/17fd1007673d4c44ad1c49e94a6d3d68/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:27.615213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.615499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.615790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.661957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] MFA Rules not processed for user `17fd1007673d4c44ad1c49e94a6d3d68`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:27.663285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:27.674757 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:27.789267 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3714/7396] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:27.804979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.807257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:27.839188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:27.842117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:27.939730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3487952-2a19-4b49-8cad-656ccec0ff26 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.940292 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:27.947633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb527-991a-48b5-8d2b-cb33d57bf883 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:27.949448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.950704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.951090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.951473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] PATH_INFO: `/v3/projects/51b6de01779e46aaa4e17a5a8b0c1087` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.952449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d9aa-7a49-4552-8d70-7535d7ccbf60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:27.953182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b6de01779e46aaa4e17a5a8b0c1087)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.953319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d9aa-7a49-4552-8d70-7535d7ccbf60 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:27.953538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d9aa-7a49-4552-8d70-7535d7ccbf60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:27.954062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d9aa-7a49-4552-8d70-7535d7ccbf60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:27.956346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.967092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d9aa-7a49-4552-8d70-7535d7ccbf60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:27.969039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d9aa-7a49-4552-8d70-7535d7ccbf60 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:27.986680 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3683/7397] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:28.023739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b6de01779e46aaa4e17a5a8b0c1087', 'request_id': 'req-1ddda28f-b421-44d2-aa44-0e65b31ca466'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:28.027004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b6de01779e46aaa4e17a5a8b0c1087', 'request_id': 'req-1ddda28f-b421-44d2-aa44-0e65b31ca466'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:28.037273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b6de01779e46aaa4e17a5a8b0c1087', 'request_id': 'req-1ddda28f-b421-44d2-aa44-0e65b31ca466'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:28.065013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] The token cache is being invalidate because project 51b6de01779e46aaa4e17a5a8b0c1087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:28.065013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:28.066179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:28.082866 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3715/7398] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:27 2022] DELETE /identity/v3/projects/51b6de01779e46aaa4e17a5a8b0c1087 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:28.085631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50530fb-1711-4577-b855-12ce2a864b17 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.086112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50530fb-1711-4577-b855-12ce2a864b17 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.086598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50530fb-1711-4577-b855-12ce2a864b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.137744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b50530fb-1711-4577-b855-12ce2a864b17 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:28.139069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b50530fb-1711-4577-b855-12ce2a864b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:28.150292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.160436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:28.254988 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:28.264929 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3684/7399] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:18:28.266364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.266695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.267045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.289209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:28.290440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:28.321352 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3685/7400] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:28.327662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda28f-b421-44d2-aa44-0e65b31ca466 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.327828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.328006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.328006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.328006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.328006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.332806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:28.334620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2266-5adf-4159-9d40-7c55ad9ff09e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.340426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.341225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.341581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.341934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.343062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:28.343438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.345693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.367417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3686/7401] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:18:28.368979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.380915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49506ff9-a584-4276-8751-927fe281ad38 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.387613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.388825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.389286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.390034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.390948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.393208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.466551 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3687/7402] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:28 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:18:28.474460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.477897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.479849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.492750 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3716/7403] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:18:28.579280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ef6f7-7c4f-4212-a332-6c4617794aed admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.585250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.586108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.586468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.586859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.587678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.589646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.615137 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3688/7404] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:28 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:28.618974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.631769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6e6c-fe93-4b93-97f1-756a54c2a1cb service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.638125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.639185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.639479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.639758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.640571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.642320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.656331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3717/7405] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:28.661658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.673806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69786d64-bfcb-4143-95cc-e1af227d2643 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.679958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc339a71-021b-488b-98d6-db50efad8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.680846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc339a71-021b-488b-98d6-db50efad8bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.681195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc339a71-021b-488b-98d6-db50efad8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.681547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc339a71-021b-488b-98d6-db50efad8bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.682398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc339a71-021b-488b-98d6-db50efad8bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.684799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc339a71-021b-488b-98d6-db50efad8bfc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.699401 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3689/7406] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:28.703775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:28.716824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce4ef-be8c-4c11-aab7-3e75a2ae7898 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:28.722163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:28.724697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.725103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.725450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] PATH_INFO: `/v3/projects/629e51ad53db4818a39ffde1ad25fc57/users/3cced2e2903b42f580b9221464af5537/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.751248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629e51ad53db4818a39ffde1ad25fc57, user_id=3cced2e2903b42f580b9221464af5537, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:28.754093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:28.772332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3718/7407] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:28 2022] PUT /identity/v3/projects/629e51ad53db4818a39ffde1ad25fc57/users/3cced2e2903b42f580b9221464af5537/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:28.911937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a9cc-6b8d-48d2-b840-9a1092ff4900 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:28.912229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a9cc-6b8d-48d2-b840-9a1092ff4900 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:28.912516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a9cc-6b8d-48d2-b840-9a1092ff4900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:28.969309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8ad4a9cc-6b8d-48d2-b840-9a1092ff4900 None None] MFA Rules not processed for user `3cced2e2903b42f580b9221464af5537`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:28.970646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8ad4a9cc-6b8d-48d2-b840-9a1092ff4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:28.997163 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:29.166183 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3690/7408] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:29.168680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.302836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d8db-2495-4c0b-8d5a-a4c9e86977c1 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.304628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d8db-2495-4c0b-8d5a-a4c9e86977c1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.305288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d8db-2495-4c0b-8d5a-a4c9e86977c1 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.306851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684bef-b3f9-4721-8e95-111dbeef45d7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.307984 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3691/7409] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:18:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:18:29.322159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.322159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.322159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.323123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.323123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.323123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.323123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.323922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.323922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.339625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:29.341561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:29.371939 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3719/7410] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:29 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:29.378569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.428406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3692/7411] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:18:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:18:29.435768 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:29.452020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.453642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:29.460528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b9b1-2f5c-4b1c-a2cd-ed04e6fd2967 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.466590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.467514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.468080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.468365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.469229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.471283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac4fb-92db-4e63-9ff4-2cb59722e6ea None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.471455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.508453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3720/7412] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:29 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:29.509543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.545363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8d3f-9777-4583-a4bc-cd0553589aee admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.556916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.557604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.557891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.558171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.559372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.561001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.563992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.565160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.566723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.567252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.583168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.585171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.592218 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3721/7413] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:29.597293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.600666 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3693/7414] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:18:29.612078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323857c-0a5e-48e4-8736-c6f1208002dd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.625886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.626830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.627113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.627385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] PATH_INFO: `/v3/projects/82995d1a851e4817bcd2f0eb28b61bfb/users/ded6cb8baf424f2c957af5266bb06460/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.650084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82995d1a851e4817bcd2f0eb28b61bfb, user_id=ded6cb8baf424f2c957af5266bb06460, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.653723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.675033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.675623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3722/7415] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:29 2022] PUT /identity/v3/projects/82995d1a851e4817bcd2f0eb28b61bfb/users/ded6cb8baf424f2c957af5266bb06460/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:29.697748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bf86-90f4-4e60-831a-da9894cc5191 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.772885 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:29.795010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abe44-6518-4978-bd63-682f632f91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.795702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abe44-6518-4978-bd63-682f632f91b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.796151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abe44-6518-4978-bd63-682f632f91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.796459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abe44-6518-4978-bd63-682f632f91b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.797496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abe44-6518-4978-bd63-682f632f91b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.799237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abe44-6518-4978-bd63-682f632f91b1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.813381 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3694/7416] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:29.818541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:29.831255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb57d41-4a92-4bd9-a8a5-0ef2ef8192e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:29.837073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:29.837990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.838270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.838779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] PATH_INFO: `/v3/projects/82995d1a851e4817bcd2f0eb28b61bfb/users/ded6cb8baf424f2c957af5266bb06460/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.840853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82995d1a851e4817bcd2f0eb28b61bfb, user_id=ded6cb8baf424f2c957af5266bb06460, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:29.845775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:29.856756 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3723/7417] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:29 2022] PUT /identity/v3/projects/82995d1a851e4817bcd2f0eb28b61bfb/users/ded6cb8baf424f2c957af5266bb06460/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:29.867681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:29.868065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:29.868592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:29.909607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] MFA Rules not processed for user `ded6cb8baf424f2c957af5266bb06460`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:29.911107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:30.087913 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3695/7418] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:30.098368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:30.100219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:30.222757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d8c13-4845-4f76-9df6-d5bf31e45902 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:30.226975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:30.227888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:30.228280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:30.228662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:30.375448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:30.378273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:30.410025 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3724/7419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:33.732676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:33.738284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:33.770737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d439-afee-48b1-aa52-e77ec945f3db None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:33.778706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:33.779763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:33.780282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:33.780765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:33.792069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:33.794970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:33.812562 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3696/7420] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:37.852225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:37.854351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:37.936888 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:38.077097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513bd00-bfa8-4146-8c5c-6fe65e390b1c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:38.098113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:38.099029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:38.099423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:38.101571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:38.107593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:38.278663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:38.281542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909b9f1-da02-4a7e-b036-2065d943fbb3 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:38.308874 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3725/7421] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:18:38.938057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:38.942199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:39.184316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168580-332f-49f3-b335-2d28e89750dc service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:39.194385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:39.196161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:39.198703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:39.199277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] PATH_INFO: `/v3/users/1a94557eff07472a94d30a7e00e66cd9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:39.204274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a94557eff07472a94d30a7e00e66cd9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:39.208595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:39.320111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a94557eff07472a94d30a7e00e66cd9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:39.330477 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:39.354665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a94557eff07472a94d30a7e00e66cd9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:39.366589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a94557eff07472a94d30a7e00e66cd9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:39.388876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a94557eff07472a94d30a7e00e66cd9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:39.389869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a94557eff07472a94d30a7e00e66cd9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:39.399760 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3697/7422] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:38 2022] DELETE /identity/v3/users/1a94557eff07472a94d30a7e00e66cd9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:39.404926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:39.405396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:39.405683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:39.441888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:39.443548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:39.609077 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3726/7423] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:39.640807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:39.642518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:39.779534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e27b1-af66-4912-ab13-11bb8f9a82da admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:39.789381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:39.790207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:39.790513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:39.790790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:39.812632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:39.815247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:39.838861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3698/7424] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:41.173860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:41.175568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:41.222968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74620c-55ad-4c3b-85ce-50c4fa6c7989 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:41.243423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:41.246355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:41.246693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:41.248168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] PATH_INFO: `/v3/projects/4567c027f1c8499fa05b8906f835c21e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:41.253762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4567c027f1c8499fa05b8906f835c21e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:41.278874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:41.422669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4567c027f1c8499fa05b8906f835c21e', 'request_id': 'req-38be126d-6262-4257-a3e1-9e7803767b37'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:41.448761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4567c027f1c8499fa05b8906f835c21e', 'request_id': 'req-38be126d-6262-4257-a3e1-9e7803767b37'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:41.451659 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:41.467890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4567c027f1c8499fa05b8906f835c21e', 'request_id': 'req-38be126d-6262-4257-a3e1-9e7803767b37'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:41.491465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] The token cache is being invalidate because project 4567c027f1c8499fa05b8906f835c21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:41.491769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:41.494125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-38be126d-6262-4257-a3e1-9e7803767b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:41.502926 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3727/7425] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:41 2022] DELETE /identity/v3/projects/4567c027f1c8499fa05b8906f835c21e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:41.507343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:41.520693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c361-4c28-49dd-83e3-1016eb32baed service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:41.727087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:41.728649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:41.729320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:41.729866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] PATH_INFO: `/v3/users/17fd1007673d4c44ad1c49e94a6d3d68` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:41.732461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fd1007673d4c44ad1c49e94a6d3d68)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:41.760487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:41.952831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fd1007673d4c44ad1c49e94a6d3d68'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:41.985898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fd1007673d4c44ad1c49e94a6d3d68'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:42.031338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fd1007673d4c44ad1c49e94a6d3d68'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:42.034900 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:42.060040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fd1007673d4c44ad1c49e94a6d3d68'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:42.061414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fd1007673d4c44ad1c49e94a6d3d68'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:42.080154 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3699/7426] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:41 2022] DELETE /identity/v3/users/17fd1007673d4c44ad1c49e94a6d3d68 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:43.377418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba58a04-3db0-4478-8aba-9d4c9e7708a6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:43.377418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba58a04-3db0-4478-8aba-9d4c9e7708a6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:43.378030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba58a04-3db0-4478-8aba-9d4c9e7708a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:43.422325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9ba58a04-3db0-4478-8aba-9d4c9e7708a6 None None] MFA Rules not processed for user `3cced2e2903b42f580b9221464af5537`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:43.427367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9ba58a04-3db0-4478-8aba-9d4c9e7708a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:43.604266 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3728/7427] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:44.213095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:44.215745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:44.352241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9787ec-bbf0-4564-909c-0286ca18eea5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:44.364227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:44.366429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:44.366859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:44.367239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] PATH_INFO: `/v3/projects/ff43b1a6de6a4a9eae8cfc89d01a9b43` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:44.368686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff43b1a6de6a4a9eae8cfc89d01a9b43)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:44.371646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:44.494956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff43b1a6de6a4a9eae8cfc89d01a9b43', 'request_id': 'req-ad4e12f8-f196-4327-9a32-bfa41efbe72f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:44.509049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff43b1a6de6a4a9eae8cfc89d01a9b43', 'request_id': 'req-ad4e12f8-f196-4327-9a32-bfa41efbe72f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:44.527604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff43b1a6de6a4a9eae8cfc89d01a9b43', 'request_id': 'req-ad4e12f8-f196-4327-9a32-bfa41efbe72f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:44.562830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] The token cache is being invalidate because project ff43b1a6de6a4a9eae8cfc89d01a9b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:44.563134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:44.567201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ad4e12f8-f196-4327-9a32-bfa41efbe72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:44.569525 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3700/7428] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:44 2022] DELETE /identity/v3/projects/ff43b1a6de6a4a9eae8cfc89d01a9b43 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:44.574582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:44.575088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:44.575193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:44.616693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:44.619392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:44.803639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3729/7429] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:44.809645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:44.810168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:44.810457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:44.857144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:44.858406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:44.879017 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3701/7430] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:44.883612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:44.897053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3807e-aa6d-4542-bb4f-3b24b2589e6b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:44.910966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:44.911433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:44.911885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:44.912158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:44.912893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:44.913208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:44.914854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:44.940791 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3730/7431] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:18:44.945693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:44.963293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f15d4-90f2-4239-99c7-7f7edff0e199 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:44.969302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:44.970192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:44.970745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:44.971206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:44.972096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:44.974276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:45.040733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3702/7432] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:44 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:45.041035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:45.057207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d44f1b-2436-459a-94bc-ee363437736a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:45.200843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:45.201963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:45.202624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:45.203077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:45.204203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:45.206779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:45.240467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:45.265634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3731/7433] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:45 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:18:45.267993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea08d97-6172-487c-8a7e-6c4d1c5b0384 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:45.296313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:45.297428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:45.297872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:45.298320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:45.300562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:45.304432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:45.334146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:45.347145 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3703/7434] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:18:45.351317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25712a-2d18-4478-8277-16a1bd1a159a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:45.359460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2631fa-d93e-4ff4-96a4-08421a75faea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:45.360405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2631fa-d93e-4ff4-96a4-08421a75faea admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:45.360850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2631fa-d93e-4ff4-96a4-08421a75faea admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:45.361731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2631fa-d93e-4ff4-96a4-08421a75faea admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:45.363004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2631fa-d93e-4ff4-96a4-08421a75faea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:45.369108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2631fa-d93e-4ff4-96a4-08421a75faea admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:45.375787 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:45.407919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:45.430813 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3732/7435] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:45.436089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7d14-b15b-485a-88bf-dcd3f12e5abd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:45.449390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:45.450726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:45.451998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:45.452469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] PATH_INFO: `/v3/projects/d134c39d25024ad38893ef1b842d2b76/users/72a03a33fbe748b8b2774f14908d8ce7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:45.503929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d134c39d25024ad38893ef1b842d2b76, user_id=72a03a33fbe748b8b2774f14908d8ce7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:45.506979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:45.553806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:45.554102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:45.554382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:45.555988 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3704/7436] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:45 2022] PUT /identity/v3/projects/d134c39d25024ad38893ef1b842d2b76/users/72a03a33fbe748b8b2774f14908d8ce7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:45.590753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] MFA Rules not processed for user `72a03a33fbe748b8b2774f14908d8ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:45.591982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:45.712834 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3733/7437] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:45.718213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:45.742626 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:45.817667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dacd86-1878-4476-a41c-921bff6d883f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:45.822845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:45.823545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:45.823831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:45.824108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:45.824962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:45.826788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:45.868193 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3705/7438] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:45 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:45.871652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:45.903309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b4aa8-a0c4-4ea4-b56c-cd0a13f54d1d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.112493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.113890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.114423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.115128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.116469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.124972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.170997 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3734/7439] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:45 2022] POST /identity/v3/users => generated 297 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:46.174911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:46.190035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f6398-c1f2-44ce-827c-39013bb0169d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.205765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.206647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.207082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.207439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.208403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.209946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.255394 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3706/7440] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:46.259811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:46.273366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b7a7e-e20c-4ee7-93c5-2b40d7fac561 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.281372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.282328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.282671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.282985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] PATH_INFO: `/v3/projects/03daeb29eb2646edb138bf2436acc9b7/users/e62ee6e9c655482097e88d374455c13c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.307129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03daeb29eb2646edb138bf2436acc9b7, user_id=e62ee6e9c655482097e88d374455c13c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.311783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.333700 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3735/7441] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:46 2022] PUT /identity/v3/projects/03daeb29eb2646edb138bf2436acc9b7/users/e62ee6e9c655482097e88d374455c13c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:18:46.337698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:46.352157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2255f-b346-4e9b-9972-7e5c0d31e64b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.427279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626f163-6a5c-4266-82d5-3d1f009a52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.428134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626f163-6a5c-4266-82d5-3d1f009a52ef admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.428717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626f163-6a5c-4266-82d5-3d1f009a52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.429237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626f163-6a5c-4266-82d5-3d1f009a52ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.430236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626f163-6a5c-4266-82d5-3d1f009a52ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.433189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626f163-6a5c-4266-82d5-3d1f009a52ef admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.448401 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3707/7442] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:46.452527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:46.467488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99e43-284f-4f50-a821-afff689c5b5b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.472350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.473245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.473529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.473802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] PATH_INFO: `/v3/projects/03daeb29eb2646edb138bf2436acc9b7/users/e62ee6e9c655482097e88d374455c13c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.475967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03daeb29eb2646edb138bf2436acc9b7, user_id=e62ee6e9c655482097e88d374455c13c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.478651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.491163 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3736/7443] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:46 2022] PUT /identity/v3/projects/03daeb29eb2646edb138bf2436acc9b7/users/e62ee6e9c655482097e88d374455c13c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:46.502022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.502993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.503479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.545540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] MFA Rules not processed for user `e62ee6e9c655482097e88d374455c13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:46.547318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:46.639873 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3708/7444] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:46.654834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:46.658530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:46.732728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:46.734163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:46.739276 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:46.763267 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:46.771609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b588b-ae4d-4208-b1f3-46d8b277ce97 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.783975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.784673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.785046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.787035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.800132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.802367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.817671 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3737/7445] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:18:46.829439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ce65c-4aad-4709-9008-ab9213350fb2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:46.835160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:46.836080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:46.837026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:46.837322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] PATH_INFO: `/v3/users/9e6e427d6093411aad6cd6d664e9b7fc` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:46.839415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6e427d6093411aad6cd6d664e9b7fc)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:46.841474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:46.931400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6e427d6093411aad6cd6d664e9b7fc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:46.962031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6e427d6093411aad6cd6d664e9b7fc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:46.972167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6e427d6093411aad6cd6d664e9b7fc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:46.981736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6e427d6093411aad6cd6d664e9b7fc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:46.982389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6e427d6093411aad6cd6d664e9b7fc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:46.989966 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3709/7446] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:46 2022] DELETE /identity/v3/users/9e6e427d6093411aad6cd6d664e9b7fc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:47.284564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:47.312572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79485-34f2-4082-b775-251d8f0a76d5 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:47.395226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:47.396910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:47.415014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:47.416175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.416653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.417275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] PATH_INFO: `/v3/users/72a03a33fbe748b8b2774f14908d8ce7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.418753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a03a33fbe748b8b2774f14908d8ce7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:47.421180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:47.524850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318be1f1-037f-4d0d-a1f3-79592354acd3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:47.528219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a03a33fbe748b8b2774f14908d8ce7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.529005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a03a33fbe748b8b2774f14908d8ce7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.534674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:47.535554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.535838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.545291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a03a33fbe748b8b2774f14908d8ce7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.545727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] PATH_INFO: `/v3/projects/a74ce7c429614bc2ae5846ac4dbea8e8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.546270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a03a33fbe748b8b2774f14908d8ce7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.548921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74ce7c429614bc2ae5846ac4dbea8e8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:47.556128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:47.558668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0db2bf48-852c-4678-84e6-e66b09d8bc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a03a33fbe748b8b2774f14908d8ce7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.583589 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3738/7447] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:47 2022] DELETE /identity/v3/users/72a03a33fbe748b8b2774f14908d8ce7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:47.588652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.589901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.590289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.614217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:47.615840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:47.638234 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:47.655464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74ce7c429614bc2ae5846ac4dbea8e8', 'request_id': 'req-9980feca-8a84-40be-ad34-8eeb93f99d99'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.679306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74ce7c429614bc2ae5846ac4dbea8e8', 'request_id': 'req-9980feca-8a84-40be-ad34-8eeb93f99d99'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.693656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74ce7c429614bc2ae5846ac4dbea8e8', 'request_id': 'req-9980feca-8a84-40be-ad34-8eeb93f99d99'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.727617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] The token cache is being invalidate because project a74ce7c429614bc2ae5846ac4dbea8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:47.728171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.729032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9980feca-8a84-40be-ad34-8eeb93f99d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:47.732103 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3710/7448] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:47 2022] DELETE /identity/v3/projects/a74ce7c429614bc2ae5846ac4dbea8e8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:47.739745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b038d4-aefc-458f-9eb7-706b6ad58399 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.740492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b038d4-aefc-458f-9eb7-706b6ad58399 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.740796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b038d4-aefc-458f-9eb7-706b6ad58399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.742848 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3739/7449] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:47.753666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:47.755692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:47.764913 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:47.771166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b6b038d4-aefc-458f-9eb7-706b6ad58399 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:47.772622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6b038d4-aefc-458f-9eb7-706b6ad58399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:47.839750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0825-c35e-47c5-83ca-b5aceeb131a9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:47.865943 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3711/7450] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:47.874847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.875163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.875425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.895756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:47.896965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:47.917012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:47.918309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.918918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.919479 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3712/7451] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:47.919897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.920458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:47.922731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:47.939059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:47.941298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:47.956918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697901fb-3257-4c30-bcbb-5fe01a1dbb4f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:47.962898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:47.963659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:47.963974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:47.964314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:47.966143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:47.966457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:47.968917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:47.978343 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3740/7452] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:18:47.983238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3713/7453] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:18:48.012891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.023190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e14796-4dd5-4502-a044-2c68507323f6 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.028840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.029820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.030344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.030840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.031803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.033997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.080392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3741/7454] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:48 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:48.084396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.105698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb332af-4427-43ff-9538-2274f7cb218e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.239132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.239851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.242690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.243027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.243770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.250915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.289179 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3714/7455] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:48 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:48.293834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.307035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf825-323f-434f-8b11-61959eaaf402 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.322773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.323770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.324254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.324922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.329994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.331913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.362298 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3742/7456] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:48.363491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.382735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7bf4-cc2a-4c2c-a67a-eef2c1624b03 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.388144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d6aed-309b-4699-9b56-a24368a22c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.388463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d6aed-309b-4699-9b56-a24368a22c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.388759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d6aed-309b-4699-9b56-a24368a22c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.389049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d6aed-309b-4699-9b56-a24368a22c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.389797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d6aed-309b-4699-9b56-a24368a22c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.391436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d6aed-309b-4699-9b56-a24368a22c70 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.406248 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3715/7457] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:48.410685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.421960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795cdf8-1062-4db1-9f20-764c8ff6ae60 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.426688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.427854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.427854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.428142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] PATH_INFO: `/v3/projects/3b2e994a10f34cb48a4e170de72e3be0/users/0a4445d6e33e4fce889e1977987a0233/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.445291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2e994a10f34cb48a4e170de72e3be0, user_id=0a4445d6e33e4fce889e1977987a0233, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.448362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.485058 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3743/7458] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:48 2022] PUT /identity/v3/projects/3b2e994a10f34cb48a4e170de72e3be0/users/0a4445d6e33e4fce889e1977987a0233/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:18:48.486933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.487231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.487550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.539336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:48.541826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:48.563258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.570314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:48.602883 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:48.715435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e72a8-7a91-4004-ad76-400983754ac4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.722079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.723175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.723510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.723981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] PATH_INFO: `/v3/projects/d134c39d25024ad38893ef1b842d2b76` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.725859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d134c39d25024ad38893ef1b842d2b76)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.726440 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3716/7459] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:18:48.729596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.740730 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:48.756426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.756955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:48.825541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd134c39d25024ad38893ef1b842d2b76', 'request_id': 'req-41159fc5-e6ab-4ace-b47c-9448a75d2a62'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:48.835616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd134c39d25024ad38893ef1b842d2b76', 'request_id': 'req-41159fc5-e6ab-4ace-b47c-9448a75d2a62'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:48.843164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd134c39d25024ad38893ef1b842d2b76', 'request_id': 'req-41159fc5-e6ab-4ace-b47c-9448a75d2a62'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:48.858914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] The token cache is being invalidate because project d134c39d25024ad38893ef1b842d2b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:48.859206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:48.859944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:48.861532 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3744/7460] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:48 2022] DELETE /identity/v3/projects/d134c39d25024ad38893ef1b842d2b76 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:48.865806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:48.867426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:48.882206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d417032-b438-4033-a3f5-c1de427ba1e5 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.949172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159fc5-e6ab-4ace-b47c-9448a75d2a62 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:48.956638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.957969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.959001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.959288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] PATH_INFO: `/v3/users/e62ee6e9c655482097e88d374455c13c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.960723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62ee6e9c655482097e88d374455c13c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.963312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:48.969798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:48.971024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:48.971537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:48.972656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:48.975066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:48.989387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:48.991345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:49.010886 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3717/7461] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:49.056981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62ee6e9c655482097e88d374455c13c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.058897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62ee6e9c655482097e88d374455c13c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.078386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62ee6e9c655482097e88d374455c13c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.079481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62ee6e9c655482097e88d374455c13c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.088220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-76dce78d-794a-4088-b60e-c5be75ade87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62ee6e9c655482097e88d374455c13c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.108202 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3745/7462] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:18:48 2022] DELETE /identity/v3/users/e62ee6e9c655482097e88d374455c13c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:49.492675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:49.517568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c391-5599-4df1-858c-42898b81825c service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:49.628354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:49.629399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:49.629788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:49.630162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] PATH_INFO: `/v3/projects/03daeb29eb2646edb138bf2436acc9b7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:49.631728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03daeb29eb2646edb138bf2436acc9b7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:49.633738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:49.685111 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:49.723265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03daeb29eb2646edb138bf2436acc9b7', 'request_id': 'req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.735033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03daeb29eb2646edb138bf2436acc9b7', 'request_id': 'req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.749920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03daeb29eb2646edb138bf2436acc9b7', 'request_id': 'req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.779128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] The token cache is being invalidate because project 03daeb29eb2646edb138bf2436acc9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:18:49.780013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.780973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bdde6c10-3bc5-434e-bedb-79c7c2842c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:18:49.782976 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3718/7463] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:18:49 2022] DELETE /identity/v3/projects/03daeb29eb2646edb138bf2436acc9b7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:49.787940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:49.789007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:49.789576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:49.827410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:49.829495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:49.846639 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:49.939591 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3746/7464] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:18:49.948686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:49.949752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:49.949752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:49.970532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:49.971855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:49.981652 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3719/7465] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:49.985718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:49.997607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed016-a4f0-445d-a1f7-b0119b93829a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.003961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.004846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.005381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.005737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.007009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:18:50.007394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.009654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.023493 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3747/7466] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:18:50.028390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.039190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cacbf5-5f27-4864-ac89-a15795571ae2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.045839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.046766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.047156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.047529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.048523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.051206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.086253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3720/7467] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:50 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:18:50.090680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.113910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc8e7c-008a-4ccd-900e-0b1adb8d68b4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.255302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.256247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.256842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.257129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.262857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.265873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.323874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.324840 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3748/7468] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:50 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:50.337165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b145-8993-475d-ac59-16863fa379fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.350012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.350471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.350865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.351211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.352852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.359586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.384336 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3721/7469] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:18:50.388538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.402601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c606e-880b-4676-a46b-8b2c79d94a5b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.408927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f6f81-7277-41af-91b9-87f6939ba348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.410154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f6f81-7277-41af-91b9-87f6939ba348 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.410686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f6f81-7277-41af-91b9-87f6939ba348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.411140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f6f81-7277-41af-91b9-87f6939ba348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.412099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f6f81-7277-41af-91b9-87f6939ba348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.413888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f6f81-7277-41af-91b9-87f6939ba348 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.427490 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3749/7470] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:50.431658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.444654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34c0d-5aad-4890-a0da-4ba792c7a3a5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.449732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.451059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.451636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.452138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] PATH_INFO: `/v3/projects/87a8be59d061477798c02b37326bd4be/users/1527182a65ef4e2f8a40ca1a3a5f5d80/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.473143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a8be59d061477798c02b37326bd4be, user_id=1527182a65ef4e2f8a40ca1a3a5f5d80, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.477040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.501800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3722/7471] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:50 2022] PUT /identity/v3/projects/87a8be59d061477798c02b37326bd4be/users/1527182a65ef4e2f8a40ca1a3a5f5d80/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:50.512493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.513194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.513770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.557646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] MFA Rules not processed for user `1527182a65ef4e2f8a40ca1a3a5f5d80`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:50.560320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:50.704420 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3750/7472] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 11 15:18:50.708819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.842324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f770d0-ddbe-453b-ba62-021e4127f61a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.861677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:50.862372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:50.862683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:50.862963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:50.863683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:50.865636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:50.920441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3723/7473] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:18:50 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:50.924814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:50.943830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55096312-6e82-422e-938d-6fea93acfe44 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:50.953223 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:51.079085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:51.079886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.080439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.092662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:51.096553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:51.110573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:51.156895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3751/7474] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:18:50 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:18:51.160655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:51.173689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693e738-2e85-4948-bf64-302837bccc62 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:51.197913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:51.199305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.199553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.199794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:51.200531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:51.202211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:51.235676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3724/7475] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:51.238933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:51.257623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8114-6e77-463f-b64f-f708f0a4636f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:51.264776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:51.265724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.266092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.266422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] PATH_INFO: `/v3/projects/203ab98708654a708ad0af0633439683/users/6e00994be2114d15af5ec719620b4c8b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:51.298745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=203ab98708654a708ad0af0633439683, user_id=6e00994be2114d15af5ec719620b4c8b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:51.305361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:51.332301 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3752/7476] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:51 2022] PUT /identity/v3/projects/203ab98708654a708ad0af0633439683/users/6e00994be2114d15af5ec719620b4c8b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:51.336566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:51.352532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101a65-c379-4119-a9e5-616d43933228 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:51.408130 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:18:51.526131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a34d7-5d47-4d31-af8d-5fd64ac68174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:51.527036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a34d7-5d47-4d31-af8d-5fd64ac68174 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.527418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a34d7-5d47-4d31-af8d-5fd64ac68174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.534187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a34d7-5d47-4d31-af8d-5fd64ac68174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:51.534187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a34d7-5d47-4d31-af8d-5fd64ac68174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:51.536121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a34d7-5d47-4d31-af8d-5fd64ac68174 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:51.560233 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3725/7477] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:18:51.563769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:51.577224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b738-40ea-4bec-a58e-3b059c6a3cfc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:51.591479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:51.595845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.596445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.596838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] PATH_INFO: `/v3/projects/203ab98708654a708ad0af0633439683/users/6e00994be2114d15af5ec719620b4c8b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:51.602165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203ab98708654a708ad0af0633439683, user_id=6e00994be2114d15af5ec719620b4c8b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:51.615714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:51.650031 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3753/7478] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:18:51 2022] PUT /identity/v3/projects/203ab98708654a708ad0af0633439683/users/6e00994be2114d15af5ec719620b4c8b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:18:51.652985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98449ec8-6ecd-420e-9670-15ea6cdf4acc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.653276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98449ec8-6ecd-420e-9670-15ea6cdf4acc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.653553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98449ec8-6ecd-420e-9670-15ea6cdf4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:51.695557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-98449ec8-6ecd-420e-9670-15ea6cdf4acc None None] MFA Rules not processed for user `6e00994be2114d15af5ec719620b4c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:51.696804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-98449ec8-6ecd-420e-9670-15ea6cdf4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:51.803622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3726/7479] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:18:51.812334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:18:51.814140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:18:51.943567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4f92-fbe0-4a32-ae1b-5661418aa7e5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:18:51.963026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3a421-d0bd-4b6d-bdfd-7ffc50ab9336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:18:51.963026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3a421-d0bd-4b6d-bdfd-7ffc50ab9336 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:51.963026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3a421-d0bd-4b6d-bdfd-7ffc50ab9336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:51.963026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3a421-d0bd-4b6d-bdfd-7ffc50ab9336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:52.087547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3a421-d0bd-4b6d-bdfd-7ffc50ab9336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:18:52.090871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3a421-d0bd-4b6d-bdfd-7ffc50ab9336 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:18:52.106601 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3754/7480] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:18:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:18:59.919553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:18:59.920042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:18:59.920183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:18:59.983892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] MFA Rules not processed for user `0a4445d6e33e4fce889e1977987a0233`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:18:59.996702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:00.141174 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3727/7481] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:18:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:00.154695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153730-2936-4c96-bb64-0456250989ba None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:00.154695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153730-2936-4c96-bb64-0456250989ba None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:00.156116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153730-2936-4c96-bb64-0456250989ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:00.180184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b5153730-2936-4c96-bb64-0456250989ba None None] MFA Rules not processed for user `0a4445d6e33e4fce889e1977987a0233`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:00.181515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b5153730-2936-4c96-bb64-0456250989ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:00.191484 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3755/7482] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:00.213120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:00.217186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:00.306548 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:00.421873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d69969-4aa0-41a4-b99a-da9ff55587cd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:00.431491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:00.433365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:00.433854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:00.434477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:00.446531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:00.449163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:00.486314 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3728/7483] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:01.005449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153730-2936-4c96-bb64-0456250989ba None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:01.019752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153730-2936-4c96-bb64-0456250989ba None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:01.030833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5b061-dfc7-4519-a613-658543d4ef44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:01.036470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b061-dfc7-4519-a613-658543d4ef44 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:01.037468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b061-dfc7-4519-a613-658543d4ef44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:01.037763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b061-dfc7-4519-a613-658543d4ef44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:01.073933 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:01.081789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5b061-dfc7-4519-a613-658543d4ef44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:01.085305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5b061-dfc7-4519-a613-658543d4ef44 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:01.123442 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3756/7484] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:10.465528 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=23 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:11.102279 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:18.115241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:18.213778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc2c8a-380a-4e05-b195-65c4ad3e7b56 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:18.246350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:18.246350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:18.246350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:18.246350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] PATH_INFO: `/v3/users/1527182a65ef4e2f8a40ca1a3a5f5d80` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:18.246898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1527182a65ef4e2f8a40ca1a3a5f5d80)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:18.256767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:18.381139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1527182a65ef4e2f8a40ca1a3a5f5d80'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:18.419767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1527182a65ef4e2f8a40ca1a3a5f5d80'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:18.436236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1527182a65ef4e2f8a40ca1a3a5f5d80'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:18.454961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1527182a65ef4e2f8a40ca1a3a5f5d80'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:18.455721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1527182a65ef4e2f8a40ca1a3a5f5d80'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:18.464515 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3729/7485] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:18 2022] DELETE /identity/v3/users/1527182a65ef4e2f8a40ca1a3a5f5d80 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:18.469087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:18.470181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:18.470682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:18.514067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:18.515808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:18.660939 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3757/7486] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:18.674625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:18.676243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:18.758379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27837b8-b8f1-4b5f-a70e-1897d39d8ea7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:18.763908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:18.764800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:18.765286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:18.765638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:18.778323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:18.779897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:18.791014 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3730/7487] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:19.352793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:19.354261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:19.375941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41269134-4743-4ab8-b93e-95cbd4eb47b6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:19.386199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:19.387520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:19.389137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:19.390248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] PATH_INFO: `/v3/projects/87a8be59d061477798c02b37326bd4be` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:19.394555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a8be59d061477798c02b37326bd4be)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:19.399917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:19.458338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a8be59d061477798c02b37326bd4be', 'request_id': 'req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.467666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a8be59d061477798c02b37326bd4be', 'request_id': 'req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.475808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a8be59d061477798c02b37326bd4be', 'request_id': 'req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.497966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] The token cache is being invalidate because project 87a8be59d061477798c02b37326bd4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:19.498390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.499235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.501600 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3758/7488] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:19 2022] DELETE /identity/v3/projects/87a8be59d061477798c02b37326bd4be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:19.505661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:19.517045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2332-4766-45ad-a404-e93dc9cf0e66 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:19.544026 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:19.586155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:19.587558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:19.588102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:19.588597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] PATH_INFO: `/v3/users/6e00994be2114d15af5ec719620b4c8b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:19.590555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e00994be2114d15af5ec719620b4c8b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:19.592886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:19.647571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e00994be2114d15af5ec719620b4c8b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.659810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e00994be2114d15af5ec719620b4c8b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.667346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e00994be2114d15af5ec719620b4c8b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.687121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e00994be2114d15af5ec719620b4c8b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.687760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc4d54c6-c928-4e31-9728-eb74b9a753ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e00994be2114d15af5ec719620b4c8b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:19.695106 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3731/7489] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:19 2022] DELETE /identity/v3/users/6e00994be2114d15af5ec719620b4c8b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:20.017901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.019785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:20.035799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe176aa7-55c8-4dda-91c9-43a464c8ef7a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:20.133023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:20.133952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.134213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.134571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] PATH_INFO: `/v3/projects/203ab98708654a708ad0af0633439683` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.135820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203ab98708654a708ad0af0633439683)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:20.137765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:20.180560 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:20.211909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203ab98708654a708ad0af0633439683', 'request_id': 'req-123bf7c7-42b0-45ad-9061-35e2202d0e61'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:20.231085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203ab98708654a708ad0af0633439683', 'request_id': 'req-123bf7c7-42b0-45ad-9061-35e2202d0e61'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:20.237878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203ab98708654a708ad0af0633439683', 'request_id': 'req-123bf7c7-42b0-45ad-9061-35e2202d0e61'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:20.250325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] The token cache is being invalidate because project 203ab98708654a708ad0af0633439683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:20.253883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:20.254863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-123bf7c7-42b0-45ad-9061-35e2202d0e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:20.256688 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3759/7490] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:20 2022] DELETE /identity/v3/projects/203ab98708654a708ad0af0633439683 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:20.263498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.264079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.264582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.288028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:20.289253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:20.373780 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3732/7491] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:20.479358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.480247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.480710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.504189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:20.505776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:20.519564 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3760/7492] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:20.523823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.535896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f259-c093-4472-89e1-5fac348d45a0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:20.542613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:20.543533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.543990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.544426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.545336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:19:20.545827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:20.547632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:20.568476 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3733/7493] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:19:20.569136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.581245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898e58-03d8-4d61-bea2-286c846b05c4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:20.586791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:20.588301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.588825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.589471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.602009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:20.604345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:20.648295 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3761/7494] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:19:20 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:19:20.653909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.665706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ec0e-90d3-47f3-9fb8-7c809958fce4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:20.707331 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:20.752624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:20.753959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.754679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.755195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.756119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:20.758399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:20.814452 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3734/7495] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:19:20 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:20.819610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.842127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181312-473d-44ca-b69b-7bf8a9518311 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:20.852445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:20.853623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.854187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.856246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.858049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:20.860659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:20.878961 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3762/7496] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:20.883446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.897251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd8af-79a3-4ac9-95f9-1aeac1b8d168 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:20.917680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9d19-98ce-4c17-825a-cd33ee4dbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:20.918468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9d19-98ce-4c17-825a-cd33ee4dbaba admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:20.919256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9d19-98ce-4c17-825a-cd33ee4dbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:20.919818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9d19-98ce-4c17-825a-cd33ee4dbaba admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:20.920862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9d19-98ce-4c17-825a-cd33ee4dbaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:20.945276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9d19-98ce-4c17-825a-cd33ee4dbaba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:20.979383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:20.982753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3735/7497] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:20.999143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4760cd8-31e4-4c55-9f03-1fca5542e34a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:21.006708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:21.008368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:21.008598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:21.019801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] PATH_INFO: `/v3/projects/f874f20427da4daf897a5be6d7bde3fe/users/20ea8f58740a4b3b84e30c4a3bf0cced/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:21.078571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f874f20427da4daf897a5be6d7bde3fe, user_id=20ea8f58740a4b3b84e30c4a3bf0cced, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:21.081870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:21.119477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3763/7498] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:19:20 2022] PUT /identity/v3/projects/f874f20427da4daf897a5be6d7bde3fe/users/20ea8f58740a4b3b84e30c4a3bf0cced/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:21.130294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:21.130420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:21.130768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:21.193507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] MFA Rules not processed for user `20ea8f58740a4b3b84e30c4a3bf0cced`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:21.195290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:21.299171 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3736/7499] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:21.311955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:21.313819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:21.378695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656831b-80b5-4435-89e9-d06f72d9296e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:21.382749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5941ff-829e-482a-8175-e5a628eacf0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:21.383505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5941ff-829e-482a-8175-e5a628eacf0d service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:21.383867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5941ff-829e-482a-8175-e5a628eacf0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:21.384227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5941ff-829e-482a-8175-e5a628eacf0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:21.395709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5941ff-829e-482a-8175-e5a628eacf0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:21.397196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5941ff-829e-482a-8175-e5a628eacf0d service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:21.408588 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3764/7500] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:21.441434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:21.547961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28b99-74c0-488a-a846-f188d56ff4b7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:21.549073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28b99-74c0-488a-a846-f188d56ff4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:21.549251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28b99-74c0-488a-a846-f188d56ff4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:21.555601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e21d83-5331-4422-98ee-f73352fb01c7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:21.568887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:21.569882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:21.570727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:21.571095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] PATH_INFO: `/v3/users/20ea8f58740a4b3b84e30c4a3bf0cced` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:21.571936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-33e28b99-74c0-488a-a846-f188d56ff4b7 None None] MFA Rules not processed for user `3a10dc703c4d442ea62abfddf18cf507`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:21.572599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ea8f58740a4b3b84e30c4a3bf0cced)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:21.573173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-33e28b99-74c0-488a-a846-f188d56ff4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:21.574804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:21.643290 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:21.652712 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:21.658957 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3765/7501] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:21.671884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ea8f58740a4b3b84e30c4a3bf0cced'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:21.701644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ea8f58740a4b3b84e30c4a3bf0cced'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:21.712018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ea8f58740a4b3b84e30c4a3bf0cced'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:21.723118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ea8f58740a4b3b84e30c4a3bf0cced'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:21.724642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ea8f58740a4b3b84e30c4a3bf0cced'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:21.733438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3737/7502] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:21 2022] DELETE /identity/v3/users/20ea8f58740a4b3b84e30c4a3bf0cced => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:21.737889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:21.738192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:21.738562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:21.778982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:21.784207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:21.899723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3766/7503] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:21.910300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:21.911839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:21.995480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bdf7a-24cb-4781-8ae5-eacdc2c86757 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:22.000062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66871-7eda-4f20-a35d-021f74b8eef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:22.000914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66871-7eda-4f20-a35d-021f74b8eef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.001528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66871-7eda-4f20-a35d-021f74b8eef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.001763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66871-7eda-4f20-a35d-021f74b8eef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.015391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e66871-7eda-4f20-a35d-021f74b8eef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:22.017037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e66871-7eda-4f20-a35d-021f74b8eef4 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:22.030245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3738/7504] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:22.394433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:22.396078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:22.416658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455274d8-4a19-446e-8880-6c4a05fe4754 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:22.432054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:22.433037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.433385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.433732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] PATH_INFO: `/v3/projects/f874f20427da4daf897a5be6d7bde3fe` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.435208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f874f20427da4daf897a5be6d7bde3fe)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:22.437660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:22.503972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f874f20427da4daf897a5be6d7bde3fe', 'request_id': 'req-68030b6b-8524-439c-a38c-3ca2f69beddf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:22.531053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f874f20427da4daf897a5be6d7bde3fe', 'request_id': 'req-68030b6b-8524-439c-a38c-3ca2f69beddf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:22.541808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f874f20427da4daf897a5be6d7bde3fe', 'request_id': 'req-68030b6b-8524-439c-a38c-3ca2f69beddf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:22.555221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] The token cache is being invalidate because project f874f20427da4daf897a5be6d7bde3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:22.555933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:22.556087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68030b6b-8524-439c-a38c-3ca2f69beddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:22.558225 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3767/7505] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:22 2022] DELETE /identity/v3/projects/f874f20427da4daf897a5be6d7bde3fe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:22.563143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.563678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.563788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.586686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:22.588374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:22.660255 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3739/7506] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:22.670078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.670372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.670685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.691775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:22.693819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:22.702523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3768/7507] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:22.706392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:22.717736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6bbc5-7889-4b3c-b418-dcbad1324ad4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:22.723510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:22.724305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.724696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.725134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.726051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:19:22.726458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:22.728703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:22.741786 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3740/7508] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:19:22.747149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:22.758656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab2cf9-bf55-40be-bc71-cd42edb4c9e4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:22.763678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:22.764452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.764747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.765026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.765779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:22.767727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:22.798989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3769/7509] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:19:22 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:19:22.803253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:22.815058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f892-f562-4f8a-85c2-1508ee8f1a5d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:22.902801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:22.903775 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:22.904286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.904810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.905321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.906288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:22.908658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:22.947926 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3741/7510] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:19:22 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:22.952247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:22.964293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c1e9-8c74-4b7a-b681-1ee77c1f602b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:22.970095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:22.971048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:22.971638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:22.972198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:22.973324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:22.975414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:22.995349 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3770/7511] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:22.999566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:23.026116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8e46-2d88-43ff-910b-76735d0d4f9b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:23.038595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84c3d-b4af-4558-a9e4-40b9ac7e20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:23.039412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84c3d-b4af-4558-a9e4-40b9ac7e20cc admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.039901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84c3d-b4af-4558-a9e4-40b9ac7e20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.040366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84c3d-b4af-4558-a9e4-40b9ac7e20cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.041787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84c3d-b4af-4558-a9e4-40b9ac7e20cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:23.051123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84c3d-b4af-4558-a9e4-40b9ac7e20cc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:23.084810 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3742/7512] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:23.089028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:23.119839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e248cc-179f-4ef3-9bf5-3d63f4257330 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:23.126953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:23.128331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.128845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.129754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] PATH_INFO: `/v3/projects/e84bda9e709c4175845b1f736437a4b1/users/9822d939346f4dbc8e72e7b9a3d75918/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.153804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84bda9e709c4175845b1f736437a4b1, user_id=9822d939346f4dbc8e72e7b9a3d75918, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:23.156946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:23.176292 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3771/7513] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:19:23 2022] PUT /identity/v3/projects/e84bda9e709c4175845b1f736437a4b1/users/9822d939346f4dbc8e72e7b9a3d75918/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:23.187432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.187755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.188018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.231336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] MFA Rules not processed for user `9822d939346f4dbc8e72e7b9a3d75918`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:23.232963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:23.333173 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3743/7514] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:23.356295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:23.358233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:23.387457 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:23.439184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf37e-8178-45e6-8822-ae97bbb8e24f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:23.443559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589513-b7d2-4097-b750-e9f7b9e1c1e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:23.444225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589513-b7d2-4097-b750-e9f7b9e1c1e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.444525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589513-b7d2-4097-b750-e9f7b9e1c1e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.444793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589513-b7d2-4097-b750-e9f7b9e1c1e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.455881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589513-b7d2-4097-b750-e9f7b9e1c1e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:23.457357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589513-b7d2-4097-b750-e9f7b9e1c1e0 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:23.468186 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3772/7515] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:23.490749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:23.565292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77c13d-c0a3-4770-bb1b-78f409e6e159 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:23.570631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:23.571656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.572643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.572933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] PATH_INFO: `/v3/users/9822d939346f4dbc8e72e7b9a3d75918` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.574251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9822d939346f4dbc8e72e7b9a3d75918)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:23.576221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:23.646251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9822d939346f4dbc8e72e7b9a3d75918'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:23.657883 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:23.667397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9822d939346f4dbc8e72e7b9a3d75918'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:23.682457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9822d939346f4dbc8e72e7b9a3d75918'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:23.700233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9822d939346f4dbc8e72e7b9a3d75918'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:23.701042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9822d939346f4dbc8e72e7b9a3d75918'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:23.708579 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3744/7516] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:23 2022] DELETE /identity/v3/users/9822d939346f4dbc8e72e7b9a3d75918 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:23.713188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.713693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.714873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.738754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:23.740662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:23.828572 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3773/7517] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:23.838927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:23.841627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:23.908475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c6dc-9a66-46ab-900c-167d0fdf7278 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:23.916166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6538d-3d90-4c30-aa4f-f024ff087757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:23.916869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6538d-3d90-4c30-aa4f-f024ff087757 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:23.917214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6538d-3d90-4c30-aa4f-f024ff087757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:23.917588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6538d-3d90-4c30-aa4f-f024ff087757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:23.936277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6538d-3d90-4c30-aa4f-f024ff087757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:23.937333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6538d-3d90-4c30-aa4f-f024ff087757 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:23.949541 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3745/7518] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:24.282998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.284902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:24.311178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9203a-63e7-44d5-aa56-8acae2c1c7ac None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.323740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.324546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.324947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.325767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] PATH_INFO: `/v3/projects/e84bda9e709c4175845b1f736437a4b1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.327532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84bda9e709c4175845b1f736437a4b1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.330295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.405454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84bda9e709c4175845b1f736437a4b1', 'request_id': 'req-5d41e216-17cb-4272-af19-3384f76cfab7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:24.414959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84bda9e709c4175845b1f736437a4b1', 'request_id': 'req-5d41e216-17cb-4272-af19-3384f76cfab7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:24.422822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84bda9e709c4175845b1f736437a4b1', 'request_id': 'req-5d41e216-17cb-4272-af19-3384f76cfab7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:24.435922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] The token cache is being invalidate because project e84bda9e709c4175845b1f736437a4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:24.436130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:24.436921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5d41e216-17cb-4272-af19-3384f76cfab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:24.444165 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3774/7519] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:24 2022] DELETE /identity/v3/projects/e84bda9e709c4175845b1f736437a4b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:24.445645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.445947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.446218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.473094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:24.474419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:24.553290 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3746/7520] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:24.560790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.561084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.561369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.581253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:24.582211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:24.592156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3775/7521] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:24.596377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.606913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eb844-fb98-4fdc-ab0d-8ededd74d2c7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.613971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.614666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.614952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.615225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.615952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:19:24.616264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.617861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.629984 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3747/7522] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:19:24.634743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.644364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15c39-576e-4ff4-8417-b018839ea9dd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.649022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.649680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.650522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.650814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.651499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.653390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.684413 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3776/7523] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:19:24 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:24.688282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.700170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343260f-148b-4709-b67f-4f50d940fa6e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.799330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.800192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.800586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.800968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.801839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.804179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.814562 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:24.835122 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3748/7524] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:19:24 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:24.839636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.851458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853ede5-6116-46a1-a7d1-965aceff38ac admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.857135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.857887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.858418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.858752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.859499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.861314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.876897 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3777/7525] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:19:24.878148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.889323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0c9b5-310d-40a8-a2e6-9d484dccbc68 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.894303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd4952-007e-4b29-ace9-c423d31fcee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.895182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd4952-007e-4b29-ace9-c423d31fcee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.895479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd4952-007e-4b29-ace9-c423d31fcee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.895765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd4952-007e-4b29-ace9-c423d31fcee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.896513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd4952-007e-4b29-ace9-c423d31fcee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.898152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd4952-007e-4b29-ace9-c423d31fcee3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.910287 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3749/7526] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:19:24.914236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:24.922184 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:24.926993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944566b3-a202-4238-b6ce-ce04047b86e8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:24.935310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:24.936563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.936945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.937303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] PATH_INFO: `/v3/projects/577e9553884444c5b4efb37d857b17c2/users/0f638070510f45b5a2c786372fe2041d/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:24.954130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577e9553884444c5b4efb37d857b17c2, user_id=0f638070510f45b5a2c786372fe2041d, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:24.957154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:24.973227 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3778/7527] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:19:24 2022] PUT /identity/v3/projects/577e9553884444c5b4efb37d857b17c2/users/0f638070510f45b5a2c786372fe2041d/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:24.984783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:24.985073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:24.985556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:25.022325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] MFA Rules not processed for user `0f638070510f45b5a2c786372fe2041d`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:25.023784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:25.145756 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3750/7528] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:25.158445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:25.160430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:25.229261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224259-7dfb-43b9-b3a2-458d88655d60 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:25.234310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:25.235480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:25.235480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:25.235713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:25.244869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:25.246363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:25.256061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3779/7529] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:28.178433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:28.180140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:28.280392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6d75-6406-4f8e-9df9-4f2ca48f38c8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:28.287558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:28.288724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:28.289180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:28.289649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] PATH_INFO: `/v3/users/0a4445d6e33e4fce889e1977987a0233` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:28.292803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4445d6e33e4fce889e1977987a0233)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:28.305164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:28.367261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4445d6e33e4fce889e1977987a0233'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.387536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4445d6e33e4fce889e1977987a0233'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.395783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4445d6e33e4fce889e1977987a0233'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.398689 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:28.426908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4445d6e33e4fce889e1977987a0233'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.428353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-272786d8-a759-440c-9c36-6e8c1c463bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4445d6e33e4fce889e1977987a0233'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.448368 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3751/7530] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:28 2022] DELETE /identity/v3/users/0a4445d6e33e4fce889e1977987a0233 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:28.645987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:28.659823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84831-db37-4889-a742-a3299c7e0272 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:28.751959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:28.753182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:28.753653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:28.753980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] PATH_INFO: `/v3/projects/3b2e994a10f34cb48a4e170de72e3be0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:28.755457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2e994a10f34cb48a4e170de72e3be0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:28.761324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:28.824085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2e994a10f34cb48a4e170de72e3be0', 'request_id': 'req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.843739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2e994a10f34cb48a4e170de72e3be0', 'request_id': 'req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.851129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2e994a10f34cb48a4e170de72e3be0', 'request_id': 'req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.869572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] The token cache is being invalidate because project 3b2e994a10f34cb48a4e170de72e3be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:28.870220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.871342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-24fb26ec-8ce3-43fb-bbea-55d09088ec8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:28.873609 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3780/7531] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:28 2022] DELETE /identity/v3/projects/3b2e994a10f34cb48a4e170de72e3be0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:28.879059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:28.879564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:28.880159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:28.901574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:28.903095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:28.981027 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3752/7532] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:28.990249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:28.990249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:28.990538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.030987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:29.036054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:29.061651 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3781/7533] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:29.065623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.078825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df175a-8169-452f-ae74-5fa7e07b0816 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.102787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.104217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.104875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.105038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.105886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:19:29.106310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.108576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.135413 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3753/7534] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:19:29.140749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.153240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf396b-ae3b-4758-9220-79dbd3d3c462 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.159877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.160635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.160982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.161262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.162056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.164935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.169658 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:29.205972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3782/7535] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:19:29 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:29.210463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.231683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaba4c-77ee-472a-ab84-4e0bcba538f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.300025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.300737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.301022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.301298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.301996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.303961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.328129 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3754/7536] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:19:29 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:29.332463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.360013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cddac4-ba02-492d-9f7a-366b482795f5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.368921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.369625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.369914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.370194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.371000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.373157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.384929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3783/7537] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:29.388874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.399386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6694e9-4567-4b59-9228-fe77ba761277 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.404713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fe2ca-fb22-492b-9b2c-38a125ecd1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.405376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fe2ca-fb22-492b-9b2c-38a125ecd1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.405666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fe2ca-fb22-492b-9b2c-38a125ecd1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.406062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fe2ca-fb22-492b-9b2c-38a125ecd1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.406850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fe2ca-fb22-492b-9b2c-38a125ecd1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.408472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fe2ca-fb22-492b-9b2c-38a125ecd1dd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.418842 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3755/7538] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:29.422790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.433082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06317-2b37-43cd-94cb-382b1ae294a1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.437830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2818c-d484-4983-954c-7499cf797af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.438758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2818c-d484-4983-954c-7499cf797af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.439057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2818c-d484-4983-954c-7499cf797af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.439341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2818c-d484-4983-954c-7499cf797af7 admin admin] PATH_INFO: `/v3/projects/4187ead63c4b47d18dd40f4e04246165/users/b44f5c70512344b99cc2a9c92cca22e3/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.455788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2818c-d484-4983-954c-7499cf797af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4187ead63c4b47d18dd40f4e04246165, user_id=b44f5c70512344b99cc2a9c92cca22e3, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.458455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2818c-d484-4983-954c-7499cf797af7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.472969 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3784/7539] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:19:29 2022] PUT /identity/v3/projects/4187ead63c4b47d18dd40f4e04246165/users/b44f5c70512344b99cc2a9c92cca22e3/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:29.482649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.482944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.483233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.514807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] MFA Rules not processed for user `b44f5c70512344b99cc2a9c92cca22e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:29.516041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:29.574375 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:29.618441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3756/7540] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:29.630268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.630587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.630874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.662059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] MFA Rules not processed for user `b44f5c70512344b99cc2a9c92cca22e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:29.663355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:29.671758 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3785/7541] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:29.687230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:29.688745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:29.853072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be3a88-ca6e-45bc-a3d8-b789db558481 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:29.862791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3f006-8c75-49d5-87a1-4160015d0d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:29.870718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3f006-8c75-49d5-87a1-4160015d0d2e service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:29.871015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3f006-8c75-49d5-87a1-4160015d0d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:29.871432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3f006-8c75-49d5-87a1-4160015d0d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:29.886602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3f006-8c75-49d5-87a1-4160015d0d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:29.888239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3f006-8c75-49d5-87a1-4160015d0d2e service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:29.899326 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3757/7542] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:35.462515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:35.463926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:35.568514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19d33-5807-4645-a6db-25be2adaf14b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:35.577067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:35.578458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:35.578779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:35.579061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] PATH_INFO: `/v3/users/0f638070510f45b5a2c786372fe2041d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:35.580316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f638070510f45b5a2c786372fe2041d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:35.582878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:35.660591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f638070510f45b5a2c786372fe2041d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:35.661287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f638070510f45b5a2c786372fe2041d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:35.675891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f638070510f45b5a2c786372fe2041d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:35.676632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f638070510f45b5a2c786372fe2041d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:35.684932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f638070510f45b5a2c786372fe2041d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:35.701786 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3786/7543] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:35 2022] DELETE /identity/v3/users/0f638070510f45b5a2c786372fe2041d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:19:35.706222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972670-179c-463c-a732-89bc950d6038 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:35.706735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972670-179c-463c-a732-89bc950d6038 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:35.706892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972670-179c-463c-a732-89bc950d6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:35.727190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-84972670-179c-463c-a732-89bc950d6038 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:35.728379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-84972670-179c-463c-a732-89bc950d6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:35.803000 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3758/7544] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:35.810394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:35.813092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:35.846096 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:35.935404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dba3b-e0c4-4780-9aad-de3847fc7e7e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:35.939344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eb476-acb3-4060-87d2-baca97d2c069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:35.940014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eb476-acb3-4060-87d2-baca97d2c069 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:35.940544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eb476-acb3-4060-87d2-baca97d2c069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:35.940966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eb476-acb3-4060-87d2-baca97d2c069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:35.952679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eb476-acb3-4060-87d2-baca97d2c069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:35.954128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eb476-acb3-4060-87d2-baca97d2c069 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:35.964830 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3787/7545] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:19:36.529153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84972670-179c-463c-a732-89bc950d6038 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:36.530597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-84972670-179c-463c-a732-89bc950d6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:36.549010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84972670-179c-463c-a732-89bc950d6038 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:36.557163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:36.558171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:36.558549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:36.565308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] PATH_INFO: `/v3/projects/577e9553884444c5b4efb37d857b17c2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:36.573258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=577e9553884444c5b4efb37d857b17c2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:36.575566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:36.658025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577e9553884444c5b4efb37d857b17c2', 'request_id': 'req-9e32531c-ded9-4cc4-a685-6e1978c3b35e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:36.666195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577e9553884444c5b4efb37d857b17c2', 'request_id': 'req-9e32531c-ded9-4cc4-a685-6e1978c3b35e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:36.674932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577e9553884444c5b4efb37d857b17c2', 'request_id': 'req-9e32531c-ded9-4cc4-a685-6e1978c3b35e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:36.678931 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:36.693496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] The token cache is being invalidate because project 577e9553884444c5b4efb37d857b17c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:36.694400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:36.695224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9e32531c-ded9-4cc4-a685-6e1978c3b35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:36.698656 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3759/7546] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:36 2022] DELETE /identity/v3/projects/577e9553884444c5b4efb37d857b17c2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:36.702266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:36.703207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:36.703796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:36.728464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:36.729573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:36.814122 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3788/7547] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:36.821713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:36.822233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:36.822692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:36.847983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:36.849607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:36.860485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3760/7548] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:36.864618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:36.875966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a581dca-c5a7-4b9e-a63a-9f655daffc8f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:36.881048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:36.881793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:36.882087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:36.882372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:36.883151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:19:36.883619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:36.885250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:36.899290 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3789/7549] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:19:36.903438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:36.913561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48916d93-334f-41c9-9366-9ce0a2b14437 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:36.919610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:36.920477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:36.920924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:36.921457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:36.922319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:36.924413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:36.955165 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3761/7550] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:19:36 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:36.960120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:36.971377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3f82-cdd5-4f86-8f9e-d9435b876338 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:37.075092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:37.075792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:37.076088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:37.076546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:37.077244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:37.079281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:37.105746 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3790/7551] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:19:36 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:37.109941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:37.122259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129fd9a-4ef2-4580-b4b8-896227af2981 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:37.128050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:37.128738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:37.129022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:37.129313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:37.130051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:37.132328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:37.153161 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3762/7552] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:37.156111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:37.169353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541e777-e0fd-49b6-9875-f53a8ed46765 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:37.174331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f90b-c252-49fe-8d43-9fd2c71d9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:37.175053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f90b-c252-49fe-8d43-9fd2c71d9f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:37.175345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f90b-c252-49fe-8d43-9fd2c71d9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:37.175622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f90b-c252-49fe-8d43-9fd2c71d9f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:37.176356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f90b-c252-49fe-8d43-9fd2c71d9f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:37.177950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f90b-c252-49fe-8d43-9fd2c71d9f77 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:37.189643 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3791/7553] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:37.193895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:37.206675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741a67-a239-4935-96d0-f5b30805f993 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:37.214775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:37.215832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:37.216183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:37.216520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] PATH_INFO: `/v3/projects/7063af479f6949fbad2cfdf7b18811eb/users/7c256fba55d74f8e842e7ab3e39dc15e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:37.235530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7063af479f6949fbad2cfdf7b18811eb, user_id=7c256fba55d74f8e842e7ab3e39dc15e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:37.238853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:37.261402 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3763/7554] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:19:37 2022] PUT /identity/v3/projects/7063af479f6949fbad2cfdf7b18811eb/users/7c256fba55d74f8e842e7ab3e39dc15e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:37.262946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aee74-e89a-428a-8338-51f62a9d978a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:37.263457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aee74-e89a-428a-8338-51f62a9d978a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:37.263811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aee74-e89a-428a-8338-51f62a9d978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:37.289741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8b9aee74-e89a-428a-8338-51f62a9d978a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:37.293000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8b9aee74-e89a-428a-8338-51f62a9d978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:37.351802 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:37.415516 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3792/7555] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:37.421415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:37.423690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:37.503385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4fb26-0202-493d-9710-fcafd4e3e087 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:37.507978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:37.509329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:37.509845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:37.510147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:37.522893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:37.524903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:37.542247 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3764/7556] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:38.361928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0303021-37c4-48e5-b20f-1f666e7464bd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:38.362397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0303021-37c4-48e5-b20f-1f666e7464bd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:38.362735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0303021-37c4-48e5-b20f-1f666e7464bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:38.394062 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c0303021-37c4-48e5-b20f-1f666e7464bd None None] MFA Rules not processed for user `7c256fba55d74f8e842e7ab3e39dc15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:38.395859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0303021-37c4-48e5-b20f-1f666e7464bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:38.490331 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3793/7557] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:38.505047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:38.506471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:38.611654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ab640-0def-4472-8cb9-8d93e38d8737 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:38.615869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f30d0-d7d4-48bc-a644-e6ff5ffe0879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:38.616533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f30d0-d7d4-48bc-a644-e6ff5ffe0879 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:38.616815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f30d0-d7d4-48bc-a644-e6ff5ffe0879 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:38.617092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f30d0-d7d4-48bc-a644-e6ff5ffe0879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:38.635232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f30d0-d7d4-48bc-a644-e6ff5ffe0879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:38.636810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f30d0-d7d4-48bc-a644-e6ff5ffe0879 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:38.646281 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3765/7558] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:39.996696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:39.997261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:39.997578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:40.016038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] MFA Rules not processed for user `7c256fba55d74f8e842e7ab3e39dc15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:40.017106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:40.024093 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3794/7559] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:46.328561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:46.329062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:46.329170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:46.357846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] MFA Rules not processed for user `3cced2e2903b42f580b9221464af5537`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:46.359520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:46.409038 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:46.456177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3766/7560] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:46.989515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:46.991004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:47.173457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad309aa7-e62b-4254-ba06-6b70eb8611f5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:47.195616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:47.196476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:47.196864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:47.198018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:47.203796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:47.309000 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:47.330071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:47.343248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6710a9-b93c-4c1b-b368-45c27ac45b74 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:47.367039 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3795/7561] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:53.243946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:53.245601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:53.363440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9023e-fe3f-4a00-8cbc-d0c675e2c475 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:53.368700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:53.369592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:53.370054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:53.370541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:53.373578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:53.393152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:53.395161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:53.413169 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3767/7562] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:55.861950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31258f9c-ca60-454e-a9ac-850aac89b352 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:55.862437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31258f9c-ca60-454e-a9ac-850aac89b352 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:55.862590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31258f9c-ca60-454e-a9ac-850aac89b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:55.886060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-31258f9c-ca60-454e-a9ac-850aac89b352 None None] MFA Rules not processed for user `7c256fba55d74f8e842e7ab3e39dc15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:55.887318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-31258f9c-ca60-454e-a9ac-850aac89b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:55.895332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3796/7563] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:56.003592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:56.005366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:56.030883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8337e70-a80f-45ab-aa2b-ce9de1b54a78 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:56.036011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:56.037158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:56.037453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:56.037734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] PATH_INFO: `/v3/users/6acf1e4b3236443fb6dc2c60f92ebb12` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:56.040112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] RBAC: Authorizing `identity:delete_user(user_id=6acf1e4b3236443fb6dc2c60f92ebb12)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:56.045525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:56.145963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6acf1e4b3236443fb6dc2c60f92ebb12'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:56.162466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6acf1e4b3236443fb6dc2c60f92ebb12'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:56.175240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6acf1e4b3236443fb6dc2c60f92ebb12'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:56.184765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6acf1e4b3236443fb6dc2c60f92ebb12'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:56.185702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6acf1e4b3236443fb6dc2c60f92ebb12'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:56.202430 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3768/7564] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:56 2022] DELETE /identity/v3/users/6acf1e4b3236443fb6dc2c60f92ebb12 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:56.207100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:56.207550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:56.207696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:56.253214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:56.259092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:56.431551 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3797/7565] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:56.456757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:56.460352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:56.524933 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:56.560387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c298e09-a3ff-4d5f-919a-f95e6f3220de admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:56.566923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:56.568074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:56.568504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:56.569097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:56.583606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:56.585737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:56.600409 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3769/7566] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:19:57.050921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:57.052579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:57.072308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2987fd-bbb5-4cbb-af0d-5f3bb4c2efea None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:57.084782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:57.086453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:57.087150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:57.087474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] PATH_INFO: `/v3/projects/ac9062a3455e4c3da9a334f7a30e902d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:57.088826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9062a3455e4c3da9a334f7a30e902d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:57.090810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:57.169616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9062a3455e4c3da9a334f7a30e902d', 'request_id': 'req-1d5ade67-314c-4cc9-b947-479f4465df0f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.182474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9062a3455e4c3da9a334f7a30e902d', 'request_id': 'req-1d5ade67-314c-4cc9-b947-479f4465df0f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.193794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9062a3455e4c3da9a334f7a30e902d', 'request_id': 'req-1d5ade67-314c-4cc9-b947-479f4465df0f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.221296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] The token cache is being invalidate because project ac9062a3455e4c3da9a334f7a30e902d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:57.221596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.222965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.230336 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3798/7567] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:57 2022] DELETE /identity/v3/projects/ac9062a3455e4c3da9a334f7a30e902d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:57.231017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:57.244905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db61890-98a2-4fb7-846d-ca38bfb57ee5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:57.327387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:57.328883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:57.329360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:57.329742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] PATH_INFO: `/v3/users/513fd8adf8a84d05ba81dd22919f93cb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:57.331378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=513fd8adf8a84d05ba81dd22919f93cb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:57.333830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:57.486680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:57.488806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:57.557190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513fd8adf8a84d05ba81dd22919f93cb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.578663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513fd8adf8a84d05ba81dd22919f93cb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.589669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513fd8adf8a84d05ba81dd22919f93cb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.601513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ade67-314c-4cc9-b947-479f4465df0f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:57.603774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513fd8adf8a84d05ba81dd22919f93cb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.605141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513fd8adf8a84d05ba81dd22919f93cb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:57.609688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:57.610787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:57.611245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:57.611694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:57.613518 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3770/7568] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:19:57 2022] DELETE /identity/v3/users/513fd8adf8a84d05ba81dd22919f93cb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:57.614322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:57.632042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:57.634303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f56ba-ab23-4a26-afa1-7b36dcd5d337 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:57.639518 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:57.648161 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3799/7569] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:19:58.006934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.009806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:58.105528 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:58.110174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf137f-5d90-4446-8044-1542cb688dfd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.116602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.117633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.118558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.118853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] PATH_INFO: `/v3/projects/d332f3d8473b4332984d39e03e6100cf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.120663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d332f3d8473b4332984d39e03e6100cf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.123246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.187286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd332f3d8473b4332984d39e03e6100cf', 'request_id': 'req-a395715b-cc30-4289-9f45-cb59b7d1d10c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:58.192775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd332f3d8473b4332984d39e03e6100cf', 'request_id': 'req-a395715b-cc30-4289-9f45-cb59b7d1d10c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:58.200305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd332f3d8473b4332984d39e03e6100cf', 'request_id': 'req-a395715b-cc30-4289-9f45-cb59b7d1d10c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:58.215868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] The token cache is being invalidate because project d332f3d8473b4332984d39e03e6100cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:19:58.216312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:58.216981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a395715b-cc30-4289-9f45-cb59b7d1d10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:19:58.218785 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3771/7570] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:19:58 2022] DELETE /identity/v3/projects/d332f3d8473b4332984d39e03e6100cf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:58.223451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.224446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.224955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.262800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:58.265526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:58.354720 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3800/7571] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:58.362012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.362577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.363125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.390088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:58.391500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:58.405647 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3772/7572] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:19:58.406897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.421151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b8926-f61a-45b6-a9b7-d1f3524ca87f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.427122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.427886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.428171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.428632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.429369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:19:58.429761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.431401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.447048 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3801/7573] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:19:58.451399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.463185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280461a-a410-477c-92ab-5a474eed37cf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.470472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.471260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.471738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.472022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.472718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.475157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.520452 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3773/7574] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:19:58 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:58.520607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.532611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425fd8-7836-4e39-8d61-65fdb9a87b2b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.623693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89870394-376f-4768-aad2-717be079394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.624717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89870394-376f-4768-aad2-717be079394d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.625246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89870394-376f-4768-aad2-717be079394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.625734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89870394-376f-4768-aad2-717be079394d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.626685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89870394-376f-4768-aad2-717be079394d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.628843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89870394-376f-4768-aad2-717be079394d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.665808 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3802/7575] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:19:58 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:19:58.669940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.693246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22f11-ee54-4faf-ab99-6621ea6f2e47 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.699135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.699815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.700104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.700385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.701128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.702771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.717558 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3774/7576] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:58.718840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89870394-376f-4768-aad2-717be079394d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.730540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89870394-376f-4768-aad2-717be079394d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.736156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6b0a0-1220-4778-be14-79cd519196d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.737536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6b0a0-1220-4778-be14-79cd519196d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.737927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6b0a0-1220-4778-be14-79cd519196d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.738269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6b0a0-1220-4778-be14-79cd519196d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.739180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6b0a0-1220-4778-be14-79cd519196d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.740874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6b0a0-1220-4778-be14-79cd519196d0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.757034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3803/7577] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:19:58.759704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:58.771982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeed18-736b-4771-be5a-336e3856102e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:58.779676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:58.780748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.781305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.781435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] PATH_INFO: `/v3/projects/050d26f7cb1448fca88b56975a49f81d/users/6c6631935fb748e38a1e61a0a33fdef7/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.813853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050d26f7cb1448fca88b56975a49f81d, user_id=6c6631935fb748e38a1e61a0a33fdef7, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:58.821526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:58.841665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3775/7578] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:19:58 2022] PUT /identity/v3/projects/050d26f7cb1448fca88b56975a49f81d/users/6c6631935fb748e38a1e61a0a33fdef7/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:19:58.853858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:58.854155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:58.854442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:58.920897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] MFA Rules not processed for user `6c6631935fb748e38a1e61a0a33fdef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:19:58.923906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:59.018779 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:19:59.036941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3804/7579] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:19:59.076628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:19:59.078785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:19:59.152946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098bfdd-58f4-4bbc-b253-5e4d74754199 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:19:59.157156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d5e4-7f7d-400c-bd1d-6262a5517bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:19:59.157816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d5e4-7f7d-400c-bd1d-6262a5517bcc service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:19:59.158105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d5e4-7f7d-400c-bd1d-6262a5517bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:19:59.158385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d5e4-7f7d-400c-bd1d-6262a5517bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:19:59.171990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d5e4-7f7d-400c-bd1d-6262a5517bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:19:59.174219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d5e4-7f7d-400c-bd1d-6262a5517bcc service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:19:59.186234 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3776/7580] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:19:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:01.569330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:01.570889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:01.651345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3076f-a379-4662-8ab1-203d6a2a7739 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:01.656279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:01.657069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:01.657224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:01.657499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:01.659987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:01.748255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:01.751491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:01.767883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3805/7581] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:06.748002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378abea-3889-4137-9993-4e20cdafb8f0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:06.748504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378abea-3889-4137-9993-4e20cdafb8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:06.748724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378abea-3889-4137-9993-4e20cdafb8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:06.789690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2378abea-3889-4137-9993-4e20cdafb8f0 None None] MFA Rules not processed for user `3fdf1208d2c34fd1b5a24c2ad4e063a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:06.791239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2378abea-3889-4137-9993-4e20cdafb8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:06.835579 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:06.942042 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3777/7582] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:11.759965 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=53 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:14.786110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:14.787460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:14.979379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6834-0b87-43ae-bc32-ecd34a818b4f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:14.991676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:14.993103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:14.993651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:14.994191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] PATH_INFO: `/v3/users/b44f5c70512344b99cc2a9c92cca22e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:14.995817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44f5c70512344b99cc2a9c92cca22e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:14.998312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:15.141454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44f5c70512344b99cc2a9c92cca22e3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:15.143158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44f5c70512344b99cc2a9c92cca22e3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:15.173970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44f5c70512344b99cc2a9c92cca22e3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:15.178857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44f5c70512344b99cc2a9c92cca22e3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:15.193590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44f5c70512344b99cc2a9c92cca22e3'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:15.222870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3806/7583] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:14 2022] DELETE /identity/v3/users/b44f5c70512344b99cc2a9c92cca22e3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:15.227388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2015e-d8c4-4bff-b6f4-00ad3565b397 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:15.228537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2015e-d8c4-4bff-b6f4-00ad3565b397 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:15.229056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2015e-d8c4-4bff-b6f4-00ad3565b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:15.261994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3de2015e-d8c4-4bff-b6f4-00ad3565b397 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:15.263969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3de2015e-d8c4-4bff-b6f4-00ad3565b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:15.384316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3778/7584] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:15.394196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:15.395805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:15.536767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14063daf-f4fe-418f-ab78-7b4b890235e0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:15.553055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:15.553055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:15.553055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:15.554335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:15.586041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:15.587581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:15.607439 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3807/7585] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:15.704462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:15.704810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:15.705052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:15.813959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:15.815243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:15.981520 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3779/7586] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:20:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:16.028629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.030091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:16.069902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bd125-731b-4ef0-a5a3-6487affea3ba service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.077213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.078114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.078404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.078727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] PATH_INFO: `/v3/projects/4187ead63c4b47d18dd40f4e04246165` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.080072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4187ead63c4b47d18dd40f4e04246165)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.081983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.106543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.108355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:16.128647 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:16.200427 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:16.212287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4187ead63c4b47d18dd40f4e04246165', 'request_id': 'req-53807d3d-0839-4db7-a18a-d251233d2abc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:16.223173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4187ead63c4b47d18dd40f4e04246165', 'request_id': 'req-53807d3d-0839-4db7-a18a-d251233d2abc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:16.231705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4187ead63c4b47d18dd40f4e04246165', 'request_id': 'req-53807d3d-0839-4db7-a18a-d251233d2abc'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:16.245774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] The token cache is being invalidate because project 4187ead63c4b47d18dd40f4e04246165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:16.246155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:16.246895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-53807d3d-0839-4db7-a18a-d251233d2abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:16.248965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3808/7587] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:16 2022] DELETE /identity/v3/projects/4187ead63c4b47d18dd40f4e04246165 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:16.256330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d8197-f4ba-439e-a499-b76d983537ea None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.256737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d8197-f4ba-439e-a499-b76d983537ea None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.257026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d8197-f4ba-439e-a499-b76d983537ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.260296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c378ca-4c81-40fc-9bf3-8fea2e9ca5db None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.293944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d44d8197-f4ba-439e-a499-b76d983537ea None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:16.295203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d44d8197-f4ba-439e-a499-b76d983537ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:16.377965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.378601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.378887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.379267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.381223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:16.383810 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3809/7588] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:16.391310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.391599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.392026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.415437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:16.416701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:16.429452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3810/7589] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:16.430700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.439921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60576eb6-7415-48fb-8d5e-bccb718a1fd4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.444958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.445617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.445964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.446254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.447144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:16.447452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.449059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.450867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.452909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.461707 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3811/7590] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:20:16.463808 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3780/7591] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:20:16.465911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.477628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c7dfd-37c3-47d4-886b-fd20f6e9b502 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.482966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.484009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.484394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.484749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.485849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.488118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.549512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3812/7592] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:16 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:16.555923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.570203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea93ce3-0f38-4694-877f-f5b48942379a service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.725447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.726480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.726708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.727042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.728050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.731947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.771346 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3781/7593] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:16 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:16.776058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.788917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02333f02-b8e1-4155-97c4-74c99ab96eb5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.800830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.801530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.802213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.802213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.804757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.809590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.836304 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3813/7594] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:16.836538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.856451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e1f16-13d2-431d-95b5-99e2d61eae6e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.862865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294dc3-47c7-4b1f-bd05-ef8092f09647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.863544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294dc3-47c7-4b1f-bd05-ef8092f09647 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.863928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294dc3-47c7-4b1f-bd05-ef8092f09647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.864205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294dc3-47c7-4b1f-bd05-ef8092f09647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.865200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294dc3-47c7-4b1f-bd05-ef8092f09647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.868352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294dc3-47c7-4b1f-bd05-ef8092f09647 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.891958 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3782/7595] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:20:16.896117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:16.907132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124f8f-0387-44d5-8991-d0382aec071b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:16.912794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:16.914406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.914733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.915022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] PATH_INFO: `/v3/projects/aa6c955af653476bab7fe988e7412825/users/0aefb2a9f2844c4c979d114eb2c38cf1/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:16.935725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6c955af653476bab7fe988e7412825, user_id=0aefb2a9f2844c4c979d114eb2c38cf1, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:16.939500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:16.978599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3814/7596] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:16 2022] PUT /identity/v3/projects/aa6c955af653476bab7fe988e7412825/users/0aefb2a9f2844c4c979d114eb2c38cf1/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:16.992776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:16.993069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:16.993344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:17.007572 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:17.041835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] MFA Rules not processed for user `0aefb2a9f2844c4c979d114eb2c38cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:17.050091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:17.174022 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3783/7597] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:17.178344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:17.244118 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:17.325060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d98023-ab35-4770-914f-0985f7ef9bd6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:17.341321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:17.343206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:17.344685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:17.344977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:17.347032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:17.354435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:17.406599 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3815/7598] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:17 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:17.410339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:17.441015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4665430-1c68-4288-bd88-76196b184ad2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:17.606488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:17.607404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:17.607762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:17.608104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:17.609450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:17.611563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:17.640524 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3784/7599] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:17 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:17.641870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:17.658487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091eb7-ad2d-4216-aea6-23860aafcd1b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:17.664161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:17.664856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:17.665754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:17.666053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:17.666840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:17.668502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:17.682223 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3816/7600] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:17.687925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:17.722827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf92c-bcee-4da0-ace9-00d6680b6032 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:17.755938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:17.758250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:17.765420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:17.765420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] PATH_INFO: `/v3/projects/f56ceccbc6904ab5b73fa2a3046a01f7/users/538e55b7401a4babaf73f407a1460617/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:17.807474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56ceccbc6904ab5b73fa2a3046a01f7, user_id=538e55b7401a4babaf73f407a1460617, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:17.816884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:17.839084 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3785/7601] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:17 2022] PUT /identity/v3/projects/f56ceccbc6904ab5b73fa2a3046a01f7/users/538e55b7401a4babaf73f407a1460617/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:20:17.842813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:17.857116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999c12-0859-45e5-81e5-c737996a1d9d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:17.945377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d539c9-b799-4dca-b543-15d86ccedead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:17.946214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d539c9-b799-4dca-b543-15d86ccedead admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:17.947016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d539c9-b799-4dca-b543-15d86ccedead admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:17.947308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d539c9-b799-4dca-b543-15d86ccedead admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:17.948767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d539c9-b799-4dca-b543-15d86ccedead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:17.951483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d539c9-b799-4dca-b543-15d86ccedead admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:17.968477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3817/7602] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:20:17.974441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:17.989574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c2eb4-d66c-4040-925b-dd11032823ea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:17.995715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:17.996896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:17.997178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:17.997456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] PATH_INFO: `/v3/projects/f56ceccbc6904ab5b73fa2a3046a01f7/users/538e55b7401a4babaf73f407a1460617/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:18.000086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56ceccbc6904ab5b73fa2a3046a01f7, user_id=538e55b7401a4babaf73f407a1460617, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:18.003590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:18.032206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:18.032534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:18.032768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:18.034910 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3786/7603] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:17 2022] PUT /identity/v3/projects/f56ceccbc6904ab5b73fa2a3046a01f7/users/538e55b7401a4babaf73f407a1460617/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:18.092870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] MFA Rules not processed for user `538e55b7401a4babaf73f407a1460617`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:18.094518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:18.225698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:18.226539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3818/7604] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:18.255067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7803-c5df-4688-9b1b-b094218cae2b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:18.260855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:18.261534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:18.261818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:18.262098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:18.262839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:18.264724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:18.327788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3787/7605] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:18 2022] POST /identity/v3/projects => generated 359 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:18.328362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:18.381177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce7d8-1369-4aca-9d3d-9e4549e459e9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:18.441807 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:18.499641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:18.500556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:18.500942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:18.501297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:18.502086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:18.503987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:18.540245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3819/7606] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:18 2022] POST /identity/v3/users => generated 416 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:18.544521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:18.556831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf959f-d7c9-437e-bb6f-337e3c9f7c74 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:18.563866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:18.565018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:18.566151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:18.566579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/users/06fd25fd6b8d48f6bb0f777d0ca7d2bf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:18.587414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_user(user_id=06fd25fd6b8d48f6bb0f777d0ca7d2bf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:18.590258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:18.592665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3788/7607] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:20:18 2022] GET /identity/v3/users/06fd25fd6b8d48f6bb0f777d0ca7d2bf => generated 416 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:18.597109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:18.609604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ce86e-078a-48a0-93aa-5b3e21d5dcf5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:18.615375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:18.617107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:18.617532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:18.617898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/users/06fd25fd6b8d48f6bb0f777d0ca7d2bf` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:18.619589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_user(user_id=06fd25fd6b8d48f6bb0f777d0ca7d2bf)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:18.621896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:18.732999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fd25fd6b8d48f6bb0f777d0ca7d2bf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:18.735257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fd25fd6b8d48f6bb0f777d0ca7d2bf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:18.778066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fd25fd6b8d48f6bb0f777d0ca7d2bf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:18.780408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fd25fd6b8d48f6bb0f777d0ca7d2bf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:18.805122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fd25fd6b8d48f6bb0f777d0ca7d2bf'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:18.831953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:18.832803 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3820/7608] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:18 2022] DELETE /identity/v3/users/06fd25fd6b8d48f6bb0f777d0ca7d2bf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:18.833968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:18.869685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63685a1-0023-49e4-b8ed-ee0faf030103 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:18.895623 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:19.056705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:19.058460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:19.060923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:19.061330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/285bf80947f849df8afe34bec46ffef6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:19.065451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=285bf80947f849df8afe34bec46ffef6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:19.071289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:19.184446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285bf80947f849df8afe34bec46ffef6', 'request_id': 'req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:19.208950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285bf80947f849df8afe34bec46ffef6', 'request_id': 'req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:19.237304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285bf80947f849df8afe34bec46ffef6', 'request_id': 'req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:19.276174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 285bf80947f849df8afe34bec46ffef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:19.276536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:19.278867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:19.290958 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3789/7609] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:18 2022] DELETE /identity/v3/projects/285bf80947f849df8afe34bec46ffef6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:19.297126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:19.311935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5778af-9ef4-4d1c-88cf-870b50ace1a5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:19.497988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:19.498717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:19.499018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:19.499305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:19.500039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:19.501752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:19.534915 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3821/7610] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:19 2022] POST /identity/v3/projects => generated 348 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:19.538786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:19.540519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:19.560019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef4f9a-5d9d-478e-be1f-8c69fa25cb39 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:19.727671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:19.729065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:19.729434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:19.729796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:19.730804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:19.731319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:19.733408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:19.754574 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3790/7611] 10.222.0.77 () {58 vars in 1159 bytes} [Mon Jul 11 15:20:19 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:19.758904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:19.779288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3050-76da-49e7-bce7-c8e0177cd17e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:19.788207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:19.788885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:19.789172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:19.789979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:19.791320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:19.793822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:19.818045 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3822/7612] 10.222.0.77 () {58 vars in 1127 bytes} [Mon Jul 11 15:20:19 2022] GET /identity/v3/domains => generated 829 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:19.822363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:19.835681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047551-51c7-4aff-b7ff-a0a321e28b2b tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:19.840893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:19.841914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:19.842301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:19.842845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/2efd74aba2f948a58e97e85f64610c6b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:19.845084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:update_project(project_id=2efd74aba2f948a58e97e85f64610c6b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:19.847038 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:20:19.847038 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:20:19.847038 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:20:19.848324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:19.926307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:19.963816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.089039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.092608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.097241 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3791/7613] 10.222.0.77 () {60 vars in 1251 bytes} [Mon Jul 11 15:20:19 2022] PATCH /identity/v3/projects/2efd74aba2f948a58e97e85f64610c6b => generated 362 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:20.104660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:20.107140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:20.130079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253f164-46f0-4e36-93fb-156ca6f07e8e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:20.136727 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:20.228198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:20.229416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:20.229912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:20.230363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/2efd74aba2f948a58e97e85f64610c6b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:20.248000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2efd74aba2f948a58e97e85f64610c6b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:20.250350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:20.333621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.347131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.460962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b', 'request_id': 'req-642b22e0-2cc5-4573-ad13-f3feb6760f8d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.488836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b', 'request_id': 'req-642b22e0-2cc5-4573-ad13-f3feb6760f8d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.497011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b', 'request_id': 'req-642b22e0-2cc5-4573-ad13-f3feb6760f8d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.524748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 2efd74aba2f948a58e97e85f64610c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:20.526967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.527878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.536666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b', 'request_id': 'req-642b22e0-2cc5-4573-ad13-f3feb6760f8d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.537717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b', 'request_id': 'req-642b22e0-2cc5-4573-ad13-f3feb6760f8d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.542785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2efd74aba2f948a58e97e85f64610c6b', 'request_id': 'req-642b22e0-2cc5-4573-ad13-f3feb6760f8d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:20.549506 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3823/7614] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:20 2022] DELETE /identity/v3/projects/2efd74aba2f948a58e97e85f64610c6b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:20.557547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:20.563587 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:20.572773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be4fc-d77e-4ce1-8613-fb0b390e02e5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:20.739150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:20.739418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:20.739799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:20.740158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:20.740981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:20.743754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:20.815299 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3792/7615] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:20 2022] POST /identity/v3/projects => generated 358 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:20.816536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:20.818346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:20.878012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b22e0-2cc5-4573-ad13-f3feb6760f8d tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:21.006125 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:21.040751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:21.041660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:21.041950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:21.042234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/380d8e9184be4c40b43c8209f70d6d9e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:21.047801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=380d8e9184be4c40b43c8209f70d6d9e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:21.050558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:21.053084 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3824/7616] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:20 2022] GET /identity/v3/projects/380d8e9184be4c40b43c8209f70d6d9e => generated 358 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:21.057630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:21.072824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ea2f-3419-440c-8040-fe7f3beaa175 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:21.079548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:21.080994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:21.081543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:21.082096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/380d8e9184be4c40b43c8209f70d6d9e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:21.083592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=380d8e9184be4c40b43c8209f70d6d9e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:21.087084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:21.153070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380d8e9184be4c40b43c8209f70d6d9e', 'request_id': 'req-f6c6010a-a770-4c93-9940-773bac62e420'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.162087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380d8e9184be4c40b43c8209f70d6d9e', 'request_id': 'req-f6c6010a-a770-4c93-9940-773bac62e420'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.181590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380d8e9184be4c40b43c8209f70d6d9e', 'request_id': 'req-f6c6010a-a770-4c93-9940-773bac62e420'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.211673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 380d8e9184be4c40b43c8209f70d6d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:21.212794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.214239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.249230 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3793/7617] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:21 2022] DELETE /identity/v3/projects/380d8e9184be4c40b43c8209f70d6d9e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:21.253607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:21.278256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:21.306919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23762e2-d9ad-4f99-ab9b-8257ac175315 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:21.498824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:21.499551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:21.499788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:21.500068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:21.501001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:21.502662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:21.578435 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3825/7618] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:21 2022] POST /identity/v3/projects => generated 360 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:21.579008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:21.600191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6010a-a770-4c93-9940-773bac62e420 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:21.729220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:21.730376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:21.730853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:21.731400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/f8167b41a4154a01b6a3d5c2f02828ff` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:21.733537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8167b41a4154a01b6a3d5c2f02828ff)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:21.736051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:21.738247 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3794/7619] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:21 2022] GET /identity/v3/projects/f8167b41a4154a01b6a3d5c2f02828ff => generated 360 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:21.742356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:21.756186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bedb17-2c38-47d7-9197-39e87443cb4c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:21.762522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:21.764231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:21.764652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:21.765011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/f8167b41a4154a01b6a3d5c2f02828ff` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:21.766691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8167b41a4154a01b6a3d5c2f02828ff)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:21.769526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:21.844120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8167b41a4154a01b6a3d5c2f02828ff', 'request_id': 'req-8da9aa8a-a547-42c3-b51c-00a194c74c82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.865055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8167b41a4154a01b6a3d5c2f02828ff', 'request_id': 'req-8da9aa8a-a547-42c3-b51c-00a194c74c82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.875079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8167b41a4154a01b6a3d5c2f02828ff', 'request_id': 'req-8da9aa8a-a547-42c3-b51c-00a194c74c82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.905397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project f8167b41a4154a01b6a3d5c2f02828ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:21.907660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.909598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:21.918345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3826/7620] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:21 2022] DELETE /identity/v3/projects/f8167b41a4154a01b6a3d5c2f02828ff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:21.924353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:21.926646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:21.943885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695b4b-98a6-443e-ad75-d7a08591f048 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:21.958512 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:22.019120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:22.019862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:22.020163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:22.020447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:22.023379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:22.024589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:22.079594 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3795/7621] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:20:21 2022] POST /identity/v3/projects => generated 348 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:22.081458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:22.099487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9aa8a-a547-42c3-b51c-00a194c74c82 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:22.229880 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:22.242598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:22.243617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:22.244946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:22.245337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/f919054aecb84919a2364126c743580c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:22.249363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=f919054aecb84919a2364126c743580c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:22.252207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:22.257691 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3827/7622] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:22 2022] GET /identity/v3/projects/f919054aecb84919a2364126c743580c => generated 348 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:22.259377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:22.274208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595a21a-a7fe-4969-88d2-7b32abee70e4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:22.293782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:22.294709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:22.298811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:22.300332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/f919054aecb84919a2364126c743580c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:22.305129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f919054aecb84919a2364126c743580c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:22.310414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:22.416832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f919054aecb84919a2364126c743580c', 'request_id': 'req-e808019f-6fce-49d6-831b-1e0cbba88a81'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:22.431626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f919054aecb84919a2364126c743580c', 'request_id': 'req-e808019f-6fce-49d6-831b-1e0cbba88a81'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:22.449711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f919054aecb84919a2364126c743580c', 'request_id': 'req-e808019f-6fce-49d6-831b-1e0cbba88a81'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:22.474824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project f919054aecb84919a2364126c743580c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:22.475214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:22.480188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:22.482146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3796/7623] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:22 2022] DELETE /identity/v3/projects/f919054aecb84919a2364126c743580c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:22.488493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:22.490691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:22.512385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb0e1-8e34-4ad4-b752-ee7f29edffd8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:22.699451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:22.700182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:22.700574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:22.700781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:22.702131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:22.703773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:22.730789 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3828/7624] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:20:22 2022] POST /identity/v3/domains => generated 276 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:22.734545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:22.748267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808019f-6fce-49d6-831b-1e0cbba88a81 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:22.885438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:22.886141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:22.886426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:22.886780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:22.887503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:22.889446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:22.980979 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:23.011639 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3797/7625] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:22 2022] POST /identity/v3/projects => generated 405 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:23.013229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:23.031310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403a25-d2ae-40f4-8132-e070f1e8fde4 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:23.145007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:23.145701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:23.145994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:23.146338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/5972395651094a6788b3835f11a67d14` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:23.148415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=5972395651094a6788b3835f11a67d14)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:23.151008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:23.153260 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3829/7626] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:23 2022] GET /identity/v3/projects/5972395651094a6788b3835f11a67d14 => generated 405 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:23.157532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:23.184231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b6bf-86d4-4770-8919-a31d5c658dd5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:23.189193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:23.190140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:23.190533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:23.190807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/5972395651094a6788b3835f11a67d14` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:23.192909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5972395651094a6788b3835f11a67d14)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:23.194965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:23.347620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5972395651094a6788b3835f11a67d14', 'request_id': 'req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.363163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5972395651094a6788b3835f11a67d14', 'request_id': 'req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.382669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5972395651094a6788b3835f11a67d14', 'request_id': 'req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.408645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 5972395651094a6788b3835f11a67d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:23.410416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.412360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.420870 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3798/7627] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:23 2022] DELETE /identity/v3/projects/5972395651094a6788b3835f11a67d14 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:23.421843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:23.423983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:23.447887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1650d-712f-462d-8af0-12f61bd60c34 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:23.597906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:23.601073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:23.603146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:23.603569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains/794ae92426054dee9c2a7e08ac25f7be` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:23.606365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=794ae92426054dee9c2a7e08ac25f7be)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:23.610367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:23.680544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.684833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.747824 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:23.760152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.760814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:23.771139 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3830/7628] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:20:23 2022] PATCH /identity/v3/domains/794ae92426054dee9c2a7e08ac25f7be => generated 277 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:20:23.772949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:23.796167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4f1b-4ff2-40e9-b06e-a603f8022fd6 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:23.916174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:23.917678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:23.918157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:23.918635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains/794ae92426054dee9c2a7e08ac25f7be` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:23.953907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=794ae92426054dee9c2a7e08ac25f7be)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:23.957776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:23.997808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.016870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.149252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be', 'request_id': 'req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.151304 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:24.177598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be', 'request_id': 'req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.228826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be', 'request_id': 'req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.247596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 794ae92426054dee9c2a7e08ac25f7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:24.248243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.249281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.268927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be', 'request_id': 'req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.277383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be', 'request_id': 'req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.279847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '794ae92426054dee9c2a7e08ac25f7be', 'request_id': 'req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:24.297621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3799/7629] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:23 2022] DELETE /identity/v3/domains/794ae92426054dee9c2a7e08ac25f7be => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:24.298916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:24.307747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:24.338577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e1bf-22d4-4663-99d2-3c56d42d9825 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:24.468635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:24.469506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:24.469867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:24.470223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:24.471391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:24.473270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:24.515192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:24.516967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:24.520552 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3831/7630] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:20:24 2022] POST /identity/v3/domains => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:24.535381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3015-8f65-429e-9d9d-49c3bbc1f865 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:24.632336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:24.633292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:24.635659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:24.636054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:24.637040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:24.641165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:24.727203 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3800/7631] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:24 2022] POST /identity/v3/projects => generated 410 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:24.730972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:24.744560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa2ff6-36a6-46c1-b390-ad46ddb427fd tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:24.877087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:24.879311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:24.879812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:24.880278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:24.881179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:24.884151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:24.962559 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3832/7632] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:24 2022] POST /identity/v3/projects => generated 404 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:24.965568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:24.998968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd17c7e-aa5f-43fc-8c74-37e4589db7c3 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:25.098797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:25.101035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:25.101501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:25.101970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/b90e2df2edfc4e959ac5b34699a14ae9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:25.109160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b90e2df2edfc4e959ac5b34699a14ae9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:25.124562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:25.230726 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:25.265969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90e2df2edfc4e959ac5b34699a14ae9', 'request_id': 'req-c876bf45-9aac-47be-8a95-34b08805bf55'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.273009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90e2df2edfc4e959ac5b34699a14ae9', 'request_id': 'req-c876bf45-9aac-47be-8a95-34b08805bf55'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.325301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90e2df2edfc4e959ac5b34699a14ae9', 'request_id': 'req-c876bf45-9aac-47be-8a95-34b08805bf55'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.389640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project b90e2df2edfc4e959ac5b34699a14ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:25.389909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.391063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.393642 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3801/7633] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:24 2022] DELETE /identity/v3/projects/b90e2df2edfc4e959ac5b34699a14ae9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:25.398270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:25.403278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:25.429411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaf7d0-9760-4984-855c-cb81f4c7c410 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:25.643631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:25.645775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:25.646706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:25.654472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/de7270ef4009429d8e00cf538454e8fd` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:25.656256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de7270ef4009429d8e00cf538454e8fd)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:25.658466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:25.711094 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:25.774876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7270ef4009429d8e00cf538454e8fd', 'request_id': 'req-68902acf-b113-4ede-b0dc-9a72430d8dc5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.795866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7270ef4009429d8e00cf538454e8fd', 'request_id': 'req-68902acf-b113-4ede-b0dc-9a72430d8dc5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.818441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7270ef4009429d8e00cf538454e8fd', 'request_id': 'req-68902acf-b113-4ede-b0dc-9a72430d8dc5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.879023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project de7270ef4009429d8e00cf538454e8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:25.879728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.882194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:25.886555 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3833/7634] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:25 2022] DELETE /identity/v3/projects/de7270ef4009429d8e00cf538454e8fd => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:25.891151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:25.909608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876bf45-9aac-47be-8a95-34b08805bf55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:26.032237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:26.036921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:26.037679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:26.039891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains/369526ccdcc44aa6856ba7570b225f3e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:26.086347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=369526ccdcc44aa6856ba7570b225f3e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:26.092873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:26.205239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.206473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.283558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.284571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.291775 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3802/7635] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:20:25 2022] PATCH /identity/v3/domains/369526ccdcc44aa6856ba7570b225f3e => generated 276 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:26.296394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:26.298129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:26.330950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902acf-b113-4ede-b0dc-9a72430d8dc5 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:26.471970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:26.477993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:26.478371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:26.478678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains/369526ccdcc44aa6856ba7570b225f3e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:26.505979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=369526ccdcc44aa6856ba7570b225f3e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:26.509188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:26.568866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.579345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.703190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e', 'request_id': 'req-65b3bd3a-59d9-4c4f-8969-28fffd77035f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.725137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e', 'request_id': 'req-65b3bd3a-59d9-4c4f-8969-28fffd77035f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.736407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e', 'request_id': 'req-65b3bd3a-59d9-4c4f-8969-28fffd77035f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.755435 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:26.764148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 369526ccdcc44aa6856ba7570b225f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:26.764860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.768196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.790357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e', 'request_id': 'req-65b3bd3a-59d9-4c4f-8969-28fffd77035f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.792745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e', 'request_id': 'req-65b3bd3a-59d9-4c4f-8969-28fffd77035f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.803000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '369526ccdcc44aa6856ba7570b225f3e', 'request_id': 'req-65b3bd3a-59d9-4c4f-8969-28fffd77035f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:26.813573 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3834/7636] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:26 2022] DELETE /identity/v3/domains/369526ccdcc44aa6856ba7570b225f3e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:26.827543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:26.832860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:26.871036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566b80-ed9a-486e-ba59-8375f4e8ba6c tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:27.014372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:27.015548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:27.016125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:27.016413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:27.017496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:27.026888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:27.082574 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3803/7637] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:26 2022] POST /identity/v3/projects => generated 376 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:27.088787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:27.090389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:27.112712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3bd3a-59d9-4c4f-8969-28fffd77035f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:27.265114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:27.265790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:27.266238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:27.266616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/344a2ba47c114f0abeffc2a979af3f12` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:27.268057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=344a2ba47c114f0abeffc2a979af3f12)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:27.270150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:27.272132 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3835/7638] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:27 2022] GET /identity/v3/projects/344a2ba47c114f0abeffc2a979af3f12 => generated 376 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:27.289588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:27.310861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb0d5a-333b-42f6-9cea-1576adeeb1b9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:27.317689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:27.318425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:27.319252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:27.319698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:27.320679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:27.323297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:27.335673 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:27.347304 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3804/7639] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:20:27 2022] GET /identity/v3/projects => generated 6930 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:27.351756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:27.364628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b61fe-27a6-45d0-b298-f08d5e4939c7 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:27.377565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:27.378467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:27.378785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:27.379071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/344a2ba47c114f0abeffc2a979af3f12` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:27.383477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=344a2ba47c114f0abeffc2a979af3f12)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:27.385623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:27.505032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344a2ba47c114f0abeffc2a979af3f12', 'request_id': 'req-dbef4a46-5eeb-410b-b627-cae612a898f8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:27.525094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344a2ba47c114f0abeffc2a979af3f12', 'request_id': 'req-dbef4a46-5eeb-410b-b627-cae612a898f8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:27.533263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344a2ba47c114f0abeffc2a979af3f12', 'request_id': 'req-dbef4a46-5eeb-410b-b627-cae612a898f8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:27.547359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 344a2ba47c114f0abeffc2a979af3f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:27.547727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:27.548551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:27.556581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3836/7640] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:27 2022] DELETE /identity/v3/projects/344a2ba47c114f0abeffc2a979af3f12 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:27.557855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:27.560324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:27.590339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a30609-3b4a-467a-a6f9-e2145b8cb71e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:27.783416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:27.784030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:27.784321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:27.785137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:27.785356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:27.787242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:27.908931 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3805/7641] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:20:27 2022] POST /identity/v3/projects => generated 347 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:27.910098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:27.925756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4a46-5eeb-410b-b627-cae612a898f8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:28.078603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:28.079620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:28.081329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:28.081329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/47882e3be6f24b709c92144c6c3d6656` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:28.083469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:update_project(project_id=47882e3be6f24b709c92144c6c3d6656)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:28.084134 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:20:28.084134 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:20:28.084134 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:20:28.085466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:28.107002 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:28.183584 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3837/7642] 10.222.0.77 () {60 vars in 1251 bytes} [Mon Jul 11 15:20:27 2022] PATCH /identity/v3/projects/47882e3be6f24b709c92144c6c3d6656 => generated 362 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:28.188157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:28.224665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572e1c4-1069-47b9-a1ec-c1f06920cd12 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:28.241348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:28.242703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:28.243233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:28.244475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/47882e3be6f24b709c92144c6c3d6656` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:28.289305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=47882e3be6f24b709c92144c6c3d6656)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:28.292505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:28.294631 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3806/7643] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:28 2022] GET /identity/v3/projects/47882e3be6f24b709c92144c6c3d6656 => generated 349 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:28.306204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:28.366238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93e8d9-7881-48d8-9664-4cb12c013052 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:28.375736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:28.376919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:28.378281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:28.378281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/47882e3be6f24b709c92144c6c3d6656` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:28.379399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47882e3be6f24b709c92144c6c3d6656)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:28.381378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:28.477756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47882e3be6f24b709c92144c6c3d6656', 'request_id': 'req-92bffa0a-079c-4521-b21b-61d66f1fbe5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:28.488611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47882e3be6f24b709c92144c6c3d6656', 'request_id': 'req-92bffa0a-079c-4521-b21b-61d66f1fbe5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:28.502959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47882e3be6f24b709c92144c6c3d6656', 'request_id': 'req-92bffa0a-079c-4521-b21b-61d66f1fbe5a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:28.522954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project 47882e3be6f24b709c92144c6c3d6656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:28.523959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:28.524594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:28.526465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3838/7644] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:28 2022] DELETE /identity/v3/projects/47882e3be6f24b709c92144c6c3d6656 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:28.533384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:28.537090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:28.559228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3f9be-d3bf-4229-937b-5fbfdab9fb31 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:28.853529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:28.854217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:28.854519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:28.854802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:28.859308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:28.865878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:28.995576 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3807/7645] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:28 2022] POST /identity/v3/projects => generated 360 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:29.007552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:29.039834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bffa0a-079c-4521-b21b-61d66f1fbe5a tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:29.232353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:29.233373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:29.233889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:29.234159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/edd7d9df5e364403ac07d26064a2bcd2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:29.235976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:update_project(project_id=edd7d9df5e364403ac07d26064a2bcd2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:29.238238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:29.367233 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3839/7646] 10.222.0.77 () {60 vars in 1251 bytes} [Mon Jul 11 15:20:29 2022] PATCH /identity/v3/projects/edd7d9df5e364403ac07d26064a2bcd2 => generated 372 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:29.368716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:29.389425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7aa5-52ee-4e79-95cd-2205f9751870 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:29.408530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:29.409608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:29.410002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:29.410722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/edd7d9df5e364403ac07d26064a2bcd2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:29.451749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=edd7d9df5e364403ac07d26064a2bcd2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:29.454398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:29.460721 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3808/7647] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:29 2022] GET /identity/v3/projects/edd7d9df5e364403ac07d26064a2bcd2 => generated 359 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:29.461960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:29.473237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f15a-826c-49b1-bed9-c62f80328c3e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:29.486423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:29.487585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:29.488498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:29.488498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/edd7d9df5e364403ac07d26064a2bcd2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:29.496412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=edd7d9df5e364403ac07d26064a2bcd2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:29.504111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:29.543602 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:UPDATE=2,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:29.589645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd7d9df5e364403ac07d26064a2bcd2', 'request_id': 'req-5e51b891-82e9-4966-98af-ea4851c67b55'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:29.610918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd7d9df5e364403ac07d26064a2bcd2', 'request_id': 'req-5e51b891-82e9-4966-98af-ea4851c67b55'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:29.630810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd7d9df5e364403ac07d26064a2bcd2', 'request_id': 'req-5e51b891-82e9-4966-98af-ea4851c67b55'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:29.650412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project edd7d9df5e364403ac07d26064a2bcd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:29.650855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:29.655156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:29.658995 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3840/7648] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:29 2022] DELETE /identity/v3/projects/edd7d9df5e364403ac07d26064a2bcd2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:29.672103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:29.675617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:29.704816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550fb3-75a3-485d-b665-68b16600aff1 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:29.759903 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:29.829922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:29.830774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:29.835059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:29.835846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:29.836553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:29.842910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:29.951380 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3809/7649] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:29 2022] POST /identity/v3/projects => generated 355 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:29.952389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:29.967973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51b891-82e9-4966-98af-ea4851c67b55 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:30.237347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:30.241414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:30.242079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:30.242079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/b1451bb417314140aa63af5b233cc512` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:30.254751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:update_project(project_id=b1451bb417314140aa63af5b233cc512)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:30.261772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:30.335887 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3841/7650] 10.222.0.77 () {60 vars in 1251 bytes} [Mon Jul 11 15:20:29 2022] PATCH /identity/v3/projects/b1451bb417314140aa63af5b233cc512 => generated 369 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:30.337369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:30.350388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a809be-1288-4227-bf31-f1c73a27d1eb tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:30.376476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:30.377531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:30.383431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:30.384675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/b1451bb417314140aa63af5b233cc512` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:30.432996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1451bb417314140aa63af5b233cc512)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:30.439306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:30.441661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3810/7651] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:30 2022] GET /identity/v3/projects/b1451bb417314140aa63af5b233cc512 => generated 356 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:30.457352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:30.473389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab5e43-54c4-42a0-9624-cb517067e39f tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:30.509418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:30.510331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:30.510637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:30.510918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/projects/b1451bb417314140aa63af5b233cc512` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:30.522450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1451bb417314140aa63af5b233cc512)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:30.524411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:30.649929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1451bb417314140aa63af5b233cc512', 'request_id': 'req-b2fa04da-30bb-4675-909a-3daeae71f3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:30.663111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1451bb417314140aa63af5b233cc512', 'request_id': 'req-b2fa04da-30bb-4675-909a-3daeae71f3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:30.684782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1451bb417314140aa63af5b233cc512', 'request_id': 'req-b2fa04da-30bb-4675-909a-3daeae71f3a8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:30.721701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] The token cache is being invalidate because project b1451bb417314140aa63af5b233cc512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:30.722097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:30.723676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:30.730646 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3842/7652] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:30 2022] DELETE /identity/v3/projects/b1451bb417314140aa63af5b233cc512 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:30.735030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:30.737095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:30.752614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529addf-a4e3-45e7-a412-dcc4b93ed649 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:30.893223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:30.894564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:30.897827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:30.898398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains/369526ccdcc44aa6856ba7570b225f3e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:30.915240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Could not find domain: 369526ccdcc44aa6856ba7570b225f3e.: keystone.exception.DomainNotFound: Could not find domain: 369526ccdcc44aa6856ba7570b225f3e. Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 369526ccdcc44aa6856ba7570b225f3e. Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:20:30.930899 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:20:30.932320 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 369526ccdcc44aa6856ba7570b225f3e. Jul 11 15:20:30.933477 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:30.942916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:30.950944 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3811/7653] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:20:30 2022] PATCH /identity/v3/domains/369526ccdcc44aa6856ba7570b225f3e => generated 112 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:20:30.965755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa04da-30bb-4675-909a-3daeae71f3a8 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:30.976223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d35b7-3d4f-4677-b83f-43729f09be1e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538e55b7401a4babaf73f407a1460617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:30.981842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d35b7-3d4f-4677-b83f-43729f09be1e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:30.982958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d35b7-3d4f-4677-b83f-43729f09be1e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:30.983495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d35b7-3d4f-4677-b83f-43729f09be1e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] PATH_INFO: `/v3/domains/794ae92426054dee9c2a7e08ac25f7be` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:31.000424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d35b7-3d4f-4677-b83f-43729f09be1e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-277d35b7-3d4f-4677-b83f-43729f09be1e tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Could not find domain: 794ae92426054dee9c2a7e08ac25f7be.: keystone.exception.DomainNotFound: Could not find domain: 794ae92426054dee9c2a7e08ac25f7be. Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 794ae92426054dee9c2a7e08ac25f7be. Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:20:31.024084 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:20:31.025396 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 794ae92426054dee9c2a7e08ac25f7be. Jul 11 15:20:31.026549 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:20:31.032178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3843/7654] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:20:30 2022] PATCH /identity/v3/domains/794ae92426054dee9c2a7e08ac25f7be => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:20:31.036336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:31.039563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:31.300115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7e4bf-660b-4a74-9084-770f6d38aad9 tempest-ProjectsTestJSON-989863196 tempest-ProjectsTestJSON-989863196-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:31.312427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:31.313623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:31.314105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:31.314622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] PATH_INFO: `/v3/users/0aefb2a9f2844c4c979d114eb2c38cf1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:31.318565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aefb2a9f2844c4c979d114eb2c38cf1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:31.326226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:31.553758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aefb2a9f2844c4c979d114eb2c38cf1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:31.566549 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:31.589328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aefb2a9f2844c4c979d114eb2c38cf1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:31.622460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aefb2a9f2844c4c979d114eb2c38cf1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:31.645312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aefb2a9f2844c4c979d114eb2c38cf1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:31.646325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aefb2a9f2844c4c979d114eb2c38cf1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:31.654607 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3812/7655] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:31 2022] DELETE /identity/v3/users/0aefb2a9f2844c4c979d114eb2c38cf1 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:31.659455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:31.659963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:31.660232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:31.669103 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:31.709287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:31.711383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:31.915896 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3844/7656] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:31.926602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:31.928612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:32.016663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4472-0c59-4641-b181-e5ef4c77072b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:32.025594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:32.026699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:32.027104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:32.029230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:32.096899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:32.098374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:32.144294 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3813/7657] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:32.965884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:32.968310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:32.998487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083061e-f5e7-4fbf-b9ce-c13e046adbe2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:33.014117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:33.017212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:33.017683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:33.020658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] PATH_INFO: `/v3/projects/aa6c955af653476bab7fe988e7412825` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:33.023596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6c955af653476bab7fe988e7412825)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:33.025526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:33.234065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6c955af653476bab7fe988e7412825', 'request_id': 'req-9b031627-e74e-4a77-8bc2-1d84e0c32bae'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.259610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6c955af653476bab7fe988e7412825', 'request_id': 'req-9b031627-e74e-4a77-8bc2-1d84e0c32bae'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.287943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6c955af653476bab7fe988e7412825', 'request_id': 'req-9b031627-e74e-4a77-8bc2-1d84e0c32bae'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.326995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] The token cache is being invalidate because project aa6c955af653476bab7fe988e7412825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:33.327293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.338154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.338154 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3845/7658] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:32 2022] DELETE /identity/v3/projects/aa6c955af653476bab7fe988e7412825 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:33.342846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:33.377705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872f10-b349-4885-9275-1018bffccf73 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:33.569524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:33.577006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:33.578861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:33.579267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] PATH_INFO: `/v3/users/538e55b7401a4babaf73f407a1460617` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:33.586852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538e55b7401a4babaf73f407a1460617)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:33.596743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:33.789305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538e55b7401a4babaf73f407a1460617'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.845169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538e55b7401a4babaf73f407a1460617'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.858002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538e55b7401a4babaf73f407a1460617'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.863921 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:33.873714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538e55b7401a4babaf73f407a1460617'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.886063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2a4cd57e-6a06-42c0-b57c-3a93e3231373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538e55b7401a4babaf73f407a1460617'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:33.925750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3814/7659] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:33 2022] DELETE /identity/v3/users/538e55b7401a4babaf73f407a1460617 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:34.569720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:34.571985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:34.618463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b031627-e74e-4a77-8bc2-1d84e0c32bae admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:34.811992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:34.813189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:34.813882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:34.814346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] PATH_INFO: `/v3/projects/f56ceccbc6904ab5b73fa2a3046a01f7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:34.815804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56ceccbc6904ab5b73fa2a3046a01f7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:34.818520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:34.869549 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:34.903996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'request_id': 'req-472f797e-9534-4698-8658-68084efc50c7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:34.915810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'request_id': 'req-472f797e-9534-4698-8658-68084efc50c7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:34.928427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56ceccbc6904ab5b73fa2a3046a01f7', 'request_id': 'req-472f797e-9534-4698-8658-68084efc50c7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:34.958346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] The token cache is being invalidate because project f56ceccbc6904ab5b73fa2a3046a01f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:34.958936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:34.960597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-472f797e-9534-4698-8658-68084efc50c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:34.963392 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3846/7660] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:34 2022] DELETE /identity/v3/projects/f56ceccbc6904ab5b73fa2a3046a01f7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:34.968365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:34.970275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:34.970786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:35.019522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:35.033973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:35.313794 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3815/7661] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:35.321987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:35.322546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:35.323137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:35.374230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:35.383913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:35.422686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3847/7662] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:35.422932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:35.438472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315641fa-a9fd-4517-b61e-0ba7d4463729 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:35.453760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:35.454460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:35.458226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:35.458736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:35.463832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:35.464159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:35.465858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:35.526407 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3816/7663] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:35.528175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:35.546795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34a935-9b51-4c01-b00c-99bf4e38a2ce None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:35.562545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:35.563414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:35.563936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:35.568123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:35.569384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:35.582649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:35.628204 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3848/7664] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:35 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:35.636215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:35.658400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40d7df-f130-4ddd-861b-1e5097b02d7d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:35.810009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:35.810847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:35.811237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:35.812139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:35.813724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:35.818132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:35.875667 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3817/7665] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:35 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:35.877770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:35.899828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77714c-ae04-4bf9-9d5c-f5e94aac027b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:35.921934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:35.922678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:35.922976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:35.927213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:35.931507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:35.939184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:35.963405 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3849/7666] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:35.967751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:35.989111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263fdb5-04b4-4e12-a94e-26c938bd71ee admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:36.000812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f3fc9-9275-48a8-9bd3-5ca19595a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:36.001649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3fc9-9275-48a8-9bd3-5ca19595a837 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:36.002072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3fc9-9275-48a8-9bd3-5ca19595a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:36.002205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3fc9-9275-48a8-9bd3-5ca19595a837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:36.003240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f3fc9-9275-48a8-9bd3-5ca19595a837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:36.005611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f3fc9-9275-48a8-9bd3-5ca19595a837 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:36.030122 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3818/7667] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:36.031548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:36.043466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171447a-888e-4316-ade5-f40e766eda89 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:36.057806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:36.058760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:36.059049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:36.059335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] PATH_INFO: `/v3/projects/c13d5dff48b4428298b7367a68a91d53/users/11785e9a5ff24ff6b3da58e6d615887b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:36.084073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13d5dff48b4428298b7367a68a91d53, user_id=11785e9a5ff24ff6b3da58e6d615887b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:36.088345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:36.140344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3850/7668] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:36 2022] PUT /identity/v3/projects/c13d5dff48b4428298b7367a68a91d53/users/11785e9a5ff24ff6b3da58e6d615887b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:36.150910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:36.152194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:36.152686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:36.268507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] MFA Rules not processed for user `11785e9a5ff24ff6b3da58e6d615887b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:36.274292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:36.432635 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:36.505917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:36.507363 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3819/7669] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:36.629274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400468c-a807-4767-bb8e-b4b3dd980cd0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:36.669518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:36.672854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:36.673391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:36.674460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:36.676831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:36.680700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:36.766373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:36.775653 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3851/7670] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:36 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:20:36.779361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e775e-2e32-4584-b393-6b74e808f04e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:36.899666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:36.900476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:36.900832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:36.901345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:36.903357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:36.905414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:36.948743 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3820/7671] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:36 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:36.953542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:36.969243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e9aa-58c8-4f07-ae6a-b33ae6965c56 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:36.982399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:36.983368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:36.983722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:36.984074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:36.984907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:36.990373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:37.017190 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3852/7672] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:20:37.022424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:37.035249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad0832-306a-41a8-b0c0-ebf42ee2cf66 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:37.056498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:37.057724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.058183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.058659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] PATH_INFO: `/v3/projects/f0143f179aa346df806068669e79f133/users/a72b3c20ba1f4c368d10b7d6af56d7c1/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:37.107355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0143f179aa346df806068669e79f133, user_id=a72b3c20ba1f4c368d10b7d6af56d7c1, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:37.110539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:37.143225 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3821/7673] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:37 2022] PUT /identity/v3/projects/f0143f179aa346df806068669e79f133/users/a72b3c20ba1f4c368d10b7d6af56d7c1/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:37.147505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:37.173929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49811-f192-47ac-96e1-4f4753220918 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:37.235554 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:37.317580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8094f-20f8-483a-90ce-bd4ffd2a6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:37.318274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8094f-20f8-483a-90ce-bd4ffd2a6d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.319152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8094f-20f8-483a-90ce-bd4ffd2a6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.319434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8094f-20f8-483a-90ce-bd4ffd2a6d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:37.320176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8094f-20f8-483a-90ce-bd4ffd2a6d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:37.328187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8094f-20f8-483a-90ce-bd4ffd2a6d8f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:37.353535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:37.367196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8e7b-3b95-4479-8fca-62a11fea19b1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:37.369193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3853/7674] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:37.377606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:37.378553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.378848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.379132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] PATH_INFO: `/v3/projects/f0143f179aa346df806068669e79f133/users/a72b3c20ba1f4c368d10b7d6af56d7c1/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:37.381750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0143f179aa346df806068669e79f133, user_id=a72b3c20ba1f4c368d10b7d6af56d7c1, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:37.384607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:37.415587 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3822/7675] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:37 2022] PUT /identity/v3/projects/f0143f179aa346df806068669e79f133/users/a72b3c20ba1f4c368d10b7d6af56d7c1/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:37.419690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.419985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.420272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:37.515861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] MFA Rules not processed for user `a72b3c20ba1f4c368d10b7d6af56d7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:37.521735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:37.723377 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3854/7676] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:37.724189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:37.743072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2e677-7947-40c5-a41e-a28c6806beee admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:37.755206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:37.756319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.756319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.756559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:37.757246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:37.758908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:37.815171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:37.823512 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3823/7677] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:20:37 2022] POST /identity/v3/services => generated 239 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:37.828170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27c683-fe49-4c12-80ba-1dcee414ba68 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:37.851557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:37.858860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.860938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.862950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/850c6123321b4b59ba48ba0981708a16` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:37.864260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:delete_service(service_id=850c6123321b4b59ba48ba0981708a16)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:37.868351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:37.934359 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3855/7678] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:37 2022] DELETE /identity/v3/services/850c6123321b4b59ba48ba0981708a16 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:20:37.941747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:37.963762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce164a8-a79c-4a07-affb-609fd1cd305a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:37.996974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:37.997803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:37.998223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:37.999534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.002072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.007015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.041942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.042422 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3824/7679] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:37 2022] POST /identity/v3/services => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:38.058597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a871e4-b70f-4edd-b216-a804cd66da09 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.105526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.107281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.108362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.109481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/3f4e459b568042318bf7547a6b2c7aad` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.110464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:update_service(service_id=3f4e459b568042318bf7547a6b2c7aad)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.113830 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:20:38.113830 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:20:38.113830 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:20:38.117476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.157121 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3856/7680] 10.222.0.77 () {60 vars in 1251 bytes} [Mon Jul 11 15:20:38 2022] PATCH /identity/v3/services/3f4e459b568042318bf7547a6b2c7aad => generated 281 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:38.162784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.175843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440854c-ae50-43a5-a153-eba531639910 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.207765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.209927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.210225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.212298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/3f4e459b568042318bf7547a6b2c7aad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.213305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:get_service(service_id=3f4e459b568042318bf7547a6b2c7aad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.216302 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:20:38.216302 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:20:38.216302 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:20:38.217275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.237606 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3825/7681] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:38 2022] GET /identity/v3/services/3f4e459b568042318bf7547a6b2c7aad => generated 281 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:38.239113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.257248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0d072-3a31-4a3e-89e7-3f7e86b273b0 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.273483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.275210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.277152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.278011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/3f4e459b568042318bf7547a6b2c7aad` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.279365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3f4e459b568042318bf7547a6b2c7aad)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.282045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.341317 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3857/7682] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:38 2022] DELETE /identity/v3/services/3f4e459b568042318bf7547a6b2c7aad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:38.345669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.393366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354f59a-e841-444b-8e24-a596c2584f6f tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.443164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.449926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.450351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.450704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/3f4e459b568042318bf7547a6b2c7aad` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.451393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:get_service(service_id=3f4e459b568042318bf7547a6b2c7aad)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.453441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Could not find service: 3f4e459b568042318bf7547a6b2c7aad.: keystone.exception.ServiceNotFound: Could not find service: 3f4e459b568042318bf7547a6b2c7aad. Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 3f4e459b568042318bf7547a6b2c7aad. Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:20:38.484919 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:20:38.490469 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 3f4e459b568042318bf7547a6b2c7aad. Jul 11 15:20:38.491778 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:38.493300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3826/7683] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:20:38 2022] GET /identity/v3/services/3f4e459b568042318bf7547a6b2c7aad => generated 113 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:20:38.495169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.526286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c5a41-7238-4d1b-9602-41689a0cbc3c tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.576890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.577586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.578099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.578402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.579167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.583836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.619880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3858/7684] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:38 2022] POST /identity/v3/services => generated 274 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:38.621188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.636353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c72d7-5f93-4ab0-837f-ae67f5348eff tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.677512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.679524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.679904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.680142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.683885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.687272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.723326 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3827/7685] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:38 2022] POST /identity/v3/services => generated 273 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:20:38.724570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.746511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c5903-64e8-4847-9e52-7e8e5d0d47fe tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.776661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.777134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.777423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.777703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.778423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.780361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.784950 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:38.826264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3859/7686] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:38 2022] POST /identity/v3/services => generated 274 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:38.832875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.853927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effbefe-e5db-4c82-bc52-a29d13a8b23a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.891607 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:38.901573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.902547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.902909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.903177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.904071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.905625 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:20:38.905625 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:20:38.905625 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:20:38.906540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.917091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3828/7687] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:20:38 2022] GET /identity/v3/services => generated 2976 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:38.920752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.938117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac24a8-71bd-43a2-bb6e-e45b0e0b26c8 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.952171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:38.954297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:38.954964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:38.955565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:38.958405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1581534637) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:38.959035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:38.960453 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:20:38.960453 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:20:38.960453 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:20:38.963613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:38.972248 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3860/7688] 10.222.0.77 () {58 vars in 1221 bytes} [Mon Jul 11 15:20:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1581534637 => generated 417 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:38.976154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:38.992146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de82ba-0976-49fc-aa2e-773cc06ae2bd tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:38.999629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:39.000391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.000744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.001089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.001872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-337946290) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:39.002262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:39.004690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:39.016274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3829/7689] 10.222.0.77 () {58 vars in 1219 bytes} [Mon Jul 11 15:20:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-337946290 => generated 415 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:39.017905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:39.033439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff81037-17fb-407e-8ca2-9fb3bc2f9bd1 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:39.057700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:39.062797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.063308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.069347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.070751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-262246306) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:39.071255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:39.073554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:39.090709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:39.092235 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3861/7690] 10.222.0.77 () {58 vars in 1219 bytes} [Mon Jul 11 15:20:39 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-262246306 => generated 416 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:39.102163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df079f-665c-4e24-8e1f-066e7fa400cb tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:39.124733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:39.125757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.126140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.126531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/ce444f5b2d2e457cb27c3b1b43211e42` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.127310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ce444f5b2d2e457cb27c3b1b43211e42)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:39.129059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:39.177368 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3830/7691] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:39 2022] DELETE /identity/v3/services/ce444f5b2d2e457cb27c3b1b43211e42 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:20:39.179931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:39.198130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b88a7-259f-443c-a3f5-8d6171e243d5 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:39.255639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:39.256492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.256784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.257066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/c53c2ce741f645f4b22b2c632062faa5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.257742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c53c2ce741f645f4b22b2c632062faa5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:39.259380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:39.297307 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3862/7692] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:39 2022] DELETE /identity/v3/services/c53c2ce741f645f4b22b2c632062faa5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:39.304034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:39.319302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bffb8-2ceb-4ff4-aba8-47b7369b9f4a tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:39.355853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0574d8c-b6cb-4bae-9ac0-6342e3fad8a4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a72b3c20ba1f4c368d10b7d6af56d7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0143f179aa346df806068669e79f133', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:39.357231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0574d8c-b6cb-4bae-9ac0-6342e3fad8a4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.358197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0574d8c-b6cb-4bae-9ac0-6342e3fad8a4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.358197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0574d8c-b6cb-4bae-9ac0-6342e3fad8a4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] PATH_INFO: `/v3/services/25447490262a48469bb628896359a59e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.359149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0574d8c-b6cb-4bae-9ac0-6342e3fad8a4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorizing `identity:delete_service(service_id=25447490262a48469bb628896359a59e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:39.360954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0574d8c-b6cb-4bae-9ac0-6342e3fad8a4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:39.405389 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3831/7693] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:39 2022] DELETE /identity/v3/services/25447490262a48469bb628896359a59e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:39.410113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:39.610354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e308-8101-418f-a90b-f2d2777469d4 tempest-ServicesTestJSON-282972208 tempest-ServicesTestJSON-282972208-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:39.648906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:39.649914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.650246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.650609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] PATH_INFO: `/v3/users/11785e9a5ff24ff6b3da58e6d615887b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.656082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11785e9a5ff24ff6b3da58e6d615887b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:39.658429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:39.752337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11785e9a5ff24ff6b3da58e6d615887b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:39.753133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11785e9a5ff24ff6b3da58e6d615887b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:39.768247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11785e9a5ff24ff6b3da58e6d615887b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:39.769139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11785e9a5ff24ff6b3da58e6d615887b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:39.803604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11785e9a5ff24ff6b3da58e6d615887b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:39.847493 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3863/7694] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:39 2022] DELETE /identity/v3/users/11785e9a5ff24ff6b3da58e6d615887b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:39.849295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:39.849731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:39.850099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:39.903114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:39.904849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:40.070893 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3832/7695] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:40.080394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:40.082154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:40.091209 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=2,keystone:SELECT=86,keystone:DELETE=12 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:40.339561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a921c-0313-47a9-9f4a-76f02bb211d9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:40.353843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:40.355037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:40.357694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:40.358269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:40.434281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:40.445154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:40.524194 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3864/7696] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:41.280846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:41.283108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:41.314705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b9fc3-f3c1-428b-8131-ba04e287f013 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:41.345262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:41.346764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:41.347310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:41.347839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] PATH_INFO: `/v3/projects/c13d5dff48b4428298b7367a68a91d53` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:41.351055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13d5dff48b4428298b7367a68a91d53)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:41.354137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:41.451811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13d5dff48b4428298b7367a68a91d53', 'request_id': 'req-315606a4-1873-44ca-9112-2e039e5fc1c9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.460095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13d5dff48b4428298b7367a68a91d53', 'request_id': 'req-315606a4-1873-44ca-9112-2e039e5fc1c9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.477215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13d5dff48b4428298b7367a68a91d53', 'request_id': 'req-315606a4-1873-44ca-9112-2e039e5fc1c9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.494347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] The token cache is being invalidate because project c13d5dff48b4428298b7367a68a91d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:41.495126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.496814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.501393 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3833/7697] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:41 2022] DELETE /identity/v3/projects/c13d5dff48b4428298b7367a68a91d53 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:41.505196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:41.526541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b396-89c2-42c1-b8ac-c12a501978f9 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:41.695672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:41.696560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:41.696845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:41.697125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] PATH_INFO: `/v3/users/a72b3c20ba1f4c368d10b7d6af56d7c1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:41.699517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72b3c20ba1f4c368d10b7d6af56d7c1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:41.701544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:41.797715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72b3c20ba1f4c368d10b7d6af56d7c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.798394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72b3c20ba1f4c368d10b7d6af56d7c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.819538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72b3c20ba1f4c368d10b7d6af56d7c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.820290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72b3c20ba1f4c368d10b7d6af56d7c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.829203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d9ed2a4d-a4ae-4207-a6f6-7f56b4e8c5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72b3c20ba1f4c368d10b7d6af56d7c1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:41.860594 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3865/7698] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:41 2022] DELETE /identity/v3/users/a72b3c20ba1f4c368d10b7d6af56d7c1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:42.923465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:42.925291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:42.958594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315606a4-1873-44ca-9112-2e039e5fc1c9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:42.971544 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:43.050886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:43.052085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:43.053406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:43.054784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] PATH_INFO: `/v3/projects/f0143f179aa346df806068669e79f133` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:43.056570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0143f179aa346df806068669e79f133)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:43.059822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:43.143992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0143f179aa346df806068669e79f133', 'request_id': 'req-dc538366-e340-498d-b93f-1bb7691b25d1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:43.157225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0143f179aa346df806068669e79f133', 'request_id': 'req-dc538366-e340-498d-b93f-1bb7691b25d1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:43.179738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0143f179aa346df806068669e79f133', 'request_id': 'req-dc538366-e340-498d-b93f-1bb7691b25d1'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:43.200211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] The token cache is being invalidate because project f0143f179aa346df806068669e79f133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:43.201057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:43.201888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dc538366-e340-498d-b93f-1bb7691b25d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:43.204397 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3834/7699] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:42 2022] DELETE /identity/v3/projects/f0143f179aa346df806068669e79f133 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:43.213900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:43.216094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:43.216484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:43.278076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:43.282209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:43.319645 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:43.450474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3866/7700] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:43.452267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:43.452560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:43.452839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:43.508383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:43.509650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:43.577538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3835/7701] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:43.578714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:43.587277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546e9f2-f784-4338-b6e3-fe1c002a2b91 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:43.605194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:43.605879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:43.606164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:43.606445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:43.607205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:43.607515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:43.609371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:43.646186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:43.650647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3867/7702] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:43.661630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f79d-414c-47d0-a7e1-cbd43aaf3637 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:43.679252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:43.679931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:43.680217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:43.680499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:43.681188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:43.683116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:43.745311 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3836/7703] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:43 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:43.749521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:43.765719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ceb0-511e-41e5-b986-73626d86a3a3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:43.921645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:43.922363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:43.922684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:43.922966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:43.924022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:43.925614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:43.978649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3868/7704] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:43 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:43.982755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:43.996790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944dac5-3444-40f3-8fe4-0b4d6685addd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:44.016197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:44.016885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:44.017176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:44.017456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:44.018197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:44.019857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:44.080573 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3837/7705] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:44.084762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:44.103020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ca612-c4ca-4eff-a32c-c503805998bc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:44.120467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8d4cc-f221-4b6d-a3d6-197aaf640055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:44.121396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d4cc-f221-4b6d-a3d6-197aaf640055 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:44.121806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d4cc-f221-4b6d-a3d6-197aaf640055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:44.122204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d4cc-f221-4b6d-a3d6-197aaf640055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:44.123096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d4cc-f221-4b6d-a3d6-197aaf640055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:44.125135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d4cc-f221-4b6d-a3d6-197aaf640055 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:44.142681 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3869/7706] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:44.147509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:44.168007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f3c76-16f4-4054-a405-d858e5e8d632 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:44.177719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:44.178719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:44.178987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:44.179266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] PATH_INFO: `/v3/projects/e5bb5b7c367d407a9e9e0ef508f579da/users/f1552c4418ce43c7ba1270a31ce97ad8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:44.213254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bb5b7c367d407a9e9e0ef508f579da, user_id=f1552c4418ce43c7ba1270a31ce97ad8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:44.215977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:44.249192 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3838/7707] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:44 2022] PUT /identity/v3/projects/e5bb5b7c367d407a9e9e0ef508f579da/users/f1552c4418ce43c7ba1270a31ce97ad8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:44.261597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:44.262061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:44.262237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:44.328319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] MFA Rules not processed for user `f1552c4418ce43c7ba1270a31ce97ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:44.329533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:44.492260 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3870/7708] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:44.493935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:44.513959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b18ce-b2ce-4028-bb5e-0e9a9805357e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:44.535306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14df5-b608-4642-a240-abb27b181746 tempest-IdentityCatalogTest-1096712516 tempest-IdentityCatalogTest-1096712516-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1552c4418ce43c7ba1270a31ce97ad8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bb5b7c367d407a9e9e0ef508f579da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:44.536200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14df5-b608-4642-a240-abb27b181746 tempest-IdentityCatalogTest-1096712516 tempest-IdentityCatalogTest-1096712516-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:44.536605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14df5-b608-4642-a240-abb27b181746 tempest-IdentityCatalogTest-1096712516 tempest-IdentityCatalogTest-1096712516-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:44.537024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14df5-b608-4642-a240-abb27b181746 tempest-IdentityCatalogTest-1096712516 tempest-IdentityCatalogTest-1096712516-project] PATH_INFO: `/v3/auth/catalog` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:44.537820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b14df5-b608-4642-a240-abb27b181746 tempest-IdentityCatalogTest-1096712516 tempest-IdentityCatalogTest-1096712516-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:44.540315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b14df5-b608-4642-a240-abb27b181746 tempest-IdentityCatalogTest-1096712516 tempest-IdentityCatalogTest-1096712516-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:44.549937 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3839/7709] 10.222.0.77 () {58 vars in 1142 bytes} [Mon Jul 11 15:20:44 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:44.552098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:44.582255 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:44.703932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0939cd-8941-4423-8aab-e625b36cc324 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:44.716202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:44.717113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:44.717400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:44.717676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] PATH_INFO: `/v3/users/f1552c4418ce43c7ba1270a31ce97ad8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:44.719829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1552c4418ce43c7ba1270a31ce97ad8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:44.741609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:44.931755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1552c4418ce43c7ba1270a31ce97ad8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:44.932837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1552c4418ce43c7ba1270a31ce97ad8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:44.963798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1552c4418ce43c7ba1270a31ce97ad8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:44.964791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1552c4418ce43c7ba1270a31ce97ad8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:44.976444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1552c4418ce43c7ba1270a31ce97ad8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:45.006710 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3871/7710] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:44 2022] DELETE /identity/v3/users/f1552c4418ce43c7ba1270a31ce97ad8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:45.007435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:45.007906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:45.008005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:45.044420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:45.046551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:45.104700 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:45.184043 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3840/7711] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:45.195693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:45.197198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:45.299410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aeb8e-a468-4805-bcfd-c31508868eb2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:45.305292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcdfd3-e1c5-4fb4-9bac-2151902c2a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:45.306202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcdfd3-e1c5-4fb4-9bac-2151902c2a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:45.306546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcdfd3-e1c5-4fb4-9bac-2151902c2a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:45.306858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcdfd3-e1c5-4fb4-9bac-2151902c2a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:45.323727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcdfd3-e1c5-4fb4-9bac-2151902c2a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:45.325303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcdfd3-e1c5-4fb4-9bac-2151902c2a22 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:45.340521 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3872/7712] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:45.901529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:45.903901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:45.988276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3de71-168c-47ba-98af-50e5d11cd0f3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.006704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.007936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.008491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.008491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] PATH_INFO: `/v3/projects/e5bb5b7c367d407a9e9e0ef508f579da` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.012598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bb5b7c367d407a9e9e0ef508f579da)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.015766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.146807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bb5b7c367d407a9e9e0ef508f579da', 'request_id': 'req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:46.164619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bb5b7c367d407a9e9e0ef508f579da', 'request_id': 'req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:46.184649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bb5b7c367d407a9e9e0ef508f579da', 'request_id': 'req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:46.203947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] The token cache is being invalidate because project e5bb5b7c367d407a9e9e0ef508f579da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:46.204678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:46.205769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cc44dbbd-6b9e-4b06-ad95-4a7cbaa614bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:46.207662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3841/7713] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:45 2022] DELETE /identity/v3/projects/e5bb5b7c367d407a9e9e0ef508f579da => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:46.213529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.213855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.214122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.234932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:46.236514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:46.292436 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:46.350684 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3873/7714] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:46.357715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32017995-879f-4fb0-b592-b366392067d1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.358529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32017995-879f-4fb0-b592-b366392067d1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.358529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32017995-879f-4fb0-b592-b366392067d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.391877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-32017995-879f-4fb0-b592-b366392067d1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:46.393242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-32017995-879f-4fb0-b592-b366392067d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:46.410233 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3842/7715] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:46.414725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:46.432774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6f952-334a-49dd-be53-ed6874d87377 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.441813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.444036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.444330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.444667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.445435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:46.447466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.455841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.470950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3874/7716] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:46.475556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32017995-879f-4fb0-b592-b366392067d1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:46.499204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32017995-879f-4fb0-b592-b366392067d1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.506827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.507334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.507623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.507906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.508687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.511023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.579355 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3843/7717] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:46 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:46.580044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:46.595219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280dbef-2753-4038-b672-1dea3ecad8aa admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.683013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.683878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.684272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.684667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.685381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.687890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.723070 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3875/7718] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:46 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:20:46.724401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:46.739857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0f523-249f-4bf5-9064-fcf5dc22bb0d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.745743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.746673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.747150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.747591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.748489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.750638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.769729 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3844/7719] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:46.774040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:46.790600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2386b2-dd3a-4b45-88ad-61b6d6814cdc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.796989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf9488-26f8-4b75-8bfe-ab72911371a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.798296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9488-26f8-4b75-8bfe-ab72911371a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.798757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9488-26f8-4b75-8bfe-ab72911371a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.799200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9488-26f8-4b75-8bfe-ab72911371a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.800307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9488-26f8-4b75-8bfe-ab72911371a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.802296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9488-26f8-4b75-8bfe-ab72911371a3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.844176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3876/7720] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:46.849801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:46.866770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59285f-12ee-43d2-ae40-c8a3592641a6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:46.875589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:46.876991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.877284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.877567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] PATH_INFO: `/v3/projects/f91b5a1b2c86475ca2d4f42aaa88fdc0/users/290a67bbcdaa479caa3d813acb178669/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:46.895493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91b5a1b2c86475ca2d4f42aaa88fdc0, user_id=290a67bbcdaa479caa3d813acb178669, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:46.899203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:46.938567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3845/7721] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:46 2022] PUT /identity/v3/projects/f91b5a1b2c86475ca2d4f42aaa88fdc0/users/290a67bbcdaa479caa3d813acb178669/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:46.950660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:46.950962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:46.951684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.018900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] MFA Rules not processed for user `290a67bbcdaa479caa3d813acb178669`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:47.022124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:47.198582 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3877/7722] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:47.203595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.218988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f10f4-3ce6-4fec-a624-f0753ca0673c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.227557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.233177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.235629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.236162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.239568 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.243336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.294369 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3846/7723] 10.222.0.77 () {60 vars in 1298 bytes} [Mon Jul 11 15:20:47 2022] POST /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2 => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:47.298870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.316190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ca23-229a-423f-8541-18d780bad1c0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.324582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.325286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.326123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.326123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/dd6fa816f61d43de952d04abeecc98bc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.328682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=290a67bbcdaa479caa3d813acb178669, credential_id=dd6fa816f61d43de952d04abeecc98bc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.330917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.377238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3878/7724] 10.222.0.77 () {58 vars in 1379 bytes} [Mon Jul 11 15:20:47 2022] DELETE /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/dd6fa816f61d43de952d04abeecc98bc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:20:47.382714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.399435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26378b36-7d73-4c11-9538-0951e951f7ad tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.413628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.414718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.415431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.415776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.417023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.418976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.440201 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3847/7725] 10.222.0.77 () {60 vars in 1298 bytes} [Mon Jul 11 15:20:47 2022] POST /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2 => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:47.444959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.461235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeadffd-c144-4427-bdee-fead9e2bf59e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.472367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.473453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.474934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.475355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/73218af8653b48aba2af05706ef6eea9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.478368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=290a67bbcdaa479caa3d813acb178669, credential_id=73218af8653b48aba2af05706ef6eea9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.480065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.502760 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:47.540332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.540902 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3879/7726] 10.222.0.77 () {58 vars in 1379 bytes} [Mon Jul 11 15:20:47 2022] DELETE /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/73218af8653b48aba2af05706ef6eea9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:47.551257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d77d-c9bb-4da5-9ed7-ca6449f4108e tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.584222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.585135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.585422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.585707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/73218af8653b48aba2af05706ef6eea9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Could not find credential: 3eae72d5d14e2d7d1afeaae67cc7a250194698a3cc519fd9c269c43b70bbd255.: keystone.exception.CredentialNotFound: Could not find credential: 3eae72d5d14e2d7d1afeaae67cc7a250194698a3cc519fd9c269c43b70bbd255. Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 11 15:20:47.646941 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:20:47.648001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 3eae72d5d14e2d7d1afeaae67cc7a250194698a3cc519fd9c269c43b70bbd255. Jul 11 15:20:47.649068 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:20:47.655733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3848/7727] 10.222.0.77 () {58 vars in 1376 bytes} [Mon Jul 11 15:20:47 2022] GET /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/73218af8653b48aba2af05706ef6eea9 => generated 148 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:20:47.658795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.683321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e0d2a-726a-458b-a6f1-31ad2994e3ff tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.699533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.701285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.710107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.710929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.711975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.713658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.771642 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3880/7728] 10.222.0.77 () {60 vars in 1298 bytes} [Mon Jul 11 15:20:47 2022] POST /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2 => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:47.778628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.789310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252b3c-d626-4771-8257-23902ef139de tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.798907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.799892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.800329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.800712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.801506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.803963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.840038 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3849/7729] 10.222.0.77 () {60 vars in 1298 bytes} [Mon Jul 11 15:20:47 2022] POST /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2 => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:47.840921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.860522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77178-369c-4b0d-a6d5-ae31ff98bf02 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.872768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.872768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.872768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.873094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.873345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.875070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.911375 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3881/7730] 10.222.0.77 () {58 vars in 1277 bytes} [Mon Jul 11 15:20:47 2022] GET /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2 => generated 865 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:47.914777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:47.922185 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:47.933673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8d04-15aa-4251-8beb-979be12a5514 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:47.947656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:47.949469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:47.950069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:47.950386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/0d3f296789474771aeff2707f1c35d06` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:47.954638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=290a67bbcdaa479caa3d813acb178669, credential_id=0d3f296789474771aeff2707f1c35d06)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:47.960834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:47.998162 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3850/7731] 10.222.0.77 () {58 vars in 1379 bytes} [Mon Jul 11 15:20:47 2022] DELETE /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/0d3f296789474771aeff2707f1c35d06 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:47.999278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.012542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0ab8-54ae-47f0-83a7-db683d6444ec tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:48.027322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:48.028224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.028511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.028790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/5ef9bc76ac0642aa8169feb34cc80960` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.031059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=290a67bbcdaa479caa3d813acb178669, credential_id=5ef9bc76ac0642aa8169feb34cc80960)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:48.032479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:48.069457 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3882/7732] 10.222.0.77 () {58 vars in 1379 bytes} [Mon Jul 11 15:20:47 2022] DELETE /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/5ef9bc76ac0642aa8169feb34cc80960 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:48.074168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.090251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d979c7-c77c-4b31-9812-7bf18ebc09d9 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:48.104503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:48.105457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.105811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.106161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.106956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:48.108557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:48.175086 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3851/7733] 10.222.0.77 () {60 vars in 1298 bytes} [Mon Jul 11 15:20:48 2022] POST /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2 => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:48.178551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.193997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ff29-be96-4471-bce6-82ae5639aeed tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:48.203900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:48.205123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.205723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.206288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/085b8b54639d4d3a8bcd4306abe365b0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.209926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=290a67bbcdaa479caa3d813acb178669, credential_id=085b8b54639d4d3a8bcd4306abe365b0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:48.214152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:48.223634 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3883/7734] 10.222.0.77 () {58 vars in 1376 bytes} [Mon Jul 11 15:20:48 2022] GET /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/085b8b54639d4d3a8bcd4306abe365b0 => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:48.228133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.244800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87cb52-1912-4ae8-a75b-9882cbc597ef tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:48.278672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '290a67bbcdaa479caa3d813acb178669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:48.280911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.281205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.281490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/085b8b54639d4d3a8bcd4306abe365b0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.285660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=290a67bbcdaa479caa3d813acb178669, credential_id=085b8b54639d4d3a8bcd4306abe365b0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:48.289077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:48.334635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.346026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:48.385615 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3852/7735] 10.222.0.77 () {58 vars in 1379 bytes} [Mon Jul 11 15:20:48 2022] DELETE /identity/v3/users/290a67bbcdaa479caa3d813acb178669/credentials/OS-EC2/085b8b54639d4d3a8bcd4306abe365b0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:48.391956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.514282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7335d-6773-4b7f-bbd3-5e354d677b6c tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:48.518142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1330-a925-4bfd-a66c-95a795d84916 tempest-EC2CredentialsTest-1148440457 tempest-EC2CredentialsTest-1148440457-project] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:48.522333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:48.523779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.524078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.524520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] PATH_INFO: `/v3/users/290a67bbcdaa479caa3d813acb178669` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.527476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290a67bbcdaa479caa3d813acb178669)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:48.530334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:48.539260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:48.540421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.540850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.541262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] PATH_INFO: `/v3/users/6c6631935fb748e38a1e61a0a33fdef7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.543215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6631935fb748e38a1e61a0a33fdef7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:48.545310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:48.642521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290a67bbcdaa479caa3d813acb178669'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.662325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6631935fb748e38a1e61a0a33fdef7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.663364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6631935fb748e38a1e61a0a33fdef7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.668171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290a67bbcdaa479caa3d813acb178669'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.680448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290a67bbcdaa479caa3d813acb178669'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.694001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6631935fb748e38a1e61a0a33fdef7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.697835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6631935fb748e38a1e61a0a33fdef7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.710883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290a67bbcdaa479caa3d813acb178669'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.711610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-63088284-abe4-4d44-821d-5de57228e796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290a67bbcdaa479caa3d813acb178669'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.723692 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3853/7736] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:48 2022] DELETE /identity/v3/users/290a67bbcdaa479caa3d813acb178669 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:48.724939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f1befa24-0f85-4b12-b747-9b1e0c3f807b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6631935fb748e38a1e61a0a33fdef7'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:48.728380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.728587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.729002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.757465 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3884/7737] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:48 2022] DELETE /identity/v3/users/6c6631935fb748e38a1e61a0a33fdef7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:48.761609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:48.762980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:48.763694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:48.764941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:48.767977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:48.829549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:48.830925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:48.845609 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:48.911182 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3854/7738] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:48.915764 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:48.922159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:48.923714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:49.005837 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3885/7739] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:49.018863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:49.020425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:49.133748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3020-6f2a-4be6-bce0-78ada3c2b044 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:49.151797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:49.156679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:49.157346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:49.161559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:49.188989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dab7c4-b26b-40cf-9fa1-dbca8674b993 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:49.197547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:49.199109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:49.199451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccd088-561e-4b79-a519-94023508dbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:49.201038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd088-561e-4b79-a519-94023508dbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:49.201334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd088-561e-4b79-a519-94023508dbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:49.202118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd088-561e-4b79-a519-94023508dbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:49.217303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccd088-561e-4b79-a519-94023508dbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:49.219397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccd088-561e-4b79-a519-94023508dbc1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:49.231617 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3855/7740] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:20:49.235804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3886/7741] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:49.832479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:49.834661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:49.860006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e439f-2709-4086-8e00-3f9957451169 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:49.865839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:49.867160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:49.868272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:49.868852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] PATH_INFO: `/v3/projects/f91b5a1b2c86475ca2d4f42aaa88fdc0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:49.870335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91b5a1b2c86475ca2d4f42aaa88fdc0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:49.872659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:49.946547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'request_id': 'req-dca63030-753e-4ece-ac5d-51c0a02a4ebf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:49.954245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'request_id': 'req-dca63030-753e-4ece-ac5d-51c0a02a4ebf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:49.967883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91b5a1b2c86475ca2d4f42aaa88fdc0', 'request_id': 'req-dca63030-753e-4ece-ac5d-51c0a02a4ebf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:49.988374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] The token cache is being invalidate because project f91b5a1b2c86475ca2d4f42aaa88fdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:49.988800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:49.989864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-dca63030-753e-4ece-ac5d-51c0a02a4ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:49.993910 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3856/7742] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:49 2022] DELETE /identity/v3/projects/f91b5a1b2c86475ca2d4f42aaa88fdc0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:49.998571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:49.999450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:49.999860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.025861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:50.027267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:50.167163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.167455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.167734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.174339 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3887/7743] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:50.189062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:50.190834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:50.192750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.194349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:50.212256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4cdd0-bca6-4d09-85df-bd57f838e5d4 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.227928 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3857/7744] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:50.229546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.231438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.234124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.238046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.238335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] PATH_INFO: `/v3/projects/050d26f7cb1448fca88b56975a49f81d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.239954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] RBAC: Authorizing `identity:delete_project(project_id=050d26f7cb1448fca88b56975a49f81d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.242143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.250286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512374a1-22f2-4a7a-8ef6-723225b05c36 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.265512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.266204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.266519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.266787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.267516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:50.268886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.270675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.299699 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3858/7745] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:50.305573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.329634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42e611-94fe-4a17-95ec-dad40016688f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.347846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050d26f7cb1448fca88b56975a49f81d', 'request_id': 'req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:50.367127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050d26f7cb1448fca88b56975a49f81d', 'request_id': 'req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:50.382118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050d26f7cb1448fca88b56975a49f81d', 'request_id': 'req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:50.401949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] The token cache is being invalidate because project 050d26f7cb1448fca88b56975a49f81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:50.402336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:50.403369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c6e27a97-0c7d-4969-b3f6-6ed88a53102b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:50.407169 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3888/7746] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:50 2022] DELETE /identity/v3/projects/050d26f7cb1448fca88b56975a49f81d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:50.415967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ffe9b-cc21-4bcb-9146-4167ec44b647 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.416342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ffe9b-cc21-4bcb-9146-4167ec44b647 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.416697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ffe9b-cc21-4bcb-9146-4167ec44b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.431276 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:50.431912 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:50.453057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.453731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.454017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.454298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.455058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.456991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.464873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cb0ffe9b-cc21-4bcb-9146-4167ec44b647 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:50.471232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb0ffe9b-cc21-4bcb-9146-4167ec44b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:50.493453 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3889/7747] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:50.496196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.496682 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3859/7748] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/projects => generated 399 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:50.496946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.497507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.501119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.504481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:50.544963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:50.548635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:50.605213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657bfb7-8b49-4956-9264-d6a1ab01149a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.610856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.611573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.611864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.612499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.613225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.627098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.691059 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3860/7749] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/users => generated 306 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:50.695749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.719179 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3890/7750] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:50.720284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.729733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c1e79-123b-48b5-a403-303b94a68ece admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.742039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161eb9f-9671-4349-a71f-0628761cc2a3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.747085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.747770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.748058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.748336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.748940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.749075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:50.749374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.751014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.752711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.752711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.752711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.758613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.760410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.783541 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3891/7751] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:50.788244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.801912 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3861/7752] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:50.808440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.810397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb88cae-6118-4130-80a0-d999d0d3dcd6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.830712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.831058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.831161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.831445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.832148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.834054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a07b-85d5-421e-b9cc-90e7b6552e34 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:50.834192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.847494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:50.848818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:50.849265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:50.849626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] PATH_INFO: `/v3/projects/d9dec55dac744147a8f15e38478ac466/users/9ce0804de8b8483aabc72f058adc4b51/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:50.887754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dec55dac744147a8f15e38478ac466, user_id=9ce0804de8b8483aabc72f058adc4b51, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:50.890960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:50.915674 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3862/7753] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:50 2022] PUT /identity/v3/projects/d9dec55dac744147a8f15e38478ac466/users/9ce0804de8b8483aabc72f058adc4b51/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:50.916738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:50.926607 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3892/7754] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:20:50.927878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.066778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e17da-6ff3-4c7b-be8a-9ee56ee652c8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.067286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694211b7-fb41-4505-b9d0-ddedb3a5b4db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.073278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.073941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.074221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.074535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.075257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.076987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.092247 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3863/7755] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:51.092422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.093001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.093290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.094628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.095211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.095935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.098614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.116997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a886-e7db-4109-9996-5135a2e5d00a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.123628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38760-a2fb-42c0-8823-07a6968179b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.124892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38760-a2fb-42c0-8823-07a6968179b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.125321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38760-a2fb-42c0-8823-07a6968179b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.128593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38760-a2fb-42c0-8823-07a6968179b5 admin admin] PATH_INFO: `/v3/projects/d9dec55dac744147a8f15e38478ac466/users/9ce0804de8b8483aabc72f058adc4b51/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.134352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38760-a2fb-42c0-8823-07a6968179b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dec55dac744147a8f15e38478ac466, user_id=9ce0804de8b8483aabc72f058adc4b51, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.137623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38760-a2fb-42c0-8823-07a6968179b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.164492 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3893/7756] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:50 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:51.168663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.174896 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3864/7757] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:51 2022] PUT /identity/v3/projects/d9dec55dac744147a8f15e38478ac466/users/9ce0804de8b8483aabc72f058adc4b51/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:51.192412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.192781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.193291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.211553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cdb15-b458-4832-ba92-e62f35e17bec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.235110 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:51.249070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] MFA Rules not processed for user `9ce0804de8b8483aabc72f058adc4b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:51.250173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:51.341591 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:51.371724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431177-9e6d-4e7b-b8b6-65bb71950173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.372337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431177-9e6d-4e7b-b8b6-65bb71950173 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.372632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431177-9e6d-4e7b-b8b6-65bb71950173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.372909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431177-9e6d-4e7b-b8b6-65bb71950173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.373645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e431177-9e6d-4e7b-b8b6-65bb71950173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.375294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e431177-9e6d-4e7b-b8b6-65bb71950173 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.422817 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3894/7758] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:51.424444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.424809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.425122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.441201 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3865/7759] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:51.442571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.457743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7e812-ac13-4b64-a93d-3837a770c691 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.463671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:51.464260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.465040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:51.465150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.477061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.477479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.478362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.480266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.496479 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3866/7760] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:51.497338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.510763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f519-5d43-4d5a-9bf7-e15d58efd607 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.516374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.517181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.517471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.517751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.518670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.521263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.556325 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3867/7761] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:51 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:51.560498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.575276 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3895/7762] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:20:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:51.576757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.591638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291efc-b872-402d-9689-d1f28f2f361c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.684637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445feb5e-00db-4912-be73-65bede2d9bda admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.693727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.694814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.695250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.695674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.696850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.699124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.700720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.703348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.705153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.705448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] PATH_INFO: `/v3/projects/1a99ad7e2a6946319f1a16870063c8ec/users/dfb9ae42f1274e7383b21db571fb5ad6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.726826 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3896/7763] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:51 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:51.728013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.730955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:51.747852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a99ad7e2a6946319f1a16870063c8ec, user_id=dfb9ae42f1274e7383b21db571fb5ad6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.756456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.782917 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3868/7764] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:51 2022] PUT /identity/v3/projects/1a99ad7e2a6946319f1a16870063c8ec/users/dfb9ae42f1274e7383b21db571fb5ad6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:51.783805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:51.874723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea337a3-d0da-450b-aaa8-94cae4e654fb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.887904 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:51.894421 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:51.921203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c09c4-c8c2-4339-84bc-62f216df3a46 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:51.929133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc476-9223-4df7-b8c9-7e197da90fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.930035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc476-9223-4df7-b8c9-7e197da90fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.930388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc476-9223-4df7-b8c9-7e197da90fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.930644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc476-9223-4df7-b8c9-7e197da90fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.931816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc476-9223-4df7-b8c9-7e197da90fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:51.935079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc476-9223-4df7-b8c9-7e197da90fc3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:51.953224 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3869/7765] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:51.954760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.955053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.955431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.982185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:51.983812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:51.984105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:51.984386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:51.992265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] MFA Rules not processed for user `dfb9ae42f1274e7383b21db571fb5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:51.993764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:52.088274 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3870/7766] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:52.089776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:52.091706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:52.093436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:52.106639 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3897/7767] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:20:52.107680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:52.109185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:52.111960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c440-2c68-422f-a3d9-c54edadc5f59 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:52.119700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:52.123297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:52.124401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:52.124843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:52.125744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:52.129319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:52.141800 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3871/7768] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:52.146902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:52.158203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098d65-ff4f-46a3-9414-d10ed4e3cbf4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:52.165588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c512-e451-477b-9e5c-368744dd4fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:52.166702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c512-e451-477b-9e5c-368744dd4fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:52.167087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c512-e451-477b-9e5c-368744dd4fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:52.167518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c512-e451-477b-9e5c-368744dd4fa1 admin admin] PATH_INFO: `/v3/projects/0300b9587648420b8b5f6cdcb10dfd9a/users/0c5716e0819d455facf0dd4706b00bdd/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:52.191599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8c512-e451-477b-9e5c-368744dd4fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0300b9587648420b8b5f6cdcb10dfd9a, user_id=0c5716e0819d455facf0dd4706b00bdd, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:52.208060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8c512-e451-477b-9e5c-368744dd4fa1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:52.223778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329889-c913-4a42-86e7-61bec51ea43f service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:52.229593 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3872/7769] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:52 2022] PUT /identity/v3/projects/0300b9587648420b8b5f6cdcb10dfd9a/users/0c5716e0819d455facf0dd4706b00bdd/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:20:52.240333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:52.240766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:52.241052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:52.282539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] MFA Rules not processed for user `0c5716e0819d455facf0dd4706b00bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:52.283895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:52.328817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:52.330754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:52.331256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:52.331708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:52.347760 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:52.398391 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3873/7770] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:52.399482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:52.402925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:52.428531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:52.430113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:52.445415 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3898/7771] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:52.449501 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:52.522963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094a3e4-6a12-46e3-96ee-8b3606081842 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:52.533422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab806-646f-46cc-985d-cc6f2bbef92a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:52.534101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab806-646f-46cc-985d-cc6f2bbef92a service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:52.534397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab806-646f-46cc-985d-cc6f2bbef92a service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:52.534705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab806-646f-46cc-985d-cc6f2bbef92a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:52.631509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab806-646f-46cc-985d-cc6f2bbef92a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:52.633056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab806-646f-46cc-985d-cc6f2bbef92a service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:52.648329 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3874/7772] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:20:53.365149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:53.510188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffb73a-c3e8-4f0f-9f20-d878306e21b2 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:53.519578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:53.520698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:53.521704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:53.522118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] PATH_INFO: `/v3/users/9ce0804de8b8483aabc72f058adc4b51` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:53.523606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce0804de8b8483aabc72f058adc4b51)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:53.525862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:53.614781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce0804de8b8483aabc72f058adc4b51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:53.616050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce0804de8b8483aabc72f058adc4b51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:53.638392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce0804de8b8483aabc72f058adc4b51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:53.639300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce0804de8b8483aabc72f058adc4b51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:53.651508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce0804de8b8483aabc72f058adc4b51'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:53.694713 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3899/7773] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:53 2022] DELETE /identity/v3/users/9ce0804de8b8483aabc72f058adc4b51 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:53.699226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a884d3-2bd0-403d-8c8a-319968b8d2f4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:53.699702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a884d3-2bd0-403d-8c8a-319968b8d2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:53.699775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a884d3-2bd0-403d-8c8a-319968b8d2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:53.745968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c2a884d3-2bd0-403d-8c8a-319968b8d2f4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:53.747582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c2a884d3-2bd0-403d-8c8a-319968b8d2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:53.923145 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3875/7774] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:54.257690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:54.259327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:54.338113 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:54.403645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32831ebb-5475-4988-b51b-09e4a6019f45 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:54.430825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dbf1b-e08b-47e6-aea9-59eaefa988aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:54.431567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dbf1b-e08b-47e6-aea9-59eaefa988aa service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:54.431860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dbf1b-e08b-47e6-aea9-59eaefa988aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:54.432133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dbf1b-e08b-47e6-aea9-59eaefa988aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:54.458964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dbf1b-e08b-47e6-aea9-59eaefa988aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:54.461513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dbf1b-e08b-47e6-aea9-59eaefa988aa service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:54.496092 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3900/7775] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:54.807067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220233f-386a-4303-884f-97b93528719c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:54.807950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220233f-386a-4303-884f-97b93528719c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:54.808412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220233f-386a-4303-884f-97b93528719c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:54.811164 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3876/7776] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:20:54.826595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:54.826923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:54.827278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:54.852417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:54.853809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:54.981531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3901/7777] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:20:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:20:55.002756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220233f-386a-4303-884f-97b93528719c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:55.004892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d220233f-386a-4303-884f-97b93528719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:55.030208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220233f-386a-4303-884f-97b93528719c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:55.037469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:55.038719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:55.038719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:55.039084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:55.049692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:55.051789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:55.069850 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3877/7778] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:55.150529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:55.152896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:55.182534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63566366-306b-426c-a068-2836d0aa5e9b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:55.204696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:55.206028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:55.206375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:55.206763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] PATH_INFO: `/v3/projects/d9dec55dac744147a8f15e38478ac466` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:55.213258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9dec55dac744147a8f15e38478ac466)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:55.216173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:55.332163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9dec55dac744147a8f15e38478ac466', 'request_id': 'req-b844ab75-2424-4f52-8c71-c430d3c13261'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.342260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9dec55dac744147a8f15e38478ac466', 'request_id': 'req-b844ab75-2424-4f52-8c71-c430d3c13261'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.356693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9dec55dac744147a8f15e38478ac466', 'request_id': 'req-b844ab75-2424-4f52-8c71-c430d3c13261'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.372591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] The token cache is being invalidate because project d9dec55dac744147a8f15e38478ac466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:55.372591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.373269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.380954 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3902/7779] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:55 2022] DELETE /identity/v3/projects/d9dec55dac744147a8f15e38478ac466 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:55.381156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:55.393321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14437b7c-1d85-4712-a67f-a447cbde43e4 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:55.426003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:55.428704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:55.496647 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:55.557242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:55.563992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:55.564601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:55.564840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] PATH_INFO: `/v3/users/0c5716e0819d455facf0dd4706b00bdd` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:55.568261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5716e0819d455facf0dd4706b00bdd)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:55.570021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:55.575088 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:55.619283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844ab75-2424-4f52-8c71-c430d3c13261 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:55.634614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:55.636860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:55.637180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:55.639362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:55.646905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:55.730748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5716e0819d455facf0dd4706b00bdd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.755824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5716e0819d455facf0dd4706b00bdd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.765823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5716e0819d455facf0dd4706b00bdd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.777576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5716e0819d455facf0dd4706b00bdd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.778833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1b44c11-da90-4807-94f4-f921b5306917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5716e0819d455facf0dd4706b00bdd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:55.781577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:55.784070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:55.787723 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3878/7780] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:55 2022] DELETE /identity/v3/users/0c5716e0819d455facf0dd4706b00bdd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:55.789532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aae7a-2d71-4cb8-9a8c-3e7047940654 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:55.789873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aae7a-2d71-4cb8-9a8c-3e7047940654 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:55.790166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aae7a-2d71-4cb8-9a8c-3e7047940654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:55.822106 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3903/7781] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:20:55.858248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-384aae7a-2d71-4cb8-9a8c-3e7047940654 None None] MFA Rules not processed for user `3a10dc703c4d442ea62abfddf18cf507`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:55.859675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-384aae7a-2d71-4cb8-9a8c-3e7047940654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:56.002625 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3879/7782] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:56.502640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:56.504840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:56.534160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8844c8-8f04-41e5-8fbb-751b8a650f16 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:56.704939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:56.709596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:56.713346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:56.713771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] PATH_INFO: `/v3/projects/0300b9587648420b8b5f6cdcb10dfd9a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:56.716552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0300b9587648420b8b5f6cdcb10dfd9a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:56.728184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:56.844253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0300b9587648420b8b5f6cdcb10dfd9a', 'request_id': 'req-448158fb-57ea-46b7-a360-871a72d6261c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:56.855902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0300b9587648420b8b5f6cdcb10dfd9a', 'request_id': 'req-448158fb-57ea-46b7-a360-871a72d6261c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:56.870512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0300b9587648420b8b5f6cdcb10dfd9a', 'request_id': 'req-448158fb-57ea-46b7-a360-871a72d6261c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:56.887990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] The token cache is being invalidate because project 0300b9587648420b8b5f6cdcb10dfd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:20:56.889137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:56.890021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-448158fb-57ea-46b7-a360-871a72d6261c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:56.898615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:56.899113 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3904/7783] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:56 2022] DELETE /identity/v3/projects/0300b9587648420b8b5f6cdcb10dfd9a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:56.899754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:56.900141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:56.919824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:56.922292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:56.986155 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:57.021084 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3880/7784] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:57.022884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.023177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.023458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.044571 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:57.063679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:57.067951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:57.092889 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3905/7785] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:57.097371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.116281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88962dd0-c74f-460b-9b64-1dedfc183877 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.131277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.133906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.134307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.134719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.135590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:20:57.138249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.141768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.175119 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3881/7786] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:20:57.181090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.197210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52cd32-704c-439f-8fff-76fbd684bc29 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.206327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.207055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.207342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.207621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.209548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.216085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.273885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.275528 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3906/7787] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:57 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:57.289187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd708f2-e12b-4e33-bf29-61467b04c8f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.387838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.388611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.388911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.389193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.389904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.395340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.443256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.452709 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3882/7788] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:57 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:20:57.457752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0322c-8df8-4aae-8d60-a1c0decb97de admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.471260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.472152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.472446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.472726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.473468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.479500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.505836 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3907/7789] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:57.511074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.525188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fc57f-4066-40a1-8cc6-6b7562c09c50 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.540756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.542542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.544670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.545051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] PATH_INFO: `/v3/projects/82c05d346115427490c97fad48a289b6/users/f9a4d70f91c149c1a16629abc54c19a6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.590410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c05d346115427490c97fad48a289b6, user_id=f9a4d70f91c149c1a16629abc54c19a6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.594173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.633746 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3883/7790] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:57 2022] PUT /identity/v3/projects/82c05d346115427490c97fad48a289b6/users/f9a4d70f91c149c1a16629abc54c19a6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:20:57.639757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.660183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6209-0ecd-4d22-8b7c-6675bc8c9da7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.794561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642c841-266b-454b-8838-fb9b631ad062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.797198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c841-266b-454b-8838-fb9b631ad062 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.797490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c841-266b-454b-8838-fb9b631ad062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.797774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c841-266b-454b-8838-fb9b631ad062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.798542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642c841-266b-454b-8838-fb9b631ad062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.802022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642c841-266b-454b-8838-fb9b631ad062 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.820054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:57.830619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3908/7791] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:57.832273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366fff5-3cf2-4404-a131-2f450b8fd8a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:57.845104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:57.846113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.846662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.848280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] PATH_INFO: `/v3/projects/82c05d346115427490c97fad48a289b6/users/f9a4d70f91c149c1a16629abc54c19a6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.855183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c05d346115427490c97fad48a289b6, user_id=f9a4d70f91c149c1a16629abc54c19a6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:57.860952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:57.886451 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3884/7792] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:57 2022] PUT /identity/v3/projects/82c05d346115427490c97fad48a289b6/users/f9a4d70f91c149c1a16629abc54c19a6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:57.897757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:57.898055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:57.898338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:57.936265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] MFA Rules not processed for user `f9a4d70f91c149c1a16629abc54c19a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:57.937495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:58.045306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.048558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:58.135826 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3909/7793] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:58.137198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.189140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b34b8-cc5d-423b-887c-a0b545e6a00b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.198918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.200056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.207500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.214648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] PATH_INFO: `/v3/users/7c256fba55d74f8e842e7ab3e39dc15e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:58.218312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c256fba55d74f8e842e7ab3e39dc15e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:58.230041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:58.233983 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:58.278685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51240-b1e2-4e6e-9df8-5f3e72a456c9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.290661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.291558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.291987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.292408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:58.294051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:58.314007 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:58.405578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3910/7794] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:20:58 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:58.406754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.443975 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:58.461103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c256fba55d74f8e842e7ab3e39dc15e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:58.488259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c256fba55d74f8e842e7ab3e39dc15e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:58.518650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c256fba55d74f8e842e7ab3e39dc15e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:58.543486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c256fba55d74f8e842e7ab3e39dc15e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:58.545034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c256fba55d74f8e842e7ab3e39dc15e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:20:58.564989 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3885/7795] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:20:58 2022] DELETE /identity/v3/users/7c256fba55d74f8e842e7ab3e39dc15e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:58.566158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.568693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:58.594715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855238a-a56f-4cea-8e22-96c1ac18db3e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.718037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae459bd-d727-49b2-ad76-d4acfff7354b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.722076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.722816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.723106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.723390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:58.726004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:58.763013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.764091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.765000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.765438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:58.768662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:58.773784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:58.817537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:58.819976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:58.834680 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3911/7796] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:20:58 2022] POST /identity/v3/users => generated 293 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:20:58.835715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3886/7797] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:58.840072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.845430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:58.865999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8944c-92c4-43c5-a204-aeb583a8a5a6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.874758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.875662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.876328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.876774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:58.877817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:58.880073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:58.892514 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3912/7798] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:58.896724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.910312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2fabb-9b4e-497f-b519-35d9251748cd service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.916774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1e5a-a2bd-44e5-b3fb-f8322b3ef05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.917587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1e5a-a2bd-44e5-b3fb-f8322b3ef05e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.917883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1e5a-a2bd-44e5-b3fb-f8322b3ef05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.918168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1e5a-a2bd-44e5-b3fb-f8322b3ef05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:58.919328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1e5a-a2bd-44e5-b3fb-f8322b3ef05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:58.921230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1e5a-a2bd-44e5-b3fb-f8322b3ef05e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:58.934543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3887/7799] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:20:58.939449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:58.959238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d2193-d139-4fb4-a64a-77d35e4b2d73 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:58.978348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:58.987321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:58.988959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:58.989623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] PATH_INFO: `/v3/projects/bdf3d3acf4524e0e8f7f5119646c4547/users/d4a5aa030dfc464b94efd0337ee37ade/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:59.047745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf3d3acf4524e0e8f7f5119646c4547, user_id=d4a5aa030dfc464b94efd0337ee37ade, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:59.050430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:59.086336 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3913/7800] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:20:58 2022] PUT /identity/v3/projects/bdf3d3acf4524e0e8f7f5119646c4547/users/d4a5aa030dfc464b94efd0337ee37ade/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:20:59.096161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:59.097045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:59.097462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:59.179372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] MFA Rules not processed for user `d4a5aa030dfc464b94efd0337ee37ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:20:59.189293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:59.300505 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:59.367928 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3888/7801] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:20:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:20:59.387169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:59.389763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:59.482773 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:20:59.520232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0a56f-a920-4518-836c-a1493b8c6711 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:59.531422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:59.532112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:59.532882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:59.533171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:59.536429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:59.731230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:20:59.733142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:20:59.756981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:59.764770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:20:59.800713 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3914/7802] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:20:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:20:59.959670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aafa4d-b729-4c20-a9d8-5031e06a4ba0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:20:59.976510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:20:59.977334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:20:59.977620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:20:59.978015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] PATH_INFO: `/v3/projects/7063af479f6949fbad2cfdf7b18811eb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:20:59.983336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7063af479f6949fbad2cfdf7b18811eb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:20:59.985291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:00.019370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:00.020831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:00.122054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7063af479f6949fbad2cfdf7b18811eb', 'request_id': 'req-3593005e-7c09-446b-b6e8-e5100a4f4e3d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.152956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7063af479f6949fbad2cfdf7b18811eb', 'request_id': 'req-3593005e-7c09-446b-b6e8-e5100a4f4e3d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.180264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7063af479f6949fbad2cfdf7b18811eb', 'request_id': 'req-3593005e-7c09-446b-b6e8-e5100a4f4e3d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.228119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] The token cache is being invalidate because project 7063af479f6949fbad2cfdf7b18811eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:00.228652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.231692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.241590 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3889/7803] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:20:59 2022] DELETE /identity/v3/projects/7063af479f6949fbad2cfdf7b18811eb => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:00.244703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:00.246470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a473de-18aa-4f0a-bbfc-8731b0c46972 service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:00.248295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:00.389946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593005e-7c09-446b-b6e8-e5100a4f4e3d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:00.398965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:00.400619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:00.401106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:00.401582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] PATH_INFO: `/v3/users/dfb9ae42f1274e7383b21db571fb5ad6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:00.401855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:00.403669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb9ae42f1274e7383b21db571fb5ad6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:00.403783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:00.404054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:00.404342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:00.406232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:00.406982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:00.415911 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:00.528383 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:00.537329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb9ae42f1274e7383b21db571fb5ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.585107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:00.586317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01658b5-8259-459d-853f-680dc083df61 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:00.590589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb9ae42f1274e7383b21db571fb5ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.607090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb9ae42f1274e7383b21db571fb5ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.624693 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3915/7804] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:00.626369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef254d6-ed33-41ce-86d4-8ef883c6e2db None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:00.626691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef254d6-ed33-41ce-86d4-8ef883c6e2db None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:00.626978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef254d6-ed33-41ce-86d4-8ef883c6e2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:00.628911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb9ae42f1274e7383b21db571fb5ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.629602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb9ae42f1274e7383b21db571fb5ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:00.651935 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3890/7805] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:00 2022] DELETE /identity/v3/users/dfb9ae42f1274e7383b21db571fb5ad6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:00.655764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:00.662552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:00.688593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3ef254d6-ed33-41ce-86d4-8ef883c6e2db None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:00.689839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3ef254d6-ed33-41ce-86d4-8ef883c6e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:00.901964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b248c-4fad-4bf6-b1a6-284037b9bf24 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:00.918114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:00.919386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:00.920211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:00.920596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] PATH_INFO: `/v3/users/f9a4d70f91c149c1a16629abc54c19a6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:00.922517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a4d70f91c149c1a16629abc54c19a6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:00.926049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:00.928715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3916/7806] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:00.933057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867daa-3adc-4ef2-b906-72d7dffcc5b7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:00.933609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867daa-3adc-4ef2-b906-72d7dffcc5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:00.934485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867daa-3adc-4ef2-b906-72d7dffcc5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:00.986606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d8867daa-3adc-4ef2-b906-72d7dffcc5b7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:00.987848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d8867daa-3adc-4ef2-b906-72d7dffcc5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.017824 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3917/7807] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:01.019547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.019905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.020161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.070235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:01.072215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.076815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a4d70f91c149c1a16629abc54c19a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:01.102805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a4d70f91c149c1a16629abc54c19a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:01.105507 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3918/7808] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:01.106226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.124528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980226f9-19fa-47bb-a76c-cfb5589256eb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.134444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.135165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.135447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.135731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.136473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:01.136782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.136888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a4d70f91c149c1a16629abc54c19a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:01.138408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.167103 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3919/7809] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:21:01.168066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.170022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a4d70f91c149c1a16629abc54c19a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:01.170953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a4d70f91c149c1a16629abc54c19a6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:01.181774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d565e6-f18a-46ee-a7dc-57374ef1c498 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.188092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a86cb4-abd1-44fb-b2ac-f73214e31756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.188836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a86cb4-abd1-44fb-b2ac-f73214e31756 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.189130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a86cb4-abd1-44fb-b2ac-f73214e31756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.189410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a86cb4-abd1-44fb-b2ac-f73214e31756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.190116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a86cb4-abd1-44fb-b2ac-f73214e31756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.192423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a86cb4-abd1-44fb-b2ac-f73214e31756 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.196360 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3891/7810] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:00 2022] DELETE /identity/v3/users/f9a4d70f91c149c1a16629abc54c19a6 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:01.199883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.204100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.230788 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:01.250277 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3920/7811] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:01 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:01.251678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.254185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.254534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.279082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:01.280343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.380550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749b17-a186-44cb-865a-03bdce06fbe8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.417519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3921/7812] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:01.419999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.423226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.453584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab99e6-3f2a-40b0-8428-91aa2672a9f6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.476108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.476808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.477091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.477368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.478627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.483251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.503585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.505470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.505758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.506039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.508202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.541165 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3922/7813] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:01 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:01.543606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.547931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:01.576500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.579816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.634481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93e13-19c0-4bb8-a8c5-3babfe80f1db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.644705 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3892/7814] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:01.646865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.651234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.657960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.659974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.662019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.682296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21982-c53c-40a1-92e5-093dfb7054fe service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.696052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.703636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.704858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.705317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.706376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.706587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.710930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.712745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.747315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3923/7815] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:01.749300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3893/7816] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:01.754354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.772020 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:01.784256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffec5e-e3c5-4213-a56f-3e4805136e62 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.799010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942296bd-7353-44e2-a77f-67cd339ab9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.800152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942296bd-7353-44e2-a77f-67cd339ab9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.800828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942296bd-7353-44e2-a77f-67cd339ab9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.801113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942296bd-7353-44e2-a77f-67cd339ab9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.802121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942296bd-7353-44e2-a77f-67cd339ab9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.804061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942296bd-7353-44e2-a77f-67cd339ab9ef admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.824860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:01.838328 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3924/7817] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:01.842742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5c3b-b6cb-4fe7-b299-c2fd72094f6f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:01.850016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:01.851529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.851918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.852298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] PATH_INFO: `/v3/projects/9355888886b2404ca713423c59ddad40/users/cdfac6d72aa0476b8fb6cdc11e4b33e8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:01.877778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9355888886b2404ca713423c59ddad40, user_id=cdfac6d72aa0476b8fb6cdc11e4b33e8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:01.881919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:01.925841 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3894/7818] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:01 2022] PUT /identity/v3/projects/9355888886b2404ca713423c59ddad40/users/cdfac6d72aa0476b8fb6cdc11e4b33e8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:01.937427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:01.937969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:01.938187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:02.052095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] MFA Rules not processed for user `cdfac6d72aa0476b8fb6cdc11e4b33e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:02.054445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:02.197562 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3925/7819] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:02.209318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:02.214084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:02.352198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1e1bf-3e76-4d7a-8291-93ae2b7c17e0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:02.362190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ece07-1831-4ff2-8eb3-5b4e9ab4b6fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:02.363258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ece07-1831-4ff2-8eb3-5b4e9ab4b6fe service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:02.365398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ece07-1831-4ff2-8eb3-5b4e9ab4b6fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:02.365939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ece07-1831-4ff2-8eb3-5b4e9ab4b6fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:02.391043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ece07-1831-4ff2-8eb3-5b4e9ab4b6fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:02.395726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ece07-1831-4ff2-8eb3-5b4e9ab4b6fe service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:02.414661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3895/7820] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:02.897307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:02.903431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:03.102198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b517-49ca-4b4e-8bbe-39e68c1cec7b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:03.119067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:03.120355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:03.123213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:03.125020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] PATH_INFO: `/v3/projects/1a99ad7e2a6946319f1a16870063c8ec` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:03.128273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a99ad7e2a6946319f1a16870063c8ec)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:03.136034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:03.253668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a99ad7e2a6946319f1a16870063c8ec', 'request_id': 'req-1903800a-5550-42b2-ba47-026ff7ea04f6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:03.283102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a99ad7e2a6946319f1a16870063c8ec', 'request_id': 'req-1903800a-5550-42b2-ba47-026ff7ea04f6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:03.290709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a99ad7e2a6946319f1a16870063c8ec', 'request_id': 'req-1903800a-5550-42b2-ba47-026ff7ea04f6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:03.320488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] The token cache is being invalidate because project 1a99ad7e2a6946319f1a16870063c8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:03.320793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:03.322931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1903800a-5550-42b2-ba47-026ff7ea04f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:03.324838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3926/7821] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:02 2022] DELETE /identity/v3/projects/1a99ad7e2a6946319f1a16870063c8ec => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:03.329787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:03.330232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:03.330351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:03.373714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:03.375059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:03.447263 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:03.566449 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3896/7822] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:03.568525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:03.569375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:03.569670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:03.624308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:03.627781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:03.654000 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3927/7823] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:21:03.658185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:03.676333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3cdd9-a608-46f9-9819-37d0e51ee363 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:03.687072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:03.687767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:03.688056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:03.688343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:03.689092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:03.689408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:03.691076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:03.727393 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3897/7824] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:21:03.732250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:03.742361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8d9c-35c1-452b-a558-82b4dd40becf None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:03.762794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:03.763521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:03.763776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:03.764061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:03.764789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:03.766748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:03.776773 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:03.836048 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3928/7825] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:03 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:03.839649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:03.860305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2446-fcf4-4f1e-b302-eba605983695 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:03.992485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:03.993275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:03.993643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:03.994000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:03.994814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:03.996855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.092810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:04.093760 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3898/7826] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:03 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:04.104161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323391e-35f0-47ee-ad04-793de1bad385 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:04.126736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:04.127686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.128123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.128552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.130648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:04.132455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.155748 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3929/7827] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:21:04.160031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:04.173275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72f0a3-5c17-4505-bd80-fcdcd8b338a7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:04.181544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399823fe-96fa-4ae3-9c75-a4735212c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:04.182232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399823fe-96fa-4ae3-9c75-a4735212c4be admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.182553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399823fe-96fa-4ae3-9c75-a4735212c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.182845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399823fe-96fa-4ae3-9c75-a4735212c4be admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.183633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399823fe-96fa-4ae3-9c75-a4735212c4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:04.185439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399823fe-96fa-4ae3-9c75-a4735212c4be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.207952 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3899/7828] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:04.212053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:04.226951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfd100-d9d1-4b35-b780-e0e9dc7cdbf8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:04.237151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:04.238632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.239838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.240296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] PATH_INFO: `/v3/projects/9927140e2e534410b623783f43db6d54/users/302eed11186a4ce2899c3f2a1100403c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.272668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9927140e2e534410b623783f43db6d54, user_id=302eed11186a4ce2899c3f2a1100403c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:04.275854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.299283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3930/7829] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:04 2022] PUT /identity/v3/projects/9927140e2e534410b623783f43db6d54/users/302eed11186a4ce2899c3f2a1100403c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:04.305644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.306211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.306671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.344703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:04.355055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:04.394165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:04.397536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:04.533337 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3900/7830] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:04.549170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dbe6d-e341-4da7-9b92-9be9853efafa admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:04.561924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:04.563146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.563582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.564012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] PATH_INFO: `/v3/projects/82c05d346115427490c97fad48a289b6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.565533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c05d346115427490c97fad48a289b6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:04.568213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.570658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:04.572169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:04.636915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c05d346115427490c97fad48a289b6', 'request_id': 'req-1a1f8803-71dc-468c-b6db-db2ee140185c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:04.650734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c05d346115427490c97fad48a289b6', 'request_id': 'req-1a1f8803-71dc-468c-b6db-db2ee140185c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:04.666315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c05d346115427490c97fad48a289b6', 'request_id': 'req-1a1f8803-71dc-468c-b6db-db2ee140185c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:04.677189 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:04.687444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] The token cache is being invalidate because project 82c05d346115427490c97fad48a289b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:04.688022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:04.689159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:04.692692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3931/7831] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:04 2022] DELETE /identity/v3/projects/82c05d346115427490c97fad48a289b6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:04.697014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:04.700546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:04.719779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fa6e9-968f-4eaa-b44d-9507a0a86346 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:04.798938 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:04.824263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:04.826452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.826789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.827078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.831420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:04.853513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f8803-71dc-468c-b6db-db2ee140185c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:04.861752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:04.863277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecc33b-e09d-4b33-9dc6-b82077eb5035 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.877217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:04.878159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:04.878450 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:04.883546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] PATH_INFO: `/v3/users/d4a5aa030dfc464b94efd0337ee37ade` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:04.887299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a5aa030dfc464b94efd0337ee37ade)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:04.890339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:04.904133 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3901/7832] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:04.975853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a5aa030dfc464b94efd0337ee37ade'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:04.976632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a5aa030dfc464b94efd0337ee37ade'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:05.001975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a5aa030dfc464b94efd0337ee37ade'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:05.003516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a5aa030dfc464b94efd0337ee37ade'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:05.014067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a5aa030dfc464b94efd0337ee37ade'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:05.041213 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3932/7833] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:04 2022] DELETE /identity/v3/users/d4a5aa030dfc464b94efd0337ee37ade => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:21:05.224136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a04c-3438-4cc0-9fa2-8a401a971e80 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:05.224438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a04c-3438-4cc0-9fa2-8a401a971e80 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:05.224708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a04c-3438-4cc0-9fa2-8a401a971e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:05.249783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-43c8a04c-3438-4cc0-9fa2-8a401a971e80 None None] MFA Rules not processed for user `cdfac6d72aa0476b8fb6cdc11e4b33e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:05.251370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-43c8a04c-3438-4cc0-9fa2-8a401a971e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:05.375458 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3902/7834] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:06.797260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:06.799921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:06.922018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e521-a8a8-4449-8a61-f5e11351214b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:06.929871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:06.930853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:06.931138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:06.932067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] PATH_INFO: `/v3/projects/bdf3d3acf4524e0e8f7f5119646c4547` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:06.933459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf3d3acf4524e0e8f7f5119646c4547)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:06.936131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.108153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf3d3acf4524e0e8f7f5119646c4547', 'request_id': 'req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:07.127650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf3d3acf4524e0e8f7f5119646c4547', 'request_id': 'req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:07.144871 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:07.169178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf3d3acf4524e0e8f7f5119646c4547', 'request_id': 'req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:07.204321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.204818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.204927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.217554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] The token cache is being invalidate because project bdf3d3acf4524e0e8f7f5119646c4547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:07.220035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:07.220861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6fd7be2e-10bb-4319-9cae-3f6214bb39d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:07.227474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3933/7835] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:06 2022] DELETE /identity/v3/projects/bdf3d3acf4524e0e8f7f5119646c4547 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:07.228981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745091e-40e0-4744-9eec-22ea5ca531ba None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.229277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745091e-40e0-4744-9eec-22ea5ca531ba None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.229561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745091e-40e0-4744-9eec-22ea5ca531ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.254918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2745091e-40e0-4744-9eec-22ea5ca531ba None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:07.257940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2745091e-40e0-4744-9eec-22ea5ca531ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:07.261654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] MFA Rules not processed for user `302eed11186a4ce2899c3f2a1100403c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:07.265293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:07.358044 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3934/7836] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:07.368547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.368763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.369153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.427223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:07.430173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:07.430634 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3903/7837] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:21:07.443670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.445340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:07.461665 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3935/7838] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:07.462828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.485583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946661c9-20cc-4613-bbdc-76d4db44a5c7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.499028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:07.499920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.500222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.500857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.501238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:07.501550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:07.503338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.505475 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:07.534307 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3936/7839] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:21:07.538754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.542713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0b12-f2f5-40b7-bc6c-9becdc5d94fe None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.551471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe165a-ecaf-40a6-bd56-da0d01271adb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.553730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:07.554606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.554897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.555175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.566134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:07.567674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.567965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.568245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.570212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:07.573358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.575542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:07.577159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.596972 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3904/7840] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:21:07.623657 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3937/7841] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:07 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:21:07.627701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.650544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac43962-9024-4f6d-a5c0-faece3bc2cae service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.731977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:07.732966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.733392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.733807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.734667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:07.737615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.782313 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3905/7842] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:07 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:07.783638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.823943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4517-a17d-4b14-af0a-fcf4bf55181f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.853166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:07.853894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.854179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.854460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.855262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:07.856856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.893101 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3938/7843] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:07.894522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.918536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad2cc-f3e1-426d-a5b9-d45a134f4627 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.932770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8591187-7ee0-4a62-a8fe-c7c280f4eff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:07.933475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8591187-7ee0-4a62-a8fe-c7c280f4eff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:07.933762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8591187-7ee0-4a62-a8fe-c7c280f4eff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:07.934136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8591187-7ee0-4a62-a8fe-c7c280f4eff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:07.935003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8591187-7ee0-4a62-a8fe-c7c280f4eff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:07.937029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8591187-7ee0-4a62-a8fe-c7c280f4eff5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:07.960543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3906/7844] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:07.964941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:07.978596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a7c88-2602-4f20-9f25-2f8eedfdeaa0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:07.999373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:08.000301 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.000658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.000911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] PATH_INFO: `/v3/projects/f6be3b52a9614ad8bfe6ac2b2bf4e9d1/users/49fdf80114ca4cc68e7606f7af2ef832/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.041208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6be3b52a9614ad8bfe6ac2b2bf4e9d1, user_id=49fdf80114ca4cc68e7606f7af2ef832, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:08.048022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:08.081689 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3939/7845] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:07 2022] PUT /identity/v3/projects/f6be3b52a9614ad8bfe6ac2b2bf4e9d1/users/49fdf80114ca4cc68e7606f7af2ef832/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:21:08.094643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.094939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.095247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.169361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] MFA Rules not processed for user `49fdf80114ca4cc68e7606f7af2ef832`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:08.201911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:08.346454 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3907/7846] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:08.351915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:08.483571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a7e7e-b325-4428-a4b2-df2354ec58a9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:08.490711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:08.491559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.491990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.492414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.493294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:08.495396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:08.530705 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:08.553020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:08.563322 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3940/7847] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:08 2022] POST /identity/v3/projects => generated 407 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:08.567067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e147-3fd3-427a-ac07-00ecc1f1ce23 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:08.683089 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:08.713262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f25f2-6046-406c-87e6-84d02d636da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:08.714104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f25f2-6046-406c-87e6-84d02d636da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.715328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f25f2-6046-406c-87e6-84d02d636da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.715695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f25f2-6046-406c-87e6-84d02d636da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.716633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f25f2-6046-406c-87e6-84d02d636da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:08.718768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f25f2-6046-406c-87e6-84d02d636da5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:08.755092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:08.762754 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3908/7848] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:08 2022] POST /identity/v3/users => generated 310 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:08.764416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.767089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.770629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.774482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815561d-e00e-4116-b834-f8f5d08fbf09 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:08.780660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:08.781399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.781757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.782196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.784129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:08.788826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:08.811765 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3941/7849] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:08.811895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] MFA Rules not processed for user `3cced2e2903b42f580b9221464af5537`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:08.812561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:08.813143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:08.824617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c0f4-e86c-4dc3-a9db-96f13998ea77 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:08.830541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:08.831469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:08.839680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:08.840032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] PATH_INFO: `/v3/projects/bcfc0278f6614446b9d7708eca17ab3e/users/df83e86ceeaf4348b17d089e4fa0f8ef/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:08.858425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfc0278f6614446b9d7708eca17ab3e, user_id=df83e86ceeaf4348b17d089e4fa0f8ef, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:08.861516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:08.894880 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3942/7850] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:08 2022] PUT /identity/v3/projects/bcfc0278f6614446b9d7708eca17ab3e/users/df83e86ceeaf4348b17d089e4fa0f8ef/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:08.899312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:08.943979 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3909/7851] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:09.159321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f172-b8e4-4ba2-a139-e68ecf12b389 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:09.174121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82298ea0-0497-4d94-927c-251fecc75233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:09.176632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82298ea0-0497-4d94-927c-251fecc75233 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:09.177151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82298ea0-0497-4d94-927c-251fecc75233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:09.177636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82298ea0-0497-4d94-927c-251fecc75233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:09.178999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82298ea0-0497-4d94-927c-251fecc75233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:09.181105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82298ea0-0497-4d94-927c-251fecc75233 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:09.217709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3943/7852] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:09.218869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:09.235697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb192-c760-4568-922b-9f6b9a202e5c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:09.260911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:09.262451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:09.262780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:09.263065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] PATH_INFO: `/v3/projects/bcfc0278f6614446b9d7708eca17ab3e/users/df83e86ceeaf4348b17d089e4fa0f8ef/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:09.268010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfc0278f6614446b9d7708eca17ab3e, user_id=df83e86ceeaf4348b17d089e4fa0f8ef, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:09.279991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:09.311615 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3910/7853] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:09 2022] PUT /identity/v3/projects/bcfc0278f6614446b9d7708eca17ab3e/users/df83e86ceeaf4348b17d089e4fa0f8ef/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:09.325146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:09.325684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:09.326202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:09.362966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] MFA Rules not processed for user `df83e86ceeaf4348b17d089e4fa0f8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:09.364698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:09.524640 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3944/7854] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:09.550121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:09.554173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:09.693685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8ab44-5a61-431a-9f74-a2c48c92a3fb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:09.703550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:09.704658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:09.706279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:09.706694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:09.794900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:09.798204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:09.810857 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3911/7855] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:11.239444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:11.241206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:11.324073 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:11.368043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bab2e-65cc-44f9-aedf-44751ebe8141 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:11.376665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a7c2b-57e1-4dc0-a6ec-1dbcd363e96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:11.379401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a7c2b-57e1-4dc0-a6ec-1dbcd363e96c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:11.379885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a7c2b-57e1-4dc0-a6ec-1dbcd363e96c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:11.380751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a7c2b-57e1-4dc0-a6ec-1dbcd363e96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:11.401336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a7c2b-57e1-4dc0-a6ec-1dbcd363e96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:11.405557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a7c2b-57e1-4dc0-a6ec-1dbcd363e96c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:11.428863 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3945/7856] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:19.805482 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:21.420131 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=14 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:24.835521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:24.921507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1ad3f-f1ef-40f7-b7a7-7e27e0e2d19b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:24.927963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:24.929116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:24.929546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:24.929982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] PATH_INFO: `/v3/users/49fdf80114ca4cc68e7606f7af2ef832` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:24.931455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fdf80114ca4cc68e7606f7af2ef832)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:24.933566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:24.999246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fdf80114ca4cc68e7606f7af2ef832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.013706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fdf80114ca4cc68e7606f7af2ef832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.022887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fdf80114ca4cc68e7606f7af2ef832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.037103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fdf80114ca4cc68e7606f7af2ef832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.037738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fdf80114ca4cc68e7606f7af2ef832'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.059193 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3912/7857] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:24 2022] DELETE /identity/v3/users/49fdf80114ca4cc68e7606f7af2ef832 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:25.064425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:25.064959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:25.064959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:25.086410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:25.087675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:25.160933 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3946/7858] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:25.171138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:25.172669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:25.243698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238f02-ef39-4ffa-a96e-6b22468fd588 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:25.247834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:25.248490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:25.248772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:25.249049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:25.272078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:25.273574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:25.284734 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3913/7859] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:25.734032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:25.735482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:25.748974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc713b2-8761-4dfe-af86-f9262e54013d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:25.753742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:25.754981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:25.754981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:25.755177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] PATH_INFO: `/v3/projects/f6be3b52a9614ad8bfe6ac2b2bf4e9d1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:25.756406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6be3b52a9614ad8bfe6ac2b2bf4e9d1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:25.758481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:25.884408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6be3b52a9614ad8bfe6ac2b2bf4e9d1', 'request_id': 'req-3723cb30-989e-4fc3-a25e-e1b1004fc706'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.893856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6be3b52a9614ad8bfe6ac2b2bf4e9d1', 'request_id': 'req-3723cb30-989e-4fc3-a25e-e1b1004fc706'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.904171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6be3b52a9614ad8bfe6ac2b2bf4e9d1', 'request_id': 'req-3723cb30-989e-4fc3-a25e-e1b1004fc706'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.925581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] The token cache is being invalidate because project f6be3b52a9614ad8bfe6ac2b2bf4e9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:25.925836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.928632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3723cb30-989e-4fc3-a25e-e1b1004fc706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:25.936260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:25.937452 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3947/7860] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:25 2022] DELETE /identity/v3/projects/f6be3b52a9614ad8bfe6ac2b2bf4e9d1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:25.950922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea763ee-0ff3-4fdb-b825-c9ca2ac96e4a service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:25.992375 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:26.018759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:26.020136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:26.020628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:26.042228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:26.062267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:26.062387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:26.063142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:26.063438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:26.063746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] PATH_INFO: `/v3/users/df83e86ceeaf4348b17d089e4fa0f8ef` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:26.064999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df83e86ceeaf4348b17d089e4fa0f8ef)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:26.067642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:26.147394 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3948/7861] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:21:26.173173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:26.177321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:26.184506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df83e86ceeaf4348b17d089e4fa0f8ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:26.208660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df83e86ceeaf4348b17d089e4fa0f8ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:26.216731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df83e86ceeaf4348b17d089e4fa0f8ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:26.228571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df83e86ceeaf4348b17d089e4fa0f8ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:26.229246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df83e86ceeaf4348b17d089e4fa0f8ef'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:26.239498 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3914/7862] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:25 2022] DELETE /identity/v3/users/df83e86ceeaf4348b17d089e4fa0f8ef => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:26.244818 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:26.312609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc3b01-365f-4262-a7be-80c869a3b33e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:26.397587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:26.398856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:26.399195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:26.399484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:26.401716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:26.481594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:26.483258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f4858-bcc7-4652-acc9-e01600779bb3 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:26.511460 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3949/7863] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:21:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:21:27.436999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:27.438562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:27.448868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:27.449755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:27.450178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:27.505745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:27.507247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:27.538654 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3950/7864] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:21:27.564601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:27.572820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:27.629677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f31aa-b8d2-4344-9a2e-bbb26d573e8c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:27.640499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02bac2-2205-44ad-b298-65d35c119939 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:27.641700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02bac2-2205-44ad-b298-65d35c119939 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:27.642140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02bac2-2205-44ad-b298-65d35c119939 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:27.642674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02bac2-2205-44ad-b298-65d35c119939 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:27.656717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343b93-c114-4b7b-95ac-3e566166d0cc admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:27.662299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02bac2-2205-44ad-b298-65d35c119939 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:27.664113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02bac2-2205-44ad-b298-65d35c119939 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:27.670842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:27.672337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:27.672635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:27.673052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] PATH_INFO: `/v3/projects/bcfc0278f6614446b9d7708eca17ab3e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:27.675063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfc0278f6614446b9d7708eca17ab3e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:27.676828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:27.677378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3951/7865] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:21:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:21:27.748060 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:27.755143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfc0278f6614446b9d7708eca17ab3e', 'request_id': 'req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:27.763455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfc0278f6614446b9d7708eca17ab3e', 'request_id': 'req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:27.777088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfc0278f6614446b9d7708eca17ab3e', 'request_id': 'req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:27.802137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] The token cache is being invalidate because project bcfc0278f6614446b9d7708eca17ab3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:27.803256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:27.804125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:27.806407 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3915/7866] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:27 2022] DELETE /identity/v3/projects/bcfc0278f6614446b9d7708eca17ab3e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:27.811237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fc0da-2b37-4339-a729-bd5eebd61ccf None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:27.811672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fc0da-2b37-4339-a729-bd5eebd61ccf None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:27.811784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fc0da-2b37-4339-a729-bd5eebd61ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:27.835949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1f3fc0da-2b37-4339-a729-bd5eebd61ccf None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:27.842037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1f3fc0da-2b37-4339-a729-bd5eebd61ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:27.952871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:27.956125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:27.986998 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:28.012173 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3952/7867] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:28.023981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d169-10c3-41aa-947a-d7be6ae23c16 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.024285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d169-10c3-41aa-947a-d7be6ae23c16 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.024536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d169-10c3-41aa-947a-d7be6ae23c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.063424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0bd6d169-10c3-41aa-947a-d7be6ae23c16 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:28.064733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0bd6d169-10c3-41aa-947a-d7be6ae23c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:28.085085 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3953/7868] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:28.086868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.086868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.087040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.124799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:28.126017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:28.159036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb8dad-e90f-4b02-9df7-45c3e7b834d8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.174583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.175918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.176211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.176510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.188384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:28.244753 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3954/7869] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:28.245801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.259679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c4d1-b00e-4cea-8bc9-7303751fbb94 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.267654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.268334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.268621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.268912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.271213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:28.271528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.276400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.295042 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3955/7870] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:21:28.296417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.299204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:28.303816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.308292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.354159 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3916/7871] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:28.355436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.372751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d68f80-6e59-4b2c-979e-e026e535ce80 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.388089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.388797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.389193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.389949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.391147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.413720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.437528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d12adc-7205-4417-bfab-d8f69104dfcd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.446375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.447655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.448984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.448984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.465246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.467378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3917/7872] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:28 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:28.468746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.471824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.483854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3956/7873] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:21:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:21:28.549643 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:28.613640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31951a5-cfa5-4eff-bd0e-e372235c4045 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.625671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.626808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.631583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.632893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.635737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.640652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.727689 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3918/7874] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:28 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:21:28.727901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.749912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d356f8a-89ef-48b3-ab52-bf76e35816d1 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.763310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.764018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.764315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.764601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.765353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.766997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.787079 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3957/7875] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:28.792902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.814519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed961aa-13ec-4a14-a44e-a44106130df0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.829757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b93b4-f1a7-4708-9c7a-bc12deedc543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.830464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b93b4-f1a7-4708-9c7a-bc12deedc543 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.838815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b93b4-f1a7-4708-9c7a-bc12deedc543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.839126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b93b4-f1a7-4708-9c7a-bc12deedc543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.839929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b93b4-f1a7-4708-9c7a-bc12deedc543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.842272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b93b4-f1a7-4708-9c7a-bc12deedc543 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.876845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3919/7876] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:28.881044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:28.897263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f4ad-7f35-40e2-8bc9-b09ab4303fa5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:28.909249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53ec83-ab05-498a-9ac9-4629d3eb4311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:28.910833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53ec83-ab05-498a-9ac9-4629d3eb4311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.911123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53ec83-ab05-498a-9ac9-4629d3eb4311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.911404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53ec83-ab05-498a-9ac9-4629d3eb4311 admin admin] PATH_INFO: `/v3/projects/328e42b329da4178a1c1548afbe9f7e7/users/f205aebd06da482a8ddd69b2dcdd9461/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:28.947738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53ec83-ab05-498a-9ac9-4629d3eb4311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328e42b329da4178a1c1548afbe9f7e7, user_id=f205aebd06da482a8ddd69b2dcdd9461, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:28.951310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53ec83-ab05-498a-9ac9-4629d3eb4311 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:28.970784 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3958/7877] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:28 2022] PUT /identity/v3/projects/328e42b329da4178a1c1548afbe9f7e7/users/f205aebd06da482a8ddd69b2dcdd9461/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:28.985912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:28.986045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:28.986970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.022981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.023514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.024016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.054742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] MFA Rules not processed for user `f205aebd06da482a8ddd69b2dcdd9461`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:29.055876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:29.057707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:29.059192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:29.116478 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:29.156544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3920/7878] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:29.162421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.181644 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3959/7879] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:21:29.198602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.279497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdde2-db10-4142-af44-6dbd0c1060f9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:29.285604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:29.287058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.287407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.287795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.288693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:29.290960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:29.312611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb0ee9-3c66-415f-8791-618b7a6b9b49 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:29.325078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:29.326089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.326292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.326655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.342220 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3921/7880] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:29 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:29.342989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.346668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:29.351250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:29.355125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:29.373474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3960/7881] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:21:29.374468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.389692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20806f5-7a46-4d4c-8ae2-f0dde6518be2 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:29.476873 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:29.512366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:29.516172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.517110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.517515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.518332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:29.524916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:29.588896 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3961/7882] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:29 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:29.590050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761d26-ccdc-4e58-a018-b4baa896b57d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:29.594957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.615825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:29.616729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.617118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.618116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.620229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:29.622251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec27c3-cd91-4c95-953b-3ea8cc8ce093 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:29.638215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:29.639129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.639617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.642702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.647081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:29.648381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:29.652032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:29.656118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:29.696366 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3962/7883] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:29.697512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.706714 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3922/7884] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:29.769556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1938ed-e424-40ff-93c8-894cd9fe8601 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:29.784214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:29.785243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:29.785625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:29.785821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] PATH_INFO: `/v3/projects/896109e215894a80a4cf24c092fd7b8c/users/07eea17c233249cd86ae06ca2144e92e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:29.839548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=896109e215894a80a4cf24c092fd7b8c, user_id=07eea17c233249cd86ae06ca2144e92e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:29.843774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:29.883339 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3963/7885] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:29 2022] PUT /identity/v3/projects/896109e215894a80a4cf24c092fd7b8c/users/07eea17c233249cd86ae06ca2144e92e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:29.884467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:29.905612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7424d-f8b2-4e5d-ae61-7ee3b94ca62b service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:30.096527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ee4f-852c-48fe-9cc8-82ed1453fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:30.097771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ee4f-852c-48fe-9cc8-82ed1453fc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:30.098068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ee4f-852c-48fe-9cc8-82ed1453fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:30.098350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ee4f-852c-48fe-9cc8-82ed1453fc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:30.099589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ee4f-852c-48fe-9cc8-82ed1453fc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:30.101230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ee4f-852c-48fe-9cc8-82ed1453fc6a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:30.125517 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3923/7886] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:30.128870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:30.147539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655f12-7056-4ecf-8295-9b8be8563eee admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:30.161769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:30.162772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:30.163063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:30.163344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] PATH_INFO: `/v3/projects/896109e215894a80a4cf24c092fd7b8c/users/07eea17c233249cd86ae06ca2144e92e/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:30.168641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896109e215894a80a4cf24c092fd7b8c, user_id=07eea17c233249cd86ae06ca2144e92e, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:30.176837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:30.232793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3964/7887] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:30 2022] PUT /identity/v3/projects/896109e215894a80a4cf24c092fd7b8c/users/07eea17c233249cd86ae06ca2144e92e/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:30.235610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:30.235919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:30.236271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:30.302389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] MFA Rules not processed for user `07eea17c233249cd86ae06ca2144e92e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:30.303242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:30.303874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:30.305152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:30.346102 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:30.399539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf015df-b143-4789-aa54-ee263fc64074 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:30.404095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:30.405632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:30.406148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:30.406694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:30.408851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:30.440720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:30.442359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:30.452417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3924/7888] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:30.465200 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:30.472081 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3965/7889] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:30.492015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10cf24-b277-4eac-8452-568c6d5c3d7f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:30.503773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:30.504449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:30.504735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:30.505013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:30.528657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:30.530394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:30.553459 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3925/7890] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:21:32.711878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:32.931240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9d38-7a9c-4a45-b8a5-063d654dcb87 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:32.976187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:32.979633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:32.980771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:32.981107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:32.983501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:33.025768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:33.029197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:33.082608 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3966/7891] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:34.413210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:34.481389 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:34.553384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3f5cf-93f2-43e0-a4b5-591de97938d9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:34.563633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:34.565051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:34.565051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:34.565225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:34.570958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:34.604979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:34.606570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:34.667966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:34.669821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f59697-4e38-45c1-8b39-4596924ac832 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:34.710332 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3926/7892] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:21:34.759717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b90e-ca6b-4afb-b677-43affaa7e824 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:34.771771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:34.772684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:34.772979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:34.773265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] PATH_INFO: `/v3/users/cdfac6d72aa0476b8fb6cdc11e4b33e8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:34.783425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfac6d72aa0476b8fb6cdc11e4b33e8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:34.785986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:34.877169 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:34.896767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfac6d72aa0476b8fb6cdc11e4b33e8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:34.897734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfac6d72aa0476b8fb6cdc11e4b33e8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:34.921245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfac6d72aa0476b8fb6cdc11e4b33e8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:34.922687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfac6d72aa0476b8fb6cdc11e4b33e8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:34.933225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfac6d72aa0476b8fb6cdc11e4b33e8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:34.971887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:34.973029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:34.973759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:34.980071 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3967/7893] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:34 2022] DELETE /identity/v3/users/cdfac6d72aa0476b8fb6cdc11e4b33e8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:34.994639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:34.995865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:35.124435 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3927/7894] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:35.145349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:35.148722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:35.247486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66c57-ac91-4259-bdde-971572366066 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:35.254748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:35.255990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:35.256537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:35.257681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:35.295808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:35.301938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:35.317427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3968/7895] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:36.584166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:36.593755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:36.674865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f813c9-0aa8-4f76-a021-ccf79d2fc728 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:36.692964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:36.696102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:36.696369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:36.696661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] PATH_INFO: `/v3/projects/9355888886b2404ca713423c59ddad40` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:36.701050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9355888886b2404ca713423c59ddad40)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:36.704406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:36.838377 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9355888886b2404ca713423c59ddad40', 'request_id': 'req-472cb010-4e65-4a61-b80b-291acc65e4d8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:36.852125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9355888886b2404ca713423c59ddad40', 'request_id': 'req-472cb010-4e65-4a61-b80b-291acc65e4d8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:36.865941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9355888886b2404ca713423c59ddad40', 'request_id': 'req-472cb010-4e65-4a61-b80b-291acc65e4d8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:36.869355 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:36.926836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] The token cache is being invalidate because project 9355888886b2404ca713423c59ddad40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:36.927706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:36.929193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:36.933331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-472cb010-4e65-4a61-b80b-291acc65e4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:36.938433 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3928/7896] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:36 2022] DELETE /identity/v3/projects/9355888886b2404ca713423c59ddad40 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:36.946628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ffe8c-90ca-4c84-9851-5e176035a04a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:36.947008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ffe8c-90ca-4c84-9851-5e176035a04a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:36.947537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ffe8c-90ca-4c84-9851-5e176035a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:36.951275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65940da4-79d0-4add-b38a-14eab116a6dd service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:36.968945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1c6ffe8c-90ca-4c84-9851-5e176035a04a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:36.970994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1c6ffe8c-90ca-4c84-9851-5e176035a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:37.071326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.072086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.072520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.072925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.075104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:37.095594 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3929/7897] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:37.097935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.098280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.098611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.138050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:37.140220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:37.165493 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3930/7898] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:37.166823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.174797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.177955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.178743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535ec7d-400e-4254-8047-8517ea47d2a1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:37.189649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.192121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.192426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.192706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.193436 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3969/7899] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:37.193559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:37.193849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.195516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.212586 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3931/7900] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:21:37.213737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.225050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e863-a960-4946-ad9b-102c6ce53a32 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:37.231182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.231922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.232248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.232533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.233228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.235388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.240995 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:37.276446 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3970/7901] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:37 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:37.280353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.296239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c4c4-3289-4b53-b429-c3fe8a2b8cdb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:37.396193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.397300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.402893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.407030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.407887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.410609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.468806 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3932/7902] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:37 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:37.473552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.489237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68da63-3b64-470b-81b7-f2cf30054573 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:37.507193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.509588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.509736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.510578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.513794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.520174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.540345 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3971/7903] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:37.541536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.554473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77177d4-e2b5-40ed-a42f-5db27ef965a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:37.569039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bbd83-eaa9-40d8-937c-d04bd48cdde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.570143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbd83-eaa9-40d8-937c-d04bd48cdde4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.570577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbd83-eaa9-40d8-937c-d04bd48cdde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.570930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbd83-eaa9-40d8-937c-d04bd48cdde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.572306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bbd83-eaa9-40d8-937c-d04bd48cdde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.574254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bbd83-eaa9-40d8-937c-d04bd48cdde4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.595483 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3933/7904] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:37.596088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.609033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c726-656d-465d-bbe3-59cf644dffcd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:37.624253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:37.625363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.625768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.626136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] PATH_INFO: `/v3/projects/b1832ad2e5e94d00ad0dec02c7bbf272/users/a0a8c7cc666443e5beaa27396edac7cb/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.667641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1832ad2e5e94d00ad0dec02c7bbf272, user_id=a0a8c7cc666443e5beaa27396edac7cb, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:37.671427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:37.692560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3972/7905] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:37 2022] PUT /identity/v3/projects/b1832ad2e5e94d00ad0dec02c7bbf272/users/a0a8c7cc666443e5beaa27396edac7cb/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:21:37.704948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:37.705462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:37.705980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:37.747263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] MFA Rules not processed for user `a0a8c7cc666443e5beaa27396edac7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:37.748947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:37.868260 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:37.910136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3934/7906] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:37.914817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:37.995651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2acb0-5568-4aa6-ba4e-a7f6ee9afee7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:38.001910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:38.002798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.003801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.004298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.005567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:38.007572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:38.048369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3973/7907] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:37 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:38.051233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:38.070794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d53426-c0a7-4a16-9a0c-39d8307eb38d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:38.154942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:38.156380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.156676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.156961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.158698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:38.161015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:38.220216 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3935/7908] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:38 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:21:38.223906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:38.247091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf600a-2bc3-45b9-a9c9-c0e716f68977 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:38.258429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:38.259827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.260298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.260784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.261719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:38.263730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:38.281184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3974/7909] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:38.287229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:38.299596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1641-676f-4a90-8c5b-84a3160f776f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:38.320251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e910c0-a1d5-48fb-9807-13a0aa72aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:38.321059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e910c0-a1d5-48fb-9807-13a0aa72aea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.322437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e910c0-a1d5-48fb-9807-13a0aa72aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.322819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e910c0-a1d5-48fb-9807-13a0aa72aea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.328744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e910c0-a1d5-48fb-9807-13a0aa72aea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:38.336156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e910c0-a1d5-48fb-9807-13a0aa72aea3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:38.360936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:38.372190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3936/7910] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:38.374485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d26ea9-0b44-4df7-ba4c-f4a441ff3286 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:38.391040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:38.392111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.392472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.392829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] PATH_INFO: `/v3/projects/fff68d6667264e4693bae53788882f99/users/330a0b304e6c40cd8297c68b98798763/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.424560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff68d6667264e4693bae53788882f99, user_id=330a0b304e6c40cd8297c68b98798763, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:38.433077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:38.471041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.474354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.476282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.479868 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3975/7911] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:38 2022] PUT /identity/v3/projects/fff68d6667264e4693bae53788882f99/users/330a0b304e6c40cd8297c68b98798763/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:38.525162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] MFA Rules not processed for user `330a0b304e6c40cd8297c68b98798763`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:38.526466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:38.722632 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3937/7912] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:38.727138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:38.840259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf51bf-86ad-4db6-9d51-d420be324775 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:38.850329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:38.851350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:38.851803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:38.852878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:38.854375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:38.856320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:38.866175 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:38.931034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3976/7913] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:38 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:38.932221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:38.948097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a0ac6-38a8-48b1-b0e6-c67519338a89 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:39.109022 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:39.138173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:39.138918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:39.139216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:39.139506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:39.140239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:39.142257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:39.222291 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3938/7914] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:21:38 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:21:39.226356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:39.241940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07e81-e03b-4244-a820-a42266a0db52 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:39.258340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:39.259115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:39.259457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:39.259741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:39.260538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:39.263331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:39.287707 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3977/7915] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:39.291420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:39.309548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b255b73-36ab-430c-b406-7a2c7accf232 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:39.320983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:39.321827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:39.322116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:39.322442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] PATH_INFO: `/v3/projects/d05986a6e4d342ad97f0c051109aa785/users/c003725e9b1f4473bacae14da803b37b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:39.375986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05986a6e4d342ad97f0c051109aa785, user_id=c003725e9b1f4473bacae14da803b37b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:39.379520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:39.413092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3939/7916] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:39 2022] PUT /identity/v3/projects/d05986a6e4d342ad97f0c051109aa785/users/c003725e9b1f4473bacae14da803b37b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:39.418117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:39.433629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a6020-95c1-4f30-9048-180badc41255 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:39.602459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed97e3-d09d-42f0-bde4-ebbfe5e57ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:39.603333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed97e3-d09d-42f0-bde4-ebbfe5e57ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:39.603730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed97e3-d09d-42f0-bde4-ebbfe5e57ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:39.604113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed97e3-d09d-42f0-bde4-ebbfe5e57ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:39.604965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed97e3-d09d-42f0-bde4-ebbfe5e57ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:39.607661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed97e3-d09d-42f0-bde4-ebbfe5e57ed1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:39.648257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:39.669736 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3978/7917] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:21:39.671762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd769-098e-43ac-8634-917ffe3f27da admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:39.687207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:39.688489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:39.688987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:39.689523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] PATH_INFO: `/v3/projects/d05986a6e4d342ad97f0c051109aa785/users/c003725e9b1f4473bacae14da803b37b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:39.696964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05986a6e4d342ad97f0c051109aa785, user_id=c003725e9b1f4473bacae14da803b37b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:39.700048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:39.739665 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3940/7918] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:21:39 2022] PUT /identity/v3/projects/d05986a6e4d342ad97f0c051109aa785/users/c003725e9b1f4473bacae14da803b37b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:39.754613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a696-999e-4d28-8aad-275cfa04f8b6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:39.755091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a696-999e-4d28-8aad-275cfa04f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:39.755488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a696-999e-4d28-8aad-275cfa04f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:39.831043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7cd0a696-999e-4d28-8aad-275cfa04f8b6 None None] MFA Rules not processed for user `c003725e9b1f4473bacae14da803b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:39.832309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7cd0a696-999e-4d28-8aad-275cfa04f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:39.994798 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3979/7919] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:40.005336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:40.007741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:40.224290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a77a7-0278-47b0-9cbf-ceaaacd9c814 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:40.263348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:40.264484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:40.264769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:40.265043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:40.457825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:40.460067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:40.489534 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3941/7920] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:21:43.323888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:43.324312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:43.324488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:43.362285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] MFA Rules not processed for user `3fdf1208d2c34fd1b5a24c2ad4e063a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:43.365750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:43.452753 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:43.495378 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3980/7921] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:21:43.944730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:43.947033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:44.005643 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:44.030458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ea109-ae63-4ad9-a6ff-12cdfde98b09 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:44.035220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:44.035897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:44.036233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:44.036519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:44.039711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:44.071535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:44.072993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:44.097071 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3942/7922] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:44.282667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:44.285421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:44.431102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:44.433501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:44.533816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d9647-25f1-4489-ac71-f5d157bf54d5 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:44.544943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:44.546322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:44.547307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:44.548325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:44.559887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:44.618199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:44.623147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:44.655288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6fc3-0cfa-4a25-91cd-ad438591ffe6 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:44.666291 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3981/7923] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:21:44.669419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eea17c233249cd86ae06ca2144e92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896109e215894a80a4cf24c092fd7b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:44.670238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:44.671243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:44.671531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:44.687499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:44.689029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:44.694769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:44.757076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:44.759029 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3943/7924] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:21:44.777165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8807c1-bdd4-4e51-bf0b-818d8becab6b service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:44.786812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eea17c233249cd86ae06ca2144e92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896109e215894a80a4cf24c092fd7b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:44.787510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:44.787803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:44.788089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:44.789559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:44.791553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:44.890691 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3982/7925] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:21:44 2022] POST /identity/v3/projects => generated 348 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:21:44.892709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:44.912967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f5c1d-2949-4d50-b534-87ac24a4ee38 tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:45.140926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eea17c233249cd86ae06ca2144e92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896109e215894a80a4cf24c092fd7b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:45.141822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:45.142210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:45.142660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:45.144094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:21:45.144513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:45.146700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:45.178731 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3944/7926] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:21:47.288501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:47.301456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a074-6ed5-4ca1-8503-d260c545084d tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:47.307816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eea17c233249cd86ae06ca2144e92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896109e215894a80a4cf24c092fd7b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:47.311856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:47.312662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:47.313158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] PATH_INFO: `/v3/projects/8c35d617f97e456d9277c779ea7b176c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:47.319151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c35d617f97e456d9277c779ea7b176c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:47.326481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:47.408806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c35d617f97e456d9277c779ea7b176c', 'request_id': 'req-78722da6-b194-44b7-9c94-3025c11f36be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:47.428392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c35d617f97e456d9277c779ea7b176c', 'request_id': 'req-78722da6-b194-44b7-9c94-3025c11f36be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:47.435933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c35d617f97e456d9277c779ea7b176c', 'request_id': 'req-78722da6-b194-44b7-9c94-3025c11f36be'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:47.463026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] The token cache is being invalidate because project 8c35d617f97e456d9277c779ea7b176c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:47.463601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:47.464535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:47.466666 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3983/7927] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:47 2022] DELETE /identity/v3/projects/8c35d617f97e456d9277c779ea7b176c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:47.494324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:47.496638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:47.635446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f03528-288a-49ab-a738-bb3b88fd036c tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:47.686567 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:47.723657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:47.724656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:47.725106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:47.726025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:47.728062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:47.828623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:47.831268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:47.850226 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3945/7928] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:48.074193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:48.075943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:48.104911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722da6-b194-44b7-9c94-3025c11f36be tempest-RoutersAdminTest-562589097 tempest-RoutersAdminTest-562589097-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:48.127478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:48.128439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:48.128745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:48.129076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:48.137188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:48.243452 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:48.285307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:48.286733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:48.338050 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3984/7929] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:50.037448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:50.059966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebd0be-d56d-4829-a7da-320e1e6241b9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:50.082598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:50.082598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:50.090806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:50.090806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:50.112523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:50.142361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:50.150596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:50.165484 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3946/7930] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:52.667767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:52.672632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:52.907866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916719eb-0b93-4e3f-b916-e0bcb8a944b6 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:52.917376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:52.918540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:52.919281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:52.919711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:52.922771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:53.023983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:53.025917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:53.043138 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3985/7931] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:21:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:21:54.824467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:54.827226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:54.949282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fcdca-e673-489f-b89c-5780ae50a73f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:54.954701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:54.955825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:54.956263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:54.957039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] PATH_INFO: `/v3/users/ec4c77f30b214db293091ef9b4e1acf8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:54.958823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4c77f30b214db293091ef9b4e1acf8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:54.961036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:55.043398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4c77f30b214db293091ef9b4e1acf8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.072920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4c77f30b214db293091ef9b4e1acf8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.099793 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:55.109639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4c77f30b214db293091ef9b4e1acf8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.130076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4c77f30b214db293091ef9b4e1acf8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.131272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4c77f30b214db293091ef9b4e1acf8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.142467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3947/7932] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:54 2022] DELETE /identity/v3/users/ec4c77f30b214db293091ef9b4e1acf8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:55.464040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:55.481076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee4a45-5f9c-4135-b24c-97bf49b12784 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:55.552253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:55.553128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:55.553697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:55.554131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] PATH_INFO: `/v3/projects/3679b71cd94f402a859118909bd7a6c8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:55.555577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3679b71cd94f402a859118909bd7a6c8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:55.557743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:55.587388 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:21:55.631406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3679b71cd94f402a859118909bd7a6c8', 'request_id': 'req-a9e7a577-455c-4cfe-8e4c-1f947ba02413'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.645431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3679b71cd94f402a859118909bd7a6c8', 'request_id': 'req-a9e7a577-455c-4cfe-8e4c-1f947ba02413'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.653785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3679b71cd94f402a859118909bd7a6c8', 'request_id': 'req-a9e7a577-455c-4cfe-8e4c-1f947ba02413'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.675980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] The token cache is being invalidate because project 3679b71cd94f402a859118909bd7a6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:55.675980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.683282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.692718 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3986/7933] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:55 2022] DELETE /identity/v3/projects/3679b71cd94f402a859118909bd7a6c8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:55.692957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:55.693072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:55.711597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d789-6f2e-47be-a93c-c671d1d06651 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:55.794541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:55.795640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:55.796008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:55.796371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] PATH_INFO: `/v3/users/42d1104aa52d45348066a708bc77628b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:55.797746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d1104aa52d45348066a708bc77628b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:55.800444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:55.887743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d1104aa52d45348066a708bc77628b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.904325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d1104aa52d45348066a708bc77628b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.914336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d1104aa52d45348066a708bc77628b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.927417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d1104aa52d45348066a708bc77628b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.928109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-18ac6a9b-f331-4fab-8e6a-7d07457081f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d1104aa52d45348066a708bc77628b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:55.945279 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3948/7934] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:21:55 2022] DELETE /identity/v3/users/42d1104aa52d45348066a708bc77628b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:56.324264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:21:56.326328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:56.355559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a577-455c-4cfe-8e4c-1f947ba02413 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:21:56.453988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:21:56.455970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:56.456263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:56.457373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] PATH_INFO: `/v3/projects/d0afcecbc16b4eb1bb773a65607268dc` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:56.458706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0afcecbc16b4eb1bb773a65607268dc)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:21:56.460710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:21:56.572848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0afcecbc16b4eb1bb773a65607268dc', 'request_id': 'req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:56.595190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0afcecbc16b4eb1bb773a65607268dc', 'request_id': 'req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:56.602942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0afcecbc16b4eb1bb773a65607268dc', 'request_id': 'req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:56.628442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] The token cache is being invalidate because project d0afcecbc16b4eb1bb773a65607268dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:21:56.629006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:56.632861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:21:56.636478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3987/7935] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:21:56 2022] DELETE /identity/v3/projects/d0afcecbc16b4eb1bb773a65607268dc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:21:59.066637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa507518-c9dc-46c4-8a3d-df39419861a3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:21:59.067205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa507518-c9dc-46c4-8a3d-df39419861a3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:21:59.067589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa507518-c9dc-46c4-8a3d-df39419861a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:21:59.101368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fa507518-c9dc-46c4-8a3d-df39419861a3 None None] MFA Rules not processed for user `a0a8c7cc666443e5beaa27396edac7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:21:59.102932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fa507518-c9dc-46c4-8a3d-df39419861a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:21:59.267171 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3949/7936] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:06.624422 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:09.250634 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:19.618842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:19.623121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:19.744082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9052f5-bd1d-4d93-8dd4-e0ccabc24bf5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:19.749503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:19.750565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:19.751429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:19.751738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] PATH_INFO: `/v3/users/3cced2e2903b42f580b9221464af5537` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:19.753013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cced2e2903b42f580b9221464af5537)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:19.755124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:19.835839 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cced2e2903b42f580b9221464af5537'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:19.836715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cced2e2903b42f580b9221464af5537'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:19.872769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cced2e2903b42f580b9221464af5537'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:19.873980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cced2e2903b42f580b9221464af5537'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:19.887297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cced2e2903b42f580b9221464af5537'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:19.903996 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3988/7937] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:19 2022] DELETE /identity/v3/users/3cced2e2903b42f580b9221464af5537 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:19.909005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:19.909491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:19.909711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:19.945065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:19.946944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:20.034438 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3950/7938] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:20.049571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:20.051388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:20.168489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368d7b4-8821-465a-b02a-f106bece56fb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:20.176258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:20.177036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:20.177398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:20.177868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:20.192438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:20.194170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:20.229403 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3989/7939] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:21.058467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:21.061078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:21.082792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedcba-3bd1-4e59-8ca1-517ec407a59e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:21.102976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:21.104134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.105765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.108194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] PATH_INFO: `/v3/projects/629e51ad53db4818a39ffde1ad25fc57` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:21.113840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629e51ad53db4818a39ffde1ad25fc57)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:21.129584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:21.209208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629e51ad53db4818a39ffde1ad25fc57', 'request_id': 'req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.219124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629e51ad53db4818a39ffde1ad25fc57', 'request_id': 'req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.233312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629e51ad53db4818a39ffde1ad25fc57', 'request_id': 'req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.252068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] The token cache is being invalidate because project 629e51ad53db4818a39ffde1ad25fc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:21.252649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.253697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.256886 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3951/7940] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:21 2022] DELETE /identity/v3/projects/629e51ad53db4818a39ffde1ad25fc57 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:21.261335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:21.278598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c6c15-4eae-499c-b22b-0e4a2998b722 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:21.325346 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:21.409156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:21.409879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:21.410272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:21.410821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] PATH_INFO: `/v3/users/ded6cb8baf424f2c957af5266bb06460` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:21.412302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded6cb8baf424f2c957af5266bb06460)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:21.414591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:21.500157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded6cb8baf424f2c957af5266bb06460'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.501003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded6cb8baf424f2c957af5266bb06460'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.520941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded6cb8baf424f2c957af5266bb06460'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.521871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded6cb8baf424f2c957af5266bb06460'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.536986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-695a4a09-8c8b-4d10-be5a-cdc945b28e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded6cb8baf424f2c957af5266bb06460'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:21.563878 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3990/7941] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:21 2022] DELETE /identity/v3/users/ded6cb8baf424f2c957af5266bb06460 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:22.452075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:22.454451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:22.472001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2afd4-adf0-460f-a1ff-3cd0daf14a56 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:22.554644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:22.555832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:22.556315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:22.556801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] PATH_INFO: `/v3/projects/82995d1a851e4817bcd2f0eb28b61bfb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:22.558242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82995d1a851e4817bcd2f0eb28b61bfb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:22.560694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:22.604820 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:22.627207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82995d1a851e4817bcd2f0eb28b61bfb', 'request_id': 'req-e27ac573-9adf-4916-8f2a-26a1e9614426'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:22.634853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82995d1a851e4817bcd2f0eb28b61bfb', 'request_id': 'req-e27ac573-9adf-4916-8f2a-26a1e9614426'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:22.646268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82995d1a851e4817bcd2f0eb28b61bfb', 'request_id': 'req-e27ac573-9adf-4916-8f2a-26a1e9614426'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:22.666261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] The token cache is being invalidate because project 82995d1a851e4817bcd2f0eb28b61bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:22.667231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:22.668007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:22.682519 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3952/7942] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:22 2022] DELETE /identity/v3/projects/82995d1a851e4817bcd2f0eb28b61bfb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:29.856701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:29.857624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:29.857969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:29.877712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] MFA Rules not processed for user `302eed11186a4ce2899c3f2a1100403c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:29.879129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:29.942645 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3991/7943] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:30.221418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:30.223664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:30.297262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ac573-9adf-4916-8f2a-26a1e9614426 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:30.301135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:30.301862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:30.302227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:30.302678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:30.304583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:30.318134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:30.319898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:30.331872 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3953/7944] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:31.163059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:31.164978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:31.256569 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:31.286738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88fdee-f1ff-41cc-aeec-dd8ed918547c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:31.292674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:31.294310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:31.295002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:31.295557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:31.298856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:31.315541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:31.317439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:31.331583 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3992/7945] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:34.793013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:34.794720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:34.893075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac1b7-2aed-4f70-ab12-2eee7fc9c6df service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:34.901675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:34.902822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:34.903305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:34.903896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:34.907365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:34.925891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:34.928003 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:34.948002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3954/7946] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:35.236109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:35.237726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:35.307574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ed34e-304a-4d6e-a721-be52b2aced27 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:35.313688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:35.314607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.314898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.315226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] PATH_INFO: `/v3/users/f205aebd06da482a8ddd69b2dcdd9461` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.316843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f205aebd06da482a8ddd69b2dcdd9461)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:35.318770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:35.437316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f205aebd06da482a8ddd69b2dcdd9461'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:35.443231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f205aebd06da482a8ddd69b2dcdd9461'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:35.457075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:35.468804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f205aebd06da482a8ddd69b2dcdd9461'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:35.470098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f205aebd06da482a8ddd69b2dcdd9461'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:35.474940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7e859-f519-482c-9d0a-fbc85b0db071 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:35.480846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0ed2b583-4710-4075-b427-fbc91baa0f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f205aebd06da482a8ddd69b2dcdd9461'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:35.485843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:35.486591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.486829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.487114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.489255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:35.499899 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3993/7947] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:35 2022] DELETE /identity/v3/users/f205aebd06da482a8ddd69b2dcdd9461 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:35.507053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.507703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.508197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.514216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:35.516856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:35.529935 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3955/7948] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:35.533536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:35.534824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:35.593859 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:35.610660 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3994/7949] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:35.642951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:35.646045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:35.668422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e340b-69df-4db4-934e-61753caa5cc1 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:35.700231 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:35.729526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:35.730432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:35.730750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:35.731029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:35.741642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:35.743125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:35.754815 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3956/7950] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:36.245685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:36.247511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:36.265158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd09f6-8895-44ca-9cc9-a0de43df8e48 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:36.287511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:36.289802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:36.290845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:36.291460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] PATH_INFO: `/v3/projects/328e42b329da4178a1c1548afbe9f7e7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:36.292905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=328e42b329da4178a1c1548afbe9f7e7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:36.298215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.353805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328e42b329da4178a1c1548afbe9f7e7', 'request_id': 'req-74e44d93-0237-4db2-87ca-9849125d2e8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.363404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328e42b329da4178a1c1548afbe9f7e7', 'request_id': 'req-74e44d93-0237-4db2-87ca-9849125d2e8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.369070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328e42b329da4178a1c1548afbe9f7e7', 'request_id': 'req-74e44d93-0237-4db2-87ca-9849125d2e8f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.380320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] The token cache is being invalidate because project 328e42b329da4178a1c1548afbe9f7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:36.380611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.381253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.382927 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3995/7951] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:36 2022] DELETE /identity/v3/projects/328e42b329da4178a1c1548afbe9f7e7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:36.386849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:36.397733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664c20-5f2b-45d7-b6cb-4048a56671cf service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:36.460072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:36.460967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:36.461245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:36.461526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] PATH_INFO: `/v3/users/07eea17c233249cd86ae06ca2144e92e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:36.463894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07eea17c233249cd86ae06ca2144e92e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:36.466017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:36.524425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07eea17c233249cd86ae06ca2144e92e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.538558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07eea17c233249cd86ae06ca2144e92e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.549088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07eea17c233249cd86ae06ca2144e92e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.559244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07eea17c233249cd86ae06ca2144e92e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.559897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9ba541d8-02b6-4709-a35b-5ecd3ad6a970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07eea17c233249cd86ae06ca2144e92e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:36.566940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3957/7952] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:36 2022] DELETE /identity/v3/users/07eea17c233249cd86ae06ca2144e92e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:37.253648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.255256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:37.270293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44d93-0237-4db2-87ca-9849125d2e8f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.356791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.357566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.357855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.358124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] PATH_INFO: `/v3/projects/896109e215894a80a4cf24c092fd7b8c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.360294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=896109e215894a80a4cf24c092fd7b8c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.361907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.417974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896109e215894a80a4cf24c092fd7b8c', 'request_id': 'req-fa1a7739-8e35-49c6-805c-bb6b235128ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:37.428817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896109e215894a80a4cf24c092fd7b8c', 'request_id': 'req-fa1a7739-8e35-49c6-805c-bb6b235128ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:37.441702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896109e215894a80a4cf24c092fd7b8c', 'request_id': 'req-fa1a7739-8e35-49c6-805c-bb6b235128ed'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:37.465967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] The token cache is being invalidate because project 896109e215894a80a4cf24c092fd7b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:37.465967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:37.465967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fa1a7739-8e35-49c6-805c-bb6b235128ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:37.465967 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3996/7953] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:37 2022] DELETE /identity/v3/projects/896109e215894a80a4cf24c092fd7b8c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:37.466405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.466405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.466405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.486708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:37.487978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:37.542673 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:37.563386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3958/7954] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:37.571662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.571968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.572250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.590998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:37.592223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:37.600885 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3997/7955] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:37.605085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.616178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7101-ffdc-44be-9a60-e79c17ea226e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.623213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.623969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.624168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.624445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.625815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:37.625815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.627885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.645539 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3959/7956] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:37.646766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.651456 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:37.657278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be077a-c7d6-428f-9fa8-024e1318c84a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.664259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.665444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.665444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.665753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.666999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.669583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.699984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3998/7957] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:37 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:37.704177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.716347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f2320-8553-4e96-a9ab-94d36d2fa664 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.783092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.783833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.784127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.784408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.785099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.787124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.811821 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3960/7958] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:37 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:37.813889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.825938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0b85-cc77-4f32-a219-05a47197b577 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.832345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.833346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.833643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.833928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.834736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.836388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.853664 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 3999/7959] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:37.855201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.870333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362cfb6-7387-4eec-b8a7-81aee81322ba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.876025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab398-72be-4d25-ac7e-f165eebeafbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.876700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab398-72be-4d25-ac7e-f165eebeafbe admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.876992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab398-72be-4d25-ac7e-f165eebeafbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.877460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab398-72be-4d25-ac7e-f165eebeafbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.878144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab398-72be-4d25-ac7e-f165eebeafbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.879764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab398-72be-4d25-ac7e-f165eebeafbe admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.894578 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3961/7960] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:37.896678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:37.907533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea594-16bc-43de-a3c5-b438adc57c8c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:37.913135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:37.914045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.914338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.914666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] PATH_INFO: `/v3/projects/0819c709b6e84059849fe20ffea1b87c/users/ae99c518b7cf466fbaaa76653e011da0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.931452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0819c709b6e84059849fe20ffea1b87c, user_id=ae99c518b7cf466fbaaa76653e011da0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:37.933930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:37.958984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4000/7961] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:37 2022] PUT /identity/v3/projects/0819c709b6e84059849fe20ffea1b87c/users/ae99c518b7cf466fbaaa76653e011da0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:37.962155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:37.962466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:37.962826 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:37.999626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] MFA Rules not processed for user `ae99c518b7cf466fbaaa76653e011da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:38.001317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:38.118795 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3962/7962] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:38.130821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:38.132788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:38.215235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33277a8-8ddb-4981-b1aa-5adc01bd7239 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:38.220967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:38.221733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:38.222128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:38.222482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:38.235975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:38.237591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:38.252918 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4001/7963] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:39.204050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:39.208447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:39.289545 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:39.337338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58a9e6-d29d-4281-9857-73beb48def06 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:39.343809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:39.344722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:39.345155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:39.345439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:39.347287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:39.363664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:39.365745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:39.388071 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3963/7964] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:39.995082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:39.997222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:40.110880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0de2f-029e-404c-bfe3-97427feba338 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:40.116276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:40.117241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.117440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.117721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] PATH_INFO: `/v3/users/3a10dc703c4d442ea62abfddf18cf507` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:40.119067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a10dc703c4d442ea62abfddf18cf507)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:40.121079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:40.194259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a10dc703c4d442ea62abfddf18cf507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.195358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a10dc703c4d442ea62abfddf18cf507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.197652 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:40.216247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a10dc703c4d442ea62abfddf18cf507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.217337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a10dc703c4d442ea62abfddf18cf507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.230827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c761e7a3-420c-46cb-839b-ac9b302dd722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a10dc703c4d442ea62abfddf18cf507'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.251170 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4002/7965] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:39 2022] DELETE /identity/v3/users/3a10dc703c4d442ea62abfddf18cf507 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:40.459475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:40.474077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af417e-13f3-427c-b6f5-1bba74e736d1 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:40.564022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:40.565145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.565582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.566286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] PATH_INFO: `/v3/projects/22b32c130d2547519149383827ed1c4c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:40.567612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b32c130d2547519149383827ed1c4c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:40.569541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:40.633064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b32c130d2547519149383827ed1c4c', 'request_id': 'req-05362edb-1e7c-41dc-a6ff-8e3e97361c94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.640415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b32c130d2547519149383827ed1c4c', 'request_id': 'req-05362edb-1e7c-41dc-a6ff-8e3e97361c94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.651255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b32c130d2547519149383827ed1c4c', 'request_id': 'req-05362edb-1e7c-41dc-a6ff-8e3e97361c94'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.664749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] The token cache is being invalidate because project 22b32c130d2547519149383827ed1c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:40.665064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.665887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-05362edb-1e7c-41dc-a6ff-8e3e97361c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:40.667750 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3964/7966] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:40 2022] DELETE /identity/v3/projects/22b32c130d2547519149383827ed1c4c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:40.674594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.674862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.675144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:40.699979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:40.702924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:40.767663 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4003/7967] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:40.775290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.775586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.775867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:40.796469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:40.797764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:40.806671 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3965/7968] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:40.810597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:40.822095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb86f-67b9-4331-8407-bedff6df2e38 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:40.827322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:40.828132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.829431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.831262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:40.831262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:40.831262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:40.832876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:40.851799 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4004/7969] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:40.856242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:40.869320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba206423-361c-45da-904d-cda85e97ae55 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:40.876590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:40.877524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.877832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.878218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:40.879087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:40.881177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:40.918347 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3966/7970] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:40 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:40.923456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:40.934165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b562a-4bd1-4423-bc42-6dfe0a511284 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:40.997916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:40.998840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:40.999194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:40.999310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.000011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.002678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.023512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4005/7971] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:40 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:41.027464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.040046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab80f-d971-4845-bbbd-5cd0d0147d93 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.055044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.055956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.056373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.057357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.058429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.060146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.077640 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3967/7972] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:41.081679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.093072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b7421-b9ff-49e4-9980-4a553daa8aa9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.099719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37931d5-270e-44eb-bafa-f449ca8ca7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.100632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37931d5-270e-44eb-bafa-f449ca8ca7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.100924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37931d5-270e-44eb-bafa-f449ca8ca7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.101650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37931d5-270e-44eb-bafa-f449ca8ca7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.102759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37931d5-270e-44eb-bafa-f449ca8ca7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.104558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37931d5-270e-44eb-bafa-f449ca8ca7a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.117344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4006/7973] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:41.121384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.151989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96751d31-55fc-48d3-af45-8d6a50f84e77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.153017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.154000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.154358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.154812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] PATH_INFO: `/v3/projects/7f40beeb8f31425b8d5e34abae2a7deb/users/0f38d3c0e4594cfdb959f5885f2ea873/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.181317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f40beeb8f31425b8d5e34abae2a7deb, user_id=0f38d3c0e4594cfdb959f5885f2ea873, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.185509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.199843 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:41.210009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3968/7974] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:41 2022] PUT /identity/v3/projects/7f40beeb8f31425b8d5e34abae2a7deb/users/0f38d3c0e4594cfdb959f5885f2ea873/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:41.223804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.225340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.225845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.261515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] MFA Rules not processed for user `0f38d3c0e4594cfdb959f5885f2ea873`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:41.262539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:41.291004 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:41.346259 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4007/7975] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:41.351026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.432052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672754ce-c75f-4801-a435-59a8277d1a52 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.443445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.444133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.444434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.444699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.445408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.447494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.490542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3969/7976] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:41 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:41.492429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.505935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f31529-e2c2-48c2-8ec0-39134a92b77f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.596968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.597905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.598201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.598483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.599321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.601434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.638302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.646154 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4008/7977] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:41 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:41.657452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26447fc8-33d4-4156-8030-fe2276063adf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.671105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.671908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.672484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.672602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.674479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.676418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.707714 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3970/7978] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:41.708617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.721564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b909-9246-49db-8fda-c4bfad7403d8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.727359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.728430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.728876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.729444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] PATH_INFO: `/v3/projects/95b25e8bc4f64d4999ab86186a467c49/users/41fb5d1872964896a2cb256af1c646b2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.748283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b25e8bc4f64d4999ab86186a467c49, user_id=41fb5d1872964896a2cb256af1c646b2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.752089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.775910 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4009/7979] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:41 2022] PUT /identity/v3/projects/95b25e8bc4f64d4999ab86186a467c49/users/41fb5d1872964896a2cb256af1c646b2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:41.777170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.791757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09610e-1be2-4da9-8e2f-5f0c9389da01 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.884102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d18e44-c4dd-4eaf-a19f-5cb39a3e485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.884759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d18e44-c4dd-4eaf-a19f-5cb39a3e485d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.885051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d18e44-c4dd-4eaf-a19f-5cb39a3e485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.885340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d18e44-c4dd-4eaf-a19f-5cb39a3e485d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.886938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d18e44-c4dd-4eaf-a19f-5cb39a3e485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.903161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d18e44-c4dd-4eaf-a19f-5cb39a3e485d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.922597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3971/7980] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:41.925425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:41.938643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c42d5-7814-48de-b55c-7e6cb0510d9c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:41.951071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:41.951991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.952506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.952715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] PATH_INFO: `/v3/projects/95b25e8bc4f64d4999ab86186a467c49/users/41fb5d1872964896a2cb256af1c646b2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.955574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b25e8bc4f64d4999ab86186a467c49, user_id=41fb5d1872964896a2cb256af1c646b2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:41.958233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:41.980942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:41.981246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:41.981625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:41.984407 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4010/7981] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:41 2022] PUT /identity/v3/projects/95b25e8bc4f64d4999ab86186a467c49/users/41fb5d1872964896a2cb256af1c646b2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:42.080847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] MFA Rules not processed for user `41fb5d1872964896a2cb256af1c646b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:42.082099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:42.163528 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:42.176993 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3972/7982] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:42.182182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.200902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19123a83-530c-4c1a-a5e5-e200637d86eb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.213532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.214281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.214467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.215801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.215801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.217102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invalid input for field 'name': '' is too short Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: On instance['name']: Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: On instance['name']: Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: '' Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise error Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application '' Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.232499 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 15:22:42.233917 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application '' Jul 11 15:22:42.235044 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:42.239045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.244868 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4011/7983] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:22:42 2022] POST /identity/v3/domains => generated 283 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:22:42.249470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11635f-4e37-470c-88cd-d757473ea0cf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.259876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.263092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.263521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.264008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.264865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.275443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: On instance['name']: Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: On instance['name']: Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise error Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.282086 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 11 15:22:42.283201 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application On instance['name']: Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.284173 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3973/7984] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:22:42 2022] POST /identity/v3/domains => generated 412 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 11 15:22:42.288449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.311844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e235bc-05bc-46a3-bbb9-3f3ac3347f2d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.324704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.325462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.325626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.325916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.326688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.329024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.380032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4012/7985] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:22:42 2022] POST /identity/v3/domains => generated 276 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:42.383759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.405675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488278d1-9e40-4e7e-a7fe-e49d768bfcd7 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.513035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.514032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.514590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.515134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/b72be44301ff4065934a5317bbd87c70` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.538108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b72be44301ff4065934a5317bbd87c70)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.540742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 11 15:22:42.581596 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 11 15:22:42.582440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:42.596589 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3974/7986] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:42 2022] DELETE /identity/v3/domains/b72be44301ff4065934a5317bbd87c70 => generated 120 bytes in 210 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:22:42.599668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.612142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c55276-b5f4-4b15-acb1-f7266d8382be tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.624083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.625730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.626206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.627137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/b72be44301ff4065934a5317bbd87c70` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.629996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b72be44301ff4065934a5317bbd87c70)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.635030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.683302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b72be44301ff4065934a5317bbd87c70'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:42.684373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b72be44301ff4065934a5317bbd87c70'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:42.735525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b72be44301ff4065934a5317bbd87c70'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:42.736317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b72be44301ff4065934a5317bbd87c70'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:42.741881 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4013/7987] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:22:42 2022] PATCH /identity/v3/domains/b72be44301ff4065934a5317bbd87c70 => generated 277 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:42.743128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:42.744894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:42.767398 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019414cf-56ed-49cb-9d8f-a86822ad5b5d tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:42.851828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:42.852959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:42.853321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:42.853680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/b72be44301ff4065934a5317bbd87c70` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:42.873705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b72be44301ff4065934a5317bbd87c70)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:42.875935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:42.908740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b72be44301ff4065934a5317bbd87c70'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:42.915366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b72be44301ff4065934a5317bbd87c70'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:42.986849 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:42.998545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72be44301ff4065934a5317bbd87c70', 'request_id': 'req-0b7f130f-591e-4732-aada-3a0ae752ae9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.007987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72be44301ff4065934a5317bbd87c70', 'request_id': 'req-0b7f130f-591e-4732-aada-3a0ae752ae9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.028232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72be44301ff4065934a5317bbd87c70', 'request_id': 'req-0b7f130f-591e-4732-aada-3a0ae752ae9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.044141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] The token cache is being invalidate because project b72be44301ff4065934a5317bbd87c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:43.045119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.045872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.058103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b72be44301ff4065934a5317bbd87c70', 'request_id': 'req-0b7f130f-591e-4732-aada-3a0ae752ae9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.062305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b72be44301ff4065934a5317bbd87c70', 'request_id': 'req-0b7f130f-591e-4732-aada-3a0ae752ae9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.064085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b72be44301ff4065934a5317bbd87c70', 'request_id': 'req-0b7f130f-591e-4732-aada-3a0ae752ae9b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.071601 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3975/7988] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:42 2022] DELETE /identity/v3/domains/b72be44301ff4065934a5317bbd87c70 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:43.076815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:43.091686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8a3d-9e58-4df2-b029-69ba08cbfbe8 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:43.115166 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:43.192612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:43.192612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:43.193933 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:43.195163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/0177a727694740b2a590860b9dfd9f7f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:43.206836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Could not find domain: 0177a727694740b2a590860b9dfd9f7f.: keystone.exception.DomainNotFound: Could not find domain: 0177a727694740b2a590860b9dfd9f7f. Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0177a727694740b2a590860b9dfd9f7f. Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:22:43.219951 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:22:43.220910 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application with Lock( Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:22:43.223304 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0177a727694740b2a590860b9dfd9f7f. Jul 11 15:22:43.224215 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.224215 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4014/7989] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:43 2022] DELETE /identity/v3/domains/0177a727694740b2a590860b9dfd9f7f => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:22:43.226836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:43.228713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:43.242164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f130f-591e-4732-aada-3a0ae752ae9b tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:43.247012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:43.247693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:43.247983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:43.248874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:43.248995 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:43.251181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:43.273014 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3976/7990] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:22:43 2022] POST /identity/v3/domains => generated 252 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:43.276996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:43.298257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22edc5e-3c06-4d9d-84c4-b8eaaa26e043 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:43.385143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:43.385903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:43.386162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:43.386446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:43.387240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:43.389200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:43.402270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.sql.core [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-642443994' for key 'project.ixu_project_name_domain_id'") Jul 11 15:22:43.402270 n-d-master-1 devstack@keystone.service[80989]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:22:43.402270 n-d-master-1 devstack@keystone.service[80989]: [parameters: {'id': '17d8ead7158c4997885a2f2372fe199f', 'name': 'tempest-domain-dup-642443994', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 11 15:22:43.402270 n-d-master-1 devstack@keystone.service[80989]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80989) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-642443994.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-642443994. Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:22:43.433844 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result.read() Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-642443994' for key 'project.ixu_project_name_domain_id'") Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 15:22:43.434926 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application yield resource Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise self.value Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application session.commit() Jul 11 15:22:43.436179 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:22:43.437522 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:22:43.438709 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application result.read() Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:22:43.439605 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-642443994' for key 'project.ixu_project_name_domain_id'") Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [parameters: {'id': '17d8ead7158c4997885a2f2372fe199f', 'name': 'tempest-domain-dup-642443994', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.440728 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-642443994. Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:22:43.441932 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-642443994. Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:22:43.443346 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4015/7991] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:22:43 2022] POST /identity/v3/domains => generated 211 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:22:43.444447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:43.456271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44c12-1134-4ef9-bd22-b50664eb8530 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:43.461967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:43.463084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:43.463353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:43.463711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/bbe407ac2eef4105b02bbd980cc7be08` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:43.480587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bbe407ac2eef4105b02bbd980cc7be08)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:43.482979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:43.507822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.509050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.565672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.569346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.577135 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3977/7992] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:22:43 2022] PATCH /identity/v3/domains/bbe407ac2eef4105b02bbd980cc7be08 => generated 253 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:43.577337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:43.579769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:43.601395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d3ef5-7871-4364-adf5-8653dad4e2e4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:43.685594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:43.687152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:43.687458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:43.688286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/bbe407ac2eef4105b02bbd980cc7be08` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:43.717654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bbe407ac2eef4105b02bbd980cc7be08)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:43.722366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:43.756410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.760224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.796595 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:43.826127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08', 'request_id': 'req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.838902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08', 'request_id': 'req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.849847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08', 'request_id': 'req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.877901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] The token cache is being invalidate because project bbe407ac2eef4105b02bbd980cc7be08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:43.878405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.879221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.890298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08', 'request_id': 'req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.891727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08', 'request_id': 'req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.896018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bbe407ac2eef4105b02bbd980cc7be08', 'request_id': 'req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:43.907175 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4016/7993] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:43 2022] DELETE /identity/v3/domains/bbe407ac2eef4105b02bbd980cc7be08 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:43.908512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:43.921813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88ef72-827a-44af-b927-41ecb965e45e tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:43.993429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e19b-71d8-41a4-b773-d3ffabaeded4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41fb5d1872964896a2cb256af1c646b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95b25e8bc4f64d4999ab86186a467c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:43.994178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e19b-71d8-41a4-b773-d3ffabaeded4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:43.995052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e19b-71d8-41a4-b773-d3ffabaeded4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:43.995169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e19b-71d8-41a4-b773-d3ffabaeded4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] PATH_INFO: `/v3/domains/b72be44301ff4065934a5317bbd87c70` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.003609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149e19b-71d8-41a4-b773-d3ffabaeded4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-b149e19b-71d8-41a4-b773-d3ffabaeded4 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Could not find domain: b72be44301ff4065934a5317bbd87c70.: keystone.exception.DomainNotFound: Could not find domain: b72be44301ff4065934a5317bbd87c70. Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b72be44301ff4065934a5317bbd87c70. Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:22:44.015242 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:22:44.016440 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application with Lock( Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:22:44.017530 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b72be44301ff4065934a5317bbd87c70. Jul 11 15:22:44.018684 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:22:44.022892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:44.024419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.026724 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3978/7994] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:22:43 2022] PATCH /identity/v3/domains/b72be44301ff4065934a5317bbd87c70 => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:22:44.129150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ac02-e0fd-4010-84eb-6b1fc725a6f9 tempest-DomainsNegativeTestJSON-328664663 tempest-DomainsNegativeTestJSON-328664663-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:44.137633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:44.138579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.138874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.139432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] PATH_INFO: `/v3/users/0f38d3c0e4594cfdb959f5885f2ea873` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.140799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f38d3c0e4594cfdb959f5885f2ea873)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:44.142773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:44.260412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f38d3c0e4594cfdb959f5885f2ea873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.262922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f38d3c0e4594cfdb959f5885f2ea873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.284455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f38d3c0e4594cfdb959f5885f2ea873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.285323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f38d3c0e4594cfdb959f5885f2ea873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.301500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f38d3c0e4594cfdb959f5885f2ea873'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.321785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4017/7995] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:44 2022] DELETE /identity/v3/users/0f38d3c0e4594cfdb959f5885f2ea873 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:44.326147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.326445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.326772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.359070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:44.363948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.364177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:44.365665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.385514 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=21,keystone:SELECT=77,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:44.421794 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:44.447228 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3979/7996] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:44.457560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:44.457744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4b4-19a3-41dd-b461-a71d15f1a99a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:44.459106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.463289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:44.464616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.465009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.465974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] PATH_INFO: `/v3/users/ae99c518b7cf466fbaaa76653e011da0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.467475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae99c518b7cf466fbaaa76653e011da0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:44.470121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:44.530155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae99c518b7cf466fbaaa76653e011da0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.530874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae99c518b7cf466fbaaa76653e011da0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.533191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228fa7-501b-4324-9ba2-5b7f48ae0e01 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:44.538441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:44.539522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.539974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.540314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.542304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.546465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae99c518b7cf466fbaaa76653e011da0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.547799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae99c518b7cf466fbaaa76653e011da0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.556619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae99c518b7cf466fbaaa76653e011da0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:44.556784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:44.558226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14394566-8d06-4a51-804a-5deb45f09922 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:44.570167 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3980/7997] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:22:44.576300 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4018/7998] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:44 2022] DELETE /identity/v3/users/ae99c518b7cf466fbaaa76653e011da0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:44.580687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48931a-097c-41d8-8389-198194936cdc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.581186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48931a-097c-41d8-8389-198194936cdc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.581469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48931a-097c-41d8-8389-198194936cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.603098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cc48931a-097c-41d8-8389-198194936cdc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:44.604576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cc48931a-097c-41d8-8389-198194936cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.675069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3981/7999] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:44.686946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:44.688584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.763596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d34615-0566-41f1-b499-1e8e0c422138 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:44.768215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:44.768952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.769693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.770053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.783478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:44.786629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:44.796324 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4019/8000] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:44.954729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48931a-097c-41d8-8389-198194936cdc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:44.956277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cc48931a-097c-41d8-8389-198194936cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:44.969952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48931a-097c-41d8-8389-198194936cdc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:44.976417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:44.977305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:44.977591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:44.977891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] PATH_INFO: `/v3/projects/7f40beeb8f31425b8d5e34abae2a7deb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:44.987114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f40beeb8f31425b8d5e34abae2a7deb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:44.989326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.056840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.065693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.081453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f40beeb8f31425b8d5e34abae2a7deb', 'request_id': 'req-8a17df39-2008-4aa0-a5f2-446580073ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.081658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795b82d-5480-4fcb-8fb6-cb59df8f53ba service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.096573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f40beeb8f31425b8d5e34abae2a7deb', 'request_id': 'req-8a17df39-2008-4aa0-a5f2-446580073ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.109271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f40beeb8f31425b8d5e34abae2a7deb', 'request_id': 'req-8a17df39-2008-4aa0-a5f2-446580073ad6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.124817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] The token cache is being invalidate because project 7f40beeb8f31425b8d5e34abae2a7deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:45.125147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.125258 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:45.126130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.127875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3982/8001] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:44 2022] DELETE /identity/v3/projects/7f40beeb8f31425b8d5e34abae2a7deb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:45.132426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.135181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.151018 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:45.162223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.163484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.163819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.164133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] PATH_INFO: `/v3/projects/0819c709b6e84059849fe20ffea1b87c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.165336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0819c709b6e84059849fe20ffea1b87c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.167306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.215218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17df39-2008-4aa0-a5f2-446580073ad6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.226412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0819c709b6e84059849fe20ffea1b87c', 'request_id': 'req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.236584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0819c709b6e84059849fe20ffea1b87c', 'request_id': 'req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.243801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0819c709b6e84059849fe20ffea1b87c', 'request_id': 'req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.257863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] The token cache is being invalidate because project 0819c709b6e84059849fe20ffea1b87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:45.258237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.259343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-14bc68d6-0115-44cb-8ed1-ba6d6001f99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.260922 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4020/8002] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:45 2022] DELETE /identity/v3/projects/0819c709b6e84059849fe20ffea1b87c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:45.265991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35158b-7378-4a38-9607-0e1b365713d1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.265991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35158b-7378-4a38-9607-0e1b365713d1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.266398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35158b-7378-4a38-9607-0e1b365713d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.292374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ce35158b-7378-4a38-9607-0e1b365713d1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:45.293586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ce35158b-7378-4a38-9607-0e1b365713d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.298101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.299020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.299308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.299587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] PATH_INFO: `/v3/users/41fb5d1872964896a2cb256af1c646b2` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.300797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fb5d1872964896a2cb256af1c646b2)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.302769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.318636 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4021/8003] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:45.368229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fb5d1872964896a2cb256af1c646b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.387058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fb5d1872964896a2cb256af1c646b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.398931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fb5d1872964896a2cb256af1c646b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.409540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fb5d1872964896a2cb256af1c646b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.410305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fb5d1872964896a2cb256af1c646b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.414962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.416135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.416975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.418199 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3983/8004] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:45 2022] DELETE /identity/v3/users/41fb5d1872964896a2cb256af1c646b2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:45.442182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:45.443617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.523498 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4022/8005] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:45.527656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.540312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfea19c-2e9f-42fc-9283-15ed03ec8b35 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.547420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.547939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.548225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.548890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.549923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:45.550238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.552517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.571747 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3984/8006] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:45.572906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.583886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8401fc-6648-4377-b6d8-43d49dc37ca1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.598123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.599228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.599612 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.599990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.601063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.603967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.638538 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4023/8007] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:45.640380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.653283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75858c-8509-41a4-82ca-8081b4330bd8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.679877 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:45.731058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.733242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.734565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.735386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.735767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.736158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.737257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.739295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.749333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca886e7-859f-47ca-9845-ed9f8f3934c1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.755434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.756728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.757000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.757283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] PATH_INFO: `/v3/projects/95b25e8bc4f64d4999ab86186a467c49` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.759706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b25e8bc4f64d4999ab86186a467c49)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.769580 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3985/8008] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:45.769791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.773505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.784226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452df5-1396-4ea7-95d5-dfd33b89fc62 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.792249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.792942 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.793233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.793517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.794245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.795937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.807483 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3986/8009] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:45.810652 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:45.811756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.822413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7845-aaf5-434d-a41e-00da4f14e113 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.835043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b25e8bc4f64d4999ab86186a467c49', 'request_id': 'req-b20043de-a526-4cad-9fdc-3bf898e76c5b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.843821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b25e8bc4f64d4999ab86186a467c49', 'request_id': 'req-b20043de-a526-4cad-9fdc-3bf898e76c5b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.852124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b25e8bc4f64d4999ab86186a467c49', 'request_id': 'req-b20043de-a526-4cad-9fdc-3bf898e76c5b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.868184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] The token cache is being invalidate because project 95b25e8bc4f64d4999ab86186a467c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:45.868482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.869182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b20043de-a526-4cad-9fdc-3bf898e76c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:45.871324 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4024/8010] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:45 2022] DELETE /identity/v3/projects/95b25e8bc4f64d4999ab86186a467c49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:45.876709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.877097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.877468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.892652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a9a36-cb43-492d-a648-cd259e3b611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.893642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a9a36-cb43-492d-a648-cd259e3b611b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.893992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a9a36-cb43-492d-a648-cd259e3b611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.894336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a9a36-cb43-492d-a648-cd259e3b611b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.895196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a9a36-cb43-492d-a648-cd259e3b611b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.897316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a9a36-cb43-492d-a648-cd259e3b611b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.898017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:45.899446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.910569 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4025/8011] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:45.910743 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3987/8012] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:45.913065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.914396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.916744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.917085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.917374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.928069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e661e-0e03-4e6d-bb61-49f8d8a22b8a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.933913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92a3a5-7ba1-4d9c-a3a7-db0043ec81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.934871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a3a5-7ba1-4d9c-a3a7-db0043ec81dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.935157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a3a5-7ba1-4d9c-a3a7-db0043ec81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.935436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a3a5-7ba1-4d9c-a3a7-db0043ec81dc admin admin] PATH_INFO: `/v3/projects/861c9e3f7b824951a00cf79de712c312/users/b801c09362f6419b9396fb6b1f7ec61c/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.939660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:45.941565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:45.950137 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3988/8013] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:45.952865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92a3a5-7ba1-4d9c-a3a7-db0043ec81dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=861c9e3f7b824951a00cf79de712c312, user_id=b801c09362f6419b9396fb6b1f7ec61c, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.957013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:45.957273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92a3a5-7ba1-4d9c-a3a7-db0043ec81dc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.966307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68ebb-90bc-4664-947a-b47b93e51147 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:45.971900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:45.972612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.972899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.973173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.973929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:45.974236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:45.985532 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4026/8014] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:45 2022] PUT /identity/v3/projects/861c9e3f7b824951a00cf79de712c312/users/b801c09362f6419b9396fb6b1f7ec61c/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:45.985734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:45.990221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:45.990622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:45.990974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:45.998424 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3989/8015] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:22:46.003033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.017194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fab28-054a-4d12-af38-7f442fdd1d01 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.024328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] MFA Rules not processed for user `b801c09362f6419b9396fb6b1f7ec61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:46.025628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:46.086412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.087124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.087418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.087699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.088397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.090453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.115723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4027/8016] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:46.134028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.138401 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3990/8017] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:46 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:46.138570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:46.139457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.161069 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:46.217837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36bcc3-ad99-4f9c-8f2b-d620b0098efa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.255705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542922-90ae-4b4c-8119-5833e3730f14 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.261988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.262369 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:46.262889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.262985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.263248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.263945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.266185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.293357 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3991/8018] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:46 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:46.294444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.302837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.303822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.304131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.304420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.306662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6ac54-15d4-40ed-aa3f-f0db3acb7a11 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.314819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.315431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.315723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.316259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.316997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.318664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.333009 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3992/8019] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:46.334285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.345543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e47b-7093-41fc-bbaf-2144260cff7a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.354101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.354804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.355097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.355381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.356124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.357738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.370546 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3993/8020] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:46.374296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.388022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a9d9-649e-4f6d-ad6b-46cdd0018dbb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.388224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.389661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.393385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70176df7-a653-4623-a594-963e6efaf777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.395509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70176df7-a653-4623-a594-963e6efaf777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.395509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70176df7-a653-4623-a594-963e6efaf777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.395509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70176df7-a653-4623-a594-963e6efaf777 admin admin] PATH_INFO: `/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11/users/a018e018f3f14ec3a880e262c62c5638/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.404495 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4028/8021] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:22:46.417071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.418455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70176df7-a653-4623-a594-963e6efaf777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73007dcc95fa480a8c446eb6ea7b4e11, user_id=a018e018f3f14ec3a880e262c62c5638, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.422402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70176df7-a653-4623-a594-963e6efaf777 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.432804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c1f9a-0805-455d-9595-6ad6cbdeb87d service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.436966 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3994/8022] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:46 2022] PUT /identity/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11/users/a018e018f3f14ec3a880e262c62c5638/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:46.504935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.505929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.506350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.506600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] PATH_INFO: `/v3/users/b801c09362f6419b9396fb6b1f7ec61c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.507910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b801c09362f6419b9396fb6b1f7ec61c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.510102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.515687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.515991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.516278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.544916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] MFA Rules not processed for user `a018e018f3f14ec3a880e262c62c5638`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:46.546337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:46.571775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b801c09362f6419b9396fb6b1f7ec61c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:46.572624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b801c09362f6419b9396fb6b1f7ec61c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:46.587310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b801c09362f6419b9396fb6b1f7ec61c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:46.588114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b801c09362f6419b9396fb6b1f7ec61c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:46.598232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ed12590e-62f8-4949-bf47-d8ca2609059b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b801c09362f6419b9396fb6b1f7ec61c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:46.612770 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4029/8023] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:46 2022] DELETE /identity/v3/users/b801c09362f6419b9396fb6b1f7ec61c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:46.617467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.617831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.618210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.619694 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3995/8024] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:46.624126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.626645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:46.632082 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:46.639932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0540d9-2c56-44bf-af32-8c4c368c66e6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.644925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:46.647481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:46.685797 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:46.710656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.711468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.711759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.712044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.712733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.714998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.717556 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4030/8025] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:46.728248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.731259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:46.747034 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3996/8026] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:46 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:46.751085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.799704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f574-d342-444b-90e1-ab411064dff8 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.825149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf884e-58b6-449a-852f-57e317461bdf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.831916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.832817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.833387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.833825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.834965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.837065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.861029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.861783 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3997/8027] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:46 2022] POST /identity/v3/users => generated 301 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:46.862881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.863405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.863785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.865432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.875722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.876440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63e14d-416c-42ba-ad9e-5b302a2861ad admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.877420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.881994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.882764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.883051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.883592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.884328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.885923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.890635 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4031/8028] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:22:46.898670 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3998/8029] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:46.902623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.913511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb10373-4f69-4f05-9bf7-5d79f3ee0126 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:46.918712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:46.919641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:46.919930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:46.920208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] PATH_INFO: `/v3/projects/b545f68412554c98aa0232cc3e20db2a/users/ed0f640563654a5994e2b3eb2f49c97c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:46.942028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b545f68412554c98aa0232cc3e20db2a, user_id=ed0f640563654a5994e2b3eb2f49c97c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:46.944711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:46.960975 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4032/8030] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:46 2022] PUT /identity/v3/projects/b545f68412554c98aa0232cc3e20db2a/users/ed0f640563654a5994e2b3eb2f49c97c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:46.965144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:46.975825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0dc72-f0c0-4b85-a954-02322c37520f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.050429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d68f9-6b28-422a-b603-1fb105592e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.051213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d68f9-6b28-422a-b603-1fb105592e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.051574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d68f9-6b28-422a-b603-1fb105592e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.051927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d68f9-6b28-422a-b603-1fb105592e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.054954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d68f9-6b28-422a-b603-1fb105592e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.057636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d68f9-6b28-422a-b603-1fb105592e85 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.075676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 3999/8031] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:47.076124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.088429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804711e-3e3a-4f3e-a3b0-a3e766c61904 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.093671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.094792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.094915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.095191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] PATH_INFO: `/v3/projects/b545f68412554c98aa0232cc3e20db2a/users/ed0f640563654a5994e2b3eb2f49c97c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.097925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b545f68412554c98aa0232cc3e20db2a, user_id=ed0f640563654a5994e2b3eb2f49c97c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.102858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.116424 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4033/8032] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:47 2022] PUT /identity/v3/projects/b545f68412554c98aa0232cc3e20db2a/users/ed0f640563654a5994e2b3eb2f49c97c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:47.127026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.127322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.127612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.157233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] MFA Rules not processed for user `ed0f640563654a5994e2b3eb2f49c97c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:47.158453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:47.194030 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:47.223843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.226258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:47.264066 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4000/8033] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:47.268650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.272124 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:47.281659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba1683-1f63-4f89-941a-0349096580ad None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.287321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.288947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.289226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.289500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.290896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:get_project(project_id=73007dcc95fa480a8c446eb6ea7b4e11)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.294617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.296648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4001/8034] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11 => generated 389 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:47.301058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.313813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1a0b-30be-4d0d-90f6-c78ad5e2b9f1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.320619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.321332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.321666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.322893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.323947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.324081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3ac9-334d-495b-96b9-691f7990e959 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.328489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.331209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.332359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.332655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.332937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] PATH_INFO: `/v3/projects/861c9e3f7b824951a00cf79de712c312` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.335167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861c9e3f7b824951a00cf79de712c312)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.338638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.369185 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4002/8035] 10.222.0.77 () {60 vars in 1151 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/projects => generated 339 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:47.373834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.405593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861c9e3f7b824951a00cf79de712c312', 'request_id': 'req-d10f2868-1224-4f95-afd8-3b2837d4cd99'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:47.416647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861c9e3f7b824951a00cf79de712c312', 'request_id': 'req-d10f2868-1224-4f95-afd8-3b2837d4cd99'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:47.424665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861c9e3f7b824951a00cf79de712c312', 'request_id': 'req-d10f2868-1224-4f95-afd8-3b2837d4cd99'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:47.446015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] The token cache is being invalidate because project 861c9e3f7b824951a00cf79de712c312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:47.446315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:47.447083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d10f2868-1224-4f95-afd8-3b2837d4cd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:47.450578 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4034/8036] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:47 2022] DELETE /identity/v3/projects/861c9e3f7b824951a00cf79de712c312 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:47.455648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd855-5719-4b0e-96ce-51cd7749b879 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.456314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd855-5719-4b0e-96ce-51cd7749b879 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.457399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd855-5719-4b0e-96ce-51cd7749b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.477516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d39cd855-5719-4b0e-96ce-51cd7749b879 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:47.478935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d39cd855-5719-4b0e-96ce-51cd7749b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:47.492783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd890-222c-449e-ab5e-df6d96f545db tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.551581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4035/8037] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:47.559197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.559494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.559779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.576391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.577078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.577416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.577691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.578471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.579488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:47.580386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.580675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:47.591904 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4036/8038] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:47.596453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.602554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4003/8039] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects => generated 5888 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:47.605301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.607360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d2fb-bb2d-472c-b3c6-0658383a3488 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.608009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:47.612749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.613416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.613692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.613962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.614748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:47.615059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.616634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.625753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b239c-7412-4473-a9e0-299e8a4a9d33 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.631584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.632459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.632751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.633041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.633980 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4037/8040] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:47.635586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:get_project(project_id=73007dcc95fa480a8c446eb6ea7b4e11)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.638030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.638182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.641363 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4004/8041] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11 => generated 389 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:47.645936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.649373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341042-3e24-43ca-ad92-04f2d877e519 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.658095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.659153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.659976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.660240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.661052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.666243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.669730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bcef-dc15-4c50-bf87-a085e7fd556b tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.674915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.675780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.676099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.676372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects/ff782855f336438f90bb44e2116690f4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.677580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:get_project(project_id=ff782855f336438f90bb44e2116690f4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.679745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.681641 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4005/8042] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects/ff782855f336438f90bb44e2116690f4 => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:22:47.688143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.702218 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4038/8043] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:47.702424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae48ca-3496-42ef-a7fe-6abb2108cf70 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.703879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.727163 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:47.737219 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:47.769043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.770028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.770515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.770814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.772779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.773447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.780124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caba4f-b67c-4e35-a60f-431fa1f0dfbe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.786959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.787752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.788036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.788312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.788996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.791156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.796804 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4006/8044] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects => generated 6279 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:47.797840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.812615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69813e-b57a-47fd-8dea-a4ba48df9cd1 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.818144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.818912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.819210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.819338 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4039/8045] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:47.819488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.820084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.820253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:47.820595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.822937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.832502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea756a4-dd87-4c20-84fd-4a40c5819ca0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.837416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.838094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.838376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.838689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.839540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.841282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.849470 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4007/8046] 10.222.0.77 () {58 vars in 1165 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects?domain_id=default => generated 5948 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:47.853615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.854557 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4040/8047] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:47.858356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.868675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235209f-2d82-4068-8ae1-6a8f6769df2a tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.869245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078338-75ce-44c5-85d0-b162da45ca85 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.874036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.874622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.876898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.877028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.877136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.877232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.877325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.877416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.877509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.877607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.878279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.878395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.891084 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4041/8048] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:47.895252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.898312 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4008/8049] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects => generated 6279 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:47.902785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.912109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597cd48-35ac-4e18-b490-ac0d7d59e6c2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.915994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c15e-f242-45d6-91fd-3f259f253632 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.917634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8868cef-9cc1-4273-a97b-ae6193098fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.918550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8868cef-9cc1-4273-a97b-ae6193098fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.918968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8868cef-9cc1-4273-a97b-ae6193098fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.919245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8868cef-9cc1-4273-a97b-ae6193098fa0 admin admin] PATH_INFO: `/v3/projects/887f71bbdee54b32a19eab0af50190bd/users/7373ef0c347d4bb0a306df7f910b1a35/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.921999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:47.922704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.923002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.923291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.924085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:47.924406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.927816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.936379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8868cef-9cc1-4273-a97b-ae6193098fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887f71bbdee54b32a19eab0af50190bd, user_id=7373ef0c347d4bb0a306df7f910b1a35, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:47.939118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8868cef-9cc1-4273-a97b-ae6193098fa0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:47.946975 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4009/8050] 10.222.0.77 () {58 vars in 1165 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects?domain_id=default => generated 5948 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:47.952399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:47.955859 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4042/8051] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:47 2022] PUT /identity/v3/projects/887f71bbdee54b32a19eab0af50190bd/users/7373ef0c347d4bb0a306df7f910b1a35/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:47.963047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcce26-a32f-491e-9436-4c89742c1ebe tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:47.967179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:47.967470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:47.967747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:47.997701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] MFA Rules not processed for user `7373ef0c347d4bb0a306df7f910b1a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:47.998993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.034190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.034912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.035203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.035496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.036238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.038184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.067864 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4010/8052] 10.222.0.77 () {58 vars in 1130 bytes} [Mon Jul 11 15:22:47 2022] GET /identity/v3/projects => generated 6279 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:48.068987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.080653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b1d06-4e70-40b4-a7e7-974bfa8ae75d tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.081297 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4043/8053] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:48.085702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.086753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.087490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.087786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.088068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.088870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1206728377) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:48.089183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.091092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.105018 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4011/8054] 10.222.0.77 () {58 vars in 1231 bytes} [Mon Jul 11 15:22:48 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1206728377 => generated 537 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:22:48.110643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.122369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330727fe-55fb-4fa7-b47a-a4cce780c7f2 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.127616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed0f640563654a5994e2b3eb2f49c97c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b545f68412554c98aa0232cc3e20db2a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.128483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.128771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.129063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] PATH_INFO: `/v3/projects/ff782855f336438f90bb44e2116690f4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.130258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff782855f336438f90bb44e2116690f4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.132397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.145121 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:48.162588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b81f-3c21-4d2f-8105-3b8f2d8030fb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.170840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.171665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.172618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.172959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.173796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.176191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.195907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff782855f336438f90bb44e2116690f4', 'request_id': 'req-c5bf73a6-4603-4069-8b63-c431567bd545'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.203120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff782855f336438f90bb44e2116690f4', 'request_id': 'req-c5bf73a6-4603-4069-8b63-c431567bd545'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.206042 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:48.207523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4044/8055] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:48 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:48.211640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.213146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff782855f336438f90bb44e2116690f4', 'request_id': 'req-c5bf73a6-4603-4069-8b63-c431567bd545'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.229992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] The token cache is being invalidate because project ff782855f336438f90bb44e2116690f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:48.230305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.231009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.232631 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4012/8056] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:48 2022] DELETE /identity/v3/projects/ff782855f336438f90bb44e2116690f4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:48.237034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.238538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.291030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b5e1-8b47-4af0-b9c3-2981269065f9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.298779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.299704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.299990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.300267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.300975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.303278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.317619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf73a6-4603-4069-8b63-c431567bd545 tempest-ListProjectsStaticTestJSON-1520533270 tempest-ListProjectsStaticTestJSON-1520533270-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.323936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.325102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.325451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.325880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] PATH_INFO: `/v3/users/a018e018f3f14ec3a880e262c62c5638` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.327139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a018e018f3f14ec3a880e262c62c5638)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.327917 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4045/8057] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:48 2022] POST /identity/v3/users => generated 308 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:48.329444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.331885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.333750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.348453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003184-0950-4e7b-984c-c441b5db5482 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.353175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.353842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.354131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.354412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.355200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.357001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.369722 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4046/8058] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:48.373629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.383554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e421ea2-bdb1-4c3c-b5c6-695e2681a6e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.386634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a018e018f3f14ec3a880e262c62c5638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.390319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.391770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.392055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.392328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] PATH_INFO: `/v3/projects/f7c2e15b52b14729927b172349a5f68e/users/667e8e44627f492b958747aa1c6c7132/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.400959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a018e018f3f14ec3a880e262c62c5638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.411399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c2e15b52b14729927b172349a5f68e, user_id=667e8e44627f492b958747aa1c6c7132, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.411889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a018e018f3f14ec3a880e262c62c5638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.414840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.420444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a018e018f3f14ec3a880e262c62c5638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.421088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-11ef12ce-59fe-45e1-85b3-f971b388a87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a018e018f3f14ec3a880e262c62c5638'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:48.429162 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4013/8059] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:48 2022] DELETE /identity/v3/users/a018e018f3f14ec3a880e262c62c5638 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:48.433580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.434679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.434961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.440024 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4047/8060] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:48 2022] PUT /identity/v3/projects/f7c2e15b52b14729927b172349a5f68e/users/667e8e44627f492b958747aa1c6c7132/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:48.441240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.443347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.467834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:48.471536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.524778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53b82-144e-419a-bae6-2444a8d78bf2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.529941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.530686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.530980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.531838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.532582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.536582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.545517 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4014/8061] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:48.552262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.553662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.557903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4048/8062] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:48.558717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.569658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb444b7-2548-40ba-af90-35ee9e8a43e6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.580307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95247d-fdc4-4017-a185-fa0d47e64d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.582085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95247d-fdc4-4017-a185-fa0d47e64d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.582367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95247d-fdc4-4017-a185-fa0d47e64d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.582677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95247d-fdc4-4017-a185-fa0d47e64d43 admin admin] PATH_INFO: `/v3/projects/f7c2e15b52b14729927b172349a5f68e/users/667e8e44627f492b958747aa1c6c7132/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.585353 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:48.586316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95247d-fdc4-4017-a185-fa0d47e64d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c2e15b52b14729927b172349a5f68e, user_id=667e8e44627f492b958747aa1c6c7132, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.591111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95247d-fdc4-4017-a185-fa0d47e64d43 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.607533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4049/8063] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:48 2022] PUT /identity/v3/projects/f7c2e15b52b14729927b172349a5f68e/users/667e8e44627f492b958747aa1c6c7132/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:48.620519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.621186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.621476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.646930 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:48.659566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] MFA Rules not processed for user `667e8e44627f492b958747aa1c6c7132`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:48.661313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.677868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc9865-26e4-4ccb-87be-9be4d110cdef None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.738199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.738886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.739167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.739471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.763827 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4050/8064] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:48.775811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:48.777302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:48.818756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.820330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.832669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4015/8065] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:22:48.850440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e92d4-20a5-49ec-9c33-5e155d67eed0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:48.854735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:48.855502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:48.855864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:48.856205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:48.867133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:48.868902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:48.880219 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4051/8066] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:22:49.028684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:49.044374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c150fa-e8cf-493c-bb18-47659a7e268f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:49.052597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:49.054380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:49.054713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:49.054998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] PATH_INFO: `/v3/users/7373ef0c347d4bb0a306df7f910b1a35` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:49.056908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7373ef0c347d4bb0a306df7f910b1a35)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:49.059556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:49.122130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7373ef0c347d4bb0a306df7f910b1a35'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.140041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7373ef0c347d4bb0a306df7f910b1a35'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.146073 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:49.149518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7373ef0c347d4bb0a306df7f910b1a35'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.162580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:49.164148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:49.172573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7373ef0c347d4bb0a306df7f910b1a35'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.173602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4ffa3fa9-5f9f-404b-a462-a5d65960a78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7373ef0c347d4bb0a306df7f910b1a35'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.180431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407a6d-e200-40cd-a0f3-5aa3f8573c8c service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:49.186405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:49.187376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:49.187660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:49.187971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] PATH_INFO: `/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:49.189174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73007dcc95fa480a8c446eb6ea7b4e11)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:49.191424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:49.200662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4016/8067] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:49 2022] DELETE /identity/v3/users/7373ef0c347d4bb0a306df7f910b1a35 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:49.205774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:49.206322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:49.206449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:49.234061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:49.235650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:49.264522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73007dcc95fa480a8c446eb6ea7b4e11', 'request_id': 'req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.275993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73007dcc95fa480a8c446eb6ea7b4e11', 'request_id': 'req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.284886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73007dcc95fa480a8c446eb6ea7b4e11', 'request_id': 'req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.296562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] The token cache is being invalidate because project 73007dcc95fa480a8c446eb6ea7b4e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:49.297195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.297727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.299445 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4052/8068] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:49 2022] DELETE /identity/v3/projects/73007dcc95fa480a8c446eb6ea7b4e11 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:49.305405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:49.307110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:49.318582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4017/8069] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:49.330327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:49.332090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:49.347056 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:49.412632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2a22c-66bd-4f64-9aa6-8a7906e9ee73 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:49.418281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:49.419288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:49.419659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:49.420033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] PATH_INFO: `/v3/users/ed0f640563654a5994e2b3eb2f49c97c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:49.421314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0f640563654a5994e2b3eb2f49c97c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:49.421839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34634c0-5c54-4d43-9dac-943472ea8dc8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:49.423763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:49.495827 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0f640563654a5994e2b3eb2f49c97c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.498197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0f640563654a5994e2b3eb2f49c97c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.506409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:49.507595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:49.508143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:49.508772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:49.512010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:49.530166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0f640563654a5994e2b3eb2f49c97c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.531452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0f640563654a5994e2b3eb2f49c97c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.537630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:49.540027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:49.549434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-487a939e-8e9a-4138-b330-69f4531593e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0f640563654a5994e2b3eb2f49c97c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:49.553602 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4018/8070] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:49.574348 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4053/8071] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:49 2022] DELETE /identity/v3/users/ed0f640563654a5994e2b3eb2f49c97c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:49.895937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:49.897409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:49.911131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339f956-27f2-4e8a-bc04-9ada156e1f32 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:49.971636 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:49.990635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:49.991687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:49.991977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:49.992255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] PATH_INFO: `/v3/projects/b545f68412554c98aa0232cc3e20db2a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:49.993513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b545f68412554c98aa0232cc3e20db2a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:49.995618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.065668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b545f68412554c98aa0232cc3e20db2a', 'request_id': 'req-a00a6a6d-e7a6-4eac-bf78-c59945074114'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.072351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b545f68412554c98aa0232cc3e20db2a', 'request_id': 'req-a00a6a6d-e7a6-4eac-bf78-c59945074114'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.081797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b545f68412554c98aa0232cc3e20db2a', 'request_id': 'req-a00a6a6d-e7a6-4eac-bf78-c59945074114'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.100682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] The token cache is being invalidate because project b545f68412554c98aa0232cc3e20db2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:50.101309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.102049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a00a6a6d-e7a6-4eac-bf78-c59945074114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.103971 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4019/8072] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:49 2022] DELETE /identity/v3/projects/b545f68412554c98aa0232cc3e20db2a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:50.108897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.109747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.110034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.134388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:50.135654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:50.213115 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4054/8073] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:50.220836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.221196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.221479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.245734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:50.247002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:50.270379 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4020/8074] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:50.271616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.285190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b594a21-836c-404a-a5a1-9e826bf78d3c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.294974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.295659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.295943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.296220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.297556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:50.298117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.299809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.317271 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4055/8075] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:50.321671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.333359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef55d4a-dfd4-48a6-baa5-8d4e4660389d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.340005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.340679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.340969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.341506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.342207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.345117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.388345 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4021/8076] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:50 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:50.392231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.406773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2d324-817c-4f13-9b13-b8edfba74aea admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.458018 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:50.462760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.464662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:50.511151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.511550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.512202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.512724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.513405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.516295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.540399 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4056/8077] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:50 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:50.543936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.559531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681976-ba8c-4913-8b31-2d1f4d40190c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.566408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.566620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.566929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.567414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.568209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.570084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.573795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296812a-5419-4f2f-af05-0b775ddd7ec2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.580719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.581724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.582071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.582688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] PATH_INFO: `/v3/projects/887f71bbdee54b32a19eab0af50190bd` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.584913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] RBAC: Authorizing `identity:delete_project(project_id=887f71bbdee54b32a19eab0af50190bd)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.586946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.593191 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4057/8078] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:50.594637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.610219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0723-cf03-4f94-a0b5-857349aa1c95 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.622375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.623123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.623421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.623723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.624470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.634421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.639573 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4058/8079] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:50.644168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.650255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887f71bbdee54b32a19eab0af50190bd', 'request_id': 'req-38a543e6-16d4-4999-bdfe-57bf528c852a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.653097 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:50.657429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a84b-b8b3-4595-b668-8d9e2ab8f090 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.658615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887f71bbdee54b32a19eab0af50190bd', 'request_id': 'req-38a543e6-16d4-4999-bdfe-57bf528c852a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.668833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887f71bbdee54b32a19eab0af50190bd', 'request_id': 'req-38a543e6-16d4-4999-bdfe-57bf528c852a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.683081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] The token cache is being invalidate because project 887f71bbdee54b32a19eab0af50190bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:50.683372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.684038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.686146 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4022/8080] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:50 2022] DELETE /identity/v3/projects/887f71bbdee54b32a19eab0af50190bd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:50.690529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.692924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:50.739147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4475-3396-4ae7-9c20-ebe1c75f21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.740065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4475-3396-4ae7-9c20-ebe1c75f21f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.740360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4475-3396-4ae7-9c20-ebe1c75f21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.740643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4475-3396-4ae7-9c20-ebe1c75f21f4 admin admin] PATH_INFO: `/v3/projects/2eb42df793c5410b9878445c904a4eb7/users/99103a8a3c764355a9e20f7d11058ae6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.763099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4475-3396-4ae7-9c20-ebe1c75f21f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb42df793c5410b9878445c904a4eb7, user_id=99103a8a3c764355a9e20f7d11058ae6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.766584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4475-3396-4ae7-9c20-ebe1c75f21f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.775362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a543e6-16d4-4999-bdfe-57bf528c852a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:50.782379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:50.784087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.784386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.784651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] PATH_INFO: `/v3/users/667e8e44627f492b958747aa1c6c7132` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.785906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667e8e44627f492b958747aa1c6c7132)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:50.787101 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4059/8081] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:50 2022] PUT /identity/v3/projects/2eb42df793c5410b9878445c904a4eb7/users/99103a8a3c764355a9e20f7d11058ae6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:50.788122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:50.797087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:50.797390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:50.797672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:50.835306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] MFA Rules not processed for user `99103a8a3c764355a9e20f7d11058ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:50.837135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:50.865476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667e8e44627f492b958747aa1c6c7132'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.883251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667e8e44627f492b958747aa1c6c7132'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.895494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667e8e44627f492b958747aa1c6c7132'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.908500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667e8e44627f492b958747aa1c6c7132'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.909155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667e8e44627f492b958747aa1c6c7132'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:50.919187 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4023/8082] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:50 2022] DELETE /identity/v3/users/667e8e44627f492b958747aa1c6c7132 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:50.947232 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4060/8083] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:50.951427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:50.954616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:51.056651 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:51.069099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345194b-9430-45e8-9ff5-490e311b98e4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.077327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.078019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.078307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.078674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.079979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.082104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.126528 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4024/8084] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:50 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:51.130473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.146572 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:51.237793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645445f-3b69-4ca0-9bba-8fabb7f1b97b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.305982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.307912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:51.312200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.314348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.324478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.324910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.326359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613142c6-10a1-4f16-8f1a-5c35239f5698 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.326482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.329677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.332823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.333636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.333636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.333930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] PATH_INFO: `/v3/projects/f7c2e15b52b14729927b172349a5f68e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.335340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c2e15b52b14729927b172349a5f68e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.337930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.366667 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4061/8085] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:51 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:51.371625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.387061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2266-29f5-42a2-80e5-b023f5b6e93e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.396034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.397329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.398178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.398643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.400127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.402281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.417240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c2e15b52b14729927b172349a5f68e', 'request_id': 'req-6b8788fe-44be-47a3-b445-217d1f225f63'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:51.418352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4062/8086] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:51.422852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.425592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c2e15b52b14729927b172349a5f68e', 'request_id': 'req-6b8788fe-44be-47a3-b445-217d1f225f63'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:51.436245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c2e15b52b14729927b172349a5f68e', 'request_id': 'req-6b8788fe-44be-47a3-b445-217d1f225f63'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:51.437890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8598a-e9f3-4857-b1f4-29f6229e6ef9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.454316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] The token cache is being invalidate because project f7c2e15b52b14729927b172349a5f68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:51.454836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:51.455823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6b8788fe-44be-47a3-b445-217d1f225f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:51.464313 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4025/8087] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:51 2022] DELETE /identity/v3/projects/f7c2e15b52b14729927b172349a5f68e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:51.466304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59287ec-ee5e-4a30-a75e-a55904972953 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.466666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59287ec-ee5e-4a30-a75e-a55904972953 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.467017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59287ec-ee5e-4a30-a75e-a55904972953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.489486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c59287ec-ee5e-4a30-a75e-a55904972953 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:51.490862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c59287ec-ee5e-4a30-a75e-a55904972953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:51.545840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.547319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.547604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.547885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] PATH_INFO: `/v3/projects/e98090d186844773b69a6f1a54b20cff/users/de9dd9cabc304520a551446a73d3e133/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.588428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98090d186844773b69a6f1a54b20cff, user_id=de9dd9cabc304520a551446a73d3e133, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.591910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.598542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4026/8088] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:51.606686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.609053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.609474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.623946 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4063/8089] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:51 2022] PUT /identity/v3/projects/e98090d186844773b69a6f1a54b20cff/users/de9dd9cabc304520a551446a73d3e133/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:51.627501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.629412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:51.643328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:51.644456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:51.689470 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:51.744793 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4027/8090] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:51.748904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.758900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bed3e-77cb-4ebe-b048-fe319869bd55 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.759381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fd0f8-cf3a-4c6e-b0b9-e4770936f53d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.768367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.768599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.769262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.769388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.769555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.769795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.769912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.770248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.770597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.771325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:51.771771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.772208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.773729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.775606 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:51.784374 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4064/8091] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:22:51.788115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.790814 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4028/8092] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:51.792513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.799457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e519-92da-4595-81ac-8a7e1c3869f8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.805454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288140bb-c4c3-4e82-8bed-7bdc0bcacd6a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:51.806810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bcb0d-b1d0-4b32-baa8-3d1823f5d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.807785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcb0d-b1d0-4b32-baa8-3d1823f5d59f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.808149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcb0d-b1d0-4b32-baa8-3d1823f5d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.808543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcb0d-b1d0-4b32-baa8-3d1823f5d59f admin admin] PATH_INFO: `/v3/projects/e98090d186844773b69a6f1a54b20cff/users/de9dd9cabc304520a551446a73d3e133/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.811167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bcb0d-b1d0-4b32-baa8-3d1823f5d59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98090d186844773b69a6f1a54b20cff, user_id=de9dd9cabc304520a551446a73d3e133, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.814791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bcb0d-b1d0-4b32-baa8-3d1823f5d59f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.828454 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4065/8093] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:51 2022] PUT /identity/v3/projects/e98090d186844773b69a6f1a54b20cff/users/de9dd9cabc304520a551446a73d3e133/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:51.831298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:51.832753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.833045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.833328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.834771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:51.838081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:51.838840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:51.839330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:51.843091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:51.888850 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4029/8094] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:51 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:51.892363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] MFA Rules not processed for user `de9dd9cabc304520a551446a73d3e133`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:51.893478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:51.895072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:52.004606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de26c83-9fd1-4b0a-94c0-4b2b0e015074 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.018553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.019558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.020130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.020738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.021815 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.022742 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4066/8095] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:52.026816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.028518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.042468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6184-627a-4af0-b0a8-5a2925fc2546 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.057388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.058179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.059372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.062741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.067056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.070041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.073960 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4030/8096] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:51 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:52.083489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.097513 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4067/8097] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:22:52 2022] POST /identity/v3/domains => generated 276 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:52.102877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.112746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a67e-c078-471a-9dfb-ad5aa180281a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.195615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0718-a22c-4331-a723-2af04de6910d tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.206797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.207543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.207843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.208500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.208837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.211102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.236657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.237344 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:52.237458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.237644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.237924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.239687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.242057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.256386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4031/8098] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:52.261515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.268542 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4068/8099] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:52 2022] POST /identity/v3/users => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:52.269859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.284758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289014f-3cdd-4af8-88b3-9c850413ed9f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.292989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9d30-f360-4f66-a15e-c5f642d389fc tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.296390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.298093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.298801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.299612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.301540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.304385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.305381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.306149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.306529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.306872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.307644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.314777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.330540 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4032/8100] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:52.338399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.363435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586dd7e-daa4-441d-9164-c12fe0785594 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.379519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4069/8101] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:52 2022] POST /identity/v3/users => generated 320 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:52.384321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.388920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7b47d-434f-41fb-80fe-ab2ef4cd4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.389953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7b47d-434f-41fb-80fe-ab2ef4cd4d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.390390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7b47d-434f-41fb-80fe-ab2ef4cd4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.390848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7b47d-434f-41fb-80fe-ab2ef4cd4d47 admin admin] PATH_INFO: `/v3/projects/93adca6600cb4f2ca5ed93786c1a7f21/users/ca7ef83fe1f64e7dbcac10527a650331/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.396997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b07c5c-11ee-4623-8351-d9ba6da79088 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.402417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.403586 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.404009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.404296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users/fa438811c5e94e0b914167a5c5efa9a2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.414127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7b47d-434f-41fb-80fe-ab2ef4cd4d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93adca6600cb4f2ca5ed93786c1a7f21, user_id=ca7ef83fe1f64e7dbcac10527a650331, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.419366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7b47d-434f-41fb-80fe-ab2ef4cd4d47 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.425325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:get_user(user_id=fa438811c5e94e0b914167a5c5efa9a2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.428934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.437919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4070/8102] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/users/fa438811c5e94e0b914167a5c5efa9a2 => generated 347 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:22:52.449257 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4033/8103] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:52 2022] PUT /identity/v3/projects/93adca6600cb4f2ca5ed93786c1a7f21/users/ca7ef83fe1f64e7dbcac10527a650331/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:52.454756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.460626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.461021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.461888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.478915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702e5c-4e93-4811-915b-cc8a247b2f23 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.495301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] MFA Rules not processed for user `ca7ef83fe1f64e7dbcac10527a650331`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:52.496838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:52.513524 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:52.598106 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4034/8104] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:52.603972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.627529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.629249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.631303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.631672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.633255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Adding query filter params (domain_id=95be95947e8d4a37bbe6c9163e7f70aa) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:52.634868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.638801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.675548 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4071/8105] 10.222.0.77 () {58 vars in 1206 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/users?domain_id=95be95947e8d4a37bbe6c9163e7f70aa => generated 484 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:52.682385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.716780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30625f43-f886-4c10-aefb-b7f68d055e60 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.745598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.746361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.746689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.746982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.750618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.754569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.768147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6e79-a7d1-4fa6-9284-0a4f285248a0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.773980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.774858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.775301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.775787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.776635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.778807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.819356 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4072/8106] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/users => generated 8328 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:52.820720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.832899 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4035/8107] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:52 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:52.835075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.838413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a295385-ee3a-4201-aa0e-c91c6de821c0 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.938983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fef36-9d44-40d8-8565-d6e5e25fff60 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:52.944711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.945384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.945673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.945951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.946676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.947673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:52.948458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:52.948592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.948927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:52.949307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:52.950449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Adding query filter params (name=tempest-test_user-269921587) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:52.951151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:52.953775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:52.981092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4036/8108] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:52 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:52.985289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.988209 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4073/8109] 10.222.0.77 () {58 vars in 1186 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/users?name=tempest-test_user-269921587 => generated 474 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:52.993036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:52.997447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f2764-4005-46d9-a100-376cb59c53b2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.009033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.009778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.012531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.012865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.013708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.018712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.023180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0164-4dd4-4d50-83b0-b88354b5af3e tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.036798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.037748 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4037/8110] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:53.040756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.041560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.042046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.042347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.043174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:53.043496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.048266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.075178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92280-01b9-43a2-80d4-3708fd848b43 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.081594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.083076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.083383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.083663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] PATH_INFO: `/v3/projects/579347512eb74561a94c665219261b2c/users/9699cca43e3e4d3fb24cd544791ac6c7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.094987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4074/8111] 10.222.0.77 () {58 vars in 1148 bytes} [Mon Jul 11 15:22:52 2022] GET /identity/v3/users?enabled=False => generated 428 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:53.099589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.102568 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:53.114519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=579347512eb74561a94c665219261b2c, user_id=9699cca43e3e4d3fb24cd544791ac6c7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.118214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.120359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf666-c81d-4189-92b1-458372d27171 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.134577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.135416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.135707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.135991 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users/a2d4b337ea2f48769daf47e75bbc2fc6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.137824 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4038/8112] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:53 2022] PUT /identity/v3/projects/579347512eb74561a94c665219261b2c/users/9699cca43e3e4d3fb24cd544791ac6c7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:53.143241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.162553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a2d4b337ea2f48769daf47e75bbc2fc6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.164770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.184726 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:53.272762 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d4b337ea2f48769daf47e75bbc2fc6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.274513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d4b337ea2f48769daf47e75bbc2fc6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.289207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec8af5-5b5a-40f6-889e-195fb3f6f3fa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.298079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.300188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.300497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.300784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.301668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.305475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.317304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d4b337ea2f48769daf47e75bbc2fc6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.318572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d4b337ea2f48769daf47e75bbc2fc6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.324261 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4039/8113] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:53.329230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.331783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:53.336799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d4b337ea2f48769daf47e75bbc2fc6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.349780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c752c-4166-415e-9acd-7883eef14ca6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.355273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb212f10-ce63-48df-ab7d-87c6e0cef953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.356310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb212f10-ce63-48df-ab7d-87c6e0cef953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.356969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb212f10-ce63-48df-ab7d-87c6e0cef953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.357106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb212f10-ce63-48df-ab7d-87c6e0cef953 admin admin] PATH_INFO: `/v3/projects/579347512eb74561a94c665219261b2c/users/9699cca43e3e4d3fb24cd544791ac6c7/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.361651 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4075/8114] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:53 2022] DELETE /identity/v3/users/a2d4b337ea2f48769daf47e75bbc2fc6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:53.361822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb212f10-ce63-48df-ab7d-87c6e0cef953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579347512eb74561a94c665219261b2c, user_id=9699cca43e3e4d3fb24cd544791ac6c7, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.363197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb212f10-ce63-48df-ab7d-87c6e0cef953 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.363329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.365341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:53.384030 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4040/8115] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:53 2022] PUT /identity/v3/projects/579347512eb74561a94c665219261b2c/users/9699cca43e3e4d3fb24cd544791ac6c7/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:53.395029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.395326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.395603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.447521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] MFA Rules not processed for user `9699cca43e3e4d3fb24cd544791ac6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:53.447867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3bdb-9336-4d9b-958c-ce1d1de944e2 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.454457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:53.561885 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4041/8116] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:53.582354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.587603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:53.663445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.665338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.665648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.665935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/users/fa438811c5e94e0b914167a5c5efa9a2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.669077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fa438811c5e94e0b914167a5c5efa9a2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.674413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.766870 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:53.775849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c730-69c3-4b96-bd60-d5d6180f887b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:53.784770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:53.785148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:53.785434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:53.785713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:53.787848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa438811c5e94e0b914167a5c5efa9a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.788592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa438811c5e94e0b914167a5c5efa9a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.791474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:53.815344 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:53.821533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa438811c5e94e0b914167a5c5efa9a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.822871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa438811c5e94e0b914167a5c5efa9a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.841496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa438811c5e94e0b914167a5c5efa9a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:53.884212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:53.885499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:53.898033 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4042/8117] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:53.913396 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4076/8118] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:53 2022] DELETE /identity/v3/users/fa438811c5e94e0b914167a5c5efa9a2 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:22:53.919148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:53.940043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae966-3c74-471c-b4f9-4245c72fa2c8 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:54.117149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:54.118663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:54.118970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:54.119353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/domains/95be95947e8d4a37bbe6c9163e7f70aa` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:54.123274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=95be95947e8d4a37bbe6c9163e7f70aa)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:54.125102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:54.153738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.154730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.208918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.210573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.220895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:54.223630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:54.232586 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4043/8119] 10.222.0.77 () {60 vars in 1248 bytes} [Mon Jul 11 15:22:53 2022] PATCH /identity/v3/domains/95be95947e8d4a37bbe6c9163e7f70aa => generated 277 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:22:54.250863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d499-6e8a-445a-bdd1-6354dc979a97 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:54.471206 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9dd9cabc304520a551446a73d3e133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e98090d186844773b69a6f1a54b20cff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:54.472172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:54.472394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:54.472680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] PATH_INFO: `/v3/domains/95be95947e8d4a37bbe6c9163e7f70aa` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:54.517183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=95be95947e8d4a37bbe6c9163e7f70aa)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:54.518666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:54.594168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.601834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.743621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa', 'request_id': 'req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.760871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa', 'request_id': 'req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.770272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa', 'request_id': 'req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.784532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] The token cache is being invalidate because project 95be95947e8d4a37bbe6c9163e7f70aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:54.785074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.785930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.795247 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:54.797642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa', 'request_id': 'req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.800641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa', 'request_id': 'req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.805441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '95be95947e8d4a37bbe6c9163e7f70aa', 'request_id': 'req-5b7f30da-70ca-4461-afe3-ca63c0bc5cff'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:54.816821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4077/8120] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:22:54 2022] DELETE /identity/v3/domains/95be95947e8d4a37bbe6c9163e7f70aa => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:54.821292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:54.823163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:54.956011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbadef-a62e-4e78-ba13-9095cfe5c6f1 tempest-UsersV3TestJSON-1029939653 tempest-UsersV3TestJSON-1029939653-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:55.039809 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:55.161926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:55.164516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:55.164814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:55.166480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] PATH_INFO: `/v3/users/99103a8a3c764355a9e20f7d11058ae6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:55.170415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99103a8a3c764355a9e20f7d11058ae6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:55.182260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:55.310955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99103a8a3c764355a9e20f7d11058ae6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:55.333171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99103a8a3c764355a9e20f7d11058ae6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:55.362176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99103a8a3c764355a9e20f7d11058ae6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:55.385633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99103a8a3c764355a9e20f7d11058ae6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:55.386804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99103a8a3c764355a9e20f7d11058ae6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:55.398940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4044/8121] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:54 2022] DELETE /identity/v3/users/99103a8a3c764355a9e20f7d11058ae6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:55.404834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:55.405126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:55.405432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:55.439265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:55.443703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:55.608142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4078/8122] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:55.617847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:55.619542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:55.773286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae862657-860b-4201-98f5-c694f4cfc206 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:55.782589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:55.783559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:55.783845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:55.784124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:55.797099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:55.798607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:55.812788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4045/8123] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:22:56.474332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:56.475879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:56.496798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e561b8-85b2-490e-918a-69c2531003f2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:56.503068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:56.503966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:56.504254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:56.504537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] PATH_INFO: `/v3/projects/2eb42df793c5410b9878445c904a4eb7` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:56.506089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb42df793c5410b9878445c904a4eb7)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:56.508627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:56.587585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb42df793c5410b9878445c904a4eb7', 'request_id': 'req-eade2b01-1860-4129-a93f-9839285db8f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.614678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb42df793c5410b9878445c904a4eb7', 'request_id': 'req-eade2b01-1860-4129-a93f-9839285db8f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.623498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb42df793c5410b9878445c904a4eb7', 'request_id': 'req-eade2b01-1860-4129-a93f-9839285db8f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.644432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] The token cache is being invalidate because project 2eb42df793c5410b9878445c904a4eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:56.644705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.645838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.650798 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4079/8124] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:56 2022] DELETE /identity/v3/projects/2eb42df793c5410b9878445c904a4eb7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:56.652908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:56.675981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e615882-b450-49df-9a9a-ff003e09300b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:56.778997 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:56.832560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:56.833635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:56.834013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:56.834319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] PATH_INFO: `/v3/users/de9dd9cabc304520a551446a73d3e133` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:56.836165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9dd9cabc304520a551446a73d3e133)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:56.840164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:56.967162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9dd9cabc304520a551446a73d3e133'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.989253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9dd9cabc304520a551446a73d3e133'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:56.998136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9dd9cabc304520a551446a73d3e133'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:57.011479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9dd9cabc304520a551446a73d3e133'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:57.013741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0eca09dc-f5c3-4ac6-83af-c7940963c7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9dd9cabc304520a551446a73d3e133'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:57.027253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4046/8125] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:22:56 2022] DELETE /identity/v3/users/de9dd9cabc304520a551446a73d3e133 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:57.715440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:57.717653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:57.743484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2b01-1860-4129-a93f-9839285db8f9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:57.848920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:57.850154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:57.850572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:57.851633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] PATH_INFO: `/v3/projects/e98090d186844773b69a6f1a54b20cff` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:57.862977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98090d186844773b69a6f1a54b20cff)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:57.866307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:57.901626 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:57.961272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98090d186844773b69a6f1a54b20cff', 'request_id': 'req-48f625b3-6e3e-4976-8ffc-370c69a45e59'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:57.978910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98090d186844773b69a6f1a54b20cff', 'request_id': 'req-48f625b3-6e3e-4976-8ffc-370c69a45e59'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:57.987885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98090d186844773b69a6f1a54b20cff', 'request_id': 'req-48f625b3-6e3e-4976-8ffc-370c69a45e59'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:58.006351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] The token cache is being invalidate because project e98090d186844773b69a6f1a54b20cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:22:58.006812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:58.007824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-48f625b3-6e3e-4976-8ffc-370c69a45e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:22:58.010396 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4080/8126] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:22:57 2022] DELETE /identity/v3/projects/e98090d186844773b69a6f1a54b20cff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:58.015889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1191e-2496-4f33-8280-adbeda7e7f4c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.016405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1191e-2496-4f33-8280-adbeda7e7f4c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.016521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1191e-2496-4f33-8280-adbeda7e7f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.085823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1ef1191e-2496-4f33-8280-adbeda7e7f4c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:58.087124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1ef1191e-2496-4f33-8280-adbeda7e7f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:58.120394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.120724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.120963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.147487 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] MFA Rules not processed for user `a0a8c7cc666443e5beaa27396edac7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:58.149145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:58.305526 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4047/8127] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:58.312965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.313162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.313445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.349970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:58.364248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:58.389749 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4048/8128] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:22:58.394592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:58.411410 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4081/8129] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:58.447945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dded6d-30a6-4734-87b0-4819d1412cdc None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:58.463846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:58.464811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.465256 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.465681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.466610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:22:58.467065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:58.468887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:58.493098 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4049/8130] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:22:58.497473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:58.511162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaaef3-b0e8-4648-a2bf-207f9b56d2f0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:58.516744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:58.517433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.517721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.518190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.518999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:58.521111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:58.566950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4082/8131] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:58 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:58.570655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:58.594452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f29b3e-dd99-4a56-a5ba-f6176ecae7fd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:58.696232 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:58.721146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:58.721837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.722130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.723279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.724368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:58.728048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:58.755861 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4050/8132] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:58 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:22:58.759493 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:58.772055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf04360-9eef-47fa-adf8-424101ec0464 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:58.778389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:58.779266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.779650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.780031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.780914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:58.783914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:58.799570 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4083/8133] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:58.803979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:58.821473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3bcc-7b8a-4292-82e3-896bd6d03425 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:58.843029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a64b3f-4e8b-4edb-8f02-7f886dc6e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:58.844570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64b3f-4e8b-4edb-8f02-7f886dc6e6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.845573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64b3f-4e8b-4edb-8f02-7f886dc6e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.845999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64b3f-4e8b-4edb-8f02-7f886dc6e6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.847008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a64b3f-4e8b-4edb-8f02-7f886dc6e6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:58.849305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a64b3f-4e8b-4edb-8f02-7f886dc6e6f8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:58.866537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4051/8134] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:58.870215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:58.884430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3b9f5-bb9c-44ea-ba20-ddc6a192a544 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:58.890641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:58.891803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.892602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.893433 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] PATH_INFO: `/v3/projects/8c5dd15a3a1d4ec6816db1f2cab27d89/users/11235ea5fa474e32a4a96f42053331d8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:58.917325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5dd15a3a1d4ec6816db1f2cab27d89, user_id=11235ea5fa474e32a4a96f42053331d8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:58.921989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:58.950156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4084/8135] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:58 2022] PUT /identity/v3/projects/8c5dd15a3a1d4ec6816db1f2cab27d89/users/11235ea5fa474e32a4a96f42053331d8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:58.960788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578af45-1752-453d-b76e-757940e08275 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:58.961193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578af45-1752-453d-b76e-757940e08275 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:58.961775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578af45-1752-453d-b76e-757940e08275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:59.012546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-4578af45-1752-453d-b76e-757940e08275 None None] MFA Rules not processed for user `11235ea5fa474e32a4a96f42053331d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:22:59.013975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4578af45-1752-453d-b76e-757940e08275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:22:59.175020 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4052/8136] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:22:59.176159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:59.249124 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:22:59.264357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf621-89cb-4202-8d46-b755059a2f22 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:59.271663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:59.272484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:59.273055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:59.273436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:59.274241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:59.276529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:59.325805 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4085/8137] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:22:59 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:59.326915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578af45-1752-453d-b76e-757940e08275 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:59.342819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578af45-1752-453d-b76e-757940e08275 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:59.448080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:59.449022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:59.449180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:59.449374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:59.450371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:59.453421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:59.494349 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4053/8138] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:22:59 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:22:59.495649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:59.508813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25295-271a-4e3f-bcc7-fdd397fe235c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:59.515279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:59.516154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:59.516514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:59.516874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:59.517754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:59.519621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:59.542539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4086/8139] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:22:59.548067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:59.563453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9799-5946-45a7-bb4a-addf7a334c90 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:22:59.595258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:22:59.596263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:22:59.596622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:22:59.597024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] PATH_INFO: `/v3/projects/d18247c0e8684a44985fb73ab4bd9ac6/users/da4ca2cf74b34cff88987996d996a516/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:22:59.626881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18247c0e8684a44985fb73ab4bd9ac6, user_id=da4ca2cf74b34cff88987996d996a516, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:22:59.633266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:22:59.688644 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4054/8140] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:22:59 2022] PUT /identity/v3/projects/d18247c0e8684a44985fb73ab4bd9ac6/users/da4ca2cf74b34cff88987996d996a516/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:22:59.692723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:22:59.715764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d830f-8ff0-4e6c-b474-9e80df99367a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.089549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96753bd-ae0f-4566-9c85-13ed94a8fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.091294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96753bd-ae0f-4566-9c85-13ed94a8fe12 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.091801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96753bd-ae0f-4566-9c85-13ed94a8fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.092282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96753bd-ae0f-4566-9c85-13ed94a8fe12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.094187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96753bd-ae0f-4566-9c85-13ed94a8fe12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.096068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96753bd-ae0f-4566-9c85-13ed94a8fe12 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.113312 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4087/8141] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:00.114863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.133676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edb36-839d-45a8-aaa5-e15de0b5bb0c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.143888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.144818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.145104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.145380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] PATH_INFO: `/v3/projects/d18247c0e8684a44985fb73ab4bd9ac6/users/da4ca2cf74b34cff88987996d996a516/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.148920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18247c0e8684a44985fb73ab4bd9ac6, user_id=da4ca2cf74b34cff88987996d996a516, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.152318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.176291 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4055/8142] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:00 2022] PUT /identity/v3/projects/d18247c0e8684a44985fb73ab4bd9ac6/users/da4ca2cf74b34cff88987996d996a516/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:00.177916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.178209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.178642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.213877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] MFA Rules not processed for user `da4ca2cf74b34cff88987996d996a516`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:00.215036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:00.294619 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4088/8143] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:00.299601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.315544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928ec16-1d04-4508-8016-be6e79708bc8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.326882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.327248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.327573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.328866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.331507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.333362 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:23:00.333362 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:23:00.333362 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:23:00.335490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.340827 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:00.375695 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4056/8144] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:23:00 2022] POST /identity/v3/regions => generated 223 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:00.376853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.387184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4d29d-2695-4e3f-a765-dec4a4d01ac7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.407058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.407735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.408022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.408302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.409100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.411712 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:23:00.411712 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:23:00.411712 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:23:00.412711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.447714 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4089/8145] 10.222.0.77 () {60 vars in 1148 bytes} [Mon Jul 11 15:23:00 2022] POST /identity/v3/regions => generated 224 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:00.448968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.472815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.475271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:00.477301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3d81-a1ef-444f-933f-caaea8dd0ff2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.500799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.503844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.505576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.505968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/275c1e33-a67a-496c-b309-14e83967d658` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.508482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:create_region(region_id=275c1e33-a67a-496c-b309-14e83967d658)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.515836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.536039 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:00.554570 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4057/8146] 10.222.0.77 () {60 vars in 1258 bytes} [Mon Jul 11 15:23:00 2022] PUT /identity/v3/regions/275c1e33-a67a-496c-b309-14e83967d658 => generated 231 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:00.558786 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.584195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594686be-6882-4ece-9241-76c566671261 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.589587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.590584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.590972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.591433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/275c1e33-a67a-496c-b309-14e83967d658` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.592199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:delete_region(region_id=275c1e33-a67a-496c-b309-14e83967d658)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.594861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.625121 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4058/8147] 10.222.0.77 () {58 vars in 1241 bytes} [Mon Jul 11 15:23:00 2022] DELETE /identity/v3/regions/275c1e33-a67a-496c-b309-14e83967d658 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:00.625538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb83a-e37c-437b-8a22-b50a41b15cba tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.626365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.644234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.645176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.650965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.651491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.651993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a260dd-7a89-487c-8ba3-0df70d07997c tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.653987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:00.659494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.660254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.660606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.660963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.661749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.672501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.727752 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4059/8148] 10.222.0.77 () {60 vars in 1149 bytes} [Mon Jul 11 15:23:00 2022] POST /identity/v3/regions => generated 254 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:00.733931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.783523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f217eb-4f69-4032-85f0-ed024dac74c5 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.793081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.793285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.794380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.795031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.795138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.795476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/91127cbb5c754c8b9eef02b5931bef86` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.796480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:update_region(region_id=91127cbb5c754c8b9eef02b5931bef86)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.797764 n-d-master-1 devstack@keystone.service[80990]: WARNING py.warnings [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:23:00.797764 n-d-master-1 devstack@keystone.service[80990]: warnings.warn(msg) Jul 11 15:23:00.797764 n-d-master-1 devstack@keystone.service[80990]: Jul 11 15:23:00.799257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:00.837282 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4090/8149] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:23:00.856568 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4060/8150] 10.222.0.77 () {60 vars in 1249 bytes} [Mon Jul 11 15:23:00 2022] PATCH /identity/v3/regions/91127cbb5c754c8b9eef02b5931bef86 => generated 254 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:00.861153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:00.906841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cc4d5-20cc-4c31-92ae-c829bfbd3f87 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:00.975965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:00.977218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:00.977702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:00.978117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/91127cbb5c754c8b9eef02b5931bef86` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:00.978880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:get_region(region_id=91127cbb5c754c8b9eef02b5931bef86)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:00.980071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.000249 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4091/8151] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:23:00 2022] GET /identity/v3/regions/91127cbb5c754c8b9eef02b5931bef86 => generated 254 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:01.004051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.025252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d906-14af-4e55-879d-e4ed3716c640 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.035275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.036900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.037265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.037620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/91127cbb5c754c8b9eef02b5931bef86` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.038653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:delete_region(region_id=91127cbb5c754c8b9eef02b5931bef86)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.040464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.097533 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4061/8152] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:23:01 2022] DELETE /identity/v3/regions/91127cbb5c754c8b9eef02b5931bef86 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:01.100083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.119703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dbcb-73ff-4132-b003-a6b04f42d717 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.167923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.179513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.179841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.181858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.181858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.184813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.207000 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4092/8153] 10.222.0.77 () {58 vars in 1127 bytes} [Mon Jul 11 15:23:01 2022] GET /identity/v3/regions => generated 669 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:01.210284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.223845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d221-246b-49e7-8527-4d3b7e73e434 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.231611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.232776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.233435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.234407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/91127cbb5c754c8b9eef02b5931bef86` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.235431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:delete_region(region_id=91127cbb5c754c8b9eef02b5931bef86)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.238241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Could not find region: 91127cbb5c754c8b9eef02b5931bef86.: keystone.exception.RegionNotFound: Could not find region: 91127cbb5c754c8b9eef02b5931bef86. Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 91127cbb5c754c8b9eef02b5931bef86. Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:23:01.271491 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 91127cbb5c754c8b9eef02b5931bef86. Jul 11 15:23:01.272910 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:23:01.274784 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4062/8154] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:23:01 2022] DELETE /identity/v3/regions/91127cbb5c754c8b9eef02b5931bef86 => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:23:01.279763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.295503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1dffc-f2ef-4d12-90e0-2d6c49e95e1a tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.313270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.314038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.314432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.314788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.315597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.316995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.339277 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4093/8155] 10.222.0.77 () {58 vars in 1127 bytes} [Mon Jul 11 15:23:01 2022] GET /identity/v3/regions => generated 669 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:01.340322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.364317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a8e8-5a4b-4681-a5f1-68e7c77717d2 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.369560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.370372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.370787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.371169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.372169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.374000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.414460 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4063/8156] 10.222.0.77 () {60 vars in 1149 bytes} [Mon Jul 11 15:23:01 2022] POST /identity/v3/regions => generated 254 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:01.418663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.436662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a1333-b3b2-4cbd-a3ec-6e67a1db2748 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.462701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.463374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.463659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.463937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.464643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Adding query filter params (parent_region_id=7b5cbcb73d224fd7ba9953788f2158f6) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:01.464948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.466159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.475738 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4094/8157] 10.222.0.77 () {58 vars in 1226 bytes} [Mon Jul 11 15:23:01 2022] GET /identity/v3/regions?parent_region_id=7b5cbcb73d224fd7ba9953788f2158f6 => generated 400 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:01.479901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.493378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa63f4c-25bb-4c45-9362-18d973b313bc tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.505685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.507781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.508129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.508423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/b8733b6e32a24c5ba60f327abeb31c0c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.510936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:delete_region(region_id=b8733b6e32a24c5ba60f327abeb31c0c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.512805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.547061 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4064/8158] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:23:01 2022] DELETE /identity/v3/regions/b8733b6e32a24c5ba60f327abeb31c0c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:01.552477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.563211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbca6e-5bfb-4a83-8583-559918969728 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.584503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.584770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.587784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.587784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/72767548d49846ba80e8f50bcfb787a9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.587784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:delete_region(region_id=72767548d49846ba80e8f50bcfb787a9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.588225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.617858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.618082 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4095/8159] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:23:01 2022] DELETE /identity/v3/regions/72767548d49846ba80e8f50bcfb787a9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:01.639312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9361e-c754-4da4-9981-5a130b789f84 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.676131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e031d08-b20f-4044-b688-73d5538f7533 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4ca2cf74b34cff88987996d996a516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd18247c0e8684a44985fb73ab4bd9ac6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.676961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031d08-b20f-4044-b688-73d5538f7533 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.677434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031d08-b20f-4044-b688-73d5538f7533 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.677723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031d08-b20f-4044-b688-73d5538f7533 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] PATH_INFO: `/v3/regions/7b5cbcb73d224fd7ba9953788f2158f6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.678402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e031d08-b20f-4044-b688-73d5538f7533 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7b5cbcb73d224fd7ba9953788f2158f6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.680249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e031d08-b20f-4044-b688-73d5538f7533 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.708659 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:01.736799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4065/8160] 10.222.0.77 () {58 vars in 1229 bytes} [Mon Jul 11 15:23:01 2022] DELETE /identity/v3/regions/7b5cbcb73d224fd7ba9953788f2158f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:01.738659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:01.764571 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:01.839692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31598e4-bbdc-4b02-abb4-484006cac438 tempest-RegionsTestJSON-1199294167 tempest-RegionsTestJSON-1199294167-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:01.858428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:01.859414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:01.859721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:01.859976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] PATH_INFO: `/v3/users/11235ea5fa474e32a4a96f42053331d8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:01.861838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11235ea5fa474e32a4a96f42053331d8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:01.863893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:01.990149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11235ea5fa474e32a4a96f42053331d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:01.990852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11235ea5fa474e32a4a96f42053331d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:02.024670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11235ea5fa474e32a4a96f42053331d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:02.027112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11235ea5fa474e32a4a96f42053331d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:02.044796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11235ea5fa474e32a4a96f42053331d8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:02.075245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4096/8161] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:01 2022] DELETE /identity/v3/users/11235ea5fa474e32a4a96f42053331d8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:02.078322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:02.079041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:02.079372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:02.128047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:02.129761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:02.283813 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4066/8162] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:02.294304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:02.296175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:02.443217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481e80-e02b-4602-b00f-ab7a752a4e27 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:02.521033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:02.527245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:02.529227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:02.530179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:02.587424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:02.589796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:02.607885 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4097/8163] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:03.104279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:03.105741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:03.129528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f3f4a-c2f0-4694-8c6b-347c88e4696e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:03.137881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:03.138790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:03.139076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:03.139354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] PATH_INFO: `/v3/projects/8c5dd15a3a1d4ec6816db1f2cab27d89` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:03.142556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5dd15a3a1d4ec6816db1f2cab27d89)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:03.148579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:03.247736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5dd15a3a1d4ec6816db1f2cab27d89', 'request_id': 'req-1216c72e-42d6-4776-a947-87dff9977aaa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.268894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5dd15a3a1d4ec6816db1f2cab27d89', 'request_id': 'req-1216c72e-42d6-4776-a947-87dff9977aaa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.297864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5dd15a3a1d4ec6816db1f2cab27d89', 'request_id': 'req-1216c72e-42d6-4776-a947-87dff9977aaa'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.320608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] The token cache is being invalidate because project 8c5dd15a3a1d4ec6816db1f2cab27d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:03.321069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.321975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.326978 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4067/8164] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:03 2022] DELETE /identity/v3/projects/8c5dd15a3a1d4ec6816db1f2cab27d89 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:03.328221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:03.342821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e186-8078-4cbf-a403-d7af5f60e169 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:03.349504 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:03.441352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:03.443222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:03.443699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:03.443988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] PATH_INFO: `/v3/users/da4ca2cf74b34cff88987996d996a516` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:03.445864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4ca2cf74b34cff88987996d996a516)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:03.448030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:03.548955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4ca2cf74b34cff88987996d996a516'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.550258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4ca2cf74b34cff88987996d996a516'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.585627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4ca2cf74b34cff88987996d996a516'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.586410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4ca2cf74b34cff88987996d996a516'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.601154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43d62f9b-64a3-4d0f-8798-8409de74e65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4ca2cf74b34cff88987996d996a516'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:03.627100 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4098/8165] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:03 2022] DELETE /identity/v3/users/da4ca2cf74b34cff88987996d996a516 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:04.157833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:04.160033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:04.203036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216c72e-42d6-4776-a947-87dff9977aaa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:04.337296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:04.339166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:04.339825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:04.340613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] PATH_INFO: `/v3/projects/d18247c0e8684a44985fb73ab4bd9ac6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:04.342054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18247c0e8684a44985fb73ab4bd9ac6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:04.345141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:04.389263 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:04.435720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18247c0e8684a44985fb73ab4bd9ac6', 'request_id': 'req-7e412ff7-fe43-4709-85af-83c2b0d6d602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:04.465560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18247c0e8684a44985fb73ab4bd9ac6', 'request_id': 'req-7e412ff7-fe43-4709-85af-83c2b0d6d602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:04.478430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18247c0e8684a44985fb73ab4bd9ac6', 'request_id': 'req-7e412ff7-fe43-4709-85af-83c2b0d6d602'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:04.511217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] The token cache is being invalidate because project d18247c0e8684a44985fb73ab4bd9ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:04.512230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:04.517612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7e412ff7-fe43-4709-85af-83c2b0d6d602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:04.520615 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4068/8166] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:04 2022] DELETE /identity/v3/projects/d18247c0e8684a44985fb73ab4bd9ac6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:04.527932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:04.528491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:04.529081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:04.565333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:04.568260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:04.667834 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4099/8167] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:04.676972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:04.677297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:04.677608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:04.717189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:04.723369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:04.745648 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4069/8168] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:04.749616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:04.766228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05252b84-07bb-40ce-9605-81d2ddd44bcd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:04.777907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:04.778631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:04.778963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:04.779252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:04.779994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:04.780868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:04.782585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:04.807050 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4100/8169] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:04.811181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:04.825590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bbf89-3313-4ddb-af5f-502cae97cf46 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:04.836928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:04.837887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:04.838324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:04.838878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:04.839747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:04.846999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:04.895940 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4070/8170] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:04 2022] POST /identity/v3/projects => generated 393 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:04.896824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:04.914709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1ce9-ee79-414a-97ba-c24183bd46a7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:04.936958 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:04.999499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.000220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.000518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.000798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.001545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.003671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.031560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4101/8171] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:04 2022] POST /identity/v3/users => generated 303 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:05.036581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.052106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5b43d-e40e-4b79-8885-adcbf3ca444f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.059620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.060320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.060611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.060902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.061674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.063585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.077042 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4071/8172] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:05.082348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.096977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8ebe-b07a-4534-a986-1636ece9a2ad admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.104437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.105392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.107496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.108069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] PATH_INFO: `/v3/projects/64c36547c1ac4a25999d2b16d7058a6a/users/f66faa4108a94daf838fc06494ea767b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.129474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c36547c1ac4a25999d2b16d7058a6a, user_id=f66faa4108a94daf838fc06494ea767b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.134712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.162640 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4102/8173] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:05 2022] PUT /identity/v3/projects/64c36547c1ac4a25999d2b16d7058a6a/users/f66faa4108a94daf838fc06494ea767b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:05.163813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.178314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd53aa-1cb9-42b1-9cbe-5ea0ea0ab270 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.288079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7c6c8-5500-4dd5-baf0-8c300cc22c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.289216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c6c8-5500-4dd5-baf0-8c300cc22c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.289656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c6c8-5500-4dd5-baf0-8c300cc22c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.290560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c6c8-5500-4dd5-baf0-8c300cc22c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.292138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7c6c8-5500-4dd5-baf0-8c300cc22c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.294308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7c6c8-5500-4dd5-baf0-8c300cc22c9e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.314905 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4072/8174] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:05.316289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.334240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4626386-715d-444e-ad87-e3377ea5de23 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.341480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.343249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.343805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.344680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] PATH_INFO: `/v3/projects/64c36547c1ac4a25999d2b16d7058a6a/users/f66faa4108a94daf838fc06494ea767b/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.347459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c36547c1ac4a25999d2b16d7058a6a, user_id=f66faa4108a94daf838fc06494ea767b, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.350687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.371018 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4103/8175] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:05 2022] PUT /identity/v3/projects/64c36547c1ac4a25999d2b16d7058a6a/users/f66faa4108a94daf838fc06494ea767b/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:05.382540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.383076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.383076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.419701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] MFA Rules not processed for user `f66faa4108a94daf838fc06494ea767b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:05.422272 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:05.508257 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:05.534976 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4073/8176] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:05.538988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.611237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582108a-ad89-4f2b-91c0-e83816f72e33 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.616575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.617228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.617510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.617783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.618481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.620462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.650964 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4104/8177] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:05 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:05.654787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.666055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25245db9-ce40-4aa1-9d17-868853b8cc1c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.737439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.738262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.738598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.739005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.739701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.741678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.766922 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4074/8178] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:05 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:05.768298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.784607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff72a31-5988-41e3-87ab-2611a703f60a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.791002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.791841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.794031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.794031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.794031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.794968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.812376 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4105/8179] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:05.813571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.827892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7449fc3-35a4-4a01-88cb-09087c7721f1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.837956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a540338-f128-49e3-8a01-08ba77f90053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.838678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a540338-f128-49e3-8a01-08ba77f90053 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.838975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a540338-f128-49e3-8a01-08ba77f90053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.839260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a540338-f128-49e3-8a01-08ba77f90053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.840009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a540338-f128-49e3-8a01-08ba77f90053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.844963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a540338-f128-49e3-8a01-08ba77f90053 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.866600 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4075/8180] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:05.871409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:05.885581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34999b67-ed6e-487c-8685-3f083980dc14 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:05.896318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:05.897326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.897687 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.898047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] PATH_INFO: `/v3/projects/b9dd24ef500b460da6547872af14132d/users/0d9f3fad7ae849d4b1945ef0839e4706/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:05.918247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9dd24ef500b460da6547872af14132d, user_id=0d9f3fad7ae849d4b1945ef0839e4706, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:05.921771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:05.943960 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4106/8181] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:05 2022] PUT /identity/v3/projects/b9dd24ef500b460da6547872af14132d/users/0d9f3fad7ae849d4b1945ef0839e4706/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:05.953988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:05.954372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:05.954684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:06.003986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] MFA Rules not processed for user `0d9f3fad7ae849d4b1945ef0839e4706`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:06.005372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:06.083116 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4076/8182] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:06.094800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:06.096768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:06.120294 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:06.179500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78642f5-66fb-435a-beff-659df07dc82a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:06.184540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230b440-f1fd-41ab-8f5d-96fc5569e5e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:06.185380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230b440-f1fd-41ab-8f5d-96fc5569e5e6 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:06.185825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230b440-f1fd-41ab-8f5d-96fc5569e5e6 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:06.186316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230b440-f1fd-41ab-8f5d-96fc5569e5e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:06.263818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230b440-f1fd-41ab-8f5d-96fc5569e5e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:06.265630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230b440-f1fd-41ab-8f5d-96fc5569e5e6 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:06.281855 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4107/8183] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:06.919687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:06.980199 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:06.985184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ba86b-de3a-43b7-a8cd-9c94e36ffdb0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:06.991013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:06.992070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:06.992392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:06.992739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] PATH_INFO: `/v3/users/f66faa4108a94daf838fc06494ea767b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:06.993951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66faa4108a94daf838fc06494ea767b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:06.995946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:07.063948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66faa4108a94daf838fc06494ea767b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.079206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66faa4108a94daf838fc06494ea767b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.088207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66faa4108a94daf838fc06494ea767b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.098046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66faa4108a94daf838fc06494ea767b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.098808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66faa4108a94daf838fc06494ea767b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.109711 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4077/8184] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:06 2022] DELETE /identity/v3/users/f66faa4108a94daf838fc06494ea767b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:07.111419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:07.111867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:07.112138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:07.138777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:07.145335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:07.251766 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4108/8185] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:07.265196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:07.268041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:07.347587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1cd6-6c98-494e-b39b-c7f69f38daa3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:07.351902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:07.352930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:07.353267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:07.353779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:07.365178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:07.366793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:07.384379 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4078/8186] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:07.709511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:07.712309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:07.729222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85770f14-8c51-4ce2-98d1-ba55ba8f4346 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:07.734538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:07.735673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:07.735673 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:07.735960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] PATH_INFO: `/v3/projects/64c36547c1ac4a25999d2b16d7058a6a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:07.737210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c36547c1ac4a25999d2b16d7058a6a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:07.739215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:07.792625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c36547c1ac4a25999d2b16d7058a6a', 'request_id': 'req-35dc877d-1153-4bfd-aa77-641440060e0f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.796465 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:07.800765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c36547c1ac4a25999d2b16d7058a6a', 'request_id': 'req-35dc877d-1153-4bfd-aa77-641440060e0f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.807861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c36547c1ac4a25999d2b16d7058a6a', 'request_id': 'req-35dc877d-1153-4bfd-aa77-641440060e0f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.822171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] The token cache is being invalidate because project 64c36547c1ac4a25999d2b16d7058a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:07.822463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.823167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.825324 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4109/8187] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:07 2022] DELETE /identity/v3/projects/64c36547c1ac4a25999d2b16d7058a6a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:07.829829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:07.840349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c476-917b-44e7-a129-a4a7d4d3693b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:07.912540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:07.915108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:07.915108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:07.915108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] PATH_INFO: `/v3/users/0d9f3fad7ae849d4b1945ef0839e4706` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:07.917273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9f3fad7ae849d4b1945ef0839e4706)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:07.919511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:07.952328 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:07.979433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9f3fad7ae849d4b1945ef0839e4706'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:07.994767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9f3fad7ae849d4b1945ef0839e4706'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.003090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9f3fad7ae849d4b1945ef0839e4706'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.012880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9f3fad7ae849d4b1945ef0839e4706'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.013882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf16031b-f3df-40e7-b973-8e18681405a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9f3fad7ae849d4b1945ef0839e4706'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.027851 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4079/8188] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:07 2022] DELETE /identity/v3/users/0d9f3fad7ae849d4b1945ef0839e4706 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:08.333822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.335332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:08.354537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc877d-1153-4bfd-aa77-641440060e0f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.436440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.437297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.437578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.437845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] PATH_INFO: `/v3/projects/b9dd24ef500b460da6547872af14132d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.439060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9dd24ef500b460da6547872af14132d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.441218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:08.491963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dd24ef500b460da6547872af14132d', 'request_id': 'req-b74cc591-14e8-41fc-a203-4c4c294b8b83'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.501024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dd24ef500b460da6547872af14132d', 'request_id': 'req-b74cc591-14e8-41fc-a203-4c4c294b8b83'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.508150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dd24ef500b460da6547872af14132d', 'request_id': 'req-b74cc591-14e8-41fc-a203-4c4c294b8b83'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.520995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] The token cache is being invalidate because project b9dd24ef500b460da6547872af14132d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:08.521299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.522002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b74cc591-14e8-41fc-a203-4c4c294b8b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:08.523793 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4110/8189] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:08 2022] DELETE /identity/v3/projects/b9dd24ef500b460da6547872af14132d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:08.528382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.529490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.529978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.549850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:08.551658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:08.640380 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4080/8190] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:08.648246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.648538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.648866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.669032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:08.670593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:08.679007 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4111/8191] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:08.683270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.693552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c95bb-00d3-488e-99dd-69fe421fb298 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.698113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.698806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.699308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.699592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.700348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:08.700657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.702935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:08.715407 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4081/8192] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:08.720130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.730374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44963f-ccc2-44ed-9ae5-dcb4331a1745 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.735331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.736017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.736296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.736567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.737269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.739221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:08.768676 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4112/8193] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:08 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:08.772741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.784844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949f48f-dace-4cf3-a927-88c2546e6d74 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.849758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.850689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.850985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.851270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.852079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.854242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:08.875421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4082/8194] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:08 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:08.879204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.891019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27d7fe-64d7-4cca-8eae-e67ebe48cd94 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.896437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.897119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.897572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.897861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.898719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.900325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:08.915822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4113/8195] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:08.917353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.928145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1554e8-b3a5-4848-8702-9cdfb52d28b6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.933076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9848061-c686-4602-af61-5c1459a0e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.933750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848061-c686-4602-af61-5c1459a0e79f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.934042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848061-c686-4602-af61-5c1459a0e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.934325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848061-c686-4602-af61-5c1459a0e79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.935159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9848061-c686-4602-af61-5c1459a0e79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.936994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9848061-c686-4602-af61-5c1459a0e79f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:08.949704 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4083/8196] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:08.954353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:08.966467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4083e-9eca-4e94-a7a4-044c831ac3c4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:08.972166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:08.973056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:08.973346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:08.973626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] PATH_INFO: `/v3/projects/8ad8a747b7bb466fae715a9621b628cf/users/f46f053a2ff94d31be3e5b77f4387327/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:08.993682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad8a747b7bb466fae715a9621b628cf, user_id=f46f053a2ff94d31be3e5b77f4387327, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:08.996624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.027737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.028297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.028297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.029647 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4114/8197] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:08 2022] PUT /identity/v3/projects/8ad8a747b7bb466fae715a9621b628cf/users/f46f053a2ff94d31be3e5b77f4387327/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:09.035455 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:09.077645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] MFA Rules not processed for user `f46f053a2ff94d31be3e5b77f4387327`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:09.079048 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:09.183092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4084/8198] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:09.189609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:09.204820 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:09.301772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07700b5-74b5-468f-a5d7-03ad20c2feca admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:09.310017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:09.312025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.312447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.312690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.313934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:09.316952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.349406 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4115/8199] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:09 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:09.354381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:09.370306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684c167-ee58-4a32-9cdf-f85805ae1fec None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:09.468557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:09.469267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.469550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.469857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.470673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:09.474474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.501343 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4085/8200] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:09 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:09.505490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:09.519769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd101e-89f4-4c1f-b0a8-22c8edcbfbc1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:09.527155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:09.527851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.528142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.528429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.531085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:09.532807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.549548 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4116/8201] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:09.552811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:09.566606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da933-1962-4a1d-b2b0-a7887c9e80f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:09.574360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350819f8-0840-42e8-93ca-a495974ff464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:09.575339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350819f8-0840-42e8-93ca-a495974ff464 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.575793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350819f8-0840-42e8-93ca-a495974ff464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.576569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350819f8-0840-42e8-93ca-a495974ff464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.577989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350819f8-0840-42e8-93ca-a495974ff464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:09.579729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350819f8-0840-42e8-93ca-a495974ff464 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.598689 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4086/8202] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:09.599914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:09.614860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81eb7-b2fb-4394-95f9-e6c39053188f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:09.623407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:09.624362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.624648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.624928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] PATH_INFO: `/v3/projects/7c2751d4f3754f71aeb0904fb4f1f24d/users/16daf5b0916e494685a2e257f991dae2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.669154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2751d4f3754f71aeb0904fb4f1f24d, user_id=16daf5b0916e494685a2e257f991dae2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:09.671878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.701831 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4117/8203] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:09 2022] PUT /identity/v3/projects/7c2751d4f3754f71aeb0904fb4f1f24d/users/16daf5b0916e494685a2e257f991dae2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:09.713805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f86a6-a2be-418e-8f45-a25b2e96890b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.714178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f86a6-a2be-418e-8f45-a25b2e96890b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.714668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f86a6-a2be-418e-8f45-a25b2e96890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.744135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-028f86a6-a2be-418e-8f45-a25b2e96890b None None] MFA Rules not processed for user `16daf5b0916e494685a2e257f991dae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:09.745446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-028f86a6-a2be-418e-8f45-a25b2e96890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:09.824513 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4087/8204] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:09.832707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:09.834441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:09.898047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ca46f-a18b-4db1-9aa6-2ddce0f0bc61 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:09.901764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:09.902417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:09.902739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:09.903024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:09.963331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:09.964778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:09.975191 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4118/8205] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:10.088373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:10.088867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:10.088949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:10.096170 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:10.111022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:10.112314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:10.228053 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4088/8206] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:10.293225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:10.295052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:10.318684 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:10.411068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b63f65-3aa5-47e7-a0f3-00be115a432c service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:10.416497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6bf78-7fc2-4697-b0a8-e7f0ee488aac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:10.417103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6bf78-7fc2-4697-b0a8-e7f0ee488aac service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:10.417379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6bf78-7fc2-4697-b0a8-e7f0ee488aac service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:10.417662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6bf78-7fc2-4697-b0a8-e7f0ee488aac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:10.431197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6bf78-7fc2-4697-b0a8-e7f0ee488aac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:10.434008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6bf78-7fc2-4697-b0a8-e7f0ee488aac service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:10.453982 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4119/8207] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:23:10.675462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:10.676851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:10.705939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45506d4-d0a0-4578-af6d-98cf1334d148 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:10.721397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:10.722510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:10.722910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:10.723297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:10.734239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:10.735875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:10.747078 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4089/8208] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:23:10.849351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:10.849644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:10.849914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:10.887222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:10.888376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:10.910974 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4120/8209] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:10.924552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:10.940472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56b50-8377-492a-af6d-cc2d0e4c5a19 service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:10.946634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:10.947489 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:10.947934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:10.948396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:10.959475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:10.961389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:10.979955 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4090/8210] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:23:11.161379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:11.285429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:11.290012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:11.312322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6980-220b-4381-b21d-ce60d61a2ac7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:11.319642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:11.333534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:11.334073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:11.337000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] PATH_INFO: `/v3/users/f46f053a2ff94d31be3e5b77f4387327` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:11.339375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46f053a2ff94d31be3e5b77f4387327)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:11.343202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:11.435359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298ad03-b67b-4acb-91da-c92d0a697788 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:11.439794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46f053a2ff94d31be3e5b77f4387327'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.445748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46f053a2ff94d31be3e5b77f4387327'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.449133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:11.450158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:11.450577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:11.451017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] PATH_INFO: `/v3/users/ca7ef83fe1f64e7dbcac10527a650331` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:11.453284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7ef83fe1f64e7dbcac10527a650331)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:11.456408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:11.466541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46f053a2ff94d31be3e5b77f4387327'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.468203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46f053a2ff94d31be3e5b77f4387327'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.490686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-426985cb-ec52-43af-b17f-cc088dad22d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46f053a2ff94d31be3e5b77f4387327'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.517754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4121/8211] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:11 2022] DELETE /identity/v3/users/f46f053a2ff94d31be3e5b77f4387327 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:11.523932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:11.525775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:11.526860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:11.535101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7ef83fe1f64e7dbcac10527a650331'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.549980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7ef83fe1f64e7dbcac10527a650331'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.558132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7ef83fe1f64e7dbcac10527a650331'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.560230 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:11.571429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7ef83fe1f64e7dbcac10527a650331'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.572185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a1f544d-a93b-47ef-a1c9-7cdb2026bd98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7ef83fe1f64e7dbcac10527a650331'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:11.579601 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4091/8212] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:11 2022] DELETE /identity/v3/users/ca7ef83fe1f64e7dbcac10527a650331 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:11.583914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:11.584312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:11.584955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:11.590617 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:11.605679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:11.606560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:11.607468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:11.607761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:11.710429 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4092/8213] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:11.721270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:11.723194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:11.749365 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4122/8214] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:11.750658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:11.752291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:11.854596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c863240-225e-4094-bc32-d53e9e82231d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:11.860667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:11.860831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f940bf-9258-448c-8c38-6dd2e6b4e15d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:11.861793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:11.862230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:11.864203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:11.865078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:11.865906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:11.866200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:11.866482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:11.876537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:11.878810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:11.883571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:11.885041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:11.906049 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4123/8215] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:11.906444 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4093/8216] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:23:12.519462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:12.520957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:12.534400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:12.538598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:12.541448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187eb4a-8c69-411d-91d5-0b36a7aeaea2 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:12.551935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:12.552934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:12.553226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:12.553516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] PATH_INFO: `/v3/projects/8ad8a747b7bb466fae715a9621b628cf` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:12.554862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad8a747b7bb466fae715a9621b628cf)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:12.559512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:12.574203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394636-33e2-4936-8514-43ea34083c18 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:12.587871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:12.589030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:12.589404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:12.589973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] PATH_INFO: `/v3/projects/93adca6600cb4f2ca5ed93786c1a7f21` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:12.591545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93adca6600cb4f2ca5ed93786c1a7f21)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:12.593530 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:12.641957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad8a747b7bb466fae715a9621b628cf', 'request_id': 'req-bd8bc34d-9b45-4ea9-a125-64119d92f107'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.650394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad8a747b7bb466fae715a9621b628cf', 'request_id': 'req-bd8bc34d-9b45-4ea9-a125-64119d92f107'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.657077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad8a747b7bb466fae715a9621b628cf', 'request_id': 'req-bd8bc34d-9b45-4ea9-a125-64119d92f107'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.661947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93adca6600cb4f2ca5ed93786c1a7f21', 'request_id': 'req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.668612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93adca6600cb4f2ca5ed93786c1a7f21', 'request_id': 'req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.669241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] The token cache is being invalidate because project 8ad8a747b7bb466fae715a9621b628cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:12.669532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.670185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.673072 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4124/8217] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:12 2022] DELETE /identity/v3/projects/8ad8a747b7bb466fae715a9621b628cf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:12.676642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:12.677804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93adca6600cb4f2ca5ed93786c1a7f21', 'request_id': 'req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.678576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:12.691296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] The token cache is being invalidate because project 93adca6600cb4f2ca5ed93786c1a7f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:12.691816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.692532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.697139 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4094/8218] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:12 2022] DELETE /identity/v3/projects/93adca6600cb4f2ca5ed93786c1a7f21 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:12.698308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:12.699729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:12.719741 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:12.723250 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:12.754037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc34d-9b45-4ea9-a125-64119d92f107 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:12.782330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f15c5-dcf0-4f24-8898-dfd82cc3c637 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:12.788125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:12.789258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:12.789625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:12.789985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] PATH_INFO: `/v3/users/9699cca43e3e4d3fb24cd544791ac6c7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:12.791476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9699cca43e3e4d3fb24cd544791ac6c7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:12.793659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:12.823547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:12.824496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:12.824783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:12.825143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] PATH_INFO: `/v3/users/16daf5b0916e494685a2e257f991dae2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:12.826398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16daf5b0916e494685a2e257f991dae2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:12.828399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:12.850623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9699cca43e3e4d3fb24cd544791ac6c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.876768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9699cca43e3e4d3fb24cd544791ac6c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.882237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16daf5b0916e494685a2e257f991dae2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.883083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16daf5b0916e494685a2e257f991dae2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.887157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9699cca43e3e4d3fb24cd544791ac6c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.898861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16daf5b0916e494685a2e257f991dae2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.899521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9699cca43e3e4d3fb24cd544791ac6c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.900079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16daf5b0916e494685a2e257f991dae2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.900758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9699cca43e3e4d3fb24cd544791ac6c7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.909342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16daf5b0916e494685a2e257f991dae2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:12.910696 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4095/8219] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:12 2022] DELETE /identity/v3/users/9699cca43e3e4d3fb24cd544791ac6c7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:12.930566 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4125/8220] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:12 2022] DELETE /identity/v3/users/16daf5b0916e494685a2e257f991dae2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:13.233417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.235015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:13.269456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.271796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:13.343178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1799a-73b5-47ff-ae02-a56275a87bf3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.358795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef6fb-98ac-45cc-891d-036db083be07 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.363717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.364715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.365074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.365428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] PATH_INFO: `/v3/projects/7c2751d4f3754f71aeb0904fb4f1f24d` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.366805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2751d4f3754f71aeb0904fb4f1f24d)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.368883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.371017 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:13.394868 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:13.417801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.419251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.419750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.420439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] PATH_INFO: `/v3/projects/579347512eb74561a94c665219261b2c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.423458 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579347512eb74561a94c665219261b2c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.425915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.434967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2751d4f3754f71aeb0904fb4f1f24d', 'request_id': 'req-fe797975-7657-43ac-a96b-1ab3dfef43f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.445169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2751d4f3754f71aeb0904fb4f1f24d', 'request_id': 'req-fe797975-7657-43ac-a96b-1ab3dfef43f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.451494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2751d4f3754f71aeb0904fb4f1f24d', 'request_id': 'req-fe797975-7657-43ac-a96b-1ab3dfef43f5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.467821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] The token cache is being invalidate because project 7c2751d4f3754f71aeb0904fb4f1f24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:13.468186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.469148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fe797975-7657-43ac-a96b-1ab3dfef43f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.475044 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4126/8221] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:13 2022] DELETE /identity/v3/projects/7c2751d4f3754f71aeb0904fb4f1f24d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:13.476677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1384-5bf2-46aa-a779-a8595d2eeb4e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.477033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1384-5bf2-46aa-a779-a8595d2eeb4e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.477694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1384-5bf2-46aa-a779-a8595d2eeb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.488957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579347512eb74561a94c665219261b2c', 'request_id': 'req-c0bf1b9a-a79a-416e-b381-60d1ed940736'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.496178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579347512eb74561a94c665219261b2c', 'request_id': 'req-c0bf1b9a-a79a-416e-b381-60d1ed940736'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.499355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b55b1384-5bf2-46aa-a779-a8595d2eeb4e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:13.500695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b55b1384-5bf2-46aa-a779-a8595d2eeb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:13.505346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579347512eb74561a94c665219261b2c', 'request_id': 'req-c0bf1b9a-a79a-416e-b381-60d1ed940736'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.520376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] The token cache is being invalidate because project 579347512eb74561a94c665219261b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:13.520756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.522167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c0bf1b9a-a79a-416e-b381-60d1ed940736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:13.527306 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4096/8222] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:13 2022] DELETE /identity/v3/projects/579347512eb74561a94c665219261b2c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:13.528795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60e10-a385-47f0-a481-d4aac3435e62 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.529091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60e10-a385-47f0-a481-d4aac3435e62 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.529373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60e10-a385-47f0-a481-d4aac3435e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.561146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fab60e10-a385-47f0-a481-d4aac3435e62 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:13.562346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fab60e10-a385-47f0-a481-d4aac3435e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:13.572419 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4127/8223] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:13.580836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.581133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.581412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.602169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:13.603416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:13.613061 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4128/8224] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:13.617114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.626124 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4097/8225] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:13.626527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215cdc-92ed-422a-9d3d-7f0f64bc9292 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.631152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.631804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.632092 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.632638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.633377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:13.633672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.633792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.633970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.634251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.635331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.648643 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4129/8226] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:23:13.653128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.656301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:13.657579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:13.666115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66132-bfef-4051-9aa5-b5c2e9a617d9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.666332 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4098/8227] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:13.671403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.671647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.672309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.672593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.672904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.673615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.675892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.680808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1346-25fc-4551-b5bd-189aa8499a1f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.685909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.687071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.687071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.687266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.687920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:13.688235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.689839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.703189 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4099/8228] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:13.707705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.709519 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4130/8229] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:13.714199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.719243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ed006-0300-4eb1-bc8e-43b10afc5ff5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.785793 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:13.788793 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:13.799116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.800163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.800769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.801277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.801933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.803775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b11bc-a3fc-40f8-be03-af1f07a56366 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.804012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.808774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.809446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.809739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.810021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.810735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.812727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.835763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4100/8230] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:13.836040 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4131/8231] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:13.837032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.837151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.847257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8d112-506d-4f50-b0af-aede27ac568f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.899462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff016ef-a976-4f52-98e8-2a2ee79a88c7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.904107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.904797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.905590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.905718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.905931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.906263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.906578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.906680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.906861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.907630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.908556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.909204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.919123 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4132/8232] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:23:13.923025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.928737 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4101/8233] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:13 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:13.932709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.933101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d15479-880f-4de3-9c22-39a3ac593097 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.938438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.939137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.939425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.939711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.940430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.942419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.943083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ed9ae-307a-4137-95ff-ff4dc2c65063 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.948964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.949731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.949903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.950177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.950948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.953079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.954743 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4133/8234] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:23:13.959010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.968091 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4102/8235] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:13.971365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:13.971741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8d785-7ae2-47cf-aa7b-f335965d0c3e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.977352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.978415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.978879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:13.979177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] PATH_INFO: `/v3/projects/08d9c6db62264a30a5aa3b79b41637df/users/9873955edcad41858d06c32894f3eb6e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:13.985041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9723a92-a850-4680-8546-a7cbd0b5c3f6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:13.996717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d9c6db62264a30a5aa3b79b41637df, user_id=9873955edcad41858d06c32894f3eb6e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:13.998810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981b9c-46b2-45f0-ba67-f4edde1404b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:13.999590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981b9c-46b2-45f0-ba67-f4edde1404b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:13.999772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:13.999872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981b9c-46b2-45f0-ba67-f4edde1404b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.000152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981b9c-46b2-45f0-ba67-f4edde1404b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.000949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981b9c-46b2-45f0-ba67-f4edde1404b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.003330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981b9c-46b2-45f0-ba67-f4edde1404b7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.014871 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4134/8236] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:13 2022] PUT /identity/v3/projects/08d9c6db62264a30a5aa3b79b41637df/users/9873955edcad41858d06c32894f3eb6e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:14.017732 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4103/8237] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:23:14.025443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.026240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.026567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.026914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.070816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] MFA Rules not processed for user `9873955edcad41858d06c32894f3eb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:14.072341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:14.102530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87d246-c291-49ca-8773-f91a057324f4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.107525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc1efd-5120-472c-936a-49542c40016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.108457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc1efd-5120-472c-936a-49542c40016c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.108729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc1efd-5120-472c-936a-49542c40016c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.109010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc1efd-5120-472c-936a-49542c40016c admin admin] PATH_INFO: `/v3/projects/5ac924f555aa4ab898578d9707234371/users/3e63b265feef4c21b7650a0c39923d73/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.125073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc1efd-5120-472c-936a-49542c40016c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac924f555aa4ab898578d9707234371, user_id=3e63b265feef4c21b7650a0c39923d73, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.127788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc1efd-5120-472c-936a-49542c40016c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.144261 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4135/8238] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:14 2022] PUT /identity/v3/projects/5ac924f555aa4ab898578d9707234371/users/3e63b265feef4c21b7650a0c39923d73/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:14.156630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.157012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.157364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.158527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4104/8239] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:14.162954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.175627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5a77-a449-4251-a5f3-c6538c059ee3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.193820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] MFA Rules not processed for user `3e63b265feef4c21b7650a0c39923d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:14.194853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:14.207107 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:14.219701 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:14.252276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.252950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.253279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.253521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.254389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.256344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.276845 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4136/8240] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:14.289081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.291050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:14.294547 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4105/8241] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:14 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:14.298692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.365288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6bce-85b5-460d-98ea-bc41e0ac1586 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.382173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a0db-049d-450e-8dd7-c51f091630d9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.388904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.390156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.390445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.390757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.391467 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.393412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.422031 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4106/8242] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:14 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:14.423029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.423412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.423772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.423992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.424276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.441778 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3bfd-b894-4a86-b3df-c3c47089d388 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.448145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.448824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.450903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.452555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.455386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.457061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.471292 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4107/8243] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:14.475222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.496352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.497800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9500d3b-6a94-45fa-b3ad-d084c8f4d8dd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.497922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.507807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9674a9-9041-4985-bf6c-92537a2bcb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.508720 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4137/8244] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:14.510572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9674a9-9041-4985-bf6c-92537a2bcb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.510953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9674a9-9041-4985-bf6c-92537a2bcb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.511313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9674a9-9041-4985-bf6c-92537a2bcb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.512161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9674a9-9041-4985-bf6c-92537a2bcb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.514027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9674a9-9041-4985-bf6c-92537a2bcb56 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.527614 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4108/8245] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:23:14.531474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.546909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed839545-0ed3-42d0-91cc-ce223496f146 service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.551661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.552663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.552983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.553394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] PATH_INFO: `/v3/projects/87a3fd79e3d042989047637a248904b1/users/4be8c3f11c70486fb2b5a99e55a56f01/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.573527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a3fd79e3d042989047637a248904b1, user_id=4be8c3f11c70486fb2b5a99e55a56f01, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.576360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.591525 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:14.597605 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4138/8246] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:14 2022] PUT /identity/v3/projects/87a3fd79e3d042989047637a248904b1/users/4be8c3f11c70486fb2b5a99e55a56f01/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:14.608945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.609482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.609482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.643230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] MFA Rules not processed for user `4be8c3f11c70486fb2b5a99e55a56f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:14.644491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:14.729619 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4109/8247] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:14.741820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:14.807677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0ed1-2def-447d-a610-49b231759612 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:14.812949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:14.813607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:14.813894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:14.814177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:14.883777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:14.885503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:14.900035 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4139/8248] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:15.072978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:15.086456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d47d3-05b3-4c43-849e-9830b800c5bf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:15.090424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cf4a0-a202-45f0-bea8-5119c820591a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:15.100138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cf4a0-a202-45f0-bea8-5119c820591a service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:15.100498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cf4a0-a202-45f0-bea8-5119c820591a service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:15.101044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cf4a0-a202-45f0-bea8-5119c820591a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:15.111168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cf4a0-a202-45f0-bea8-5119c820591a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:15.112616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cf4a0-a202-45f0-bea8-5119c820591a service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:15.122832 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4110/8249] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:16.322296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:16.408967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7986-3f41-48bb-9e2b-4d64b98bcca7 service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:16.414270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:16.415284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:16.415573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:16.415861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] PATH_INFO: `/v3/users/9873955edcad41858d06c32894f3eb6e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:16.417058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9873955edcad41858d06c32894f3eb6e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:16.419005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:16.480231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9873955edcad41858d06c32894f3eb6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:16.480961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9873955edcad41858d06c32894f3eb6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:16.490261 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:16.501500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9873955edcad41858d06c32894f3eb6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:16.502356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9873955edcad41858d06c32894f3eb6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:16.511302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9873955edcad41858d06c32894f3eb6e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:16.525386 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4140/8250] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:16 2022] DELETE /identity/v3/users/9873955edcad41858d06c32894f3eb6e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:16.530743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:16.531572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:16.531885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:16.545025 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:16.553361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:16.556252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:16.626763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4111/8251] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:16.641530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:16.643033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:16.713596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd716b-e0b5-4102-b6d3-31636e604366 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:16.719003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:16.719886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:16.720607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:16.720607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:16.730920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:16.732342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:16.744036 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4141/8252] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:17.246032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:17.248131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:17.263809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf56f1-acc9-4aa2-b586-d0b620bff825 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:17.269781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:17.270958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:17.271404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:17.271914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] PATH_INFO: `/v3/projects/08d9c6db62264a30a5aa3b79b41637df` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:17.279498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d9c6db62264a30a5aa3b79b41637df)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:17.281557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:17.355614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d9c6db62264a30a5aa3b79b41637df', 'request_id': 'req-df5c49d4-d073-458e-8bd0-cc5d511b6af8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.370785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d9c6db62264a30a5aa3b79b41637df', 'request_id': 'req-df5c49d4-d073-458e-8bd0-cc5d511b6af8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.385810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d9c6db62264a30a5aa3b79b41637df', 'request_id': 'req-df5c49d4-d073-458e-8bd0-cc5d511b6af8'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.402767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] The token cache is being invalidate because project 08d9c6db62264a30a5aa3b79b41637df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:17.403367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.404236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.407698 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4112/8253] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:17 2022] DELETE /identity/v3/projects/08d9c6db62264a30a5aa3b79b41637df => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:17.411742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:17.423681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acba3c-faca-44f9-9702-cde4fde669aa service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:17.499428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:17.500411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:17.500763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:17.501099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] PATH_INFO: `/v3/users/4be8c3f11c70486fb2b5a99e55a56f01` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:17.502710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be8c3f11c70486fb2b5a99e55a56f01)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:17.504700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:17.560392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be8c3f11c70486fb2b5a99e55a56f01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.561721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be8c3f11c70486fb2b5a99e55a56f01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.580587 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be8c3f11c70486fb2b5a99e55a56f01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.581317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be8c3f11c70486fb2b5a99e55a56f01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.588719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-59b79f04-4218-4d0e-b628-692447bc3cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be8c3f11c70486fb2b5a99e55a56f01'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:17.591762 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:17.608139 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4142/8254] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:17 2022] DELETE /identity/v3/users/4be8c3f11c70486fb2b5a99e55a56f01 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:18.080318 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:18.081857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:18.097999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c49d4-d073-458e-8bd0-cc5d511b6af8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:18.239587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:18.243068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.243649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.244453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] PATH_INFO: `/v3/projects/87a3fd79e3d042989047637a248904b1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:18.247181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a3fd79e3d042989047637a248904b1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:18.254605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:18.345306 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:18.396232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a3fd79e3d042989047637a248904b1', 'request_id': 'req-aabc4568-fd5f-4d79-9814-49f91e681983'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:18.410933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a3fd79e3d042989047637a248904b1', 'request_id': 'req-aabc4568-fd5f-4d79-9814-49f91e681983'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:18.422012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a3fd79e3d042989047637a248904b1', 'request_id': 'req-aabc4568-fd5f-4d79-9814-49f91e681983'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:18.457133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] The token cache is being invalidate because project 87a3fd79e3d042989047637a248904b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:18.457443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:18.458545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aabc4568-fd5f-4d79-9814-49f91e681983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:18.462412 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4113/8255] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:18 2022] DELETE /identity/v3/projects/87a3fd79e3d042989047637a248904b1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:18.475852 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.478728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.479851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:18.522322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:18.523980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:18.640637 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4143/8256] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:18.648744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.648899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.649155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:18.689042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:18.690302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:18.713075 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4114/8257] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:18.717297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:18.728110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6c68f-1f65-453c-9be8-985520c4c9c1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:18.733233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:18.734275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.734275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.734539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:18.735191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:18.735498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:18.737089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:18.754938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:18.756095 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4144/8258] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:18.767582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169387f-d4bf-4fcc-8752-5becc597cbb7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:18.773880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:18.774672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.775042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.775397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:18.776442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:18.778734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:18.819215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:18.826420 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4115/8259] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:18 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:18.832583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a027ed-9fa2-4237-bdb2-6e3179d2d655 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:18.929835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:18.930878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.931376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.931834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:18.932731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:18.936508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:18.963082 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4145/8260] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:18 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:18.969169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:18.984529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202e30e-8743-40f3-a547-d854299808d5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:18.995934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:18.997140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:18.997495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:18.997849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.001093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.002945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.022548 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4116/8261] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:19.024368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.037784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bdfcd-0624-489a-8402-ada19c672295 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.060193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af2f2b-a092-4196-b63d-b57d7707ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.062733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af2f2b-a092-4196-b63d-b57d7707ce20 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.063028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af2f2b-a092-4196-b63d-b57d7707ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.063313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af2f2b-a092-4196-b63d-b57d7707ce20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.064072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af2f2b-a092-4196-b63d-b57d7707ce20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.068729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af2f2b-a092-4196-b63d-b57d7707ce20 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.088311 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4146/8262] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:19.092909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.106839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e61b7-629e-477c-960e-375df2a3d9af admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.113702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.114653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.114929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.115211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] PATH_INFO: `/v3/projects/a4bbd08b8e064494a525a3ed2d34f467/users/49f273afe1054b9396dbaaa319108606/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.134887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bbd08b8e064494a525a3ed2d34f467, user_id=49f273afe1054b9396dbaaa319108606, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.138347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.157136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4117/8263] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:19 2022] PUT /identity/v3/projects/a4bbd08b8e064494a525a3ed2d34f467/users/49f273afe1054b9396dbaaa319108606/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:19.172856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.173641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.173927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.224579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] MFA Rules not processed for user `49f273afe1054b9396dbaaa319108606`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:19.226656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:19.299698 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:19.328101 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4147/8264] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:19.332651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.472816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7504e66-3520-4e92-b6bf-09ca6bdda234 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.481455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.482400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.483460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.483460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.484597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.486773 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.534615 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4118/8265] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:19 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:19.538529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.554629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989016-d899-451b-96bd-72b587dd7e89 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.667039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.668051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.668348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.668927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.670714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.673711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.706535 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4148/8266] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:19 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:19.709861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.737480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ce59c-fd7c-44a4-98aa-eb2b8f7bf794 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.746723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.747712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.748294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.749376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.750770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.752772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.769005 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4119/8267] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:19.773937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.790562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecc9c5-853f-4c9f-8f1b-1991ad174a3f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.798252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d32bc-090a-4102-b327-708b2c9429b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.799465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d32bc-090a-4102-b327-708b2c9429b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.799971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d32bc-090a-4102-b327-708b2c9429b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.800531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d32bc-090a-4102-b327-708b2c9429b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.801476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d32bc-090a-4102-b327-708b2c9429b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.803335 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d32bc-090a-4102-b327-708b2c9429b1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.820719 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4149/8268] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:19.822178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:19.836906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf2f49-292c-4a77-b5cb-1245f29b6a04 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:19.842013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:19.843065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.843354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.843636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] PATH_INFO: `/v3/projects/5257f1b8cab14f03bfe8ad42abaae2ba/users/9619a3d867704c38824a51c9ece9260e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.861679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5257f1b8cab14f03bfe8ad42abaae2ba, user_id=9619a3d867704c38824a51c9ece9260e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:19.864650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:19.888878 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4120/8269] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:19 2022] PUT /identity/v3/projects/5257f1b8cab14f03bfe8ad42abaae2ba/users/9619a3d867704c38824a51c9ece9260e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:19.902524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:19.903147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:19.903633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:19.942229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] MFA Rules not processed for user `9619a3d867704c38824a51c9ece9260e`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:19.943959 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:20.058257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4150/8270] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:20.072998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:20.075132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:20.087912 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:20.152271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5dc2-aab7-42d3-9a75-15bcc5670cbd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:20.159331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66574-d123-4247-b748-21e99145b21b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:20.160255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66574-d123-4247-b748-21e99145b21b service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:20.160821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66574-d123-4247-b748-21e99145b21b service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:20.161295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66574-d123-4247-b748-21e99145b21b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:20.248031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66574-d123-4247-b748-21e99145b21b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:20.251076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66574-d123-4247-b748-21e99145b21b service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:20.272504 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4121/8271] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:20.425470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:20.445630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac87d11-b77f-4f29-b083-8fc296eb9caa None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:20.449914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6090e5-6063-43d2-aa03-3cace101d722 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:20.450728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6090e5-6063-43d2-aa03-3cace101d722 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:20.451023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6090e5-6063-43d2-aa03-3cace101d722 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:20.451456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6090e5-6063-43d2-aa03-3cace101d722 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:20.462406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6090e5-6063-43d2-aa03-3cace101d722 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:20.463949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6090e5-6063-43d2-aa03-3cace101d722 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:20.488539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4151/8272] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:20.947203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66574-d123-4247-b748-21e99145b21b service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:21.037968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66574-d123-4247-b748-21e99145b21b service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:21.043573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:21.044460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:21.044748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:21.045034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] PATH_INFO: `/v3/users/49f273afe1054b9396dbaaa319108606` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:21.046321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f273afe1054b9396dbaaa319108606)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:21.048391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:21.109033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f273afe1054b9396dbaaa319108606'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:21.133067 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:21.134804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f273afe1054b9396dbaaa319108606'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:21.144816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f273afe1054b9396dbaaa319108606'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:21.156032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f273afe1054b9396dbaaa319108606'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:21.157008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f273afe1054b9396dbaaa319108606'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:21.167457 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4122/8273] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:20 2022] DELETE /identity/v3/users/49f273afe1054b9396dbaaa319108606 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:21.169392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:21.169838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:21.170167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:21.244423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:21.254026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:21.407193 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:21.481262 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4152/8274] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:21.503953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:21.506921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:21.617837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccc51a-ffb2-42da-9382-56447fb62ffd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:21.627010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:21.628305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:21.628672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:21.628911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:21.641461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:21.643195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:21.670946 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4123/8275] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:21.985518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:21.987477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:22.004248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e710-671d-4b98-89ec-20c4e5e6a749 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:22.009916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:22.010819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:22.011105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:22.011385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] PATH_INFO: `/v3/projects/a4bbd08b8e064494a525a3ed2d34f467` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:22.012595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bbd08b8e064494a525a3ed2d34f467)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:22.014580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:22.076761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bbd08b8e064494a525a3ed2d34f467', 'request_id': 'req-7f419c66-f0a8-4cd6-883f-45571ea4db58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.086882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bbd08b8e064494a525a3ed2d34f467', 'request_id': 'req-7f419c66-f0a8-4cd6-883f-45571ea4db58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.097471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bbd08b8e064494a525a3ed2d34f467', 'request_id': 'req-7f419c66-f0a8-4cd6-883f-45571ea4db58'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.115813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] The token cache is being invalidate because project a4bbd08b8e064494a525a3ed2d34f467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:22.116249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.117099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.119336 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4153/8276] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:21 2022] DELETE /identity/v3/projects/a4bbd08b8e064494a525a3ed2d34f467 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:22.123252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:22.134733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad0a07-1123-4626-9518-dbe8fa929898 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:22.207988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:22.209584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:22.209885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:22.211115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] PATH_INFO: `/v3/users/9619a3d867704c38824a51c9ece9260e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:22.212708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9619a3d867704c38824a51c9ece9260e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:22.215081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:22.296690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9619a3d867704c38824a51c9ece9260e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.321357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9619a3d867704c38824a51c9ece9260e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.330624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9619a3d867704c38824a51c9ece9260e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.352039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9619a3d867704c38824a51c9ece9260e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.352772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c189ee62-abb5-4097-87e0-85815cc11562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9619a3d867704c38824a51c9ece9260e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:22.362949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4124/8277] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:22 2022] DELETE /identity/v3/users/9619a3d867704c38824a51c9ece9260e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:22.881881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:22.882285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:22.903046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f419c66-f0a8-4cd6-883f-45571ea4db58 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.004642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.005853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.006363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.006876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] PATH_INFO: `/v3/projects/5257f1b8cab14f03bfe8ad42abaae2ba` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.008345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5257f1b8cab14f03bfe8ad42abaae2ba)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.011160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.108797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5257f1b8cab14f03bfe8ad42abaae2ba', 'request_id': 'req-33a84d1c-3134-444f-9af5-c68496a777cd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:23.131784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5257f1b8cab14f03bfe8ad42abaae2ba', 'request_id': 'req-33a84d1c-3134-444f-9af5-c68496a777cd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:23.140199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5257f1b8cab14f03bfe8ad42abaae2ba', 'request_id': 'req-33a84d1c-3134-444f-9af5-c68496a777cd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:23.155757 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:23.166575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] The token cache is being invalidate because project 5257f1b8cab14f03bfe8ad42abaae2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:23.167221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:23.168193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-33a84d1c-3134-444f-9af5-c68496a777cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:23.173941 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4154/8278] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:22 2022] DELETE /identity/v3/projects/5257f1b8cab14f03bfe8ad42abaae2ba => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:23.179459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.180116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.180710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.193641 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:23.223741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:23.225162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:23.338176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4125/8279] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:23.348353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.348704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.348917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.380354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:23.381567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:23.393305 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4155/8280] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:23.397371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:23.410479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67061-24df-4e1f-85d3-f732730932ef None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.416478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.417561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.418079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.418629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.419460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:23.419842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.422146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.435733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4126/8281] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:23.440115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:23.452334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd47e7-503b-4156-837d-db073922b34e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.457318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.457999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.458285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.458580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.459439 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.461362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.505466 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4156/8282] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:23 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:23.510047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:23.527380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab487b-a609-464a-8f73-a6121f651c78 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.642281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.644097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.644601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.645107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.646853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.649051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.676621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4127/8283] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:23 2022] POST /identity/v3/users => generated 278 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:23.680712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:23.729844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cc57e-f77f-4e6b-8674-1a0bfc40f3a0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.744937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.745765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.747456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.749278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.751474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.753744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.785858 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4157/8284] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:23.790153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:23.807071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8c32-4a7c-4650-a4ae-e282931c31f3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.813488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ad19e-b875-46d5-b428-9873d4fc4771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.814284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ad19e-b875-46d5-b428-9873d4fc4771 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.814814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ad19e-b875-46d5-b428-9873d4fc4771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.815176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ad19e-b875-46d5-b428-9873d4fc4771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.816378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ad19e-b875-46d5-b428-9873d4fc4771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.818082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ad19e-b875-46d5-b428-9873d4fc4771 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.834545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4128/8285] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:23.837875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:23.854801 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aee89-dd21-4ec1-8f4e-22898a34f899 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:23.860233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:23.861141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.861425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.861706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] PATH_INFO: `/v3/projects/49fa95c5766242778a560b5dce8ab3de/users/e16d53f562e745f988b0314889563a4e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.882654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fa95c5766242778a560b5dce8ab3de, user_id=e16d53f562e745f988b0314889563a4e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:23.885410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:23.908545 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4158/8286] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:23 2022] PUT /identity/v3/projects/49fa95c5766242778a560b5dce8ab3de/users/e16d53f562e745f988b0314889563a4e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:23.921132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:23.921424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:23.921712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:23.960055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] MFA Rules not processed for user `e16d53f562e745f988b0314889563a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:23.963116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:24.078334 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:24.084756 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4129/8287] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:24.091034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.196674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953aa36-7954-41b3-9d3f-8320105bbcc1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.202925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.203609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.203899 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.204181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.205203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.208110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.258651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.265478 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4159/8288] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:24 2022] POST /identity/v3/projects => generated 357 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:24.272449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb91d0-cd0f-4358-9e6a-f4f824fb2b09 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.360394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.361204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.362119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.362410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.363149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.365184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.395284 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4130/8289] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:24 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:24.399241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.430029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc000-545b-43b2-a56b-9dd2fcc10380 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.435519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.436747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.437033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.437308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.438039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.439666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.452197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4160/8290] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:24.456560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.468065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d0e0-7e9b-450f-91ca-29f8f45553f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.474532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.476053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.476410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.476765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] PATH_INFO: `/v3/projects/d8c45d8fabe84e3ea3088770b9834910/users/0878bae61ce24b1198a4729c0d54e99f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.500109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c45d8fabe84e3ea3088770b9834910, user_id=0878bae61ce24b1198a4729c0d54e99f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.502371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.526430 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4131/8291] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:24 2022] PUT /identity/v3/projects/d8c45d8fabe84e3ea3088770b9834910/users/0878bae61ce24b1198a4729c0d54e99f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:24.530713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.541865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510970a-0705-4877-b277-f24abeceb001 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.627531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bc66a-e3e0-4227-acc5-0998fa0b165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.630232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc66a-e3e0-4227-acc5-0998fa0b165f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.630660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc66a-e3e0-4227-acc5-0998fa0b165f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.631011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc66a-e3e0-4227-acc5-0998fa0b165f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.631889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bc66a-e3e0-4227-acc5-0998fa0b165f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.633947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bc66a-e3e0-4227-acc5-0998fa0b165f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.647512 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4161/8292] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:24.651259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.674208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42f7e8-9e05-4323-9a33-57d51b657c31 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.681063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.682049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.682408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.682777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] PATH_INFO: `/v3/projects/d8c45d8fabe84e3ea3088770b9834910/users/0878bae61ce24b1198a4729c0d54e99f/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.684893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c45d8fabe84e3ea3088770b9834910, user_id=0878bae61ce24b1198a4729c0d54e99f, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.688361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.704949 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4132/8293] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:24 2022] PUT /identity/v3/projects/d8c45d8fabe84e3ea3088770b9834910/users/0878bae61ce24b1198a4729c0d54e99f/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:24.715156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.715847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.716455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.724018 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:24.752032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] MFA Rules not processed for user `0878bae61ce24b1198a4729c0d54e99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:24.753835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:24.881688 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4162/8294] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:24.886818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.899892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dae8b9-b263-418d-a0d5-bda3b3131158 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.906361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0878bae61ce24b1198a4729c0d54e99f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8c45d8fabe84e3ea3088770b9834910', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.907231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.909936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.910683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.912098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:24.912627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.914827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.929955 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4133/8295] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:24.933773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:24.944400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a300d-2ab6-4a69-a7f5-6d18e4d38dee None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:24.949276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0878bae61ce24b1198a4729c0d54e99f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8c45d8fabe84e3ea3088770b9834910', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:24.950066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:24.950423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:24.950805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:24.951769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:24.953761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:24.989659 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4163/8296] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:24 2022] POST /identity/v3/projects => generated 349 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:24.993510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:25.004305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074514-1936-409f-950c-30104bfaf506 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:25.074486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0878bae61ce24b1198a4729c0d54e99f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8c45d8fabe84e3ea3088770b9834910', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:25.075333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:25.075625 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:25.075910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:25.076957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:25.077595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:25.079223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:25.091516 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4134/8297] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:25.102034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:25.104045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:25.178423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1cdfb-1fb8-4df0-93e2-a3db334ca5b9 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:25.184440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:25.185605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:25.185917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:25.186257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:25.198423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:25.199898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:25.211464 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4164/8298] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:25.405300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:25.419418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb3104-03f0-4208-a827-89bf95103fa4 tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:25.428034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0878bae61ce24b1198a4729c0d54e99f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8c45d8fabe84e3ea3088770b9834910', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:25.429701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:25.430140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:25.430432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] PATH_INFO: `/v3/projects/cb9128d8862c4438bb878957426af4e5` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:25.431736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb9128d8862c4438bb878957426af4e5)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:25.433710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:25.494975 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:25.522866 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9128d8862c4438bb878957426af4e5', 'request_id': 'req-734357c7-e78e-4e90-8a88-4843e88c5f8e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:25.539314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9128d8862c4438bb878957426af4e5', 'request_id': 'req-734357c7-e78e-4e90-8a88-4843e88c5f8e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:25.557745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9128d8862c4438bb878957426af4e5', 'request_id': 'req-734357c7-e78e-4e90-8a88-4843e88c5f8e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:25.577576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] The token cache is being invalidate because project cb9128d8862c4438bb878957426af4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:25.578243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:25.580978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-734357c7-e78e-4e90-8a88-4843e88c5f8e tempest-QuotasTest-1818715769 tempest-QuotasTest-1818715769-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:25.591024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4135/8299] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:25 2022] DELETE /identity/v3/projects/cb9128d8862c4438bb878957426af4e5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:25.756049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:25.851575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492eef4-26d2-4fc4-8cbd-fa32721c4720 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:25.899763 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:26.096452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:26.097391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:26.097887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:26.098287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] PATH_INFO: `/v3/users/e16d53f562e745f988b0314889563a4e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:26.100011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16d53f562e745f988b0314889563a4e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:26.102074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:26.177767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16d53f562e745f988b0314889563a4e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.179097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16d53f562e745f988b0314889563a4e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.207823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16d53f562e745f988b0314889563a4e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.212317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16d53f562e745f988b0314889563a4e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.224430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16d53f562e745f988b0314889563a4e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.240739 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4165/8300] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:25 2022] DELETE /identity/v3/users/e16d53f562e745f988b0314889563a4e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:26.245255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:26.245550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:26.246011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:26.265706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:26.267079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:26.345529 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4136/8301] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:26.358170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:26.359796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:26.431412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733a9c-e507-4037-8e9c-2af78bb82d23 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:26.436170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:26.436833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:26.437122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:26.437399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:26.448067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:26.449538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:26.460546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4166/8302] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:26.783372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:26.788249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:26.812225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a14a7-2c90-4ab1-bf85-2734a92dfa93 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:26.834479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:26.836325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:26.836899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:26.837409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] PATH_INFO: `/v3/projects/49fa95c5766242778a560b5dce8ab3de` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:26.839146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fa95c5766242778a560b5dce8ab3de)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:26.842807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:26.921076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fa95c5766242778a560b5dce8ab3de', 'request_id': 'req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.929838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fa95c5766242778a560b5dce8ab3de', 'request_id': 'req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.941561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fa95c5766242778a560b5dce8ab3de', 'request_id': 'req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.964797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] The token cache is being invalidate because project 49fa95c5766242778a560b5dce8ab3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:26.965671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.967799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:26.972912 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4137/8303] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:26 2022] DELETE /identity/v3/projects/49fa95c5766242778a560b5dce8ab3de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:26.975076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:26.988972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1975e6-7edd-4992-a1d5-18a668502779 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:27.051857 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:27.107547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:27.110539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:27.111220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:27.112438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] PATH_INFO: `/v3/users/0878bae61ce24b1198a4729c0d54e99f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:27.116672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0878bae61ce24b1198a4729c0d54e99f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:27.120045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:27.217698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0878bae61ce24b1198a4729c0d54e99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.218672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0878bae61ce24b1198a4729c0d54e99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.235223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0878bae61ce24b1198a4729c0d54e99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.236028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0878bae61ce24b1198a4729c0d54e99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.249922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ea30fe26-c82c-4187-9ab4-2ffa6d960821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0878bae61ce24b1198a4729c0d54e99f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.276646 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4167/8304] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:26 2022] DELETE /identity/v3/users/0878bae61ce24b1198a4729c0d54e99f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:27.651140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:27.653734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:27.682560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e3ba-7059-4fee-9c2e-d0d21f9fbba7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:27.776734 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:27.841656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:27.845147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:27.845435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:27.845724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] PATH_INFO: `/v3/projects/d8c45d8fabe84e3ea3088770b9834910` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:27.847759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c45d8fabe84e3ea3088770b9834910)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:27.850762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:27.949600 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c45d8fabe84e3ea3088770b9834910', 'request_id': 'req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.962050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c45d8fabe84e3ea3088770b9834910', 'request_id': 'req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:27.986787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c45d8fabe84e3ea3088770b9834910', 'request_id': 'req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:28.016092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] The token cache is being invalidate because project d8c45d8fabe84e3ea3088770b9834910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:28.018534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:28.027503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9a7c70cf-3f3d-44a7-a191-4ecc7d7ae164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:28.075139 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4138/8305] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:27 2022] DELETE /identity/v3/projects/d8c45d8fabe84e3ea3088770b9834910 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:28.089289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.089847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.092822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.147623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:28.150600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:28.272716 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4168/8306] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:28.281691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.282837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.283202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.334365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:28.337505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:28.385776 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4139/8307] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:28.390436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.402954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f19aa-28f0-4360-9f45-6c110ba1cc07 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.415403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.419120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.422837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.424064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.428561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:28.429696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.435608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.474615 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4169/8308] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:28.479623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.491142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13946bd0-0252-450c-8630-8e07b5e8aa15 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.496414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.497085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.497370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.497644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.498905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.501072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.543726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4140/8309] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:28 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:28.547871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.562733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10d03-8d16-4034-a75a-05750ce4a404 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.636112 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:28.659709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.660748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.661213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.661661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.662619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.665293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.705257 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4170/8310] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:28 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:28.706807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.721775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41da340-f084-4619-9c92-0e805196da51 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.735445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.736131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.736419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.736697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.738121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.742437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.760158 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4141/8311] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:28.765302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.778792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324006-6076-4a5f-8926-53a629c9cda0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.786560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae9c5b-bcc6-4e8c-b8bf-e2ad652fea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.787945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae9c5b-bcc6-4e8c-b8bf-e2ad652fea41 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.788241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae9c5b-bcc6-4e8c-b8bf-e2ad652fea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.788556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae9c5b-bcc6-4e8c-b8bf-e2ad652fea41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.789263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae9c5b-bcc6-4e8c-b8bf-e2ad652fea41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.791775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae9c5b-bcc6-4e8c-b8bf-e2ad652fea41 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.818819 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4171/8312] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:23:28.823213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:28.836861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d2b8-4eea-4f09-a260-ae3ec2ce160b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:28.849948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:28.851890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.852343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.852782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] PATH_INFO: `/v3/projects/b1f73847ec404f04ad51cc2aaa1ed8d5/users/76cb062e62d04a708b602c0c0381e76f/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.877972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f73847ec404f04ad51cc2aaa1ed8d5, user_id=76cb062e62d04a708b602c0c0381e76f, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:28.883146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:28.912212 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4142/8313] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:28 2022] PUT /identity/v3/projects/b1f73847ec404f04ad51cc2aaa1ed8d5/users/76cb062e62d04a708b602c0c0381e76f/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:28.928531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:28.928920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:28.929279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:28.981066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] MFA Rules not processed for user `76cb062e62d04a708b602c0c0381e76f`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:28.982446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:29.078651 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4172/8314] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:29.080694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.163830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f047a-f4a5-4730-a32d-df03c505c6cf admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.173416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.176477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.176839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.177144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.178065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.180552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.203094 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:29.237278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4143/8315] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:29 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:29.242706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.259039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3b19b-81b1-4f80-a8a9-119787a83f12 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.392943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.393784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.394143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.394629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.395695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.397948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.425626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4173/8316] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:29 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:29.429379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.447156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b669bd-0fa1-4603-add6-5d59fba71568 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.453591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.454410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.454835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.455221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.456067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.457820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.476669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4144/8317] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:29.478261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.490807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df167-3698-4626-b544-a08366ac96b3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.497549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.499179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.499574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.499982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] PATH_INFO: `/v3/projects/b404e82e86bb45f4a8cd538799b6bd9e/users/bc941f54014d4ec3abf68b3630de2126/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.527678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b404e82e86bb45f4a8cd538799b6bd9e, user_id=bc941f54014d4ec3abf68b3630de2126, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.530789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.549933 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4174/8318] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:29 2022] PUT /identity/v3/projects/b404e82e86bb45f4a8cd538799b6bd9e/users/bc941f54014d4ec3abf68b3630de2126/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:29.555319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.570380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a07bb-9478-494b-be1c-3d28b0f32360 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.666761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528fc40-9e09-4232-abe7-b23120416d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.672665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528fc40-9e09-4232-abe7-b23120416d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.672984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528fc40-9e09-4232-abe7-b23120416d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.673258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528fc40-9e09-4232-abe7-b23120416d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.674063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528fc40-9e09-4232-abe7-b23120416d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.680112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528fc40-9e09-4232-abe7-b23120416d00 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.700624 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4145/8319] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:29.704436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.718854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea34d0-651e-4733-9a6a-84e9061b38b6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.729471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.730572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.730914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.731267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] PATH_INFO: `/v3/projects/b404e82e86bb45f4a8cd538799b6bd9e/users/bc941f54014d4ec3abf68b3630de2126/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.736321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b404e82e86bb45f4a8cd538799b6bd9e, user_id=bc941f54014d4ec3abf68b3630de2126, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.739484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.761867 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4175/8320] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:29 2022] PUT /identity/v3/projects/b404e82e86bb45f4a8cd538799b6bd9e/users/bc941f54014d4ec3abf68b3630de2126/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:29.775015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.775572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.775864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.778568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.780328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:29.791754 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:29.807203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] MFA Rules not processed for user `bc941f54014d4ec3abf68b3630de2126`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:29.808463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:29.882145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a15c5-6f42-4ceb-b243-eeace11da676 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:29.888833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:29.889811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:29.890175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:29.890550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] PATH_INFO: `/v3/users/a0a8c7cc666443e5beaa27396edac7cb` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:29.891858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a8c7cc666443e5beaa27396edac7cb)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:29.894763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:29.907974 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4146/8321] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:29.922445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:29.925542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:29.991490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a8c7cc666443e5beaa27396edac7cb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:29.992917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a8c7cc666443e5beaa27396edac7cb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.020963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a8c7cc666443e5beaa27396edac7cb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.022469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a8c7cc666443e5beaa27396edac7cb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.023339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e4159-4092-46f2-815b-e00f94fdc5d2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:30.027535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:30.028275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:30.028638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:30.028989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:30.035922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-22637d0b-ba8a-423c-b61c-d8406a1f53d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a8c7cc666443e5beaa27396edac7cb'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.036923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:30.061351 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4176/8322] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:29 2022] DELETE /identity/v3/users/a0a8c7cc666443e5beaa27396edac7cb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:30.065693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:30.066688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:30.067145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:30.067591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:30.067725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:30.080155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4147/8323] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:30.101984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:30.104150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:30.190176 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4177/8324] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:30.198438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:30.200552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:30.210539 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:30.224359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5866c-0a11-4191-83f7-619455f23f62 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:30.320486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:30.321164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:30.321455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:30.321734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:30.343561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:30.345912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:30.407598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4148/8325] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:23:30.767058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:30.768952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:30.783877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f9b1-b539-450a-86f6-1dfe655a946c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:30.788887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:30.789772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:30.790105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:30.790868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] PATH_INFO: `/v3/projects/b1832ad2e5e94d00ad0dec02c7bbf272` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:30.792288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1832ad2e5e94d00ad0dec02c7bbf272)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:30.794207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:30.826666 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:30.864192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1832ad2e5e94d00ad0dec02c7bbf272', 'request_id': 'req-ca2b2878-5750-4717-bb75-207b4ffad72f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.874169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1832ad2e5e94d00ad0dec02c7bbf272', 'request_id': 'req-ca2b2878-5750-4717-bb75-207b4ffad72f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.881037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1832ad2e5e94d00ad0dec02c7bbf272', 'request_id': 'req-ca2b2878-5750-4717-bb75-207b4ffad72f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.895649 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] The token cache is being invalidate because project b1832ad2e5e94d00ad0dec02c7bbf272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:30.896108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.896842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:30.898546 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4178/8326] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:30 2022] DELETE /identity/v3/projects/b1832ad2e5e94d00ad0dec02c7bbf272 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:30.902460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:30.914146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52c4e7-8a85-47e9-bfb1-c84b25470505 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:30.991971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:30.993439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:30.993827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:30.994206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] PATH_INFO: `/v3/users/330a0b304e6c40cd8297c68b98798763` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:30.995950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=330a0b304e6c40cd8297c68b98798763)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:30.998018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:31.073909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330a0b304e6c40cd8297c68b98798763'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.089295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330a0b304e6c40cd8297c68b98798763'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.102420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330a0b304e6c40cd8297c68b98798763'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.113747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330a0b304e6c40cd8297c68b98798763'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.114480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330a0b304e6c40cd8297c68b98798763'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.130582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4149/8327] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:30 2022] DELETE /identity/v3/users/330a0b304e6c40cd8297c68b98798763 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:31.568614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:31.570210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:31.593561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2878-5750-4717-bb75-207b4ffad72f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:31.671706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:31.672920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:31.673300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:31.673785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] PATH_INFO: `/v3/projects/fff68d6667264e4693bae53788882f99` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:31.675467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff68d6667264e4693bae53788882f99)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:31.677786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:31.747575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff68d6667264e4693bae53788882f99', 'request_id': 'req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.758221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff68d6667264e4693bae53788882f99', 'request_id': 'req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.767013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff68d6667264e4693bae53788882f99', 'request_id': 'req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.784076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] The token cache is being invalidate because project fff68d6667264e4693bae53788882f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:31.784752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.785327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.787394 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4179/8328] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:31 2022] DELETE /identity/v3/projects/fff68d6667264e4693bae53788882f99 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:31.791215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:31.792980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:31.817718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e851f-9718-4f12-9cc8-a667766dc507 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:31.846783 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:31.899988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:31.901093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:31.901409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:31.901751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] PATH_INFO: `/v3/users/c003725e9b1f4473bacae14da803b37b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:31.905178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c003725e9b1f4473bacae14da803b37b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:31.907323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:31.965396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c003725e9b1f4473bacae14da803b37b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.980409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c003725e9b1f4473bacae14da803b37b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.988619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c003725e9b1f4473bacae14da803b37b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.999149 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c003725e9b1f4473bacae14da803b37b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:31.999883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-4e50c37d-5fb5-4ad1-93c4-e2f7dc26d183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c003725e9b1f4473bacae14da803b37b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:32.008388 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4150/8329] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:31 2022] DELETE /identity/v3/users/c003725e9b1f4473bacae14da803b37b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:32.268657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:32.270152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:32.288971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a90a1-ccf7-405e-81bd-bb1b22ef63f2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:32.356080 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:32.387448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:32.388658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.389183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.389620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] PATH_INFO: `/v3/projects/d05986a6e4d342ad97f0c051109aa785` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.391184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05986a6e4d342ad97f0c051109aa785)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:32.393386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:32.455074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05986a6e4d342ad97f0c051109aa785', 'request_id': 'req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:32.467489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05986a6e4d342ad97f0c051109aa785', 'request_id': 'req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:32.477177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05986a6e4d342ad97f0c051109aa785', 'request_id': 'req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:32.490810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] The token cache is being invalidate because project d05986a6e4d342ad97f0c051109aa785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:32.491106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:32.491781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:32.493556 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4180/8330] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:32 2022] DELETE /identity/v3/projects/d05986a6e4d342ad97f0c051109aa785 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:32.499362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b577721-05ac-4e65-b02e-585dfa7edf11 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.499825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b577721-05ac-4e65-b02e-585dfa7edf11 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.500127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b577721-05ac-4e65-b02e-585dfa7edf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.506431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:32.508085 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:32.529474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6b577721-05ac-4e65-b02e-585dfa7edf11 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:32.531422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b577721-05ac-4e65-b02e-585dfa7edf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:32.591118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0d7d-7188-4ec8-b99d-bc6a8b95d960 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:32.600466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:32.601342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.603982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.604596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.608966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:32.674305 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4151/8331] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:32.684047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.684342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.684623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.720404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:32.721975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:32.727060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:32.729516 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:32.734580 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4152/8332] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:32.738650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:32.747509 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4181/8333] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:23:32.758576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c034d5-1a88-4f33-b10a-6d541d169308 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:32.764457 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:32.765160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.765459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.765755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.767044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:32.767044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:32.768851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:32.785767 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4153/8334] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:23:32.790831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:32.805690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc61a-93ba-4fd0-abfc-3495fefb6b40 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:32.812490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:32.813332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.813686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.813968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.814721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:32.816994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:32.862702 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4182/8335] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:32 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:32.864353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:32.877592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66293c8-6447-4010-aa18-21c1efec6a2f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:32.906192 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:32.972446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:32.973830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:32.974193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:32.974912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:32.975681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:32.977771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:33.012333 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4154/8336] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:32 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:23:33.014230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:33.020892 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:33.028826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caf3a4-9636-45f2-a6dc-916f38f53450 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:33.037288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:33.038036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.038429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.038843 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.039672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:33.041489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:33.065821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4183/8337] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:33.068078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:33.079298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80095b64-dcfa-4a94-b93c-082428ce082c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:33.084885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739db79-13e5-4645-b80a-8ef48406f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:33.085683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739db79-13e5-4645-b80a-8ef48406f3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.086081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739db79-13e5-4645-b80a-8ef48406f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.086477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739db79-13e5-4645-b80a-8ef48406f3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.088219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739db79-13e5-4645-b80a-8ef48406f3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:33.089117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739db79-13e5-4645-b80a-8ef48406f3e7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:33.104283 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4155/8338] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:23:33.105683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:33.116663 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd2d1-49d9-47bf-bd14-efdb754cdc0d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:33.123842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:33.125000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.125394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.125872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] PATH_INFO: `/v3/projects/2461ded20b0d40a6872e87b3c8166a09/users/46b53ee9d3e44461a9e7b61a7dd2ae10/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.151375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2461ded20b0d40a6872e87b3c8166a09, user_id=46b53ee9d3e44461a9e7b61a7dd2ae10, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:33.155451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:33.184096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4184/8339] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:33 2022] PUT /identity/v3/projects/2461ded20b0d40a6872e87b3c8166a09/users/46b53ee9d3e44461a9e7b61a7dd2ae10/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:33.186636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.187081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.187563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.215549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:33.217947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:33.300683 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4156/8340] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:33.311929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:33.385968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656258d-cd3f-4633-9993-0f037bf35fa2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:33.390508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f8a39-6aab-4816-8ea3-8e2060325a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:33.391235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f8a39-6aab-4816-8ea3-8e2060325a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.391519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f8a39-6aab-4816-8ea3-8e2060325a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.391804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f8a39-6aab-4816-8ea3-8e2060325a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.403198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f8a39-6aab-4816-8ea3-8e2060325a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:33.406255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f8a39-6aab-4816-8ea3-8e2060325a6e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:33.420019 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4185/8341] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:33.774814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:33.775991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:33.788853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2119b-407a-430d-93e6-4e8ee0da84af None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:33.795376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:33.796575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.796845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.797150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] PATH_INFO: `/v3/users/76cb062e62d04a708b602c0c0381e76f` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.798393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76cb062e62d04a708b602c0c0381e76f)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:33.801427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:33.866367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76cb062e62d04a708b602c0c0381e76f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:33.887401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76cb062e62d04a708b602c0c0381e76f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:33.895970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76cb062e62d04a708b602c0c0381e76f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:33.905393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76cb062e62d04a708b602c0c0381e76f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:33.906119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76cb062e62d04a708b602c0c0381e76f'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:33.913323 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4157/8342] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:33 2022] DELETE /identity/v3/users/76cb062e62d04a708b602c0c0381e76f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:33.917902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:33.918353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:33.920900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:33.938408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:33.939755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:34.081557 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4186/8343] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:23:34.093338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:34.095702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:34.118297 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:34.187843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7326f-f9f7-40d4-b282-ace141d5fe77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:34.194563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:34.195253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:34.195546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:34.195830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:34.207290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:34.208914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:34.233669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4158/8344] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:23:34.792388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:34.794311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:34.818372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee1c1d-b721-4e08-9bf9-31928ade4393 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:34.837501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:34.840169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:34.842569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:34.843287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] PATH_INFO: `/v3/projects/b1f73847ec404f04ad51cc2aaa1ed8d5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:34.849220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f73847ec404f04ad51cc2aaa1ed8d5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:34.855476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:34.956953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f73847ec404f04ad51cc2aaa1ed8d5', 'request_id': 'req-3aa073b5-a186-4030-8f29-313ef386802d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:34.967397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f73847ec404f04ad51cc2aaa1ed8d5', 'request_id': 'req-3aa073b5-a186-4030-8f29-313ef386802d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:34.976300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f73847ec404f04ad51cc2aaa1ed8d5', 'request_id': 'req-3aa073b5-a186-4030-8f29-313ef386802d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:34.978910 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:35.000792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] The token cache is being invalidate because project b1f73847ec404f04ad51cc2aaa1ed8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:35.001767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.003003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.005594 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4187/8345] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:34 2022] DELETE /identity/v3/projects/b1f73847ec404f04ad51cc2aaa1ed8d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:35.010324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:35.026046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdf9af-bb06-428f-890c-5899fb6e3a32 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:35.192842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:35.193756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:35.194046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:35.194328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] PATH_INFO: `/v3/users/bc941f54014d4ec3abf68b3630de2126` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:35.197271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc941f54014d4ec3abf68b3630de2126)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:35.199451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:35.324346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc941f54014d4ec3abf68b3630de2126'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.358137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc941f54014d4ec3abf68b3630de2126'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.372252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc941f54014d4ec3abf68b3630de2126'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.389701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc941f54014d4ec3abf68b3630de2126'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.391015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-9b53cd77-31a5-4d7c-a1d1-3854c0ea2aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc941f54014d4ec3abf68b3630de2126'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:35.403588 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4159/8346] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:35 2022] DELETE /identity/v3/users/bc941f54014d4ec3abf68b3630de2126 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:37.543484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:37.547990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:37.578480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa073b5-a186-4030-8f29-313ef386802d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:37.743737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:37.744894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:37.745471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:37.746421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] PATH_INFO: `/v3/projects/b404e82e86bb45f4a8cd538799b6bd9e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:37.756156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b404e82e86bb45f4a8cd538799b6bd9e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:37.760495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:37.882550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b404e82e86bb45f4a8cd538799b6bd9e', 'request_id': 'req-b256b51b-5163-424b-ab91-5819bd9afe97'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:37.904645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b404e82e86bb45f4a8cd538799b6bd9e', 'request_id': 'req-b256b51b-5163-424b-ab91-5819bd9afe97'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:37.923798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b404e82e86bb45f4a8cd538799b6bd9e', 'request_id': 'req-b256b51b-5163-424b-ab91-5819bd9afe97'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:37.972202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] The token cache is being invalidate because project b404e82e86bb45f4a8cd538799b6bd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:37.972510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:37.975948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b256b51b-5163-424b-ab91-5819bd9afe97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:37.980754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4188/8347] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:37 2022] DELETE /identity/v3/projects/b404e82e86bb45f4a8cd538799b6bd9e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:37.986788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:37.987890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:37.988300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.047452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:38.048978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:38.189968 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:38.257137 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4160/8348] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:38.264993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:38.265283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:38.265566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.304841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:38.307795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:38.329193 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4189/8349] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:38.333608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:38.346058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52186-27dd-4c2f-851c-1d48e3279ed0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:38.368641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:38.369345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:38.369637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:38.369920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.370702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:38.371019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:38.372709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:38.418845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4161/8350] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:38.423304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:38.434329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e23f48-528c-4226-bf66-822ebe98ab8e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:38.449994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:38.451256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:38.451554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:38.451888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.452558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:38.454474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:38.545553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:38.554368 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4190/8351] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:38 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:38.569307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8ce6b-c903-4fbb-adf8-38e19c419749 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:38.703261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:38.703970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:38.704264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:38.704607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.705320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:38.707332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:38.770860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4162/8352] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:38 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:38.772882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:38.787938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776d19-34a8-4501-ba85-75fcb91e17d3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:38.798249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:38.799571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:38.800135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:38.801045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.808183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:38.810451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:38.838972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4191/8353] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:38.843271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:38.865362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544f68e-e3f1-4e7c-9311-6290d27b8df5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:38.879456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afb7b2-f9b7-4a18-bcd1-9956bbce9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:38.880163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb7b2-f9b7-4a18-bcd1-9956bbce9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:38.880455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb7b2-f9b7-4a18-bcd1-9956bbce9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:38.880738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb7b2-f9b7-4a18-bcd1-9956bbce9d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:38.881492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afb7b2-f9b7-4a18-bcd1-9956bbce9d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:38.883178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afb7b2-f9b7-4a18-bcd1-9956bbce9d24 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:38.915142 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4163/8354] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:38.920559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:38.982918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee3b6-921b-4bc2-9e54-bc4485a02bb8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:38.996555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:39.001041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:39.001399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:39.001686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] PATH_INFO: `/v3/projects/ea6f9f26ef9f4110a96586a2ee268a87/users/950d45fd51734be6add88517058fd5d0/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:39.063709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6f9f26ef9f4110a96586a2ee268a87, user_id=950d45fd51734be6add88517058fd5d0, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:39.070284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:39.115991 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4192/8355] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:38 2022] PUT /identity/v3/projects/ea6f9f26ef9f4110a96586a2ee268a87/users/950d45fd51734be6add88517058fd5d0/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:39.127337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906d93-49e9-4b1c-92cf-1884ea763139 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:39.127903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906d93-49e9-4b1c-92cf-1884ea763139 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:39.127903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906d93-49e9-4b1c-92cf-1884ea763139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:39.180814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-24906d93-49e9-4b1c-92cf-1884ea763139 None None] MFA Rules not processed for user `950d45fd51734be6add88517058fd5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:39.183553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-24906d93-49e9-4b1c-92cf-1884ea763139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:39.346554 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4164/8356] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:39.359468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:39.361207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:39.432129 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:39.541878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e5745-fa13-4eae-ae53-a1d14c80c3ab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:39.545912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:39.546813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:39.547279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:39.547717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:39.557730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:39.571317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:39.584547 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4193/8357] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:41.398796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:41.399325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:41.399730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:41.459094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] MFA Rules not processed for user `46b53ee9d3e44461a9e7b61a7dd2ae10`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:41.461045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:41.489978 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:41.556830 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4165/8358] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:41.561792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:41.570464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:41.728428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ffe96-921c-4a84-afae-3e9971315f0c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:41.735960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:41.737232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:41.737723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:41.738207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:41.739270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:41.741409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:41.772162 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4194/8359] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:41 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:41.776126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:41.798215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1be80-6330-40e8-8ac4-35f8bff43e6c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:41.818852 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af60cad-eac9-4efe-b667-da2dea1f54ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:41.820062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60cad-eac9-4efe-b667-da2dea1f54ea admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:41.820863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60cad-eac9-4efe-b667-da2dea1f54ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:41.821388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60cad-eac9-4efe-b667-da2dea1f54ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:41.822938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60cad-eac9-4efe-b667-da2dea1f54ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:41.826211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60cad-eac9-4efe-b667-da2dea1f54ea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:41.855769 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4166/8360] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:41.856401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:41.874693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db769-5d76-443a-9c0c-e11dd8c15742 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:41.887640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:41.889100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:41.889391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:41.889682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] PATH_INFO: `/v3/system/users/3f3969cbcd6b4787b276f0c92d7335f9/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:41.923091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f3969cbcd6b4787b276f0c92d7335f9, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:41.924201 n-d-master-1 devstack@keystone.service[80989]: WARNING py.warnings [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:23:41.924201 n-d-master-1 devstack@keystone.service[80989]: warnings.warn(msg) Jul 11 15:23:41.924201 n-d-master-1 devstack@keystone.service[80989]: Jul 11 15:23:41.925167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:41.949137 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4195/8361] 10.222.0.77 () {60 vars in 1377 bytes} [Mon Jul 11 15:23:41 2022] PUT /identity/v3/system/users/3f3969cbcd6b4787b276f0c92d7335f9/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:23:41.964675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:41.964968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:41.965255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:42.014273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] MFA Rules not processed for user `3f3969cbcd6b4787b276f0c92d7335f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:42.015926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:42.205184 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4167/8362] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:41 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:23:42.209319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:42.373325 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:42.520631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb87d-94e1-4d2a-b530-86061edbd47e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:42.594228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3969cbcd6b4787b276f0c92d7335f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:42.594955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:42.595243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:42.595522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] PATH_INFO: `/v3/services` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:42.596214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:42.597590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:42.620078 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4196/8363] 10.222.0.77 () {58 vars in 1109 bytes} [Mon Jul 11 15:23:42 2022] GET /identity/v3/services => generated 2191 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:42.620911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:42.716916 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:42.877111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d2a3a-78f3-458a-98b8-11b0a8e0f554 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:42.982567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3969cbcd6b4787b276f0c92d7335f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:42.983197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:42.983526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:42.983842 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] PATH_INFO: `/v3/limits` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:42.984727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:42.988174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 11 15:23:43.090001 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: ERROR keystone.server.flask.application Jul 11 15:23:43.096217 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4168/8364] 10.222.0.77 () {60 vars in 1125 bytes} [Mon Jul 11 15:23:42 2022] POST /identity/v3/limits => generated 124 bytes in 471 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 11 15:23:43.102158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:43.477485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2cb96-08f0-4ec5-865f-717b2206d7af None tempest-ImageQuotaTest-1421319124-system-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:43.537116 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:43.549460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3969cbcd6b4787b276f0c92d7335f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:43.550383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:43.550884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:43.551166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:43.551967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:43.553190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:43.567077 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4197/8365] 10.222.0.77 () {58 vars in 1136 bytes} [Mon Jul 11 15:23:43 2022] GET /identity/v3/registered_limits => generated 129 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:43.574928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:43.801198 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e06d-0cee-4383-b994-04f1a4ec7511 None tempest-ImageQuotaTest-1421319124-system-admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:43.830472 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:43.899311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3857cd-27e7-4aa2-a86c-275b2ac2eea5 None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3969cbcd6b4787b276f0c92d7335f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:43.900009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3857cd-27e7-4aa2-a86c-275b2ac2eea5 None tempest-ImageQuotaTest-1421319124-system-admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:43.900302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3857cd-27e7-4aa2-a86c-275b2ac2eea5 None tempest-ImageQuotaTest-1421319124-system-admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:43.900590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3857cd-27e7-4aa2-a86c-275b2ac2eea5 None tempest-ImageQuotaTest-1421319124-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:43.901313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3857cd-27e7-4aa2-a86c-275b2ac2eea5 None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:43.902421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3857cd-27e7-4aa2-a86c-275b2ac2eea5 None tempest-ImageQuotaTest-1421319124-system-admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:43.917681 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4169/8366] 10.222.0.77 () {58 vars in 1136 bytes} [Mon Jul 11 15:23:43 2022] GET /identity/v3/registered_limits => generated 129 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:46.510216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:46.512327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:46.576346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad45e35-1ece-4e52-a776-e7527f1d68db None tempest-ImageQuotaTest-1421319124-system-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:46.588326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:46.589281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:46.592097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:46.592443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] PATH_INFO: `/v3/users/3fdf1208d2c34fd1b5a24c2ad4e063a2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:46.595155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fdf1208d2c34fd1b5a24c2ad4e063a2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:46.598236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:46.727927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fdf1208d2c34fd1b5a24c2ad4e063a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:46.729042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fdf1208d2c34fd1b5a24c2ad4e063a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:46.747042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fdf1208d2c34fd1b5a24c2ad4e063a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:46.748522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fdf1208d2c34fd1b5a24c2ad4e063a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:46.758228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fdf1208d2c34fd1b5a24c2ad4e063a2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:46.790229 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4198/8367] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:46 2022] DELETE /identity/v3/users/3fdf1208d2c34fd1b5a24c2ad4e063a2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:46.794923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:46.795759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:46.796214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:46.829795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:46.833606 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:46.989466 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4170/8368] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:46.996021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:46.998081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:47.215548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de7f8-2247-46e5-9207-b1f564215f70 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:47.224397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:47.225784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:47.226218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:47.226414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:47.241376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:47.243648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:47.274561 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4199/8369] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:47.611505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:47.614804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:47.651030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ebcc5-7e4e-48e6-ad4e-4bb7436ea1a2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:47.668349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:47.669509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:47.670185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:47.670185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] PATH_INFO: `/v3/projects/cd6e12c35a124266ba32e2a3c5a306c7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:47.671833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6e12c35a124266ba32e2a3c5a306c7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:47.673660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:47.766034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6e12c35a124266ba32e2a3c5a306c7', 'request_id': 'req-b3e6a416-7789-4ab3-b9f4-f547130dba16'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:47.773326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6e12c35a124266ba32e2a3c5a306c7', 'request_id': 'req-b3e6a416-7789-4ab3-b9f4-f547130dba16'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:47.792555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6e12c35a124266ba32e2a3c5a306c7', 'request_id': 'req-b3e6a416-7789-4ab3-b9f4-f547130dba16'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:47.810002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] The token cache is being invalidate because project cd6e12c35a124266ba32e2a3c5a306c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:47.810630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:47.811179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:47.812859 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4171/8370] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:47 2022] DELETE /identity/v3/projects/cd6e12c35a124266ba32e2a3c5a306c7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:47.817842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:47.838937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02173b5e-b1a8-4aca-ae0d-985d781053bb service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:47.895922 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:47.929295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:47.930815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:47.931814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:47.932177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] PATH_INFO: `/v3/users/e79c9cedb59948c286b3e7236e7cc864` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:47.935398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79c9cedb59948c286b3e7236e7cc864)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:47.938083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:48.026644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79c9cedb59948c286b3e7236e7cc864'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.028115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79c9cedb59948c286b3e7236e7cc864'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.074526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79c9cedb59948c286b3e7236e7cc864'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.076145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79c9cedb59948c286b3e7236e7cc864'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.087611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d0f33717-0d6f-4aed-84c5-55f4bb17b1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79c9cedb59948c286b3e7236e7cc864'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.110477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4200/8371] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:47 2022] DELETE /identity/v3/users/e79c9cedb59948c286b3e7236e7cc864 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:48.479911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:48.481433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:48.504838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6a416-7789-4ab3-b9f4-f547130dba16 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:48.611967 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:48.630652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:48.631794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:48.634703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:48.635346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] PATH_INFO: `/v3/projects/dabeab20d564412f85fa546f00b442df` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:48.639324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabeab20d564412f85fa546f00b442df)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:48.644160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:48.804226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabeab20d564412f85fa546f00b442df', 'request_id': 'req-922cbdda-7f16-414a-a441-4a7327cc1b70'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.811588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabeab20d564412f85fa546f00b442df', 'request_id': 'req-922cbdda-7f16-414a-a441-4a7327cc1b70'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.831137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabeab20d564412f85fa546f00b442df', 'request_id': 'req-922cbdda-7f16-414a-a441-4a7327cc1b70'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.852775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] The token cache is being invalidate because project dabeab20d564412f85fa546f00b442df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:48.853354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.854349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-922cbdda-7f16-414a-a441-4a7327cc1b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:48.856721 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4172/8372] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:48 2022] DELETE /identity/v3/projects/dabeab20d564412f85fa546f00b442df => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:48.865471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:48.867814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:48.868337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:48.913396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:48.914774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:49.062186 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4201/8373] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:49.064035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.064326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.064615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.130588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:49.132767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:49.164895 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4173/8374] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:49.170668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:49.201811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9a0a6-acab-455d-b46e-10eba4c89e09 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:49.224344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:49.225548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.225832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.226110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.227155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:23:49.227274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:49.228973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:49.266631 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4202/8375] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:23:49.271041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:49.287440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532eed9-7996-4150-9e55-00f2390deaa6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:49.295228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:49.295914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.296237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.297632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.297632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:49.299361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:49.367338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4174/8376] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:49 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:49.370885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:49.401957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7977ef-383f-4e1c-b5fd-d0db60167324 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:49.562521 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:49.632093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:49.633087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.633829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.634168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.634947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:49.637548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:49.680477 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4203/8377] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:49 2022] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:49.684580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:49.704717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706154-15dc-47bd-8773-a070b87e20b6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:49.720820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:49.721819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.721819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.722072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.722872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:49.724518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:49.744082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4175/8378] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:49.751559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:49.784466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6db39-6cd5-4c45-ba53-3a25eb11f37a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:49.800675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000efcc8-09a6-4d06-8998-c00ecf304a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:49.801536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000efcc8-09a6-4d06-8998-c00ecf304a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.802813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000efcc8-09a6-4d06-8998-c00ecf304a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.803799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000efcc8-09a6-4d06-8998-c00ecf304a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.804953 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000efcc8-09a6-4d06-8998-c00ecf304a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:49.812384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000efcc8-09a6-4d06-8998-c00ecf304a11 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:49.856032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:49.886648 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4204/8379] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:49.897226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689c68-218b-4d11-a7a6-7cb26f73a242 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:49.905711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:49.908911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:49.909610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:49.910346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] PATH_INFO: `/v3/projects/ecb0a2aaf88844599b4ff01ff73bee73/users/2c4f00d199324ea98d223f9f104b2760/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:49.942128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb0a2aaf88844599b4ff01ff73bee73, user_id=2c4f00d199324ea98d223f9f104b2760, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:49.952308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:49.996067 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4176/8380] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:49 2022] PUT /identity/v3/projects/ecb0a2aaf88844599b4ff01ff73bee73/users/2c4f00d199324ea98d223f9f104b2760/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:50.002373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca86e5-efa1-407c-a0dd-78cd535229c9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:50.002683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca86e5-efa1-407c-a0dd-78cd535229c9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:50.002968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca86e5-efa1-407c-a0dd-78cd535229c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:50.051813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-93ca86e5-efa1-407c-a0dd-78cd535229c9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:50.053732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93ca86e5-efa1-407c-a0dd-78cd535229c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:50.283812 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4205/8381] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:50.299994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:50.303041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:50.424016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcce6-4960-4a73-95b4-69407f336427 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:50.430641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:50.431330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:50.431821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:50.432468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:50.447371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:50.449141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:50.470199 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4177/8382] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:52.518541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:52.519560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:52.519850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:52.606966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] MFA Rules not processed for user `2c4f00d199324ea98d223f9f104b2760`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:52.615641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:52.884102 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4206/8383] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:52.888665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:52.915193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328ff0d-80f8-4157-a8ec-7a85dd08be2f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:52.941479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:52.947025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:52.947914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:52.948415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:52.951970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:52.959634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:53.095136 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4178/8384] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:23:52 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:53.101783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:53.131202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d799f-7d57-475d-b2eb-d1802e0bbc6b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:53.350054 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:53.380345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:53.381328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:53.381766 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:53.382190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:53.383154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:53.393642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:53.465075 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4207/8385] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:23:53 2022] POST /identity/v3/users => generated 295 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:23:53.469628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:53.476516 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:53.490621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0237-b488-4d94-b685-3be3c652c553 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:53.509533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:53.510406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:53.510729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:53.514654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:53.516095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:53.523872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:53.570190 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4179/8386] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:53.574789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:53.607678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f979f3-409c-4b0b-b92a-d4787db7a730 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:53.622380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:53.623003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:53.623496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:53.623672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] PATH_INFO: `/v3/projects/6147afdc0fa040d19c463cca62afff83/users/b1a63487cf794d9eb59110e2c3d079ac/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:53.687425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6147afdc0fa040d19c463cca62afff83, user_id=b1a63487cf794d9eb59110e2c3d079ac, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:53.691693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:53.722804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4208/8387] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:53 2022] PUT /identity/v3/projects/6147afdc0fa040d19c463cca62afff83/users/b1a63487cf794d9eb59110e2c3d079ac/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:53.726013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:53.764123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea226db-cbe2-497b-86ac-9085a16ffaf5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:53.897653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:53.899122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:53.899626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:53.900102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:53.901068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:53.903611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:53.923149 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4180/8388] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:23:53.932835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:53.936052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:53.942946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:53.944436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba305e-99c5-4193-b469-381c8ba78435 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:53.956175 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:53.958124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:53.961788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:53.962798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] PATH_INFO: `/v3/projects/6147afdc0fa040d19c463cca62afff83/users/b1a63487cf794d9eb59110e2c3d079ac/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:53.969087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6147afdc0fa040d19c463cca62afff83, user_id=b1a63487cf794d9eb59110e2c3d079ac, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:53.976375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:53.990723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75892-374d-480b-9691-dd3dd303cc94 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:54.003226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:54.005124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:54.005652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:54.006099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] PATH_INFO: `/v3/users/46b53ee9d3e44461a9e7b61a7dd2ae10` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:54.008161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b53ee9d3e44461a9e7b61a7dd2ae10)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:54.012792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:54.022667 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4209/8389] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:23:53 2022] PUT /identity/v3/projects/6147afdc0fa040d19c463cca62afff83/users/b1a63487cf794d9eb59110e2c3d079ac/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:54.150246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b53ee9d3e44461a9e7b61a7dd2ae10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:54.179932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b53ee9d3e44461a9e7b61a7dd2ae10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:54.194242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b53ee9d3e44461a9e7b61a7dd2ae10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:54.217641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b53ee9d3e44461a9e7b61a7dd2ae10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:54.218413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-158cd18a-1799-40d6-9dcf-64f846a5c3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b53ee9d3e44461a9e7b61a7dd2ae10'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:54.229309 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4181/8390] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:53 2022] DELETE /identity/v3/users/46b53ee9d3e44461a9e7b61a7dd2ae10 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:54.754693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:54.756548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:54.929939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700049ea-6318-4290-b31c-f29e389c0713 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:55.062810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:55.062810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:55.063193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:55.063375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] PATH_INFO: `/v3/projects/2461ded20b0d40a6872e87b3c8166a09` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:55.065756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2461ded20b0d40a6872e87b3c8166a09)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:55.069209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:55.224567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2461ded20b0d40a6872e87b3c8166a09', 'request_id': 'req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.272494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cca664-4c5e-493d-978e-41867b2df14b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:55.273005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cca664-4c5e-493d-978e-41867b2df14b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:55.273261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2461ded20b0d40a6872e87b3c8166a09', 'request_id': 'req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.273385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cca664-4c5e-493d-978e-41867b2df14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:55.275761 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:55.293519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2461ded20b0d40a6872e87b3c8166a09', 'request_id': 'req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.306631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b7cca664-4c5e-493d-978e-41867b2df14b None None] MFA Rules not processed for user `b1a63487cf794d9eb59110e2c3d079ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:55.307831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b7cca664-4c5e-493d-978e-41867b2df14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:55.322163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] The token cache is being invalidate because project 2461ded20b0d40a6872e87b3c8166a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:23:55.322479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.323192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.328697 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4210/8391] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:23:54 2022] DELETE /identity/v3/projects/2461ded20b0d40a6872e87b3c8166a09 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:55.339860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:55.345290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:55.413577 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:55.474895 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4182/8392] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:55.486303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:55.495172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:55.495722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:55.524942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eb259-06a0-48c2-bd8c-7eec3f62efe4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:55.527420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] MFA Rules not processed for user `2c4f00d199324ea98d223f9f104b2760`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:55.529173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:55.534829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:55.535873 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:55.536258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:55.536598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] PATH_INFO: `/v3/users/3f3969cbcd6b4787b276f0c92d7335f9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:55.538482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3969cbcd6b4787b276f0c92d7335f9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:55.542557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:55.628654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3969cbcd6b4787b276f0c92d7335f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.629406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3969cbcd6b4787b276f0c92d7335f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.647719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3969cbcd6b4787b276f0c92d7335f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.648420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3969cbcd6b4787b276f0c92d7335f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.655033 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4183/8393] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:23:55.657193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3969cbcd6b4787b276f0c92d7335f9'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:23:55.667812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:55.669888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:55.691046 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4211/8394] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:23:55 2022] DELETE /identity/v3/users/3f3969cbcd6b4787b276f0c92d7335f9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:23:55.822474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af661-69d8-40cd-948d-5b373f9f3319 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:56.061510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:56.062333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:56.062684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:56.062965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:56.066380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:56.087393 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:56.157769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:56.171998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa0af9-c720-4cf2-8803-43c13f30c5d8 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:56.186886 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4184/8395] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:23:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:23:56.193272 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:23:56.194746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:56.321910 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:23:56.340145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcedf6-9375-4c1d-8970-e4e0c10bd341 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:23:56.346781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:23:56.347706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:56.348032 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:56.348385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:56.356689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:23:56.358859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:23:56.374791 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 11 15:23:56.375823 n-d-master-1 devstack@keystone.service[80989]: ERROR keystone.server.flask.application Jul 11 15:23:56.376321 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4212/8396] 10.222.0.77 () {58 vars in 1148 bytes} [Mon Jul 11 15:23:56 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:23:58.353800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:23:58.354312 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:23:58.354395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:23:58.383416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] MFA Rules not processed for user `302eed11186a4ce2899c3f2a1100403c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:23:58.384743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:23:58.490441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4185/8397] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:24:06.363035 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:08.482615 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=49 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:23.383084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:23.385115 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:23.454407 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02bbd-365b-4ec4-a0a6-bc8fcdaa2327 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:23.464242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:23.465712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:23.466167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:23.466452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] PATH_INFO: `/v3/users/2c4f00d199324ea98d223f9f104b2760` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:23.467826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4f00d199324ea98d223f9f104b2760)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:23.469785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:23.593639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4f00d199324ea98d223f9f104b2760'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:23.594349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4f00d199324ea98d223f9f104b2760'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:23.623454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4f00d199324ea98d223f9f104b2760'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:23.625525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4f00d199324ea98d223f9f104b2760'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:23.663099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4f00d199324ea98d223f9f104b2760'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:23.687143 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4213/8398] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:24:23 2022] DELETE /identity/v3/users/2c4f00d199324ea98d223f9f104b2760 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:24.096878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:24.116576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1754-0175-417f-a1e7-782d3d814a45 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:24.212679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:24.213835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:24.216372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:24.216839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] PATH_INFO: `/v3/projects/ecb0a2aaf88844599b4ff01ff73bee73` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:24.228582 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb0a2aaf88844599b4ff01ff73bee73)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:24.231445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:24.342604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb0a2aaf88844599b4ff01ff73bee73', 'request_id': 'req-7b3965db-437f-4a97-a9d2-444371899cae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.352218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb0a2aaf88844599b4ff01ff73bee73', 'request_id': 'req-7b3965db-437f-4a97-a9d2-444371899cae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.365694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb0a2aaf88844599b4ff01ff73bee73', 'request_id': 'req-7b3965db-437f-4a97-a9d2-444371899cae'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.392971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] The token cache is being invalidate because project ecb0a2aaf88844599b4ff01ff73bee73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:24:24.393418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.394754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.402223 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4186/8399] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:24:24 2022] DELETE /identity/v3/projects/ecb0a2aaf88844599b4ff01ff73bee73 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:24.403538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:24.406139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:24.498976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892f68-a3c8-433a-9d41-6e1a3dbd2662 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:24.510133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:24.511821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:24.624068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:24.625311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:24.626238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:24.626653 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] PATH_INFO: `/v3/users/b1a63487cf794d9eb59110e2c3d079ac` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:24.628294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a63487cf794d9eb59110e2c3d079ac)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:24.630937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:24.653145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3965db-437f-4a97-a9d2-444371899cae admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:24.664854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:24.665897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:24.666289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:24.668304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] PATH_INFO: `/v3/users/3e63b265feef4c21b7650a0c39923d73` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:24.670108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e63b265feef4c21b7650a0c39923d73)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:24.670987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:24.707893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a63487cf794d9eb59110e2c3d079ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.709193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a63487cf794d9eb59110e2c3d079ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.721044 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:24.733312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a63487cf794d9eb59110e2c3d079ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.737512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a63487cf794d9eb59110e2c3d079ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.752114 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:24.753474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-027c4263-f925-4048-9622-c7d9c87742be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a63487cf794d9eb59110e2c3d079ac'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.770234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e63b265feef4c21b7650a0c39923d73'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.788322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e63b265feef4c21b7650a0c39923d73'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.789085 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4214/8400] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:24:24 2022] DELETE /identity/v3/users/b1a63487cf794d9eb59110e2c3d079ac => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:24.798502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e63b265feef4c21b7650a0c39923d73'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.811523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e63b265feef4c21b7650a0c39923d73'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.813153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e63b265feef4c21b7650a0c39923d73'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:24.826643 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4187/8401] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:24:24 2022] DELETE /identity/v3/users/3e63b265feef4c21b7650a0c39923d73 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:24.830110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:24.830408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:24.830721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:24.896593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:24.898448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:25.005155 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4215/8402] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:25.019580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:25.021174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:25.105822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:25.107819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:25.139355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa866fd-8c84-47b6-b5e7-e0eb94a1d160 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:25.158618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:25.159524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:25.159815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:25.160882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] PATH_INFO: `/v3/projects/6147afdc0fa040d19c463cca62afff83` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:25.166156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6147afdc0fa040d19c463cca62afff83)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:25.169698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:25.207230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df32a5-ad0e-4c75-b237-ab4c676692a6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:25.230152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901d6a1-93ce-4a62-9c10-b840ab0d4958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:25.231293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d6a1-93ce-4a62-9c10-b840ab0d4958 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:25.238901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d6a1-93ce-4a62-9c10-b840ab0d4958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:25.239294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d6a1-93ce-4a62-9c10-b840ab0d4958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:25.253545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901d6a1-93ce-4a62-9c10-b840ab0d4958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:25.256235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901d6a1-93ce-4a62-9c10-b840ab0d4958 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:25.256389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6147afdc0fa040d19c463cca62afff83', 'request_id': 'req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:25.269343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6147afdc0fa040d19c463cca62afff83', 'request_id': 'req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:25.272225 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4188/8403] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:25.276322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6147afdc0fa040d19c463cca62afff83', 'request_id': 'req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:25.309090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] The token cache is being invalidate because project 6147afdc0fa040d19c463cca62afff83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:24:25.310621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:25.311494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b8e5402-0495-4138-b2ea-de0f8bb2dacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:25.317336 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4216/8404] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:24:25 2022] DELETE /identity/v3/projects/6147afdc0fa040d19c463cca62afff83 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:25.319069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:25.319578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:25.320051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:25.478851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:25.482953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:25.615961 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4189/8405] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:25.740838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:25.741289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:25.741652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:25.794796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:25.796263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:25.811088 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4217/8406] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:25.815985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:25.830188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbc8dd-4fbc-4c93-b21a-a90e70fb558c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:25.843419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:25.844191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:25.844550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:25.845083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:25.845902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:24:25.846304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:25.848045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:25.867902 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4190/8407] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:24:25.869097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:25.882900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27e28-1b64-4f84-9d8c-b9514d420145 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:25.888514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:25.889349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:25.889699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:25.890048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:25.891120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:25.893317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:25.933900 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4218/8408] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:24:25 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:25.935438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:25.949527 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:25.956903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354517-4782-4f1b-8727-e70e3c91917d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.061807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.063785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:26.076070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.076617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.076917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.077660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.078709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.081292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.094133 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:26.123839 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4191/8409] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:24:25 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:26.126268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.142365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66537d7b-6125-4f93-9321-c929b48d1a04 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.150006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.150829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.151126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.151495 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.154177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.155045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.160936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1693ef-6af7-40cf-9acb-a56a0506a9b1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.166075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.169889 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4192/8410] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:26.170059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.170059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.170059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] PATH_INFO: `/v3/projects/5ac924f555aa4ab898578d9707234371` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.170916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.171384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac924f555aa4ab898578d9707234371)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.173406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.181087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134d2b-7480-44ae-8d2c-9737477933f1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.187937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.188538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.188860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.189143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.190289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.192373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.204640 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4193/8411] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:24:26.208769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.219766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898427aa-15f4-4b89-814c-b4ddd0839e77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.233916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac924f555aa4ab898578d9707234371', 'request_id': 'req-d66bac13-0bb3-415a-ac47-820573dec4d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:26.243904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac924f555aa4ab898578d9707234371', 'request_id': 'req-d66bac13-0bb3-415a-ac47-820573dec4d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:26.251125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac924f555aa4ab898578d9707234371', 'request_id': 'req-d66bac13-0bb3-415a-ac47-820573dec4d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:26.263532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] The token cache is being invalidate because project 5ac924f555aa4ab898578d9707234371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:24:26.264033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:26.265050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d66bac13-0bb3-415a-ac47-820573dec4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:26.266870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4219/8412] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:24:26 2022] DELETE /identity/v3/projects/5ac924f555aa4ab898578d9707234371 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:26.271840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18751e-6f55-423f-8969-6761158f9041 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.272138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18751e-6f55-423f-8969-6761158f9041 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.272422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18751e-6f55-423f-8969-6761158f9041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.284029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57243da3-064a-42ff-a5d2-b444c7f5844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.284956 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57243da3-064a-42ff-a5d2-b444c7f5844d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.285262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57243da3-064a-42ff-a5d2-b444c7f5844d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.285546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57243da3-064a-42ff-a5d2-b444c7f5844d admin admin] PATH_INFO: `/v3/projects/4008c140c71c4679adfe15f1238cb9b7/users/9026a4d3931749c081de1d18559cb204/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.299375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1e18751e-6f55-423f-8969-6761158f9041 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:26.300999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57243da3-064a-42ff-a5d2-b444c7f5844d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4008c140c71c4679adfe15f1238cb9b7, user_id=9026a4d3931749c081de1d18559cb204, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.302403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e18751e-6f55-423f-8969-6761158f9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:26.303737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57243da3-064a-42ff-a5d2-b444c7f5844d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.313159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4220/8413] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:24:26.322008 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4194/8414] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:26 2022] PUT /identity/v3/projects/4008c140c71c4679adfe15f1238cb9b7/users/9026a4d3931749c081de1d18559cb204/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:24:26.324288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.324746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.325024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.327637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.327928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.328206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.345882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:26.347140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:26.350342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:26.352978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:26.423633 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:26.439554 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4221/8415] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:26.444011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.445767 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4195/8416] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:26.456522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.458089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:26.459733 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee405a52-6dcf-485f-a570-a85c58103c7a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.466548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.467492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.467874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.468261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.469126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:24:26.469559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.471605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.493751 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4222/8417] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:24:26.495769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.512836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802f9f-410f-4333-b57e-032b434b7e90 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.532128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.532809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.533098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.536341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.537082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.539607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.540911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a0cc4-ace5-42e4-a32f-efa3818de189 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.546428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.546772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.547141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.547499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.564060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.566216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.577672 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4223/8418] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:24:26 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:26.581063 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4196/8419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:24:26.582444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.599413 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:26.684560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6163ec-ebef-4cc5-bebd-598c8b5d5a35 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.692006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.692784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.693292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.693651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.694531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.697246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.725999 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4224/8420] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:24:26 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:24:26.726878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.740170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef600a-2947-4b0a-9a24-ab58dc8d0cce service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.749383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.750166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.750689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.751044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.752124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.753848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.778762 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4197/8421] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:26.782864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.797808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6ceeb-097d-40ce-8ecc-01b675fff642 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.809290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12f785-6fa9-42eb-a1fb-a8254a846f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.810980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12f785-6fa9-42eb-a1fb-a8254a846f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.811338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12f785-6fa9-42eb-a1fb-a8254a846f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.811630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12f785-6fa9-42eb-a1fb-a8254a846f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.813087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12f785-6fa9-42eb-a1fb-a8254a846f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.815558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12f785-6fa9-42eb-a1fb-a8254a846f5b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.833429 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4225/8422] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:26.834857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:26.848559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395770a-13ed-4522-aa7a-6ab34ed94b45 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:26.854314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:26.856554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.857011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.857506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] PATH_INFO: `/v3/projects/fe44aa0ca274496cba60dd14d7716f64/users/4143c96cb3384976ae68a51d3b85f580/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:26.896791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe44aa0ca274496cba60dd14d7716f64, user_id=4143c96cb3384976ae68a51d3b85f580, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:26.904805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:26.938801 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4198/8423] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:26 2022] PUT /identity/v3/projects/fe44aa0ca274496cba60dd14d7716f64/users/4143c96cb3384976ae68a51d3b85f580/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:24:26.951014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55031c3-5b50-47c6-806e-ac56700d6521 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:26.951207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55031c3-5b50-47c6-806e-ac56700d6521 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:26.951642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55031c3-5b50-47c6-806e-ac56700d6521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:27.009280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d55031c3-5b50-47c6-806e-ac56700d6521 None None] MFA Rules not processed for user `4143c96cb3384976ae68a51d3b85f580`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:27.010808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d55031c3-5b50-47c6-806e-ac56700d6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:27.177341 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4226/8424] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:27.193226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:27.196933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:27.311141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a119cd1-d9ba-4391-9667-b6b5666a505b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:27.316873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:27.317704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:27.318827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:27.319130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:27.332179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:27.333722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:27.346406 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4199/8425] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:33.209238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:33.209764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:33.209982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:33.271173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:33.273393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:33.388982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:33.390707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:33.392616 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4227/8426] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:33.523339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471c1a-1644-4f38-abb1-f9e6f9bf05ae service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:33.540697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:33.541526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:33.542721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:33.542721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:33.543422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:33.549476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:33.569332 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:33.605093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4200/8427] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:24:33 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:24:33.608850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:33.626148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648ce3-1550-40d8-a614-d54ba0a11e59 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:33.635873 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:33.732088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:33.734019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:33.734019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:33.735588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:33.737036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:33.740811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:33.788082 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4228/8428] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:24:33 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:33.790231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:33.816147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5456-c51a-4439-a96a-bd4d312bdf7b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:33.823816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:33.824921 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:33.825442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:33.825939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:33.827106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:33.831347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:33.857491 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4201/8429] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:33.861995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:33.874161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca061-7555-4523-9f08-804e464edd49 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:33.880380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:33.881495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:33.881865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:33.882251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] PATH_INFO: `/v3/projects/879bbfed7f7f45b886e017ce86845de4/users/34a5ddfb58af4d7993050d7f95d2d180/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:33.909559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=879bbfed7f7f45b886e017ce86845de4, user_id=34a5ddfb58af4d7993050d7f95d2d180, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:33.915382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:33.955045 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4229/8430] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:33 2022] PUT /identity/v3/projects/879bbfed7f7f45b886e017ce86845de4/users/34a5ddfb58af4d7993050d7f95d2d180/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:33.959646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:33.980931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad3c3-0a4a-4f07-a852-c134c374c675 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:34.104001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f9144-9bd5-47af-b167-ba31c349534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:34.104738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f9144-9bd5-47af-b167-ba31c349534a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:34.105030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f9144-9bd5-47af-b167-ba31c349534a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:34.105366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f9144-9bd5-47af-b167-ba31c349534a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:34.106041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f9144-9bd5-47af-b167-ba31c349534a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:34.110277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f9144-9bd5-47af-b167-ba31c349534a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:34.139953 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4202/8431] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:34.144436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:34.159831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c640c-c1c7-4a7f-aec5-42fd5a210b4d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:34.179389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:34.180308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:34.180594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:34.180870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] PATH_INFO: `/v3/projects/879bbfed7f7f45b886e017ce86845de4/users/34a5ddfb58af4d7993050d7f95d2d180/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:34.183634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879bbfed7f7f45b886e017ce86845de4, user_id=34a5ddfb58af4d7993050d7f95d2d180, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:34.186956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:34.207855 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4230/8432] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:34 2022] PUT /identity/v3/projects/879bbfed7f7f45b886e017ce86845de4/users/34a5ddfb58af4d7993050d7f95d2d180/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:42.940581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:42.941064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:42.941291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:42.975570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] MFA Rules not processed for user `34a5ddfb58af4d7993050d7f95d2d180`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:42.977025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:43.154430 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4203/8433] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:43.167818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:43.171834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:43.335942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840606b-de9c-4add-85b1-8a1dc92f1ba4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:43.341306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64415d44-681b-4133-8634-1a3820077241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:43.342307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415d44-681b-4133-8634-1a3820077241 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:43.343368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415d44-681b-4133-8634-1a3820077241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:43.343850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64415d44-681b-4133-8634-1a3820077241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:43.355964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64415d44-681b-4133-8634-1a3820077241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:43.357651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64415d44-681b-4133-8634-1a3820077241 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:43.371066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4231/8434] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:43.577763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:43.594651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4bce5-c591-4da0-b904-6d5ba7504a5c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:43.599167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:43.600298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:43.600763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:43.601208 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:43.709762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:43.711445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:43.719747 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:43.732667 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4204/8435] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:46.840486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735af18-70d3-4e7a-8503-1ea25f85d54f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:46.841024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735af18-70d3-4e7a-8503-1ea25f85d54f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:46.844814 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735af18-70d3-4e7a-8503-1ea25f85d54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:46.872239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3735af18-70d3-4e7a-8503-1ea25f85d54f None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:46.877481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3735af18-70d3-4e7a-8503-1ea25f85d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:46.897388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4232/8436] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:46.978656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:46.980682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:47.120213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f907c-31c0-44f4-a887-f2d0d3846cf5 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:47.129486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:47.130389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:47.130712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:47.130992 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] PATH_INFO: `/v3/users/950d45fd51734be6add88517058fd5d0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:47.132247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=950d45fd51734be6add88517058fd5d0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:47.134916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:47.217439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950d45fd51734be6add88517058fd5d0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:47.232682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950d45fd51734be6add88517058fd5d0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:47.240783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950d45fd51734be6add88517058fd5d0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:47.257990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950d45fd51734be6add88517058fd5d0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:47.258791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950d45fd51734be6add88517058fd5d0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:47.286258 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4205/8437] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:24:46 2022] DELETE /identity/v3/users/950d45fd51734be6add88517058fd5d0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:47.291058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:47.292028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:47.292455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:47.330230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:47.331667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:47.407916 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:47.448493 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4233/8438] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:47.457877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:47.459757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:47.638367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33a9b-1ecd-465a-b032-03b60a0ca2ab admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:47.642893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cf50f-afd4-4bd7-9828-52e36d6efeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:47.643646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cf50f-afd4-4bd7-9828-52e36d6efeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:47.645172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cf50f-afd4-4bd7-9828-52e36d6efeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:47.645539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cf50f-afd4-4bd7-9828-52e36d6efeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:47.658569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cf50f-afd4-4bd7-9828-52e36d6efeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:47.660311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cf50f-afd4-4bd7-9828-52e36d6efeb0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:47.671445 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4206/8439] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:47.952207 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:47.953677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:47.976901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb93f7-7480-4d31-9f7c-5f02ec7aea02 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:47.987368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:47.987989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:47.988337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:47.988747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] PATH_INFO: `/v3/projects/ea6f9f26ef9f4110a96586a2ee268a87` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:47.990324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6f9f26ef9f4110a96586a2ee268a87)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:47.993114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.080750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6f9f26ef9f4110a96586a2ee268a87', 'request_id': 'req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:48.092018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6f9f26ef9f4110a96586a2ee268a87', 'request_id': 'req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:48.107644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6f9f26ef9f4110a96586a2ee268a87', 'request_id': 'req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:48.159051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] The token cache is being invalidate because project ea6f9f26ef9f4110a96586a2ee268a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:24:48.159536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:48.160511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a16ac8ba-5ae9-4705-9e3d-1798bf652eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:24:48.162940 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4234/8440] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:24:47 2022] DELETE /identity/v3/projects/ea6f9f26ef9f4110a96586a2ee268a87 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:48.168970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.168970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.169580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.207805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:48.209536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:48.242566 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:48.348029 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4207/8441] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:48.349775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.350067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.350461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.396022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:48.397275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:48.419923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4235/8442] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:48.423749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:48.449888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271aab2-8166-41e1-a83d-51e6b3943945 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:48.458772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:48.459636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.459968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.460347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.461193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:24:48.461733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:48.464210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.480632 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4208/8443] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:24:48.484677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:48.494749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855879a-88f0-438c-a931-0ab49af02db1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:48.500205 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:48.500901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.511050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.512597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.513446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:48.518664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.584981 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4236/8444] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:24:48 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:48.586143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:48.597659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bf6d2-4e7f-4916-b055-f15739fee05a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:48.667601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:48.668665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.669172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.669674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.671228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:48.673480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.701176 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4209/8445] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:24:48 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:24:48.705068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:48.718101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06a14-4e03-4597-967b-0c28652dab32 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:48.723363 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:48.724351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.724513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.724826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.725768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:48.727617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.742563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4237/8446] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:48.746465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:48.762199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5bc5-fc8e-4dac-b33e-a4669f2ada77 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:48.767910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18920d-c10f-4405-a596-a522f36c93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:48.768595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18920d-c10f-4405-a596-a522f36c93b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.768885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18920d-c10f-4405-a596-a522f36c93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.769160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18920d-c10f-4405-a596-a522f36c93b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.769961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18920d-c10f-4405-a596-a522f36c93b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:48.771594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18920d-c10f-4405-a596-a522f36c93b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.784316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4210/8447] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:24:48.788611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:48.803759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7b33-bbdb-47b2-83c1-e6ebe70451b0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:48.813639 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:48.815713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.816268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.816772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] PATH_INFO: `/v3/projects/a58323ff3b5c4d14a1548c5dda645b1b/users/17af11c0442846f7aceb9281673477c4/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.847978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58323ff3b5c4d14a1548c5dda645b1b, user_id=17af11c0442846f7aceb9281673477c4, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:48.854579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:48.875970 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4238/8448] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:24:48 2022] PUT /identity/v3/projects/a58323ff3b5c4d14a1548c5dda645b1b/users/17af11c0442846f7aceb9281673477c4/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:24:48.890569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:48.890868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:48.891122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:48.919985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] MFA Rules not processed for user `17af11c0442846f7aceb9281673477c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:24:48.921360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:48.999052 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4211/8449] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:24:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:24:49.009554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:49.012028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:49.077431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf1351-5fcb-44c8-a147-d5a50ea2b8a9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:49.081196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:49.081832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:49.082121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:49.082402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:49.091754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:49.093902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:49.103405 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4239/8450] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:24:58.995149 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:59.100960 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:24:59.268506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:24:59.269946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:59.471597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b9858-5598-4961-b2a3-c1c025fdcbaf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:24:59.483234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:24:59.484327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:24:59.484644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:24:59.485359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:24:59.488085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:24:59.508771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:24:59.511327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c602e-f2f4-435d-8dd6-a3c8f34453ba service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:24:59.529841 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4212/8451] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:24:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:02.475618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:02.555946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801939d-d11f-4c18-86a0-480baf5bae26 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:02.570802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:02.571682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:02.572647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:02.572647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] PATH_INFO: `/v3/users/17af11c0442846f7aceb9281673477c4` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:02.574121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17af11c0442846f7aceb9281673477c4)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:02.575664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:02.633951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17af11c0442846f7aceb9281673477c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:02.634688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17af11c0442846f7aceb9281673477c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:02.652660 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17af11c0442846f7aceb9281673477c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:02.653695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17af11c0442846f7aceb9281673477c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:02.662560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17af11c0442846f7aceb9281673477c4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:02.684860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:02.685388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:02.685470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:02.688302 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4240/8452] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:25:02 2022] DELETE /identity/v3/users/17af11c0442846f7aceb9281673477c4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:02.707021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:02.708015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:02.824465 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4213/8453] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:02.836009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:02.839437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:02.982051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999466d-b5b8-41f1-881b-4d941ce2a334 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:02.989385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ca95-933d-403f-8724-7e78fcdffeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:02.990615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ca95-933d-403f-8724-7e78fcdffeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:02.990615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ca95-933d-403f-8724-7e78fcdffeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:02.990808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ca95-933d-403f-8724-7e78fcdffeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.001389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ca95-933d-403f-8724-7e78fcdffeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.003249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ca95-933d-403f-8724-7e78fcdffeb9 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.026207 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4241/8454] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:03.250411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.252440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:03.274539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d531ec-d173-4c9b-96b2-dbda9ff04fe0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.299941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.300904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.301215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.305481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] PATH_INFO: `/v3/projects/a58323ff3b5c4d14a1548c5dda645b1b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.323337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58323ff3b5c4d14a1548c5dda645b1b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.329735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.427806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58323ff3b5c4d14a1548c5dda645b1b', 'request_id': 'req-7c726587-f233-48aa-9a63-198962f0afcd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:03.436045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58323ff3b5c4d14a1548c5dda645b1b', 'request_id': 'req-7c726587-f233-48aa-9a63-198962f0afcd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:03.446430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58323ff3b5c4d14a1548c5dda645b1b', 'request_id': 'req-7c726587-f233-48aa-9a63-198962f0afcd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:03.449007 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:03.463107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] The token cache is being invalidate because project a58323ff3b5c4d14a1548c5dda645b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:25:03.463851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:03.464522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7c726587-f233-48aa-9a63-198962f0afcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:03.466907 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4214/8455] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:25:03 2022] DELETE /identity/v3/projects/a58323ff3b5c4d14a1548c5dda645b1b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:03.471685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.472186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.472621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.497039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:03.499894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:03.519180 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:03.594213 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4242/8456] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:03.596376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.597336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.597336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.616737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:03.618034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:03.627213 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4215/8457] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:03.631603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.642390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94a5c-8264-44f2-9b55-8ef0d0428a6d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.647463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.648224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.648621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.648966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.649710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:25:03.650051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.651677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.664047 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4243/8458] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:25:03.668184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.679064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3a31a-2400-4019-bc12-98fe74175ef0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.683799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.685232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.685232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.685232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.686816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.687821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.714802 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4216/8459] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:25:03 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:25:03.719264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.730973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660122b9-92ac-48de-b200-6f7f0677f0f2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.800755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.802458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.803091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.803230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.804031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.806749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.837905 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4244/8460] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:25:03 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:25:03.839658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.852450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5cd33-315a-4e12-81c5-b17939e8c6a8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.858781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.859563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.859960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.860323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.861061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.862772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.880583 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4217/8461] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:25:03.884456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.901507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b298-1de6-43ce-8e1c-6ae0e87d4d79 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.908177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e184d95-1ce3-4616-be8e-a38aa3c564a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.909381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e184d95-1ce3-4616-be8e-a38aa3c564a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.909869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e184d95-1ce3-4616-be8e-a38aa3c564a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.910309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e184d95-1ce3-4616-be8e-a38aa3c564a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:03.911545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e184d95-1ce3-4616-be8e-a38aa3c564a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:03.913489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e184d95-1ce3-4616-be8e-a38aa3c564a8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:03.927341 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4245/8462] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:25:03.932218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:03.963692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b45eeb-f1bc-492d-8cdd-1f23f21fd230 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:03.986260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:03.987265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:03.987555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:03.987836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] PATH_INFO: `/v3/projects/798c93d98ebc4a499b5e433d7898e2a6/users/b85b5395eb404db8abd8257d1070bf18/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:04.035054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798c93d98ebc4a499b5e433d7898e2a6, user_id=b85b5395eb404db8abd8257d1070bf18, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:04.037889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:04.060090 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4218/8463] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:25:03 2022] PUT /identity/v3/projects/798c93d98ebc4a499b5e433d7898e2a6/users/b85b5395eb404db8abd8257d1070bf18/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:25:04.088028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:04.088322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:04.088629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:04.120829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] MFA Rules not processed for user `b85b5395eb404db8abd8257d1070bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:04.122053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:04.226767 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4246/8464] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:04.240278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:04.243033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:04.316156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24805549-17c2-4b88-8cea-1c17f13c4b20 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:04.320720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:04.321373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:04.321675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:04.321939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:04.332589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:04.334407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:04.355716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4219/8465] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:05.809167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:05.811688 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:05.931241 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:06.073779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a9fb4-c1ef-48f6-a9f5-17c86480ac2d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:06.090928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:06.093190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:06.096978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:06.098383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:06.107393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:06.166372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:06.168392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e22e-eb42-46ff-82ce-16b61b731411 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:06.185507 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4247/8466] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:14.340361 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:16.175809 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=24 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:17.695820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:17.708441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:17.809517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cca4-8edc-45a2-9a34-e605e0990ff8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:17.815557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:17.816558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:17.816926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:17.817308 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] PATH_INFO: `/v3/users/4143c96cb3384976ae68a51d3b85f580` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:17.818756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4143c96cb3384976ae68a51d3b85f580)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:17.820867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:17.900012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4143c96cb3384976ae68a51d3b85f580'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:17.918983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4143c96cb3384976ae68a51d3b85f580'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:17.928713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4143c96cb3384976ae68a51d3b85f580'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:17.943009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4143c96cb3384976ae68a51d3b85f580'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:17.943911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4143c96cb3384976ae68a51d3b85f580'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:17.956204 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4220/8467] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:25:17 2022] DELETE /identity/v3/users/4143c96cb3384976ae68a51d3b85f580 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:17.960840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:17.961339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:17.961524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:17.982201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:17.983845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:18.089943 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4248/8468] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:18.099575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:18.101632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:18.222717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bda577-1cff-4cd8-b9bb-2b51fc5cdacb admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:18.227757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86690-efff-41c0-8e31-802bd9eea784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:18.229106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86690-efff-41c0-8e31-802bd9eea784 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:18.229622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86690-efff-41c0-8e31-802bd9eea784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:18.230163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86690-efff-41c0-8e31-802bd9eea784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:18.250729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86690-efff-41c0-8e31-802bd9eea784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:18.253991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86690-efff-41c0-8e31-802bd9eea784 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:18.286407 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4221/8469] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:18.896564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:18.900849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:18.933664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3019b-7c28-4c9f-82d1-35fa228254d0 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:18.947595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:18.948504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:18.948784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:18.949061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] PATH_INFO: `/v3/projects/fe44aa0ca274496cba60dd14d7716f64` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:18.955732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe44aa0ca274496cba60dd14d7716f64)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:18.959325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:19.042192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe44aa0ca274496cba60dd14d7716f64', 'request_id': 'req-0b881272-4670-40fa-a195-10e1b799ada0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:19.059026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe44aa0ca274496cba60dd14d7716f64', 'request_id': 'req-0b881272-4670-40fa-a195-10e1b799ada0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:19.072942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe44aa0ca274496cba60dd14d7716f64', 'request_id': 'req-0b881272-4670-40fa-a195-10e1b799ada0'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:19.087919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] The token cache is being invalidate because project fe44aa0ca274496cba60dd14d7716f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:25:19.088261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:19.088890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b881272-4670-40fa-a195-10e1b799ada0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:19.104388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4249/8470] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:25:18 2022] DELETE /identity/v3/projects/fe44aa0ca274496cba60dd14d7716f64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:19.105651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.106109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.106224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.151269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:19.152507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:19.187834 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:19.298917 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4222/8471] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:19.308237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.308806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.308943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.344201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:19.345451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:19.366388 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4250/8472] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:19.371076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:19.384571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7895c0-be1c-4b4e-a1a6-64dba9650317 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:19.398232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:19.399430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.399893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.400351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.401261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:25:19.401740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:19.408708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:19.438160 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4223/8473] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:25:19.442622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:19.453554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21b58-f784-4fb1-8a3a-a9cff1cd458b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:19.469191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:19.469891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.470177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.470454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.471234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:19.473161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:19.532785 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4251/8474] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:25:19 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:25:19.537437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:19.553592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431841-06e4-4da3-b343-f95f4574eb13 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:19.711808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:19.712507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.713412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.713713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.714448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:19.720419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:19.770626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4224/8475] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:25:19 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:25:19.771740 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:19.784472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ada3c9-a188-4818-b5ad-0c2ae42e0aec admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:19.798904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:19.800797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.800797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.800797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.802546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:19.808879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:19.843989 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4252/8476] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:25:19.846386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:19.862182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12621f0-7b31-4669-9e02-c637e2d57a4f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:19.874281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd93c0-7ea4-4593-9c5d-4cd9f53d1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:19.876343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd93c0-7ea4-4593-9c5d-4cd9f53d1e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.886478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd93c0-7ea4-4593-9c5d-4cd9f53d1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.887207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd93c0-7ea4-4593-9c5d-4cd9f53d1e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.889747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd93c0-7ea4-4593-9c5d-4cd9f53d1e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:19.896516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd93c0-7ea4-4593-9c5d-4cd9f53d1e05 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:19.938528 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4225/8477] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:25:19.938776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:19.949965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c60d2-ba2c-4035-9a6f-996cbf240b32 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:19.955225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:19.956139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:19.956423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:19.956704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] PATH_INFO: `/v3/projects/1e83013b6aef49b2977b3c1f18518bd1/users/adf0e39b5df84692b1cb3d501635a103/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:19.977810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e83013b6aef49b2977b3c1f18518bd1, user_id=adf0e39b5df84692b1cb3d501635a103, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:19.980706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:20.000985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4253/8478] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:25:19 2022] PUT /identity/v3/projects/1e83013b6aef49b2977b3c1f18518bd1/users/adf0e39b5df84692b1cb3d501635a103/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:25:20.005507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed8b26-1220-4b47-a20a-69fccaa390df None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:20.005801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed8b26-1220-4b47-a20a-69fccaa390df None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:20.006083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed8b26-1220-4b47-a20a-69fccaa390df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:20.041838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d9ed8b26-1220-4b47-a20a-69fccaa390df None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:20.060132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d9ed8b26-1220-4b47-a20a-69fccaa390df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:20.130341 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4226/8479] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:25:20.140198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:20.142001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:20.170064 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:20.226618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df55aed-25be-4ef9-8e12-e5c7c0378ccb admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:20.232246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:20.233383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:20.233582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:20.234300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:20.247754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:20.249872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:20.263450 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4254/8480] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:29.090585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:29.091413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:29.091413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:29.154295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] MFA Rules not processed for user `adf0e39b5df84692b1cb3d501635a103`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:29.159763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:29.203700 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:29.291535 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4227/8481] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:29.295698 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:29.310276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1be1d-3fe8-4f75-8c21-79a6f42365ba service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:29.322969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:29.334874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:29.352111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:29.352529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:29.355006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:29.361627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:29.428405 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4255/8482] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:25:29 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:25:29.432158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:29.452311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761449d8-4bbd-42bc-b8a3-d5c50569869c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:29.579199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:29.579603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:29.579877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:29.580165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:29.580875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:29.583140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:29.612742 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4228/8483] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:25:29 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:25:29.619158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:29.638274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748de4f1-f72d-4f7c-9350-949aaa68ecd0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:29.661428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:29.669060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:29.669860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:29.670540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:29.671478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:29.673279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:29.714267 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4256/8484] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:25:29.717657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:29.735649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953097e-d578-467c-b258-dbb7f1b5bc08 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:29.743194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:29.744373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:29.744730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:29.745134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] PATH_INFO: `/v3/projects/6953f652c9a44847b1645449071ead91/users/08f08558a44e4a54bfa69558febbc6f2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:29.775505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6953f652c9a44847b1645449071ead91, user_id=08f08558a44e4a54bfa69558febbc6f2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:29.779672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:29.814924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4229/8485] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:25:29 2022] PUT /identity/v3/projects/6953f652c9a44847b1645449071ead91/users/08f08558a44e4a54bfa69558febbc6f2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:29.820156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:29.842183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20845-ce5f-4e21-ab7e-5ad6f18e9509 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:29.977920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fa30f-a8eb-45d9-b471-2645c8f5efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:29.978992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa30f-a8eb-45d9-b471-2645c8f5efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:29.979429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa30f-a8eb-45d9-b471-2645c8f5efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:29.979854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa30f-a8eb-45d9-b471-2645c8f5efc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:29.980781 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa30f-a8eb-45d9-b471-2645c8f5efc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:29.982724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa30f-a8eb-45d9-b471-2645c8f5efc2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:30.020166 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4257/8486] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:25:30.024837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:30.041896 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90045-482a-4965-b6e2-3f09da4eefd7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:30.066533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:30.067591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:30.068056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:30.068379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] PATH_INFO: `/v3/projects/6953f652c9a44847b1645449071ead91/users/08f08558a44e4a54bfa69558febbc6f2/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:30.072088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6953f652c9a44847b1645449071ead91, user_id=08f08558a44e4a54bfa69558febbc6f2, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:30.081140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:30.104445 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4230/8487] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:25:30 2022] PUT /identity/v3/projects/6953f652c9a44847b1645449071ead91/users/08f08558a44e4a54bfa69558febbc6f2/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:38.962647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:38.963509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:38.963960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:39.001874 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] MFA Rules not processed for user `08f08558a44e4a54bfa69558febbc6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:25:39.005560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:39.163579 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4258/8488] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:25:39.180471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:39.183424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:39.360063 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:39.430401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde3676-cff8-47cd-adff-065e5437dfc5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:39.448953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:39.448953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:39.448953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:39.450123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:39.470153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:39.477579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:39.508579 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4231/8489] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:39.823434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:39.826066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:39.870531 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:40.043287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38ad65-4e8c-47cb-994c-707a957794e2 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:40.059256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:40.061968 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:40.062142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:40.062428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:40.072778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:40.098557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:40.098557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:40.138221 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4259/8490] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:40.644290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:40.645780 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:40.669022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b5cbc-eb0f-489b-9d06-48b2ae8fc643 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:40.682199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:40.683224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:40.683774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:40.684215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:40.686212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:40.703637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:40.705715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:40.730345 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4232/8491] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:25:50.114489 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=27 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:50.712597 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=16 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:54.182876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:54.307360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b63be-c6a5-40be-a6a3-a2bed969be51 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:54.314726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:54.315930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:54.316460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:54.317260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] PATH_INFO: `/v3/users/adf0e39b5df84692b1cb3d501635a103` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:54.319274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf0e39b5df84692b1cb3d501635a103)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:54.322891 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:54.392396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf0e39b5df84692b1cb3d501635a103'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:54.393666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf0e39b5df84692b1cb3d501635a103'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:54.431527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf0e39b5df84692b1cb3d501635a103'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:54.437560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf0e39b5df84692b1cb3d501635a103'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:54.465116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf0e39b5df84692b1cb3d501635a103'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:54.512170 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4260/8492] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:25:54 2022] DELETE /identity/v3/users/adf0e39b5df84692b1cb3d501635a103 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:54.862359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:54.876820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc483a0-02dc-4f6c-9703-cbde4b88c119 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:55.029863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:55.031371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:55.031751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:55.032039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] PATH_INFO: `/v3/projects/1e83013b6aef49b2977b3c1f18518bd1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:55.040883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e83013b6aef49b2977b3c1f18518bd1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:55.044954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:55.178040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e83013b6aef49b2977b3c1f18518bd1', 'request_id': 'req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.193906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e83013b6aef49b2977b3c1f18518bd1', 'request_id': 'req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.210918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e83013b6aef49b2977b3c1f18518bd1', 'request_id': 'req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.229854 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] The token cache is being invalidate because project 1e83013b6aef49b2977b3c1f18518bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:25:55.230424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.233807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.235636 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4233/8493] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:25:54 2022] DELETE /identity/v3/projects/1e83013b6aef49b2977b3c1f18518bd1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:55.239613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:55.242186 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:55.266686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074bfa-25fb-48b4-ab5b-0a92358a3b0e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:55.394189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:55.395556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:55.396065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:55.396534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] PATH_INFO: `/v3/users/08f08558a44e4a54bfa69558febbc6f2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:55.398171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f08558a44e4a54bfa69558febbc6f2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:55.400360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:55.459610 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:55.519293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f08558a44e4a54bfa69558febbc6f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.520379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f08558a44e4a54bfa69558febbc6f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.574759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f08558a44e4a54bfa69558febbc6f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.575851 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f08558a44e4a54bfa69558febbc6f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.598474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f08558a44e4a54bfa69558febbc6f2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:55.627208 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4261/8494] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:25:55 2022] DELETE /identity/v3/users/08f08558a44e4a54bfa69558febbc6f2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:25:56.529671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:25:56.531183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:25:56.544391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ce30-9b7e-41bd-8bc9-9b3f9c95513c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:25:56.678237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:25:56.680214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:25:56.680745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:25:56.681270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] PATH_INFO: `/v3/projects/6953f652c9a44847b1645449071ead91` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:25:56.682976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6953f652c9a44847b1645449071ead91)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:25:56.685660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:25:56.737538 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:25:56.753449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6953f652c9a44847b1645449071ead91', 'request_id': 'req-c667dc5d-0434-4a2a-a548-c2b0ef939605'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:56.761870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6953f652c9a44847b1645449071ead91', 'request_id': 'req-c667dc5d-0434-4a2a-a548-c2b0ef939605'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:56.776053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6953f652c9a44847b1645449071ead91', 'request_id': 'req-c667dc5d-0434-4a2a-a548-c2b0ef939605'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:56.791124 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] The token cache is being invalidate because project 6953f652c9a44847b1645449071ead91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:25:56.792151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:56.792922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c667dc5d-0434-4a2a-a548-c2b0ef939605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:25:56.794946 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4234/8495] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:25:56 2022] DELETE /identity/v3/projects/6953f652c9a44847b1645449071ead91 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:26:00.330518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:00.332019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:00.345879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a50d-2475-42f0-94eb-3c9cd5e6b13a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:00.422104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:00.423248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:00.423682 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:00.424129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] PATH_INFO: `/v3/users/302eed11186a4ce2899c3f2a1100403c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:00.425510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302eed11186a4ce2899c3f2a1100403c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:00.427725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:00.485738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302eed11186a4ce2899c3f2a1100403c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.486596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302eed11186a4ce2899c3f2a1100403c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.501920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302eed11186a4ce2899c3f2a1100403c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.502657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302eed11186a4ce2899c3f2a1100403c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.510381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302eed11186a4ce2899c3f2a1100403c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.524156 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4262/8496] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:26:00 2022] DELETE /identity/v3/users/302eed11186a4ce2899c3f2a1100403c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:26:00.658841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:00.659266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:00.659573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:00.679485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:26:00.680740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:00.760280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:00.761830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:00.783286 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4235/8497] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:26:00.798909 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:00.829195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:00.830888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:00.890214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d11d1-21cf-442e-ad37-e90eb6d06ba1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:00.895542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:00.896546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:00.896898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:00.897809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] PATH_INFO: `/v3/projects/9927140e2e534410b623783f43db6d54` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:00.899183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9927140e2e534410b623783f43db6d54)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:00.901539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:00.932194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092ae13-869b-4ee6-be71-d094ed61052a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:00.937409 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:00.938070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:00.938363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:00.939462 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:00.942533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:00.975094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9927140e2e534410b623783f43db6d54', 'request_id': 'req-757cecaa-5913-4c24-b089-e904fb5d7631'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.986413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9927140e2e534410b623783f43db6d54', 'request_id': 'req-757cecaa-5913-4c24-b089-e904fb5d7631'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:00.995956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9927140e2e534410b623783f43db6d54', 'request_id': 'req-757cecaa-5913-4c24-b089-e904fb5d7631'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:01.012665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] The token cache is being invalidate because project 9927140e2e534410b623783f43db6d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:26:01.012985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:01.013658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:01.030527 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4263/8498] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:26:00 2022] DELETE /identity/v3/projects/9927140e2e534410b623783f43db6d54 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:26:01.050549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:01.052325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:01.073584 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4236/8499] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:26:01.827172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:01.829327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:01.908907 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cecaa-5913-4c24-b089-e904fb5d7631 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:01.914716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:01.915276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:01.915610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:01.916061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:01.918224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:02.000248 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:02.020888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:02.023013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2bbea-c41c-45fa-a020-a58f0eb11b8f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:02.038730 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4264/8500] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:11.064775 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:12.030052 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:32.160718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:32.162230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:32.176228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e047f-2650-471b-9096-431d761d58b0 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:32.245515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:32.246395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.246708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.246989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] PATH_INFO: `/v3/users/b85b5395eb404db8abd8257d1070bf18` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.248213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85b5395eb404db8abd8257d1070bf18)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:32.250186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:32.300651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85b5395eb404db8abd8257d1070bf18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.312897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85b5395eb404db8abd8257d1070bf18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.319979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85b5395eb404db8abd8257d1070bf18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.327620 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85b5395eb404db8abd8257d1070bf18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.328323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85b5395eb404db8abd8257d1070bf18'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.335215 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4237/8501] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:26:32 2022] DELETE /identity/v3/users/b85b5395eb404db8abd8257d1070bf18 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:26:32.339532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.340054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.340151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.359095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:26:32.360318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:32.421380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4265/8502] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:26:32.431580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:32.433013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:32.492839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24905e-a97d-441d-ab7e-f2e422f5876f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:32.496518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341c47-1b91-4148-b002-d4600531c6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:32.497193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341c47-1b91-4148-b002-d4600531c6fb service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.497481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341c47-1b91-4148-b002-d4600531c6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.497763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341c47-1b91-4148-b002-d4600531c6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.506998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341c47-1b91-4148-b002-d4600531c6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:32.508440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341c47-1b91-4148-b002-d4600531c6fb service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:32.518875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4238/8503] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:32.701468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:32.703430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:32.717798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935586e1-9469-4fdc-a37e-1af2e822ea20 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:32.723552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:32.725119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.725414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.725706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] PATH_INFO: `/v3/projects/798c93d98ebc4a499b5e433d7898e2a6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.727097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=798c93d98ebc4a499b5e433d7898e2a6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:32.729174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:32.784561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798c93d98ebc4a499b5e433d7898e2a6', 'request_id': 'req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.795331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798c93d98ebc4a499b5e433d7898e2a6', 'request_id': 'req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.803286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798c93d98ebc4a499b5e433d7898e2a6', 'request_id': 'req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.814990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] The token cache is being invalidate because project 798c93d98ebc4a499b5e433d7898e2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:26:32.815283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.815973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-66de26b9-7abf-4d0d-906c-7bc4e62cb09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:26:32.817531 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4266/8504] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:26:32 2022] DELETE /identity/v3/projects/798c93d98ebc4a499b5e433d7898e2a6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:26:32.822784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.823156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.823510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.841427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:26:32.842777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:32.860525 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:32.904362 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4239/8505] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:26:32.912690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.912983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.913267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.931480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:26:32.932705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:32.941197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4267/8506] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:26:32.945313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:32.954890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f4dd-c053-4c48-8622-63f306968e4a None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:32.959941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:32.960595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.960884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.961166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.961894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:26:32.962205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:32.963849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:32.975797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4240/8507] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:26:32.979788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:32.989114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7cc6d-fb41-445e-bcd7-7652397b28df None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:32.993900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:32.994574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:32.994865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:32.995145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:32.995848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:32.997743 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:33.033211 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4268/8508] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:26:32 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:26:33.037795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:33.047863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67862-d035-48e8-b0a2-9dcfdb26a867 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:33.106833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:33.107498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:33.107781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:33.108058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:33.108735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:33.110691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:33.129683 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4241/8509] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:26:33 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:26:33.134393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:33.144879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759909-7451-4b9b-92fa-20e7d73480fd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:33.150118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:33.150808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:33.151100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:33.151382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:33.152109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:33.153697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:33.163573 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4269/8510] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:26:33.167269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:33.177292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319df28-4f80-417b-ae6e-8d3e9569d6c0 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:33.181985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1c8b9-5c18-48e0-807d-d3a9af68358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:33.182751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1c8b9-5c18-48e0-807d-d3a9af68358e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:33.183040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1c8b9-5c18-48e0-807d-d3a9af68358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:33.183344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1c8b9-5c18-48e0-807d-d3a9af68358e admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:33.184070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1c8b9-5c18-48e0-807d-d3a9af68358e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:33.185656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1c8b9-5c18-48e0-807d-d3a9af68358e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:33.196494 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4242/8511] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:26:33.200634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:33.211327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd469b5-34d4-4d31-8e01-2b5849c4820e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:33.215982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:33.216864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:33.217155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:33.217472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] PATH_INFO: `/v3/projects/3fa52c3e621c4f489cd853f372dea03c/users/0efdd73e8c0648b78416d641e227e736/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:33.232073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa52c3e621c4f489cd853f372dea03c, user_id=0efdd73e8c0648b78416d641e227e736, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:33.234751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:33.247340 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4270/8512] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:26:33 2022] PUT /identity/v3/projects/3fa52c3e621c4f489cd853f372dea03c/users/0efdd73e8c0648b78416d641e227e736/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:26:33.258142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:33.258437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:33.258761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:33.285349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] MFA Rules not processed for user `0efdd73e8c0648b78416d641e227e736`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:26:33.286646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:33.350825 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4243/8513] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:26:33.361276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:33.363129 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:33.376390 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:33.426624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8a38-e47d-4fcb-903f-0bfc520953f5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:33.430838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:33.431482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:33.431901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:33.432185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:33.441088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:33.442559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:33.452846 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4271/8514] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:38.018330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:38.021043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:38.044080 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:38.129974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8351e8-46db-4e3e-a067-6f1520e2e3a9 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:38.136824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:38.137497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:38.137948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:38.138226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:38.140851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:38.162201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:38.164140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:38.194189 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4244/8515] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:43.448494 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=21 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:43.927889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:43.929424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:44.034742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d8fba-77fc-4ed3-a5f2-139c6ee1a6d7 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:44.041160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:44.042192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:44.042192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:44.042446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:44.044376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:44.062617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:44.064748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2ff2c-13a0-48c8-bc9a-bfe1ad0818d8 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:44.081139 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4272/8516] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:48.173076 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=26 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:26:50.655185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:26:50.670802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb969d-6205-43e6-820b-d5241555fbe1 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:26:50.679160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:26:50.680503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:26:50.681454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:26:50.681969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:26:50.684861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:26:50.703110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:26:50.705005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:26:50.719788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4245/8517] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:26:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:26:54.073606 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=32 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:00.714014 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:08.454172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:08.454803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:08.454803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:08.479613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:08.481170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:08.575238 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4273/8518] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:16.521991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:16.523493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:16.550032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3459-7cfa-4760-b5dd-ecd848ae6ffc service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:16.559057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:16.563898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:16.564451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:16.564999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:16.569536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:16.599873 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:16.601337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b5d3b-c535-4104-94eb-ac672211db5a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:16.628788 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4246/8519] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:18.546829 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=25 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:26.607361 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:35.989368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.071505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de8b4a-a936-4131-abc5-6c2fa385b8fb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:36.076549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:36.078152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.078793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.079374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] PATH_INFO: `/v3/users/0efdd73e8c0648b78416d641e227e736` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.081972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efdd73e8c0648b78416d641e227e736)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:36.084191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:36.115321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.115893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.115893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.143412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efdd73e8c0648b78416d641e227e736'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.144091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efdd73e8c0648b78416d641e227e736'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.146087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:36.148204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.160995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efdd73e8c0648b78416d641e227e736'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.161824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efdd73e8c0648b78416d641e227e736'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.169952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-a7367d44-f17b-41c6-918d-068e3db7bd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efdd73e8c0648b78416d641e227e736'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.184920 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4274/8520] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:27:35 2022] DELETE /identity/v3/users/0efdd73e8c0648b78416d641e227e736 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:27:36.189651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.190014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.190386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.208120 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4247/8521] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:27:36.213989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:36.215751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.260025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.261679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.286712 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4275/8522] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:27:36.296325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.297885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.322329 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:36.355033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47cff-1ccb-4771-ab09-ced8c10849dd None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:36.362036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257362d-1533-4004-9eec-e1e5a3544188 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:36.365741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:36.366517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.366759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.367155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.376599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:36.378083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:36.389539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4276/8523] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:36.422732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf56b-cfca-418a-8792-7cff394802d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:36.423415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf56b-cfca-418a-8792-7cff394802d3 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.423704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf56b-cfca-418a-8792-7cff394802d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.423985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf56b-cfca-418a-8792-7cff394802d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.458978 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:36.490579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabaf56b-cfca-418a-8792-7cff394802d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:36.492735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabaf56b-cfca-418a-8792-7cff394802d3 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:36.501687 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4248/8524] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:27:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:27:36.593501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.595244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.617089 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c581ba-43c2-41d5-a7c6-cf8be41f131d service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:36.627326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:36.628426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.628854 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.629177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] PATH_INFO: `/v3/projects/3fa52c3e621c4f489cd853f372dea03c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.630875 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa52c3e621c4f489cd853f372dea03c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:36.634278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:36.696119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa52c3e621c4f489cd853f372dea03c', 'request_id': 'req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.704348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa52c3e621c4f489cd853f372dea03c', 'request_id': 'req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.715216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa52c3e621c4f489cd853f372dea03c', 'request_id': 'req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.728027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] The token cache is being invalidate because project 3fa52c3e621c4f489cd853f372dea03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:27:36.728513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.729241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-bb4eb3ed-0847-40a5-a81a-fb4440c4aec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:36.731126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4277/8525] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:27:36 2022] DELETE /identity/v3/projects/3fa52c3e621c4f489cd853f372dea03c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:27:36.736494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.736494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.736755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.755768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:36.757429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.821488 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4249/8526] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:36.829002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.829328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.829613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.849288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:36.850515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:36.858412 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4278/8527] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:36.862611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.872523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857514-513e-43d8-91c8-d6c658e04980 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:36.877182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:36.877829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.878111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.878388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.879145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:27:36.879454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:36.881042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:36.892948 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4250/8528] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:27:36.897110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.907217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21515c6-b151-4844-9a8a-1c50477cee29 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:36.912379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:36.913038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:36.913327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:36.913721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:36.914553 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:36.916720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:36.946342 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4279/8529] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:27:36 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:27:36.950640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:36.962247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd86389-9cd4-4740-ae30-2846cc0bc4a2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:37.025289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:37.025889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.026178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.026459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.027289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:37.029323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:37.092768 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4251/8530] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:27:36 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:27:37.097300 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:37.113161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11da9d-c8a3-45d6-be2a-35c20d512ac9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:37.121375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:37.122067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.122367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.122969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.124097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:37.125725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:37.142253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:37.142984 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4280/8531] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:27:37.153439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d3cb7-dd95-43ac-ba75-c3caf4e7c71e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:37.158401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2181309-7b24-4177-a6fc-fe14562129b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:37.159112 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2181309-7b24-4177-a6fc-fe14562129b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.159403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2181309-7b24-4177-a6fc-fe14562129b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.159686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2181309-7b24-4177-a6fc-fe14562129b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.160429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2181309-7b24-4177-a6fc-fe14562129b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:37.162051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2181309-7b24-4177-a6fc-fe14562129b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:37.172985 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4252/8532] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:27:37.177304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:37.188276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75412287-4cbd-466b-94a0-53c0a1c6da99 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:37.193262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:37.194150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.195042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.195333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] PATH_INFO: `/v3/projects/cb2735da394f45ada2886038514e87bf/users/3897d5bf133f48848554d830db17b729/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.210297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2735da394f45ada2886038514e87bf, user_id=3897d5bf133f48848554d830db17b729, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:37.213988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:37.227314 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4281/8533] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:27:37 2022] PUT /identity/v3/projects/cb2735da394f45ada2886038514e87bf/users/3897d5bf133f48848554d830db17b729/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:27:37.238276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a170-a2ce-4f04-b08c-a59819b553b8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.238628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a170-a2ce-4f04-b08c-a59819b553b8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.238911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a170-a2ce-4f04-b08c-a59819b553b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.268685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1fc2a170-a2ce-4f04-b08c-a59819b553b8 None None] MFA Rules not processed for user `3897d5bf133f48848554d830db17b729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:37.269914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1fc2a170-a2ce-4f04-b08c-a59819b553b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:37.294723 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:37.343582 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4253/8534] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:37.354090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:37.355795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:37.402445 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:37.417353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d182b3-0938-4402-b1a9-28873b68f926 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:37.421078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:37.421725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.422019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.422304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.431241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:37.432669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:37.441476 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4282/8535] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:37.798685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:37.798986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:37.799274 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:37.817851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:37.819114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:37.880351 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4254/8536] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:38.147940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:38.159352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9bc6-b45a-4771-a153-b795607c1bd0 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:38.163079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:38.164442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:38.164730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:38.165068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:38.166956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:38.179544 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:38.180977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:38.192657 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4283/8537] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:38.974315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:38.977904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:39.096092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74482fe2-78f6-4fd4-8d1a-7e1807035d54 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:39.105186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:39.106232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:39.106769 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:39.107406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:39.115251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:39.141963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:39.144421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:39.161088 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4255/8538] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:42.028053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:42.031753 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:42.062481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a960-84ff-4d68-9350-73db83d0730c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:42.074929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:42.076830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:42.077503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:42.078019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:42.097182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:42.147211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:42.149569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:42.168291 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4284/8539] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:43.548663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:43.550943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:43.757749 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:43.821649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3e47-e2d5-4dde-8c5f-30c556810587 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:43.837029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:43.837703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:43.837994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:43.838279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:43.855145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:43.889802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:43.891479 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee648d-7b8f-4da0-84dd-8e93be0529b3 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:43.917715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4256/8540] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:52.155290 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=19 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:53.899696 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:56.551621 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:56.645217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b55f-4b56-4277-95ba-0d982644bebe service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:56.650668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:56.651554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:56.651842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:56.652122 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] PATH_INFO: `/v3/users/3897d5bf133f48848554d830db17b729` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:56.653442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3897d5bf133f48848554d830db17b729)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:56.655506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:56.708295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3897d5bf133f48848554d830db17b729'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:56.709016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3897d5bf133f48848554d830db17b729'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:56.724485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3897d5bf133f48848554d830db17b729'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:56.725210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3897d5bf133f48848554d830db17b729'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:56.734200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3897d5bf133f48848554d830db17b729'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:56.748533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4285/8541] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:27:56 2022] DELETE /identity/v3/users/3897d5bf133f48848554d830db17b729 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:27:56.753763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:56.754299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:56.754414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:56.772383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:56.774624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:56.849596 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4257/8542] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:56.860627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:56.862225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:56.943712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392ec0d-960d-44c5-b67b-006adc34151f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:56.947574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb85d8-1fe1-4c25-a126-5d1bc56b4800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:56.948237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb85d8-1fe1-4c25-a126-5d1bc56b4800 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:56.948540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb85d8-1fe1-4c25-a126-5d1bc56b4800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:56.948864 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb85d8-1fe1-4c25-a126-5d1bc56b4800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:56.961037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb85d8-1fe1-4c25-a126-5d1bc56b4800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:56.962556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb85d8-1fe1-4c25-a126-5d1bc56b4800 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:56.975873 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4286/8543] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:27:57.276187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.278046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:57.290338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099dcaf-2e71-498d-b0b4-26b24e2a5039 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.301599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.302648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.303013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.303346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] PATH_INFO: `/v3/projects/cb2735da394f45ada2886038514e87bf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.304657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2735da394f45ada2886038514e87bf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.307914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.366306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2735da394f45ada2886038514e87bf', 'request_id': 'req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:57.373678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2735da394f45ada2886038514e87bf', 'request_id': 'req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:57.390728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2735da394f45ada2886038514e87bf', 'request_id': 'req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:57.403624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] The token cache is being invalidate because project cb2735da394f45ada2886038514e87bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:27:57.403919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:57.404567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bfe4ef4c-1dcd-4fcd-9146-cdd0337523bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:27:57.406126 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4258/8544] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:27:57 2022] DELETE /identity/v3/projects/cb2735da394f45ada2886038514e87bf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:27:57.411244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.411539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.411826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.430454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:57.431694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:57.449596 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:57.493574 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4287/8545] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:57.502710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.503011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.503299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.523007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:57.524218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:57.532399 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4259/8546] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:27:57.536675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.546833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289d814-4015-4f54-a3f4-ce474636b5dd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.551540 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.552199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.552754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.552754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.553469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:27:57.553779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.555944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.568240 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4288/8547] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:27:57.573485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.583507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932428d0-fba2-4eaa-958f-6e9d91a0ac4f None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.589117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.589955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.590246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.590554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.591262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.593168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.620715 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4260/8548] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:27:57 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:27:57.624785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.635877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d581-6417-4035-93cb-9070946feb1b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.693895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.694655 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.695013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.695856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.696551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.698583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.719147 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4289/8549] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:27:57 2022] POST /identity/v3/users => generated 278 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:27:57.723589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.734768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e53a2-b4eb-47df-99d9-fef36e4594ae admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.739632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.740321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.740584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.740858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.741681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.743811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.755602 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4261/8550] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:27:57.760418 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.771391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe9135-77e3-4179-a9a5-ee8dafde1ae1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.776726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b77304-7260-4b75-b697-1b70cd41dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.777414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b77304-7260-4b75-b697-1b70cd41dcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.777697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b77304-7260-4b75-b697-1b70cd41dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.777972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b77304-7260-4b75-b697-1b70cd41dcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.778750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b77304-7260-4b75-b697-1b70cd41dcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.780372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b77304-7260-4b75-b697-1b70cd41dcc0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.795747 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4290/8551] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:27:57.796684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.808199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100cfbd-9c8d-42e8-b381-788c0a8e1c0d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:57.813206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:57.814165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.814656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.814812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] PATH_INFO: `/v3/projects/e96a805780444298987a822e7ef0e0ce/users/85ea1989306547ed8ccf2bb819f4b0bf/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.832750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96a805780444298987a822e7ef0e0ce, user_id=85ea1989306547ed8ccf2bb819f4b0bf, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:57.836532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:57.853926 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4262/8552] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:27:57 2022] PUT /identity/v3/projects/e96a805780444298987a822e7ef0e0ce/users/85ea1989306547ed8ccf2bb819f4b0bf/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:27:57.864577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835999-dcb4-414e-a561-2365be4838cb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:57.865265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835999-dcb4-414e-a561-2365be4838cb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:57.865537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835999-dcb4-414e-a561-2365be4838cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:57.893178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-61835999-dcb4-414e-a561-2365be4838cb None None] MFA Rules not processed for user `85ea1989306547ed8ccf2bb819f4b0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:57.894391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-61835999-dcb4-414e-a561-2365be4838cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:57.966352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4291/8553] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:27:57.971597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:57.996472 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:58.044629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce54950-3758-4de2-aada-d2ef39b6b4e3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.054229 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.055577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.055870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.056280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.056990 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.059635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.085326 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4263/8554] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:27:57 2022] POST /identity/v3/projects => generated 357 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:27:58.089944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835999-dcb4-414e-a561-2365be4838cb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.103976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835999-dcb4-414e-a561-2365be4838cb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.120430 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:58.171491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.172171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.172464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.172747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.173440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.175416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.201145 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4292/8555] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:27:58 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:27:58.205331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.218664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a99d8f-2583-408a-b712-0870a0dbbffa admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.223858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.224493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.224767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.225053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.225792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.228257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.241065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4264/8556] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:27:58.246513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.258393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba0002-98cb-4872-a700-c45564474ef6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.263466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.264352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.264644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.265020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] PATH_INFO: `/v3/projects/08e88d82ee1a454a88552a5a101056d9/users/072b981f535e4124aac69ad9123bb19c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.281838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e88d82ee1a454a88552a5a101056d9, user_id=072b981f535e4124aac69ad9123bb19c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.284717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.300560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4293/8557] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:27:58 2022] PUT /identity/v3/projects/08e88d82ee1a454a88552a5a101056d9/users/072b981f535e4124aac69ad9123bb19c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:27:58.305162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.316267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4c070-b37f-4c9d-aa4f-cd94c3974051 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.378394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a032a4d-8223-4226-9a4f-1a5e3da1e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.379130 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032a4d-8223-4226-9a4f-1a5e3da1e2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.379399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032a4d-8223-4226-9a4f-1a5e3da1e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.379779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032a4d-8223-4226-9a4f-1a5e3da1e2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.380441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a032a4d-8223-4226-9a4f-1a5e3da1e2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.382089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a032a4d-8223-4226-9a4f-1a5e3da1e2d4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.394711 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4265/8558] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:27:58.397659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.410397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00162b55-25da-4740-9776-274756bbfdaa admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.416372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.417273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.417597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.417834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] PATH_INFO: `/v3/projects/08e88d82ee1a454a88552a5a101056d9/users/072b981f535e4124aac69ad9123bb19c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.419916 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e88d82ee1a454a88552a5a101056d9, user_id=072b981f535e4124aac69ad9123bb19c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.422617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.442695 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4294/8559] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:27:58 2022] PUT /identity/v3/projects/08e88d82ee1a454a88552a5a101056d9/users/072b981f535e4124aac69ad9123bb19c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:27:58.447717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.448012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.448351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.480911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] MFA Rules not processed for user `072b981f535e4124aac69ad9123bb19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:27:58.482057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:58.574641 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4266/8560] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:27:58.583940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.586357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:27:58.667235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa0ba-a3ce-416a-af48-3d624d785543 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.671150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.671976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.672292 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.672677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.683701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.685402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.697965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4295/8561] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:27:58.774258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:27:58.792631 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead8d7-1d2e-439b-97a8-16463f9cfeb6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:27:58.798043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:27:58.799070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:27:58.799459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:27:58.799657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:27:58.815149 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:27:58.869792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:27:58.871336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:27:58.881419 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4267/8562] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:08.691533 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:08.876443 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=21 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:10.705073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:10.706581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:10.847800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ad7f0-c62b-42b8-8d00-b5285939cd3d service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:10.854425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:10.855117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:10.855471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:10.855829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:10.857681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:10.873369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:10.875097 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e210f3-a188-4172-8fb8-ab46f3d78782 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:10.889084 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4296/8563] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:18.057701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:18.126095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90be13-e6f0-4787-9802-ec95d22bd200 service cinder] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:18.131763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:18.132981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:18.133362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:18.133672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] PATH_INFO: `/v3/users/85ea1989306547ed8ccf2bb819f4b0bf` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:18.135096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ea1989306547ed8ccf2bb819f4b0bf)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:18.137197 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:18.195341 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ea1989306547ed8ccf2bb819f4b0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.209501 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ea1989306547ed8ccf2bb819f4b0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.217463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ea1989306547ed8ccf2bb819f4b0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.225585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ea1989306547ed8ccf2bb819f4b0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.226277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ea1989306547ed8ccf2bb819f4b0bf'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.234403 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4268/8564] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:18 2022] DELETE /identity/v3/users/85ea1989306547ed8ccf2bb819f4b0bf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:18.238943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:18.239789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:18.240244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:18.258367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:18.260157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:18.325966 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4297/8565] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:18.332734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:18.334252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:18.406570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee55d84-3ffa-4ce6-811b-5caed57e1070 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:18.410311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:18.411024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:18.411315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:18.411601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:18.421763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:18.423186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:18.442022 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4269/8566] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:18.732619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:18.734192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:18.756247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff556a2-78e6-4583-8fed-f774a0609153 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:18.761947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:18.763069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:18.763466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:18.763853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] PATH_INFO: `/v3/projects/e96a805780444298987a822e7ef0e0ce` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:18.765350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96a805780444298987a822e7ef0e0ce)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:18.767503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:18.831083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96a805780444298987a822e7ef0e0ce', 'request_id': 'req-70330617-7178-4e44-af1d-199ccd9da355'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.840601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96a805780444298987a822e7ef0e0ce', 'request_id': 'req-70330617-7178-4e44-af1d-199ccd9da355'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.848131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96a805780444298987a822e7ef0e0ce', 'request_id': 'req-70330617-7178-4e44-af1d-199ccd9da355'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.861905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] The token cache is being invalidate because project e96a805780444298987a822e7ef0e0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:18.862328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.863124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:18.864769 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4298/8567] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:18 2022] DELETE /identity/v3/projects/e96a805780444298987a822e7ef0e0ce => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:28:18.868941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:18.880419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc399-19d2-4f3a-ba12-2bd0a4a2330b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:18.901925 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:18.942847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:18.943729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:18.944015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:18.944324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] PATH_INFO: `/v3/users/072b981f535e4124aac69ad9123bb19c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:18.945871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=072b981f535e4124aac69ad9123bb19c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:18.948273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:18.994351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072b981f535e4124aac69ad9123bb19c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.006984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072b981f535e4124aac69ad9123bb19c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.014584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072b981f535e4124aac69ad9123bb19c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.022414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072b981f535e4124aac69ad9123bb19c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.023031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e5011d11-3d57-45bb-ad0d-a68a7f882dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072b981f535e4124aac69ad9123bb19c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.030394 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4270/8568] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:18 2022] DELETE /identity/v3/users/072b981f535e4124aac69ad9123bb19c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:19.313542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.315128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:19.330248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330617-7178-4e44-af1d-199ccd9da355 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.338124 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:19.396547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.397685 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.398564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.398846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] PATH_INFO: `/v3/projects/08e88d82ee1a454a88552a5a101056d9` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.400568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e88d82ee1a454a88552a5a101056d9)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.402465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.449622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e88d82ee1a454a88552a5a101056d9', 'request_id': 'req-9464adc0-1e92-4b0d-b627-aeb748c13321'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.457245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e88d82ee1a454a88552a5a101056d9', 'request_id': 'req-9464adc0-1e92-4b0d-b627-aeb748c13321'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.463573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e88d82ee1a454a88552a5a101056d9', 'request_id': 'req-9464adc0-1e92-4b0d-b627-aeb748c13321'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.474756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] The token cache is being invalidate because project 08e88d82ee1a454a88552a5a101056d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:19.475046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.475693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-9464adc0-1e92-4b0d-b627-aeb748c13321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:19.477315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4299/8569] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:19 2022] DELETE /identity/v3/projects/08e88d82ee1a454a88552a5a101056d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:19.482880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.483364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.483485 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.501949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:19.503179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:19.565849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4271/8570] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:19.574771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.575066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.575351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.596008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:19.597264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:19.606550 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4300/8571] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:19.610796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.621471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef86dd-e6f8-4b8a-9b5a-90dd60094f0d None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.626169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.626883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.627168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.627443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.628184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:28:19.628493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.630116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.642828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4272/8572] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:28:19.647230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.656948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd006-15d6-47d4-8204-046a39c2505c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.661759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.662419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.662759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.663041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.663759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.666254 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.694226 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4301/8573] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:19 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:19.698742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.709092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1ef6-1360-49fe-bf34-c09148514198 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.735435 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:19.772639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.773419 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.773717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.774134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.775011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.777571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.801558 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4273/8574] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:19 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:19.806635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.818307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb199-f730-4c21-bf4d-da1288dbc326 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.823858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.824550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.824838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.825119 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.825861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.827514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.839883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4302/8575] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:19.843339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.854345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712188-7b96-4b9d-908e-f0532fa447ba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.859730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f344c-f69b-4754-8f8e-880ea530e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.860405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f344c-f69b-4754-8f8e-880ea530e372 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.860695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f344c-f69b-4754-8f8e-880ea530e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.860978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f344c-f69b-4754-8f8e-880ea530e372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.861715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f344c-f69b-4754-8f8e-880ea530e372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.863391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f344c-f69b-4754-8f8e-880ea530e372 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.876959 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4274/8576] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:19.881185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:19.891549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74890b-4858-4c32-8339-fb95a86ad9fe admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:19.896928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:19.897820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.898102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.898378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] PATH_INFO: `/v3/projects/79f424b9e9f6422289908acafad9315a/users/8bf56cab223348b1b003fe69a4e0ef0a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.917209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f424b9e9f6422289908acafad9315a, user_id=8bf56cab223348b1b003fe69a4e0ef0a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:19.920133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:19.936216 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4303/8577] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:19 2022] PUT /identity/v3/projects/79f424b9e9f6422289908acafad9315a/users/8bf56cab223348b1b003fe69a4e0ef0a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:28:19.946922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:19.947222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:19.947509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:19.975688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] MFA Rules not processed for user `8bf56cab223348b1b003fe69a4e0ef0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:19.977246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:20.051291 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4275/8578] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:20.055584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.096235 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:20.120946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de77e3-4ed4-4433-bd3e-5cab8b821bb9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.127576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.128757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.130522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.131024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.131783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.133719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.166696 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4304/8579] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:20 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:20.168351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.179712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa0b95-d82f-43f7-9e0f-951d73ace2bf None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.243020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.244136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.244420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.244691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.245389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.247324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.271044 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4276/8580] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:20 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:28:20.274976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.285525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d33b8-2221-40bc-8feb-c96893596043 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.290150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.291459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.291744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.292027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.292763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.294357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.305485 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4305/8581] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:20.310290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.321302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12ea73-a27e-4fa2-ba9e-e7e4a110682d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.326910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.327789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.328077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.328359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] PATH_INFO: `/v3/projects/921d4759814647fea57aa0bbb9363d72/users/4f40dbd63b5b43568d85ea28462223d6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.343884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921d4759814647fea57aa0bbb9363d72, user_id=4f40dbd63b5b43568d85ea28462223d6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.346572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.359075 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4277/8582] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:20 2022] PUT /identity/v3/projects/921d4759814647fea57aa0bbb9363d72/users/4f40dbd63b5b43568d85ea28462223d6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:20.363031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.373306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6099412-8d10-4f17-93f6-bb3973bd8926 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.431116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620311f-4954-4215-8ef8-cea9b4baf7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.431901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620311f-4954-4215-8ef8-cea9b4baf7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.432187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620311f-4954-4215-8ef8-cea9b4baf7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.432465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620311f-4954-4215-8ef8-cea9b4baf7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.433191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620311f-4954-4215-8ef8-cea9b4baf7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.434826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620311f-4954-4215-8ef8-cea9b4baf7f8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.445353 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4306/8583] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:20.450041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.455897 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:20.463110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887a095-1198-4b17-9390-867cb355a874 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.468077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.468948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.469238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.469512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] PATH_INFO: `/v3/projects/921d4759814647fea57aa0bbb9363d72/users/4f40dbd63b5b43568d85ea28462223d6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.471533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=921d4759814647fea57aa0bbb9363d72, user_id=4f40dbd63b5b43568d85ea28462223d6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.474173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.484563 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4278/8584] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:20 2022] PUT /identity/v3/projects/921d4759814647fea57aa0bbb9363d72/users/4f40dbd63b5b43568d85ea28462223d6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:20.495596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.495820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.496100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.526147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] MFA Rules not processed for user `4f40dbd63b5b43568d85ea28462223d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:20.527400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:20.600184 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4307/8585] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:20.611496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.613260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:20.675704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbcffa-fea3-4994-81f4-8ff6b598be2c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.679469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fa64f-2754-4e6e-9bb1-97286f8f2527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.680117 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fa64f-2754-4e6e-9bb1-97286f8f2527 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.680513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fa64f-2754-4e6e-9bb1-97286f8f2527 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.680828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fa64f-2754-4e6e-9bb1-97286f8f2527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.690764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fa64f-2754-4e6e-9bb1-97286f8f2527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.692205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fa64f-2754-4e6e-9bb1-97286f8f2527 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.702538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4279/8586] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:20.774280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:20.786877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec69eb-3b88-4367-90a5-c58c1b88ae16 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:20.790674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:20.791443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:20.791794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:20.792139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:20.822537 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:20.854011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:20.855529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:20.865199 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4308/8587] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:30.698350 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:30.860700 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=14 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:35.693953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:35.694442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:35.694593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:35.720431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:35.721865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:35.784278 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4280/8588] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:35.797386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:35.798828 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:35.880537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea357d8e-abb5-4e89-a5e9-634702986042 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:35.885716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3a9ae-56e3-42f9-8b3b-5680d3679d1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:35.886387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a9ae-56e3-42f9-8b3b-5680d3679d1f service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:35.886703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a9ae-56e3-42f9-8b3b-5680d3679d1f service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:35.886984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a9ae-56e3-42f9-8b3b-5680d3679d1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:35.896380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3a9ae-56e3-42f9-8b3b-5680d3679d1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:35.897994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3a9ae-56e3-42f9-8b3b-5680d3679d1f service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:35.910315 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4309/8589] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:28:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:28:39.892491 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:39.973949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54094f1c-bcfd-4699-93a1-2ea116625bd1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:39.979162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:39.980051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:39.980328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:39.980605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] PATH_INFO: `/v3/users/8bf56cab223348b1b003fe69a4e0ef0a` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:39.981868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf56cab223348b1b003fe69a4e0ef0a)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:39.983814 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:40.034734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf56cab223348b1b003fe69a4e0ef0a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.060393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf56cab223348b1b003fe69a4e0ef0a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.069774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf56cab223348b1b003fe69a4e0ef0a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.078580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf56cab223348b1b003fe69a4e0ef0a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.079424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf56cab223348b1b003fe69a4e0ef0a'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.088814 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4281/8590] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:39 2022] DELETE /identity/v3/users/8bf56cab223348b1b003fe69a4e0ef0a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:40.093187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:40.093679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:40.093980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:40.114401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:40.115652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:40.183508 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4310/8591] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:40.193031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:40.194450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:40.235087 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:40.272789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a1e34-a490-4ec5-b4e2-ea0473cb38f1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:40.276943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:40.277604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:40.277887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:40.278155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:40.289235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:40.290819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:40.304161 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4282/8592] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:40.614296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:40.616390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:40.634030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb298a-e22f-4f95-b0d5-88e53ece70b9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:40.647534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:40.648563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:40.649601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:40.649985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] PATH_INFO: `/v3/projects/79f424b9e9f6422289908acafad9315a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:40.651582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f424b9e9f6422289908acafad9315a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:40.654326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:40.715736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f424b9e9f6422289908acafad9315a', 'request_id': 'req-ae125176-a535-4321-b1f3-20b1e676a986'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.724662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f424b9e9f6422289908acafad9315a', 'request_id': 'req-ae125176-a535-4321-b1f3-20b1e676a986'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.734421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f424b9e9f6422289908acafad9315a', 'request_id': 'req-ae125176-a535-4321-b1f3-20b1e676a986'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.748390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] The token cache is being invalidate because project 79f424b9e9f6422289908acafad9315a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:40.748614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.749903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.754571 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4311/8593] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:40 2022] DELETE /identity/v3/projects/79f424b9e9f6422289908acafad9315a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:40.756090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:40.768999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d188cf5-d0a2-4432-ad26-cd40a0fb663b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:40.831445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:40.832353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:40.832637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:40.832914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] PATH_INFO: `/v3/users/4f40dbd63b5b43568d85ea28462223d6` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:40.834251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f40dbd63b5b43568d85ea28462223d6)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:40.836207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:40.916801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f40dbd63b5b43568d85ea28462223d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.933520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f40dbd63b5b43568d85ea28462223d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.942045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f40dbd63b5b43568d85ea28462223d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.951033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f40dbd63b5b43568d85ea28462223d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.951720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a4313c98-7405-4f8d-8d1a-2dcca30aadaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f40dbd63b5b43568d85ea28462223d6'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:40.959071 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4283/8594] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:40 2022] DELETE /identity/v3/users/4f40dbd63b5b43568d85ea28462223d6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:28:41.245603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.247218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:41.261509 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125176-a535-4321-b1f3-20b1e676a986 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.272432 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:41.328326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.329152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.329533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.329810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] PATH_INFO: `/v3/projects/921d4759814647fea57aa0bbb9363d72` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.331065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921d4759814647fea57aa0bbb9363d72)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.333006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.384277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921d4759814647fea57aa0bbb9363d72', 'request_id': 'req-6d5ce81c-257a-42b0-b0d4-10b977782f93'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:41.391957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921d4759814647fea57aa0bbb9363d72', 'request_id': 'req-6d5ce81c-257a-42b0-b0d4-10b977782f93'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:41.400295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921d4759814647fea57aa0bbb9363d72', 'request_id': 'req-6d5ce81c-257a-42b0-b0d4-10b977782f93'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:41.412114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] The token cache is being invalidate because project 921d4759814647fea57aa0bbb9363d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:41.412404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:41.413084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6d5ce81c-257a-42b0-b0d4-10b977782f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:41.414897 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4312/8595] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:41 2022] DELETE /identity/v3/projects/921d4759814647fea57aa0bbb9363d72 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:41.420217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.420516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.420801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.439520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:41.440754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:41.489464 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:41.511343 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4284/8596] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:41.519370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.519750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.520145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.539729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:41.541494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:41.552636 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4313/8597] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:41.554050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.564660 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c1bb-ef92-4680-9a06-f4a716b5a612 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.569394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.570069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.570362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.570689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.571699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:28:41.572296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.575240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.590871 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4285/8598] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:28:41.591942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.602133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ef324-6ef8-412d-8d8c-99d0e1d10f2f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.607503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.608181 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.608470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.608876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.609588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.611535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.637666 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4314/8599] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:41 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:41.642233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.653771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66426639-728c-4c61-bc89-b1b4ff8b2e0e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.717036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.717719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.718010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.718293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.719033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.720957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.746285 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4286/8600] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:41 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:41.747449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.758771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94edd1-fe54-4882-a4d3-5591bc3c3a9d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.763647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.764325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.764615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.764897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.765630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.767280 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.779794 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4315/8601] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:41.783781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.794723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ded7-acd6-4bee-9034-307bdc5daf03 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.801039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaf78-fe6e-4d53-aed2-e7663ddc4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.801721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaf78-fe6e-4d53-aed2-e7663ddc4cce admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.802007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaf78-fe6e-4d53-aed2-e7663ddc4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.802283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaf78-fe6e-4d53-aed2-e7663ddc4cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.803056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aaf78-fe6e-4d53-aed2-e7663ddc4cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.804663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aaf78-fe6e-4d53-aed2-e7663ddc4cce admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.818180 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4287/8602] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:41.819342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:41.830147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e14b1-30f4-43db-824e-c42620d4f44c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:41.835095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:41.835981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.836267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.836543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] PATH_INFO: `/v3/projects/077d125d6e134d7e838b2b0993caed7b/users/f90ec9e97bc04b098bdbc6e1fe3f4bad/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.854819 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077d125d6e134d7e838b2b0993caed7b, user_id=f90ec9e97bc04b098bdbc6e1fe3f4bad, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:41.857390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:41.872081 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4316/8603] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:41 2022] PUT /identity/v3/projects/077d125d6e134d7e838b2b0993caed7b/users/f90ec9e97bc04b098bdbc6e1fe3f4bad/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:41.883593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:41.883913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:41.884194 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:41.912480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] MFA Rules not processed for user `f90ec9e97bc04b098bdbc6e1fe3f4bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:41.913187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:41.989102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4288/8604] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:41.993693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.037908 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:42.061684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6f88-008c-4e05-a874-837b2a834043 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.066469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.067168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.067457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.067738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.068434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.070353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.096659 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4317/8605] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:41 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:28:42.100682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.113696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8e697-b761-462e-8e31-7c40b7dd3c57 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.157663 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:42.175369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.176044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.176329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.176996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.177701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.179651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.203223 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4289/8606] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:42 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:42.207226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.218284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d821c9-b910-46e5-b5be-193b264d8e5e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.225457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.226299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.226618 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.226898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.227793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.229944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.244907 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4318/8607] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:42.246199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.256565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585304c-2491-4308-8293-dffcf2ecea6e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.261721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.262716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.263011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.263290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] PATH_INFO: `/v3/projects/da94e64f1c2842d0aa36c3fb3f47e5b1/users/18e5fd3284a841ad94e1fba4cc1d75d6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.278938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da94e64f1c2842d0aa36c3fb3f47e5b1, user_id=18e5fd3284a841ad94e1fba4cc1d75d6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.281597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.295759 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4290/8608] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:42 2022] PUT /identity/v3/projects/da94e64f1c2842d0aa36c3fb3f47e5b1/users/18e5fd3284a841ad94e1fba4cc1d75d6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:28:42.299981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.311183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf8641-1288-4b5c-bc4f-643c3e98fba2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.370711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831ca4-621f-4c3d-91b5-6a715817f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.371427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831ca4-621f-4c3d-91b5-6a715817f942 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.371785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831ca4-621f-4c3d-91b5-6a715817f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.372136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831ca4-621f-4c3d-91b5-6a715817f942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.372958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831ca4-621f-4c3d-91b5-6a715817f942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.374615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831ca4-621f-4c3d-91b5-6a715817f942 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.386533 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4319/8609] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:42.389863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.401148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45407442-33cc-45db-8a09-28bd12677b4d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.405964 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.406907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.407206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.407510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] PATH_INFO: `/v3/projects/da94e64f1c2842d0aa36c3fb3f47e5b1/users/18e5fd3284a841ad94e1fba4cc1d75d6/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.409682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da94e64f1c2842d0aa36c3fb3f47e5b1, user_id=18e5fd3284a841ad94e1fba4cc1d75d6, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.412468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.424093 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4291/8610] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:42 2022] PUT /identity/v3/projects/da94e64f1c2842d0aa36c3fb3f47e5b1/users/18e5fd3284a841ad94e1fba4cc1d75d6/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:42.434552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.435096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.435474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.464094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] MFA Rules not processed for user `18e5fd3284a841ad94e1fba4cc1d75d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:42.465328 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:42.544838 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4320/8611] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:42.552835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.554689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:42.620914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533466a8-85d6-43fc-b766-cceda88d9e43 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.624481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b3df-c668-4fc2-97c9-f1be902297eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.625132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b3df-c668-4fc2-97c9-f1be902297eb service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.625414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b3df-c668-4fc2-97c9-f1be902297eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.625855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b3df-c668-4fc2-97c9-f1be902297eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.635328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69b3df-c668-4fc2-97c9-f1be902297eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.636800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69b3df-c668-4fc2-97c9-f1be902297eb service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.647363 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4292/8612] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:42.772130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:42.813625 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:42.841491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea19d-606c-418a-abbc-96074aa04eab None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:42.846387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:42.847310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.847575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.847850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] PATH_INFO: `/v3/users/f90ec9e97bc04b098bdbc6e1fe3f4bad` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.849034 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90ec9e97bc04b098bdbc6e1fe3f4bad)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:42.851023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:42.905573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90ec9e97bc04b098bdbc6e1fe3f4bad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:42.906488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90ec9e97bc04b098bdbc6e1fe3f4bad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:42.921240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90ec9e97bc04b098bdbc6e1fe3f4bad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:42.921894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90ec9e97bc04b098bdbc6e1fe3f4bad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:42.931676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90ec9e97bc04b098bdbc6e1fe3f4bad'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:42.944807 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4321/8613] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:42 2022] DELETE /identity/v3/users/f90ec9e97bc04b098bdbc6e1fe3f4bad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:42.951006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:42.951383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:42.951865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:42.972875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:42.975079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:43.051711 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4293/8614] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:43.061073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:43.062565 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:43.128519 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b29f-287c-4ac8-8771-39f00799104f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:43.132243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:43.133080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:43.133371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:43.133651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:43.145282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:43.147038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:43.157016 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4322/8615] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:43.437802 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:43.439732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:43.453670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1cb69-5b73-40d7-9e8d-090501860c0b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:43.459237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:43.460157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:43.460446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:43.460982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] PATH_INFO: `/v3/projects/077d125d6e134d7e838b2b0993caed7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:43.462221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077d125d6e134d7e838b2b0993caed7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:43.464214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:43.505499 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:43.519607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077d125d6e134d7e838b2b0993caed7b', 'request_id': 'req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.525513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077d125d6e134d7e838b2b0993caed7b', 'request_id': 'req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.534808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077d125d6e134d7e838b2b0993caed7b', 'request_id': 'req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.550065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] The token cache is being invalidate because project 077d125d6e134d7e838b2b0993caed7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:43.550649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.551326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.552887 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4294/8616] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:43 2022] DELETE /identity/v3/projects/077d125d6e134d7e838b2b0993caed7b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:43.557527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:43.568260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750192-3abb-497b-a7c8-a02619d70bb8 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:43.621862 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:43.631140 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:43.632218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:43.632738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:43.633148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] PATH_INFO: `/v3/users/18e5fd3284a841ad94e1fba4cc1d75d6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:43.634560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e5fd3284a841ad94e1fba4cc1d75d6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:43.636664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:43.687427 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e5fd3284a841ad94e1fba4cc1d75d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.688045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e5fd3284a841ad94e1fba4cc1d75d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.702734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e5fd3284a841ad94e1fba4cc1d75d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.703449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e5fd3284a841ad94e1fba4cc1d75d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.710579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-3912b1d2-e633-4b2f-a2fa-02b893986d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e5fd3284a841ad94e1fba4cc1d75d6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:43.723866 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4323/8617] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:43 2022] DELETE /identity/v3/users/18e5fd3284a841ad94e1fba4cc1d75d6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:44.029732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.032111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:44.059366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e51f-cf4a-4747-a6f2-4d8b44a635f2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.127647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.128519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.128803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.129077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] PATH_INFO: `/v3/projects/da94e64f1c2842d0aa36c3fb3f47e5b1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.130284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da94e64f1c2842d0aa36c3fb3f47e5b1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.132240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.183499 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da94e64f1c2842d0aa36c3fb3f47e5b1', 'request_id': 'req-b3356fd4-46f9-4917-bf3d-833e8e638d43'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:44.190095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da94e64f1c2842d0aa36c3fb3f47e5b1', 'request_id': 'req-b3356fd4-46f9-4917-bf3d-833e8e638d43'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:44.199484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da94e64f1c2842d0aa36c3fb3f47e5b1', 'request_id': 'req-b3356fd4-46f9-4917-bf3d-833e8e638d43'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:44.214040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] The token cache is being invalidate because project da94e64f1c2842d0aa36c3fb3f47e5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:44.214587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:44.215362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b3356fd4-46f9-4917-bf3d-833e8e638d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:44.217621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4295/8618] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:44 2022] DELETE /identity/v3/projects/da94e64f1c2842d0aa36c3fb3f47e5b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:44.223835 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.224259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.224765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.251327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:44.253020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:44.336972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4324/8619] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:44.345205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.345505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.345791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.365251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:44.368037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:44.376973 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4296/8620] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:44.381139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.392217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e550f-f4df-4a38-b51d-366f41bfb449 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.397592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.398279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.398613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.398898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.399628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:28:44.399937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.401547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.414305 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4325/8621] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:28:44.419258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.428710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45ecf-96c5-4a3d-93fb-3b9925c774d3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.435503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.436176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.436474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.436753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.437472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.439411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.468027 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4297/8622] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:28:44.472252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.485402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b242-0bf5-460f-9bf8-058ff5469669 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.545690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.548710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.548710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.548710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.548710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.549949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.559717 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:44.573343 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4326/8623] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:44.577230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.587864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1aed-cc9d-4a84-9126-00b549a58ee7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.592566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.593230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.593517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.593809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.594585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.597023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.610860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4298/8624] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:28:44.612048 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.623219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9645-87cc-4177-a212-c4667483d7b4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.628344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c837e24-123f-4780-ac8a-4e5e9b69d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.629022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837e24-123f-4780-ac8a-4e5e9b69d6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.629307 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837e24-123f-4780-ac8a-4e5e9b69d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.629588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837e24-123f-4780-ac8a-4e5e9b69d6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.630314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c837e24-123f-4780-ac8a-4e5e9b69d6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.631962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c837e24-123f-4780-ac8a-4e5e9b69d6c9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.642797 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4327/8625] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:28:44.646877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.657717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fb0c2-cf34-4d27-a09f-47f73a22c219 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.662975 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.665025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.665323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.665607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] PATH_INFO: `/v3/projects/a9992a38890049d58e6760b533be40b0/users/c47bf1f3aa6e4d379fd70d3fb74d1525/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.675200 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:44.685470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9992a38890049d58e6760b533be40b0, user_id=c47bf1f3aa6e4d379fd70d3fb74d1525, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.688533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.707705 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4299/8626] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:44 2022] PUT /identity/v3/projects/a9992a38890049d58e6760b533be40b0/users/c47bf1f3aa6e4d379fd70d3fb74d1525/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:44.724763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.725069 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.725424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.755037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] MFA Rules not processed for user `c47bf1f3aa6e4d379fd70d3fb74d1525`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:44.756277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:44.825588 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4328/8627] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:28:44.830034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.893646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b5b78-f5c1-41ce-acc0-ecb09850dca9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:44.898730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:44.899411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:44.899703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:44.899987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:44.901221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:44.903317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:44.931502 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4300/8628] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:44.935506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:44.947011 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62434b-5dc0-443c-b76b-049f9a5c4154 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.008910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.009513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.010338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.010719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.011454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.013380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.035093 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4329/8629] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:44 2022] POST /identity/v3/users => generated 310 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:45.038976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:45.049798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64b971-1ac2-4824-a387-1ad9c9f2a734 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.054602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.055275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.055565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.055845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.056580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.058459 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.074620 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4301/8630] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:45.076479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:45.086657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3995c-511b-4b35-8087-10f0bda78f65 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.092108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.093002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.093284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.093561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] PATH_INFO: `/v3/projects/c1fa01f5dae34d2f9f221574b729a375/users/809ad5e2ac6a4d39b05e74dd8c8957bd/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.113154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fa01f5dae34d2f9f221574b729a375, user_id=809ad5e2ac6a4d39b05e74dd8c8957bd, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.116251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.131787 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4330/8631] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:45 2022] PUT /identity/v3/projects/c1fa01f5dae34d2f9f221574b729a375/users/809ad5e2ac6a4d39b05e74dd8c8957bd/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:45.135748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:45.151496 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12227f83-fb68-4ed7-b81c-74fc259fda2a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.214837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0247-1afa-4468-888c-d01cd3f5294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.215658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0247-1afa-4468-888c-d01cd3f5294f admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.216010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0247-1afa-4468-888c-d01cd3f5294f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.216385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0247-1afa-4468-888c-d01cd3f5294f admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.217291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0247-1afa-4468-888c-d01cd3f5294f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.219756 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0247-1afa-4468-888c-d01cd3f5294f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.234716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4302/8632] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:28:45.238785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:45.250466 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa1a7b-ceb5-4c32-b4fe-98ef9c45bf76 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.257184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.258102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.258389 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.258721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] PATH_INFO: `/v3/projects/c1fa01f5dae34d2f9f221574b729a375/users/809ad5e2ac6a4d39b05e74dd8c8957bd/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.261148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fa01f5dae34d2f9f221574b729a375, user_id=809ad5e2ac6a4d39b05e74dd8c8957bd, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.263800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.274822 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4331/8633] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:45 2022] PUT /identity/v3/projects/c1fa01f5dae34d2f9f221574b729a375/users/809ad5e2ac6a4d39b05e74dd8c8957bd/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:45.285127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.285433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.285722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.314592 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] MFA Rules not processed for user `809ad5e2ac6a4d39b05e74dd8c8957bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:45.315836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:45.361676 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:45.387695 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4303/8634] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:45.399210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:45.401000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:45.434003 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:45.469136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50906fbc-f57d-49e7-97df-0ed68c2a24a5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.472927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.473583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.473871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.474151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.483845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.485344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.495532 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4332/8635] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:45.647966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:45.661027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf90ab-3ef2-46d6-af28-712bee71cff0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:45.664712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f588eb8-f3fb-43e1-b6d7-e218a88bd84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:45.665363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588eb8-f3fb-43e1-b6d7-e218a88bd84a service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:45.665652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588eb8-f3fb-43e1-b6d7-e218a88bd84a service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:45.666091 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588eb8-f3fb-43e1-b6d7-e218a88bd84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:45.725760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f588eb8-f3fb-43e1-b6d7-e218a88bd84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:45.727245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f588eb8-f3fb-43e1-b6d7-e218a88bd84a service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:45.739002 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4304/8636] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:54.153024 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:54.216898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ef48-0dca-4ddd-b59e-5be40e003e36 service cinder] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:54.222741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:54.224031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:54.224316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:54.224592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] PATH_INFO: `/v3/users/c47bf1f3aa6e4d379fd70d3fb74d1525` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:54.225792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47bf1f3aa6e4d379fd70d3fb74d1525)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:54.227789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:54.274773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47bf1f3aa6e4d379fd70d3fb74d1525'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.275432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47bf1f3aa6e4d379fd70d3fb74d1525'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.288344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47bf1f3aa6e4d379fd70d3fb74d1525'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.289096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47bf1f3aa6e4d379fd70d3fb74d1525'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.295948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47bf1f3aa6e4d379fd70d3fb74d1525'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.308804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4333/8637] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:54 2022] DELETE /identity/v3/users/c47bf1f3aa6e4d379fd70d3fb74d1525 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:54.313324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c351af-1517-4e66-9dc9-7e365911bdcd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:54.313811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c351af-1517-4e66-9dc9-7e365911bdcd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:54.313918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c351af-1517-4e66-9dc9-7e365911bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:54.332328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d8c351af-1517-4e66-9dc9-7e365911bdcd None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:54.333674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d8c351af-1517-4e66-9dc9-7e365911bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:54.393763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4305/8638] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:54.403928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:54.405359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:54.460930 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:54.472423 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377cea-afe0-46b8-8b3b-3f3778029a3c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:54.476113 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:54.476761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:54.477045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:54.477322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:54.486749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:54.488168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:54.498862 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4334/8639] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:54.701614 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:54.701989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:54.702340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:54.721831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:54.724128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:54.787072 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4306/8640] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:54.792336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:54.794276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:54.808625 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede122a-78cf-43f3-8144-7d242d287399 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:54.814441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:54.815585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:54.816042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:54.816504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] PATH_INFO: `/v3/projects/a9992a38890049d58e6760b533be40b0` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:54.818144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9992a38890049d58e6760b533be40b0)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:54.820018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:54.872405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9992a38890049d58e6760b533be40b0', 'request_id': 'req-6dbfb357-b20b-4fb1-a73f-51497127dc82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.880584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9992a38890049d58e6760b533be40b0', 'request_id': 'req-6dbfb357-b20b-4fb1-a73f-51497127dc82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.890305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9992a38890049d58e6760b533be40b0', 'request_id': 'req-6dbfb357-b20b-4fb1-a73f-51497127dc82'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.903458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] The token cache is being invalidate because project a9992a38890049d58e6760b533be40b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:54.903909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.905306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:54.907005 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4335/8641] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:54 2022] DELETE /identity/v3/projects/a9992a38890049d58e6760b533be40b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:54.910856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:54.923622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf064e84-1efe-48fe-8ce4-f1aee9198611 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:54.949893 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:54.985140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:54.986030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:54.986328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:54.987137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] PATH_INFO: `/v3/users/809ad5e2ac6a4d39b05e74dd8c8957bd` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:54.988013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809ad5e2ac6a4d39b05e74dd8c8957bd)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:54.990037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.057903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809ad5e2ac6a4d39b05e74dd8c8957bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.073179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809ad5e2ac6a4d39b05e74dd8c8957bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.082697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809ad5e2ac6a4d39b05e74dd8c8957bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.094965 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809ad5e2ac6a4d39b05e74dd8c8957bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.095643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809ad5e2ac6a4d39b05e74dd8c8957bd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.102629 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4307/8642] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:28:54 2022] DELETE /identity/v3/users/809ad5e2ac6a4d39b05e74dd8c8957bd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:55.231127 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:55.233229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:55.299904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfb357-b20b-4fb1-a73f-51497127dc82 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:55.351409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:55.352162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.352508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.352845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.354728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:55.366734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:55.368348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc66ff-ab06-410c-9610-35799c650b80 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.379816 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4336/8643] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:28:55.458694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:55.460299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:55.533589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25160b-06d7-4781-8f94-507f24aa8cb4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:55.538287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:55.539188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.539473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.539750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] PATH_INFO: `/v3/projects/c1fa01f5dae34d2f9f221574b729a375` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.540980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fa01f5dae34d2f9f221574b729a375)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:55.543470 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.593304 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:55.594643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fa01f5dae34d2f9f221574b729a375', 'request_id': 'req-19b91823-99c5-4253-ab3d-9da11874c4dd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.602259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fa01f5dae34d2f9f221574b729a375', 'request_id': 'req-19b91823-99c5-4253-ab3d-9da11874c4dd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.611420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fa01f5dae34d2f9f221574b729a375', 'request_id': 'req-19b91823-99c5-4253-ab3d-9da11874c4dd'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.624949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] The token cache is being invalidate because project c1fa01f5dae34d2f9f221574b729a375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:28:55.625242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.625926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-19b91823-99c5-4253-ab3d-9da11874c4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:28:55.627558 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4308/8644] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:28:55 2022] DELETE /identity/v3/projects/c1fa01f5dae34d2f9f221574b729a375 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:55.633259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.633557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.633838 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.652577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:55.653821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:55.683191 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:55.720400 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4337/8645] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:55.728584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.729416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.729699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.749677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:55.750951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:55.758942 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4309/8646] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:55.763365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:55.773458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cc6e-df9d-4589-8c5a-70721046d21f None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:55.778108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:55.778811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.779100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.779380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.780110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:28:55.780419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:55.782035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.795246 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4338/8647] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:28:55.799561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:55.809882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e4a8c-da7f-4181-bf9d-b0a0fc87cca7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:55.814700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:55.815369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.815655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.815934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.816646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:55.818604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.846082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4310/8648] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:55 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:55.850212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:55.861006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e711a63-b489-4ace-a819-b61b762002e5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:55.919830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:55.920513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.920806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.921090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.921946 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:55.923908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.951055 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4339/8649] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:55 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:55.952390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:55.963870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14959f5-849b-40ee-90dc-ecc0011e21d5 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:55.969102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:55.969435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:55.969891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:55.970110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:55.970898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:55.972498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:55.989367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4311/8650] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:55.990790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.001863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca8b5c-5b0a-4e61-b826-7e9162c9ccb9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.006911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e0c8e-dbe4-4b88-bf5f-739c9bee0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.007573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0c8e-dbe4-4b88-bf5f-739c9bee0529 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.007857 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0c8e-dbe4-4b88-bf5f-739c9bee0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.008134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0c8e-dbe4-4b88-bf5f-739c9bee0529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.008855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e0c8e-dbe4-4b88-bf5f-739c9bee0529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.011027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e0c8e-dbe4-4b88-bf5f-739c9bee0529 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.021474 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4340/8651] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:56.026298 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.036824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2be9a2-337b-4eb4-ae7a-4d63d9cae08a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.042692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.043607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.043883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.044165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] PATH_INFO: `/v3/projects/06c78c5bf177414abc5e16370500e80a/users/868221267cd04c80a424959e6a9dd501/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.059759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c78c5bf177414abc5e16370500e80a, user_id=868221267cd04c80a424959e6a9dd501, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.062846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.079205 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4312/8652] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:56 2022] PUT /identity/v3/projects/06c78c5bf177414abc5e16370500e80a/users/868221267cd04c80a424959e6a9dd501/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:28:56.091395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.091714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.092068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.121602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] MFA Rules not processed for user `868221267cd04c80a424959e6a9dd501`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:56.123438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:56.217886 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4341/8653] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:56.222998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.292129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01843c2-1748-4150-a83e-6d8db92dbf72 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.297167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.297925 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.298288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.298676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.299448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.301371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.328670 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4313/8654] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:28:56 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:28:56.332728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.345357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc9e3-1668-4acf-a37c-a588bb8e803a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.370110 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:56.405697 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.406382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.406711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.406992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.407691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.409620 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.430534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4342/8655] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:28:56 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:28:56.434315 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.448442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05e79d-57bf-4dd3-90da-6cec56a849e1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.453228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.453901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.454193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.454478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.455240 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.456868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.470320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4314/8656] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:56.474923 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.486133 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec3bb-5201-4b44-b0cc-4acdd9fd28a7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.491035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.491934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.492222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.492537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] PATH_INFO: `/v3/projects/41f2675598b040f186d5ff05fef5425f/users/c9c5e268d3f24757909407cff8c92cbb/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.509380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f2675598b040f186d5ff05fef5425f, user_id=c9c5e268d3f24757909407cff8c92cbb, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.512576 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.525214 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4343/8657] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:56 2022] PUT /identity/v3/projects/41f2675598b040f186d5ff05fef5425f/users/c9c5e268d3f24757909407cff8c92cbb/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:56.529974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.542317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43d53-1bc0-4718-80eb-f5d132357350 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.588323 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:28:56.605151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9357c-88b6-42ec-b1dc-a3e579ae9030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.605834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9357c-88b6-42ec-b1dc-a3e579ae9030 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.606185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9357c-88b6-42ec-b1dc-a3e579ae9030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.606469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9357c-88b6-42ec-b1dc-a3e579ae9030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.607348 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9357c-88b6-42ec-b1dc-a3e579ae9030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.608981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9357c-88b6-42ec-b1dc-a3e579ae9030 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.620417 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4315/8658] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:28:56.624659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.635821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aff32-755f-41b0-ab5c-8c02eb3d1af9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.640595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.641505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.641795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.642077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] PATH_INFO: `/v3/projects/41f2675598b040f186d5ff05fef5425f/users/c9c5e268d3f24757909407cff8c92cbb/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.644125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f2675598b040f186d5ff05fef5425f, user_id=c9c5e268d3f24757909407cff8c92cbb, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.646795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.656985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4344/8659] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:28:56 2022] PUT /identity/v3/projects/41f2675598b040f186d5ff05fef5425f/users/c9c5e268d3f24757909407cff8c92cbb/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:28:56.667053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.667351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.667632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.694987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] MFA Rules not processed for user `c9c5e268d3f24757909407cff8c92cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:28:56.696193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:56.770723 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4316/8660] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:28:56.781473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:28:56.783250 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:28:56.844506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf4e4-eac0-4319-a341-b0a4776c7d2a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:28:56.848240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0b74-29d1-4f05-b17f-a387fed24a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:28:56.848889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0b74-29d1-4f05-b17f-a387fed24a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:28:56.849179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0b74-29d1-4f05-b17f-a387fed24a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:28:56.849461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0b74-29d1-4f05-b17f-a387fed24a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:28:56.905214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0b74-29d1-4f05-b17f-a387fed24a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:28:56.906684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0b74-29d1-4f05-b17f-a387fed24a39 service cinder] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:28:56.915582 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4345/8661] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:00.669353 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:00.741500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5cae-f849-46d4-8c01-eb3ac3a4eec1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:00.746182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:00.747172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:00.747542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:00.748001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] PATH_INFO: `/v3/users/868221267cd04c80a424959e6a9dd501` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:00.749302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=868221267cd04c80a424959e6a9dd501)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:00.751500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:00.802370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868221267cd04c80a424959e6a9dd501'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:00.819170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868221267cd04c80a424959e6a9dd501'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:00.826758 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:00.830464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868221267cd04c80a424959e6a9dd501'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:00.843599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868221267cd04c80a424959e6a9dd501'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:00.844513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868221267cd04c80a424959e6a9dd501'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:00.866162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:00.866817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:00.866932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:00.874760 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4317/8662] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:29:00 2022] DELETE /identity/v3/users/868221267cd04c80a424959e6a9dd501 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:00.892071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:00.893614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:00.930016 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:00.972033 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4346/8663] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:00.981676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:00.983696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:01.062844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cfa1f-452b-427f-a7e3-c953cbcbe36a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:01.066541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:01.067260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:01.067556 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:01.067839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:01.077776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:01.079330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:01.089509 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4318/8664] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:01.404004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:01.405677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:01.437543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a5aa9-6598-42d9-bc13-04f08bb4ee24 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:01.442930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:01.443884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:01.444244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:01.444616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] PATH_INFO: `/v3/projects/06c78c5bf177414abc5e16370500e80a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:01.446114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c78c5bf177414abc5e16370500e80a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:01.449134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:01.511449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c78c5bf177414abc5e16370500e80a', 'request_id': 'req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.520338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c78c5bf177414abc5e16370500e80a', 'request_id': 'req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.527391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c78c5bf177414abc5e16370500e80a', 'request_id': 'req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.540055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] The token cache is being invalidate because project 06c78c5bf177414abc5e16370500e80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:29:01.540413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.541095 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.543449 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4347/8665] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:29:01 2022] DELETE /identity/v3/projects/06c78c5bf177414abc5e16370500e80a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:01.547138 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:01.557783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0abee-f4bb-42bf-86dc-53fb8e1314c8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:01.626945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:01.627977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:01.628260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:01.628529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] PATH_INFO: `/v3/users/c9c5e268d3f24757909407cff8c92cbb` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:01.629952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c5e268d3f24757909407cff8c92cbb)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:01.632011 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:01.686139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c5e268d3f24757909407cff8c92cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.702140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c5e268d3f24757909407cff8c92cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.710747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c5e268d3f24757909407cff8c92cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.720074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c5e268d3f24757909407cff8c92cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.720939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-db4687b4-1165-4a0b-9607-8aa8ed01f7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c5e268d3f24757909407cff8c92cbb'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:01.727964 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4319/8666] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:29:01 2022] DELETE /identity/v3/users/c9c5e268d3f24757909407cff8c92cbb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:02.015631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.017459 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:02.032377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bbd31-b9fd-45d0-9a86-7e81e074eb57 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.114881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.115640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.115924 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.116198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] PATH_INFO: `/v3/projects/41f2675598b040f186d5ff05fef5425f` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.117400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f2675598b040f186d5ff05fef5425f)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.120648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.174927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f2675598b040f186d5ff05fef5425f', 'request_id': 'req-15e8e487-2140-41f9-a926-01565e4c2ea4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:02.184006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f2675598b040f186d5ff05fef5425f', 'request_id': 'req-15e8e487-2140-41f9-a926-01565e4c2ea4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:02.186249 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:02.193126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f2675598b040f186d5ff05fef5425f', 'request_id': 'req-15e8e487-2140-41f9-a926-01565e4c2ea4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:02.210739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] The token cache is being invalidate because project 41f2675598b040f186d5ff05fef5425f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:29:02.211036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:02.211771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-15e8e487-2140-41f9-a926-01565e4c2ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:02.214018 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4348/8667] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:29:02 2022] DELETE /identity/v3/projects/41f2675598b040f186d5ff05fef5425f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:02.220255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.220666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.221022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.239811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:02.241026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:02.245453 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:02.303382 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4320/8668] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:02.311542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.311970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.312257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.331999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:02.333263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:02.342294 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4349/8669] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:02.346676 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.357039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5c651-5252-4a75-9671-481862f9c97e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.361775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.362450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.362775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.363081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.363830 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:29:02.364147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.365851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.379441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4321/8670] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:29:02.383446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.393375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d5ed-faa6-48a3-bc86-5e25b6a445ca None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.398343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.399096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.399410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.399692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.400390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.403000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.427919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4350/8671] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:02.432761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.442649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e08ff-a5cd-4a14-9201-9f6db82686c9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.503746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.504627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.504912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.505190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.505904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.507985 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.532747 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4322/8672] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:02.534193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.545251 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530379-830b-436a-a885-8be7525ac3ed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.550111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.550894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.551310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.551631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.552414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.554017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.566527 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4351/8673] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:02.569522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.582512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf083-f726-47f8-8888-27ad8f4b65f7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.589122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a3f5-c1a6-4c19-a6cc-d8b2d6240fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.589864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a3f5-c1a6-4c19-a6cc-d8b2d6240fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.590217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a3f5-c1a6-4c19-a6cc-d8b2d6240fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.590593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a3f5-c1a6-4c19-a6cc-d8b2d6240fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.591428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a3f5-c1a6-4c19-a6cc-d8b2d6240fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.593095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a3f5-c1a6-4c19-a6cc-d8b2d6240fbd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.603482 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4323/8674] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:02.608373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.621009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe617-9377-4a2b-b5d6-2c3b5a1b7558 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.625710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.626628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.626918 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.627202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] PATH_INFO: `/v3/projects/e471fa4102ff4296854bbcb11740c67c/users/f04661b566564eb69b5a23138eed96a6/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.643180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e471fa4102ff4296854bbcb11740c67c, user_id=f04661b566564eb69b5a23138eed96a6, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.645958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.658529 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4352/8675] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:02 2022] PUT /identity/v3/projects/e471fa4102ff4296854bbcb11740c67c/users/f04661b566564eb69b5a23138eed96a6/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:02.669736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.670034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.670349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.696646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] MFA Rules not processed for user `f04661b566564eb69b5a23138eed96a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:02.698717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:02.761798 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4324/8676] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:02.766342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.829583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc20f2-6996-4ae6-a068-d999a0432d9c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.834308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.834995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.835284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.835561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.836258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.838141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.863009 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4353/8677] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:02.867066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.873894 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:02.878862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f22a-4da6-4282-bd97-9b9eed407030 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.935035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.935707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.935996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.936278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.936976 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.938936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.958041 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4325/8678] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:29:02 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:02.962324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:02.973392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8eb9e-410e-41d3-a554-a9ee486f016a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:02.978147 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1617b-92aa-4685-ad5a-478fff69e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:02.978879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1617b-92aa-4685-ad5a-478fff69e5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:02.979730 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1617b-92aa-4685-ad5a-478fff69e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:02.980030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1617b-92aa-4685-ad5a-478fff69e5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:02.980763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1617b-92aa-4685-ad5a-478fff69e5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:02.982359 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1617b-92aa-4685-ad5a-478fff69e5d6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:02.993079 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4354/8679] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:02.997056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:03.007030 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3571d2-a4af-47d3-b5b4-7d3aa434f65e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:03.012226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:03.013099 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:03.013391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:03.013674 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] PATH_INFO: `/v3/projects/5857cdd51dfa429fb2999a4aec5409d3/users/5e01353a30b149aca89bba0fa2e83d6a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:03.028654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5857cdd51dfa429fb2999a4aec5409d3, user_id=5e01353a30b149aca89bba0fa2e83d6a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:03.031337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:03.043604 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4326/8680] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:02 2022] PUT /identity/v3/projects/5857cdd51dfa429fb2999a4aec5409d3/users/5e01353a30b149aca89bba0fa2e83d6a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:03.054008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:03.054473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:03.054631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:03.081046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] MFA Rules not processed for user `5e01353a30b149aca89bba0fa2e83d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:03.082370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:03.129392 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:03.150197 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4355/8681] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:03.178449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:03.180281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:03.255932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da7c40-35da-4360-b750-d7c841f40d90 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:03.261144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4432d9-9fc1-490a-838b-9d01661aec20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:03.261799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4432d9-9fc1-490a-838b-9d01661aec20 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:03.262090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4432d9-9fc1-490a-838b-9d01661aec20 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:03.262369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4432d9-9fc1-490a-838b-9d01661aec20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:03.270709 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4432d9-9fc1-490a-838b-9d01661aec20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:03.272292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4432d9-9fc1-490a-838b-9d01661aec20 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:03.280598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4327/8682] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:29:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:29:03.811483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:03.879517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b2730-c388-4abe-8f2e-30750a1a66bb None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:03.884179 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:03.884964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:03.885752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:03.886031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] PATH_INFO: `/v3/users/f04661b566564eb69b5a23138eed96a6` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:03.887444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04661b566564eb69b5a23138eed96a6)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:03.889362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:03.934960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04661b566564eb69b5a23138eed96a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:03.935613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04661b566564eb69b5a23138eed96a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:03.947230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04661b566564eb69b5a23138eed96a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:03.948377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04661b566564eb69b5a23138eed96a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:03.955153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04661b566564eb69b5a23138eed96a6'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:03.968282 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4356/8683] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:29:03 2022] DELETE /identity/v3/users/f04661b566564eb69b5a23138eed96a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:03.973013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:03.973511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:03.973634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:03.990947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:03.992147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:04.041966 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:04.057350 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4328/8684] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:29:04.066870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:04.068266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:04.128146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b288a1d-e4eb-489a-aa54-8fd0006b1b1c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:04.131892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:04.132546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:04.132837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:04.133120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:04.142744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:04.144203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:04.153607 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4357/8685] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:04.409637 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:04.411266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:04.423653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fd500-ed64-4175-bf4c-327d5fc109ca None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:04.428642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:04.429602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:04.429952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:04.430292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] PATH_INFO: `/v3/projects/e471fa4102ff4296854bbcb11740c67c` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:04.431616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e471fa4102ff4296854bbcb11740c67c)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:04.434253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:04.489056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e471fa4102ff4296854bbcb11740c67c', 'request_id': 'req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.495758 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e471fa4102ff4296854bbcb11740c67c', 'request_id': 'req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.503874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e471fa4102ff4296854bbcb11740c67c', 'request_id': 'req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.515728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] The token cache is being invalidate because project e471fa4102ff4296854bbcb11740c67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:29:04.516074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.516753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.518310 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4329/8686] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:29:04 2022] DELETE /identity/v3/projects/e471fa4102ff4296854bbcb11740c67c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:04.522320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:04.532210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae358c7d-1f51-4e1a-92ae-d2e65c104f71 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:04.536887 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:04.595564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:04.596462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:04.596729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:04.597037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] PATH_INFO: `/v3/users/5e01353a30b149aca89bba0fa2e83d6a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:04.598229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e01353a30b149aca89bba0fa2e83d6a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:04.600215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:04.645949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e01353a30b149aca89bba0fa2e83d6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.646657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e01353a30b149aca89bba0fa2e83d6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.659164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e01353a30b149aca89bba0fa2e83d6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.659747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e01353a30b149aca89bba0fa2e83d6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.667995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-519f10ce-259a-4339-b63c-b9a53e13b926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e01353a30b149aca89bba0fa2e83d6a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:04.682067 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4358/8687] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:29:04 2022] DELETE /identity/v3/users/5e01353a30b149aca89bba0fa2e83d6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:04.945088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:04.946635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:04.966959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c50f-9003-4fe5-8907-f2ebc28ccfa2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.027877 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.028743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.029028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.029307 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] PATH_INFO: `/v3/projects/5857cdd51dfa429fb2999a4aec5409d3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.030539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5857cdd51dfa429fb2999a4aec5409d3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.032450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.080566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5857cdd51dfa429fb2999a4aec5409d3', 'request_id': 'req-c45836ec-69fd-4634-8470-117174c1f107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:05.086025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5857cdd51dfa429fb2999a4aec5409d3', 'request_id': 'req-c45836ec-69fd-4634-8470-117174c1f107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:05.092723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5857cdd51dfa429fb2999a4aec5409d3', 'request_id': 'req-c45836ec-69fd-4634-8470-117174c1f107'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:05.103913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] The token cache is being invalidate because project 5857cdd51dfa429fb2999a4aec5409d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:29:05.104209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:05.104850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c45836ec-69fd-4634-8470-117174c1f107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:05.106516 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4330/8688] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:29:04 2022] DELETE /identity/v3/projects/5857cdd51dfa429fb2999a4aec5409d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:05.111567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.112040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.112162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.130523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:05.132447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:05.194032 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4359/8689] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:29:05.203400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.203697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.203983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.222357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:05.223623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:05.232006 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4331/8690] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:05.236217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.246354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33dbe7-868d-4631-beb3-27935d7db24c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.251763 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.252415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.252701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.252979 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.253695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:29:05.253999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.255607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.267712 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4360/8691] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:29:05.272023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.281207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f4e7-7d91-4c8f-b9b5-dab87e7ada85 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.285959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.286638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.286929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.287212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.287913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.289816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.293533 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:05.319478 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4332/8692] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:29:05 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:05.321657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.332103 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6d666-b664-4287-ba1b-4040f2c5fb0a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.343488 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:05.389712 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.390379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.390694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.390974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.391672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.393592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.415441 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4361/8693] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:29:05 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:29:05.417244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.427593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf221d-f17c-4249-b16c-20d156466667 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.432347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.433511 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.433804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.434086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.434959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.436484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.448211 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4333/8694] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:05.452134 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.462145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d7ea-486f-4555-858e-763b7ce367ab admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.466995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d60a7-8528-4e29-9663-bfd4ac46c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.467662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d60a7-8528-4e29-9663-bfd4ac46c473 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.467955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d60a7-8528-4e29-9663-bfd4ac46c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.468240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d60a7-8528-4e29-9663-bfd4ac46c473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.468973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d60a7-8528-4e29-9663-bfd4ac46c473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.470603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d60a7-8528-4e29-9663-bfd4ac46c473 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.482118 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4362/8695] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:05.486435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.497297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d67411-a9ef-44de-ad25-3c6252393bca admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.502031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.502939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.503227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.503508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] PATH_INFO: `/v3/projects/560376a0f81d4a46b78a47cb282a6815/users/5ae0d5deb1c94894b193d3e495f585b9/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.517735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560376a0f81d4a46b78a47cb282a6815, user_id=5ae0d5deb1c94894b193d3e495f585b9, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.520456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.533170 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4334/8696] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:05 2022] PUT /identity/v3/projects/560376a0f81d4a46b78a47cb282a6815/users/5ae0d5deb1c94894b193d3e495f585b9/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:05.538242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826825ea-8a68-4f9a-92e3-890d3aaa665e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.538604 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826825ea-8a68-4f9a-92e3-890d3aaa665e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.538887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826825ea-8a68-4f9a-92e3-890d3aaa665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.556785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-826825ea-8a68-4f9a-92e3-890d3aaa665e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:05.558592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-826825ea-8a68-4f9a-92e3-890d3aaa665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:05.617976 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4363/8697] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:05.628447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:05.630220 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:05.691672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b3fe-237b-4dd8-b84f-5dea292f5c74 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:05.695357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:05.696000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:05.696283 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:05.696559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:05.706157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:05.707569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:05.717726 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4335/8698] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:09.793702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:09.794211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:09.794312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:09.821398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] MFA Rules not processed for user `5ae0d5deb1c94894b193d3e495f585b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:09.822744 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:09.891420 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4364/8699] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:09.895597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:09.906093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d9a42-9602-41ac-a018-41ff10ce51b3 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:09.910887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:09.911534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:09.911806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:09.912088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:09.912772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:09.914689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:09.942616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4336/8700] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:29:09 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:29:09.944079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:09.955810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109740f2-a58b-4beb-b132-bd4f845a203d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:09.977368 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:10.017208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:10.017890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:10.018174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:10.018449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:10.019296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:10.021285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:10.051210 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4365/8701] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:29:09 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:29:10.055429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:10.067604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16224f-02e2-4a7e-b349-667e0cb70d05 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:10.072426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:10.073656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:10.073934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:10.074216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:10.074977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:10.076596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:10.088405 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4337/8702] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:10.092981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:10.103370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0c9b2-ac2e-4702-b370-c0a7dbb0c78e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:10.109256 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:10.110155 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:10.110447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:10.110765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] PATH_INFO: `/v3/projects/ae523cb91f054f01971c7c1f7cfef623/users/82eae0825ae449a3a9b060f007a328c4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:10.126796 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae523cb91f054f01971c7c1f7cfef623, user_id=82eae0825ae449a3a9b060f007a328c4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:10.129465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:10.143149 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4366/8703] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:10 2022] PUT /identity/v3/projects/ae523cb91f054f01971c7c1f7cfef623/users/82eae0825ae449a3a9b060f007a328c4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:10.147228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:10.158137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809de4-a6eb-4b80-894d-db19a4c7d7ba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:10.238336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977161a2-45f7-4131-aaeb-0d72c64e4b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:10.239102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977161a2-45f7-4131-aaeb-0d72c64e4b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:10.239425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977161a2-45f7-4131-aaeb-0d72c64e4b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:10.239708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977161a2-45f7-4131-aaeb-0d72c64e4b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:10.240446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977161a2-45f7-4131-aaeb-0d72c64e4b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:10.242062 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977161a2-45f7-4131-aaeb-0d72c64e4b68 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:10.252616 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4338/8704] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:10.257715 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:10.268894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb502b-b821-4c8a-85c4-092e3db13d97 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:10.273683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:10.274630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:10.274917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:10.275199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] PATH_INFO: `/v3/projects/ae523cb91f054f01971c7c1f7cfef623/users/82eae0825ae449a3a9b060f007a328c4/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:10.277800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae523cb91f054f01971c7c1f7cfef623, user_id=82eae0825ae449a3a9b060f007a328c4, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:10.280498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:10.291626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4367/8705] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:10 2022] PUT /identity/v3/projects/ae523cb91f054f01971c7c1f7cfef623/users/82eae0825ae449a3a9b060f007a328c4/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:15.458739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec7ee-3256-4530-9928-b8bcd9cd00bf None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:15.459281 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec7ee-3256-4530-9928-b8bcd9cd00bf None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:15.459373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec7ee-3256-4530-9928-b8bcd9cd00bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:15.489102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-53eec7ee-3256-4530-9928-b8bcd9cd00bf None None] MFA Rules not processed for user `82eae0825ae449a3a9b060f007a328c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:15.490442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-53eec7ee-3256-4530-9928-b8bcd9cd00bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:15.495614 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:15.577435 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4339/8706] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:15.584847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:15.587430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:15.692676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd1421-3a02-488a-9f35-d3f9b1f4a1c7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:15.700199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3139f-20f3-4a88-b3e6-5276f942259f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:15.700961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3139f-20f3-4a88-b3e6-5276f942259f service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:15.701321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3139f-20f3-4a88-b3e6-5276f942259f service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:15.701689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3139f-20f3-4a88-b3e6-5276f942259f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:15.711295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3139f-20f3-4a88-b3e6-5276f942259f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:15.712912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3139f-20f3-4a88-b3e6-5276f942259f service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:15.723267 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4368/8707] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:29:15.775191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:15.775492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:15.775777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:15.796413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] MFA Rules not processed for user `5ae0d5deb1c94894b193d3e495f585b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:15.797632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:15.859151 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4340/8708] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:25.719076 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:25.851968 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=52 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:27.874943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:27.875492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:27.875492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:27.893806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] MFA Rules not processed for user `5ae0d5deb1c94894b193d3e495f585b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:27.895068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:27.902066 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4369/8709] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:37.888472 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:53.071795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:53.138819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c315c6-f3d2-4e18-a128-7d7e1ea609d4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:53.143292 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:53.144161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:53.144447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:53.144757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] PATH_INFO: `/v3/users/5ae0d5deb1c94894b193d3e495f585b9` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:53.145950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae0d5deb1c94894b193d3e495f585b9)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:53.147902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:53.194810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae0d5deb1c94894b193d3e495f585b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.207609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae0d5deb1c94894b193d3e495f585b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.214733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae0d5deb1c94894b193d3e495f585b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.222735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae0d5deb1c94894b193d3e495f585b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.223356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae0d5deb1c94894b193d3e495f585b9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.229557 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4341/8710] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:29:53 2022] DELETE /identity/v3/users/5ae0d5deb1c94894b193d3e495f585b9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:53.409994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:53.424780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5571-9db4-4516-bea2-ae8c60dd2cae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:53.481937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:53.482935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:53.483732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:53.484016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] PATH_INFO: `/v3/projects/560376a0f81d4a46b78a47cb282a6815` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:53.485210 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=560376a0f81d4a46b78a47cb282a6815)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:53.487171 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:53.532059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560376a0f81d4a46b78a47cb282a6815', 'request_id': 'req-21ef1333-9224-4871-8970-3f4320b1dd9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.539053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560376a0f81d4a46b78a47cb282a6815', 'request_id': 'req-21ef1333-9224-4871-8970-3f4320b1dd9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.544557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560376a0f81d4a46b78a47cb282a6815', 'request_id': 'req-21ef1333-9224-4871-8970-3f4320b1dd9d'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.556397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] The token cache is being invalidate because project 560376a0f81d4a46b78a47cb282a6815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:29:53.556692 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.557332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.559492 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4370/8711] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:29:53 2022] DELETE /identity/v3/projects/560376a0f81d4a46b78a47cb282a6815 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:53.563540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:53.565010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:53.578432 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f692082-f2fe-47c9-a973-3e5de3c07a99 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:53.633550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:53.634351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:53.634664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:53.634936 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] PATH_INFO: `/v3/users/82eae0825ae449a3a9b060f007a328c4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:53.636121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82eae0825ae449a3a9b060f007a328c4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:53.638027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:53.659484 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:53.683947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82eae0825ae449a3a9b060f007a328c4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.696230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82eae0825ae449a3a9b060f007a328c4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.703843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82eae0825ae449a3a9b060f007a328c4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.711436 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82eae0825ae449a3a9b060f007a328c4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.712148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-0b419a3f-ba2c-44fa-b6f0-7d66749d3777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82eae0825ae449a3a9b060f007a328c4'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:53.719120 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4342/8712] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:29:53 2022] DELETE /identity/v3/users/82eae0825ae449a3a9b060f007a328c4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:53.885216 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:53.886701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:53.902662 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef1333-9224-4871-8970-3f4320b1dd9d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:53.959602 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:53.960471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:53.960758 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:53.961040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] PATH_INFO: `/v3/projects/ae523cb91f054f01971c7c1f7cfef623` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:53.962223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae523cb91f054f01971c7c1f7cfef623)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:53.964174 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:53.997546 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:54.011270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae523cb91f054f01971c7c1f7cfef623', 'request_id': 'req-e60b7294-111a-4bad-ad9f-179f368132da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:54.018761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae523cb91f054f01971c7c1f7cfef623', 'request_id': 'req-e60b7294-111a-4bad-ad9f-179f368132da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:54.024276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae523cb91f054f01971c7c1f7cfef623', 'request_id': 'req-e60b7294-111a-4bad-ad9f-179f368132da'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:54.035380 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] The token cache is being invalidate because project ae523cb91f054f01971c7c1f7cfef623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:29:54.035670 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:54.036319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e60b7294-111a-4bad-ad9f-179f368132da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:29:54.037870 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4371/8713] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:29:53 2022] DELETE /identity/v3/projects/ae523cb91f054f01971c7c1f7cfef623 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:54.042914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.043321 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.043798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.062258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:54.063594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:54.123197 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4343/8714] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:54.131294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.131590 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.131880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.150226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:54.151484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:54.159927 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4372/8715] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:54.163889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.174701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce0a5-ee1b-4141-99c0-41d9a4f1c50b None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.179235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.179887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.180169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.180447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.181170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:29:54.181478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.183145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.195598 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4344/8716] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:29:54.198774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.208496 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6fc90-c6ce-48c3-8c30-27648f5176ae None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.213287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.213937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.214227 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.214535 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.215239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.217156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.243056 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4373/8717] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:29:54 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:54.247140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.256979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4c36-77ff-4918-b9d8-43f773d994a4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.313059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.313726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.314019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.314304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.315027 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.316949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.336240 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4345/8718] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:29:54 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:29:54.340494 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.351381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e53f-e7fc-4e88-9c33-485c5e598da4 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.355965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.356647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.356934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.357214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.358668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.360377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.370732 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4374/8719] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:54.374562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.384440 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728685-9ad6-4d0d-9a7d-2d61a6684c9f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.389599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0f571-89d0-4dc9-addb-06f770d5c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.390259 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f571-89d0-4dc9-addb-06f770d5c117 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.390581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f571-89d0-4dc9-addb-06f770d5c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.390865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f571-89d0-4dc9-addb-06f770d5c117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.391588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0f571-89d0-4dc9-addb-06f770d5c117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.393165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0f571-89d0-4dc9-addb-06f770d5c117 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.403178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4346/8720] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:54.407403 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.417353 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74464d05-6425-459d-ab7c-a33ae23db6c1 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.422036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.422938 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.423224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.423792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] PATH_INFO: `/v3/projects/cb6423d7344e4e41ba43c2917b62d5a1/users/87a931805395424fbfd1296c9aad787e/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.438291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6423d7344e4e41ba43c2917b62d5a1, user_id=87a931805395424fbfd1296c9aad787e, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.440960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.457248 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4375/8721] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:54 2022] PUT /identity/v3/projects/cb6423d7344e4e41ba43c2917b62d5a1/users/87a931805395424fbfd1296c9aad787e/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:29:54.463028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df220a3-5f76-4e48-b94e-42e43e0a52f7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.463393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df220a3-5f76-4e48-b94e-42e43e0a52f7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.463742 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df220a3-5f76-4e48-b94e-42e43e0a52f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.472408 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:54.485688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0df220a3-5f76-4e48-b94e-42e43e0a52f7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:54.486949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0df220a3-5f76-4e48-b94e-42e43e0a52f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:54.550273 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4347/8722] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:29:54.559867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:54.561665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:54.622037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d76e7-c08e-4ccb-9904-be385fbb140f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:54.625739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:54.626382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:54.626702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:54.626981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:54.636337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:54.637757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:54.647750 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4376/8723] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:29:58.675633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:58.676175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:58.676175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:58.709753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] MFA Rules not processed for user `87a931805395424fbfd1296c9aad787e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:29:58.711162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:29:58.792049 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4348/8724] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:29:58.797110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:58.807070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b4265-b538-4c4e-92ba-8bade907894b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:58.811986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:58.812667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:58.812960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:58.813241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:58.813957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:58.816091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:58.847322 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4377/8725] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:29:58 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:58.848585 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:58.860914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48735c-022f-4408-adec-feb06c9230e6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:58.920035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:58.920747 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:58.921033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:58.921339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:58.922178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:58.924183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:58.948203 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4349/8726] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:29:58 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:29:58.949379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:58.961551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaac72-0c0f-41f3-ab9e-ab9f54254f03 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:58.966822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:58.968357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:58.968707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:58.969051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:58.969853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:58.971645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:58.984921 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4378/8727] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:29:58.989093 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:58.999738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab29f-ec75-431b-a394-9a07cd5fdc48 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:59.004563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:59.005464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:59.005775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:59.006060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] PATH_INFO: `/v3/projects/eb9832d93aeb4f24820e5e21f521d933/users/42c313afb83c414f81fe74315e19d81a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:59.022627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9832d93aeb4f24820e5e21f521d933, user_id=42c313afb83c414f81fe74315e19d81a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:59.025439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:59.038152 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:59.044875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4350/8728] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:58 2022] PUT /identity/v3/projects/eb9832d93aeb4f24820e5e21f521d933/users/42c313afb83c414f81fe74315e19d81a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:29:59.047679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:59.059185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ca4b-a8e7-46eb-a838-df1ea62fd0d0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:59.085609 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:29:59.121652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:59.122327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:59.122652 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:59.122937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:59.123700 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:59.125324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:59.135481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4379/8729] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:29:59.140228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:29:59.150611 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e849-26c3-45ba-935d-ba2cf2dec4c3 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:29:59.156534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16166eb6-1489-4767-a2dd-ca7667ea6bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:29:59.157450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166eb6-1489-4767-a2dd-ca7667ea6bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:29:59.157902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166eb6-1489-4767-a2dd-ca7667ea6bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:29:59.158152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166eb6-1489-4767-a2dd-ca7667ea6bbc admin admin] PATH_INFO: `/v3/projects/eb9832d93aeb4f24820e5e21f521d933/users/42c313afb83c414f81fe74315e19d81a/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:29:59.160270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16166eb6-1489-4767-a2dd-ca7667ea6bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9832d93aeb4f24820e5e21f521d933, user_id=42c313afb83c414f81fe74315e19d81a, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:29:59.163142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16166eb6-1489-4767-a2dd-ca7667ea6bbc admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:29:59.174891 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4351/8730] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:29:59 2022] PUT /identity/v3/projects/eb9832d93aeb4f24820e5e21f521d933/users/42c313afb83c414f81fe74315e19d81a/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:30:02.203792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:02.207059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:02.362202 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc540ccd-5e58-4ad2-bf27-4b1283962dc8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:02.448252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:02.448920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:02.449208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:02.449546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:02.452093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:02.496217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:02.502130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:02.530395 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4380/8731] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:30:03.693065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:03.694021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:03.694329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:03.721521 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] MFA Rules not processed for user `42c313afb83c414f81fe74315e19d81a`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:30:03.722725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:03.794913 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4352/8732] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:30:03.807244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:03.808705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:03.871067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb352e8-2908-4a78-913c-1cc2db35d78a service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:03.875222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:03.876081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:03.876374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:03.876780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:03.885658 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=100 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:03.937476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:03.938958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:03.948109 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4381/8733] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:30:08.737439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:08.740554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:08.761882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28692c87-1409-47dd-b139-02fad42defb2 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:08.768708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:08.770401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:08.770401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:08.770401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:08.772010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:08.789910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:08.791609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:08.807267 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4353/8734] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:30:13.943854 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=23 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:18.798358 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:30:25.743086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:30:25.744545 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:30:25.816449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf852c-f848-4b8f-bfbe-c62a53ba4f3b service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:30:25.821503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:30:25.822154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:30:25.822441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:30:25.822754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:30:25.831220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:30:25.832805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:30:25.841031 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4382/8735] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:30:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:30:35.837525 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=32 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:13.292175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:13.293890 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:13.372909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96389385-166f-4e5f-a1a7-816fbb839ca7 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:13.379085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:13.379734 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:13.380022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:13.380301 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:13.382095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:13.442463 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:13.444134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:13.453516 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4354/8736] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:13.641631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:13.701910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943aa3d-3b0d-458f-9cc9-3bd2aaef6128 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:13.706191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:13.706989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:13.707281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:13.707562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:13.709378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:13.726845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:13.728297 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac766-2c11-49b5-8883-2825178b186e service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:13.744544 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4383/8737] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:14.932838 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:14.934217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:14.949858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ee518-6ea6-4774-87db-ae94cd5b6890 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:14.953509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:14.954155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:14.954447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:14.954777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:14.956935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:14.977725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:14.979222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:14.994567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4355/8738] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:21.820997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:21.821444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:21.821591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:21.839757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:31:21.841018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:21.848866 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4384/8739] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:31:24.986254 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=62 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:31.834401 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=29 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:44.139776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:44.152215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4c5a0-2305-4019-861f-347f809b3955 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:44.155876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:44.156517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:44.156804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:44.157082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:44.159430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:44.232253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:44.233704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc5b3f-4c38-44be-b134-e1234b476e65 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:44.244585 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4356/8740] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:31:46.238200 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:31:46.258871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a1241-78cf-4a8c-8cc4-09d941d3294e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:31:46.268726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:31:46.269488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:46.270019 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:46.270371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:46.272768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:46.290920 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:31:46.293347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:31:46.309990 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4385/8741] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:31:54.239162 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=30 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:31:54.279919 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:31:54.280132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:31:54.280490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:31:54.298344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] MFA Rules not processed for user `87a931805395424fbfd1296c9aad787e`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:31:54.299626 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:31:54.307069 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4357/8742] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:31:56.301574 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:32:04.293259 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:32:16.509383 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:32:16.521424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237db2f-1f35-4e7d-952f-493502d6f6c2 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:32:16.524998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:32:16.525664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:32:16.525949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:32:16.526230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:32:16.536201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:32:16.538152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:32:16.547902 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4386/8743] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:32:26.543583 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:32:53.841759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:32:53.858688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817e04c-19d7-4482-8706-808c4d4571ea None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:32:53.863306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:32:53.863970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:32:53.864431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:32:53.864717 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:32:53.866641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:32:53.883771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:32:53.885588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:32:53.898092 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4358/8744] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:32:56.030795 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:32:56.046345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef43d-15c9-4bef-bcac-4e58ccc416f4 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:32:56.052756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:32:56.053570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:32:56.053811 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:32:56.054194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:32:56.056226 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:32:56.073939 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:32:56.075564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:32:56.089883 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4387/8745] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:32:59.468290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:32:59.479809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486803e-d0a4-4844-8d30-2bd3634dff44 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:32:59.483529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:32:59.484196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:32:59.484595 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:32:59.484881 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:32:59.486684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:32:59.499465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:32:59.500894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:32:59.511537 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4359/8746] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:06.082416 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:08.412299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:08.426168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61d33-694c-4d53-9ef6-e79e26b4b442 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:08.431405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:08.432051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:08.432338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:08.432619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:08.434574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:08.449800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:08.451458 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:08.471637 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4388/8747] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:09.505441 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=12 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:11.685515 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:11.703471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0621bc8-8c15-4a05-86f6-f7ed4d5f4f4b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:11.708646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:11.709385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:11.709741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:11.710082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:11.712258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:11.729157 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:11.730974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:11.745657 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4360/8748] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:11.756326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:11.841847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b241a-0a0b-42b8-90f5-fc309caf7c83 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:11.847160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:11.848038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:11.848330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:11.848607 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] PATH_INFO: `/v3/users/87a931805395424fbfd1296c9aad787e` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:11.849870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a931805395424fbfd1296c9aad787e)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:11.853065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:11.899442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a931805395424fbfd1296c9aad787e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:11.900051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a931805395424fbfd1296c9aad787e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:11.912644 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a931805395424fbfd1296c9aad787e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:11.913374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a931805395424fbfd1296c9aad787e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:11.921008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a931805395424fbfd1296c9aad787e'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:11.933987 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4389/8749] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:33:11 2022] DELETE /identity/v3/users/87a931805395424fbfd1296c9aad787e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:33:12.109160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:12.120370 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbb7ea-cd92-4ae3-8d52-e70ef8ad4d08 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:12.181328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:12.182146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:12.182435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:12.182755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] PATH_INFO: `/v3/projects/cb6423d7344e4e41ba43c2917b62d5a1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:12.183959 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6423d7344e4e41ba43c2917b62d5a1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:12.185886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:12.232304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6423d7344e4e41ba43c2917b62d5a1', 'request_id': 'req-85a281a4-ca95-44c0-9cbb-e2879549e4b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.237707 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6423d7344e4e41ba43c2917b62d5a1', 'request_id': 'req-85a281a4-ca95-44c0-9cbb-e2879549e4b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.245618 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6423d7344e4e41ba43c2917b62d5a1', 'request_id': 'req-85a281a4-ca95-44c0-9cbb-e2879549e4b2'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.258243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] The token cache is being invalidate because project cb6423d7344e4e41ba43c2917b62d5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:33:12.258576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.259242 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.260780 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4361/8750] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:33:12 2022] DELETE /identity/v3/projects/cb6423d7344e4e41ba43c2917b62d5a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:33:12.265598 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:12.267047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:12.280023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd7841-71a1-4082-97fc-dc89c38f2f81 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:12.331347 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:12.338245 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:12.339163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:12.339737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:12.340094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] PATH_INFO: `/v3/users/42c313afb83c414f81fe74315e19d81a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:12.341331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c313afb83c414f81fe74315e19d81a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:12.343805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:12.388184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c313afb83c414f81fe74315e19d81a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.388833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c313afb83c414f81fe74315e19d81a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.401324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c313afb83c414f81fe74315e19d81a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.402025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c313afb83c414f81fe74315e19d81a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.409419 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-e2eb3cfa-a3ef-490a-9ec4-c31739d800be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c313afb83c414f81fe74315e19d81a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.422299 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4390/8751] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:33:12 2022] DELETE /identity/v3/users/42c313afb83c414f81fe74315e19d81a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:33:12.600529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:12.602166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:12.621804 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a281a4-ca95-44c0-9cbb-e2879549e4b2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:12.680889 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:12.681764 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:12.682169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:12.682454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] PATH_INFO: `/v3/projects/eb9832d93aeb4f24820e5e21f521d933` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:12.683710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9832d93aeb4f24820e5e21f521d933)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:12.685641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:12.707876 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:12.735170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9832d93aeb4f24820e5e21f521d933', 'request_id': 'req-d500841a-fff9-4361-b134-f11e96fd74d9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.740671 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9832d93aeb4f24820e5e21f521d933', 'request_id': 'req-d500841a-fff9-4361-b134-f11e96fd74d9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.748029 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9832d93aeb4f24820e5e21f521d933', 'request_id': 'req-d500841a-fff9-4361-b134-f11e96fd74d9'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.759227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] The token cache is being invalidate because project eb9832d93aeb4f24820e5e21f521d933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:33:12.759520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.760155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:33:12.761716 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4362/8752] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:33:12 2022] DELETE /identity/v3/projects/eb9832d93aeb4f24820e5e21f521d933 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:33:22.418291 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:22.756165 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:24.892223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968de651-330f-4571-bc85-db392d2613e6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:24.892723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968de651-330f-4571-bc85-db392d2613e6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:24.892837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968de651-330f-4571-bc85-db392d2613e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:24.910482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-968de651-330f-4571-bc85-db392d2613e6 None None] MFA Rules not processed for user `9026a4d3931749c081de1d18559cb204`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:33:24.911708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-968de651-330f-4571-bc85-db392d2613e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:24.965895 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4391/8753] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:33:25.279368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:25.281427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:25.349578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500841a-fff9-4361-b134-f11e96fd74d9 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:25.353168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:25.353806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:25.354089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:25.354361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:25.356145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:25.367823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:25.369279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:25.379434 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4363/8754] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:25.807421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968de651-330f-4571-bc85-db392d2613e6 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:25.808810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-968de651-330f-4571-bc85-db392d2613e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:25.883139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968de651-330f-4571-bc85-db392d2613e6 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:25.888199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:25.888869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:25.889187 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:25.890112 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:25.891937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:25.905880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:25.907508 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:25.919908 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4392/8755] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:35.373608 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=30 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:35.913211 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=57 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:33:42.476418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:33:42.478022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:42.577213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61063b17-8a48-4bb7-8fc1-607427fcb0a0 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:33:42.583399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:33:42.584052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:33:42.584339 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:33:42.584619 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:33:42.586379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:33:42.602155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:33:42.603749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:33:42.617097 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4364/8756] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:33:52.610303 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=45 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:09.187083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:09.248761 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5af46-ba17-42d1-afb6-567805732b68 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:09.253877 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:09.254552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:09.254844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:09.255126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:09.256902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:09.293117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:09.294696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44e698-64f2-4382-986e-9c8bd41436d7 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:09.307114 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4393/8757] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:13.736574 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:13.738118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:13.784666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a25a-fb01-4cde-ac12-6759f5653ba7 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:13.790487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:13.791196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:13.791488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:13.791774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:13.793647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:13.808789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:13.810418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:13.824446 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4365/8758] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:19.300314 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=36 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:23.816850 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=17 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:39.821309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:39.821915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:39.822220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:39.881948 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:39.883203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:39.889854 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4394/8759] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Jul 11 15:35:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:39.895643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:39.904893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8244-bda1-4a7b-9332-3f4cfaae1a62 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:39.908553 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:39.909193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:39.909481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:39.909761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:39.911573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:39.998378 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:39.999935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:40.016733 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4366/8760] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:46.070971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:46.074178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:46.091937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33e56-a10e-4708-9932-9a6596e16d64 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:46.096629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:46.097581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:46.097872 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:46.098154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] PATH_INFO: `/v3/users/9026a4d3931749c081de1d18559cb204` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:46.112716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9026a4d3931749c081de1d18559cb204)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:46.114677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:46.162876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9026a4d3931749c081de1d18559cb204'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.163542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9026a4d3931749c081de1d18559cb204'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.176790 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9026a4d3931749c081de1d18559cb204'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.177554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9026a4d3931749c081de1d18559cb204'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.185236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9026a4d3931749c081de1d18559cb204'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.199412 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4395/8761] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:35:46 2022] DELETE /identity/v3/users/9026a4d3931749c081de1d18559cb204 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:46.379635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:46.391555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b731a-8325-47a6-a9a1-2e73098bebe4 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:46.450924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:46.451825 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:46.452115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:46.452395 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] PATH_INFO: `/v3/projects/4008c140c71c4679adfe15f1238cb9b7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:46.463175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4008c140c71c4679adfe15f1238cb9b7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:46.465095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:46.510647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4008c140c71c4679adfe15f1238cb9b7', 'request_id': 'req-87643a49-ae2f-488b-ac98-36ba172d70ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.516033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4008c140c71c4679adfe15f1238cb9b7', 'request_id': 'req-87643a49-ae2f-488b-ac98-36ba172d70ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.523302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4008c140c71c4679adfe15f1238cb9b7', 'request_id': 'req-87643a49-ae2f-488b-ac98-36ba172d70ac'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.525907 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:46.537724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] The token cache is being invalidate because project 4008c140c71c4679adfe15f1238cb9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:35:46.538013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.538689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.540243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4367/8762] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:35:46 2022] DELETE /identity/v3/projects/4008c140c71c4679adfe15f1238cb9b7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:46.544365 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:46.545824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:46.559022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3791-30b8-48f3-8d42-3b29129ad813 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:46.614855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:46.615728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:46.616017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:46.616299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] PATH_INFO: `/v3/users/34a5ddfb58af4d7993050d7f95d2d180` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:46.631177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a5ddfb58af4d7993050d7f95d2d180)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:46.633107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:46.645098 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:46.685100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a5ddfb58af4d7993050d7f95d2d180'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.685926 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a5ddfb58af4d7993050d7f95d2d180'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.699240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a5ddfb58af4d7993050d7f95d2d180'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.700282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a5ddfb58af4d7993050d7f95d2d180'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.707802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-cae50b7d-e440-4470-bb63-79c83282c0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a5ddfb58af4d7993050d7f95d2d180'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:46.721762 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4396/8763] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:35:46 2022] DELETE /identity/v3/users/34a5ddfb58af4d7993050d7f95d2d180 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:46.893863 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:46.895364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:46.908767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87643a49-ae2f-488b-ac98-36ba172d70ac admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:46.965081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:46.966192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:46.966483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:46.966792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] PATH_INFO: `/v3/projects/879bbfed7f7f45b886e017ce86845de4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:46.976960 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879bbfed7f7f45b886e017ce86845de4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:46.979481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.023598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879bbfed7f7f45b886e017ce86845de4', 'request_id': 'req-fee8649b-2232-4255-82d4-92758d7ab208'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:47.029686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879bbfed7f7f45b886e017ce86845de4', 'request_id': 'req-fee8649b-2232-4255-82d4-92758d7ab208'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:47.036632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879bbfed7f7f45b886e017ce86845de4', 'request_id': 'req-fee8649b-2232-4255-82d4-92758d7ab208'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:47.048768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] The token cache is being invalidate because project 879bbfed7f7f45b886e017ce86845de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:35:47.049061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:47.049715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fee8649b-2232-4255-82d4-92758d7ab208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:35:47.051318 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4368/8764] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:35:46 2022] DELETE /identity/v3/projects/879bbfed7f7f45b886e017ce86845de4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:56.627722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.628324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.628324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.674329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:56.675582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:56.734444 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4397/8765] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:35:56.743989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.744507 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.744623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.762655 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:56.763862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:56.771863 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4369/8766] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:56.776417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:56.786022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104924c-0c4c-45fb-85b0-b605159f697c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:56.791215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:56.791869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.792157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.792438 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.793164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:56.793480 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:56.795121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:56.807306 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4398/8767] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:56.823227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:56.832356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222dd7-87c8-4d0f-9aa6-9de5479215be None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:56.836969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:56.837607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.837891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.838166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.838888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:56.840771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:56.867037 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4370/8768] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:35:56 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:56.871750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:56.882225 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb8a42-6e35-49d4-8ac0-4761318e685e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:56.933590 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:56.941573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:56.942321 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.942793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.943306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.944203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:56.946255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:56.965549 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4399/8769] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:35:56 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:56.970133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:56.980805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a62ef-6948-4ba4-a4ad-b92e17555e21 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:56.985343 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:56.985987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:56.986271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:56.986571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:56.987289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:56.988867 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:56.999178 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4371/8770] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:35:57.002996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.012963 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de86c-7792-4a5a-96d1-4b23cd8cc695 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.017643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b059c-a68e-42f8-bb9f-3e41ef0a0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.018294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b059c-a68e-42f8-bb9f-3e41ef0a0d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.018623 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b059c-a68e-42f8-bb9f-3e41ef0a0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.018909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b059c-a68e-42f8-bb9f-3e41ef0a0d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.019631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b059c-a68e-42f8-bb9f-3e41ef0a0d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.021220 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b059c-a68e-42f8-bb9f-3e41ef0a0d2e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.031135 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4400/8771] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:35:57.035065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.045168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69431862-dce4-4437-888e-5fbff8a551c8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.049792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.050694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.051182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.051329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] PATH_INFO: `/v3/projects/0c5539c55a9644b5a31f3d2f489ff723/users/7fa7a99219b2428cadfbeb35c383e387/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.066745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5539c55a9644b5a31f3d2f489ff723, user_id=7fa7a99219b2428cadfbeb35c383e387, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.069383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.081888 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4372/8772] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:35:57 2022] PUT /identity/v3/projects/0c5539c55a9644b5a31f3d2f489ff723/users/7fa7a99219b2428cadfbeb35c383e387/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:57.095298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.095596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.095909 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.123025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] MFA Rules not processed for user `7fa7a99219b2428cadfbeb35c383e387`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:57.124236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:57.187898 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4401/8773] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:57.192366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.205428 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:57.254148 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2d0d-6390-4e03-a3b5-5aaf6db2c183 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.258860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.259628 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.259843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.260164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.260934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.262952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.287358 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4373/8774] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:57.292014 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.302711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47322a75-e38f-489e-a38a-e59650c6c5d3 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.358139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.358834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.359117 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.359392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.360075 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.361988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.383588 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4402/8775] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:35:57.384715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.394970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe02c1-7e34-42c5-b191-0b68716a6417 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.400061 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.400721 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.401008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.401289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.402008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.403632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.413916 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4374/8776] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:35:57.418473 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.428258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94e8d-4924-4ae3-a378-4b98cd7fea81 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.432894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.433757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.434066 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.434345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] PATH_INFO: `/v3/projects/2a644ed47697405892e78805d99bb208/users/4f07016fbd9b4ae49f66876abb1c21f0/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.448829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a644ed47697405892e78805d99bb208, user_id=4f07016fbd9b4ae49f66876abb1c21f0, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.451434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.464050 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4403/8777] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:35:57 2022] PUT /identity/v3/projects/2a644ed47697405892e78805d99bb208/users/4f07016fbd9b4ae49f66876abb1c21f0/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:57.468237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.478652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62171-67c8-4b88-a1c4-cd7ca4d9fd61 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.534123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208e163-a65b-4690-9b3f-316d0eec0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.534833 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208e163-a65b-4690-9b3f-316d0eec0647 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.535128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208e163-a65b-4690-9b3f-316d0eec0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.535410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208e163-a65b-4690-9b3f-316d0eec0647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.536133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208e163-a65b-4690-9b3f-316d0eec0647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.537729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208e163-a65b-4690-9b3f-316d0eec0647 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.547892 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4375/8778] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:35:57.552043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.562829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caac88-164d-4118-aa96-f73b303fd997 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.567405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14484abb-7194-4fe6-9245-9cad521fd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.568277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484abb-7194-4fe6-9245-9cad521fd549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.568557 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484abb-7194-4fe6-9245-9cad521fd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.568832 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484abb-7194-4fe6-9245-9cad521fd549 admin admin] PATH_INFO: `/v3/projects/2a644ed47697405892e78805d99bb208/users/4f07016fbd9b4ae49f66876abb1c21f0/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.570830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14484abb-7194-4fe6-9245-9cad521fd549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a644ed47697405892e78805d99bb208, user_id=4f07016fbd9b4ae49f66876abb1c21f0, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.573432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14484abb-7194-4fe6-9245-9cad521fd549 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.583399 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4404/8779] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:35:57 2022] PUT /identity/v3/projects/2a644ed47697405892e78805d99bb208/users/4f07016fbd9b4ae49f66876abb1c21f0/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:35:57.593696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.594001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.594306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.621045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] MFA Rules not processed for user `4f07016fbd9b4ae49f66876abb1c21f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:57.622258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:57.689119 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4376/8780] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:57.701224 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801d6ec-a021-4ac0-a9d0-0c4f531c5709 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.701701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801d6ec-a021-4ac0-a9d0-0c4f531c5709 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.701701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801d6ec-a021-4ac0-a9d0-0c4f531c5709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.719229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d801d6ec-a021-4ac0-a9d0-0c4f531c5709 None None] MFA Rules not processed for user `7fa7a99219b2428cadfbeb35c383e387`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:57.720420 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d801d6ec-a021-4ac0-a9d0-0c4f531c5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:57.729844 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:57.774905 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4405/8781] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:35:57.787843 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.789591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:57.802875 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:57.893648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80667-502a-4b11-a292-b394547cdb85 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.900137 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.900785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.901072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.901352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.909044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.910667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.919676 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4377/8782] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:35:58.367542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:58.367981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:58.368298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:58.408417 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:58.409651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:58.473224 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4406/8783] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:35:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:35:58.484670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:58.486096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:58.503310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4f42-0ebd-4638-b58e-36b258aede97 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:58.508237 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132176a5-67f5-4b9b-b334-f6934698282e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:58.509433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132176a5-67f5-4b9b-b334-f6934698282e service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:58.509718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132176a5-67f5-4b9b-b334-f6934698282e service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:58.509993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132176a5-67f5-4b9b-b334-f6934698282e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:58.518241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132176a5-67f5-4b9b-b334-f6934698282e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:58.519835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132176a5-67f5-4b9b-b334-f6934698282e service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:58.530148 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4378/8784] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:35:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:08.464340 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=53 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.526001 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=48 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:10.145978 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:10.161765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33aeca-11e2-4ca1-9785-256fcb0d8f81 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:10.169008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:10.169746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.170052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.170536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.179434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:10.181020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:10.195382 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4407/8785] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:10.203991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8b9ae-24c3-44cb-81c6-b9eefd63b651 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.204435 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8b9ae-24c3-44cb-81c6-b9eefd63b651 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.204545 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8b9ae-24c3-44cb-81c6-b9eefd63b651 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.205923 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4379/8786] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:10.210362 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:36:10.225178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:10.233988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083ba89-2624-4442-8f56-b5dbe301b8b4 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:10.238611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f07016fbd9b4ae49f66876abb1c21f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a644ed47697405892e78805d99bb208', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:10.239451 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.239739 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.240018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] PATH_INFO: `/v3/projects/2a644ed47697405892e78805d99bb208` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.241219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] RBAC: Authorizing `identity:get_project(project_id=2a644ed47697405892e78805d99bb208)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:10.243073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:10.244756 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4408/8787] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:36:10 2022] GET /identity/v3/projects/2a644ed47697405892e78805d99bb208 => generated 391 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:10.539394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea03f18-9afc-496f-9f56-79d692a03154 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.539765 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea03f18-9afc-496f-9f56-79d692a03154 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.540050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea03f18-9afc-496f-9f56-79d692a03154 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.541467 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4380/8788] 10.222.0.77 () {54 vars in 912 bytes} [Mon Jul 11 15:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:10.546180 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] Authenticating service token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 11 15:36:10.547871 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:10.567334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:10.576889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02fef4-1200-41a1-aabd-c2608fae27f9 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:10.581468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f07016fbd9b4ae49f66876abb1c21f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a644ed47697405892e78805d99bb208', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:10.582366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.582679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.582955 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] PATH_INFO: `/v3/projects/2a644ed47697405892e78805d99bb208` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.584169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] RBAC: Authorizing `identity:get_project(project_id=2a644ed47697405892e78805d99bb208)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:10.585947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:10.587694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4409/8789] 10.222.0.77 () {58 vars in 1443 bytes} [Mon Jul 11 15:36:10 2022] GET /identity/v3/projects/2a644ed47697405892e78805d99bb208 => generated 391 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:10.740649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.740861 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.741140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.759783 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:10.761597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:10.812543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4381/8790] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Jul 11 15:36:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:10.818437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:10.829098 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06219-a99f-43c7-b612-681a3ca90040 tempest-ServersAdminNegativeTestJSON-809038938 tempest-ServersAdminNegativeTestJSON-809038938-project-admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:10.832738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:10.833409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.833696 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.833975 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.835804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:10.848504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:10.849960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f3497-e945-42fc-a0bb-2f05a204cac9 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:10.860791 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4410/8791] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:14.611817 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.674437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5afb91-33a9-4a39-969d-39bf365e80e0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.679028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.679899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.680189 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.680472 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] PATH_INFO: `/v3/users/7fa7a99219b2428cadfbeb35c383e387` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.681673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa7a99219b2428cadfbeb35c383e387)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.683630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.728450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa7a99219b2428cadfbeb35c383e387'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:14.740535 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa7a99219b2428cadfbeb35c383e387'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:14.747253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa7a99219b2428cadfbeb35c383e387'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:14.754539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa7a99219b2428cadfbeb35c383e387'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:14.755159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa7a99219b2428cadfbeb35c383e387'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:14.761419 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4382/8792] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:36:14 2022] DELETE /identity/v3/users/7fa7a99219b2428cadfbeb35c383e387 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:14.765970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.766533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.766642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.784608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:14.785820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:14.847051 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4411/8793] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:14.856781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.858331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:14.891437 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.918022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92dd72-44da-4c0e-b1d4-6f21b78b65df admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.921720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.922361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.922685 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.922972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.932012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.933433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.943156 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4383/8794] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:15.114713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.116320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.135617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e27d-2e79-4844-bb99-b920f88472dc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.140724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.141563 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.141846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.142185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] PATH_INFO: `/v3/projects/0c5539c55a9644b5a31f3d2f489ff723` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.143352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5539c55a9644b5a31f3d2f489ff723)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.145265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.192046 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5539c55a9644b5a31f3d2f489ff723', 'request_id': 'req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.200340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5539c55a9644b5a31f3d2f489ff723', 'request_id': 'req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.207337 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5539c55a9644b5a31f3d2f489ff723', 'request_id': 'req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.218869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] The token cache is being invalidate because project 0c5539c55a9644b5a31f3d2f489ff723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:36:15.219156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.219788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.221340 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4412/8795] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:36:15 2022] DELETE /identity/v3/projects/0c5539c55a9644b5a31f3d2f489ff723 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:15.225532 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.235063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd43f88-ca1d-40f9-b119-11a965d25015 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.291387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.292255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.292536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.292809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] PATH_INFO: `/v3/users/4f07016fbd9b4ae49f66876abb1c21f0` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.294004 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f07016fbd9b4ae49f66876abb1c21f0)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.295948 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.341135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f07016fbd9b4ae49f66876abb1c21f0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.353159 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f07016fbd9b4ae49f66876abb1c21f0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.360362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f07016fbd9b4ae49f66876abb1c21f0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.367388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f07016fbd9b4ae49f66876abb1c21f0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.368005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-53210c3b-4f0c-4218-8880-af3beac0e2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f07016fbd9b4ae49f66876abb1c21f0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.374450 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4384/8796] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:36:15 2022] DELETE /identity/v3/users/4f07016fbd9b4ae49f66876abb1c21f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:15.640156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.641627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.654914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e86b4-2ef7-4bff-886b-1d8c3412a561 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.696545 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.716603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.717728 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.718022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.718304 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] PATH_INFO: `/v3/projects/2a644ed47697405892e78805d99bb208` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.719534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a644ed47697405892e78805d99bb208)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.721441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.768773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a644ed47697405892e78805d99bb208', 'request_id': 'req-1291bc5d-fad9-4e0f-a142-beadd402ccb5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.775881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a644ed47697405892e78805d99bb208', 'request_id': 'req-1291bc5d-fad9-4e0f-a142-beadd402ccb5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.781542 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a644ed47697405892e78805d99bb208', 'request_id': 'req-1291bc5d-fad9-4e0f-a142-beadd402ccb5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.793238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] The token cache is being invalidate because project 2a644ed47697405892e78805d99bb208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:36:15.793529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.794164 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-1291bc5d-fad9-4e0f-a142-beadd402ccb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:36:15.795733 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4413/8797] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:36:15 2022] DELETE /identity/v3/projects/2a644ed47697405892e78805d99bb208 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:15.801648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.802123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.802235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.820173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:15.821390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.865301 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.890253 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4385/8798] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:36:15.895490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.895788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.896073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.917340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:15.918573 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.927003 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4414/8799] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:15.931032 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.942050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a54a7-fb62-467d-8a3b-8337a6a18ae4 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.947041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.947710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.947998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.948280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.949017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:15.949328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.951251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.964070 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4386/8800] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:15.969217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.981009 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f68eb-4978-4ed0-9ddd-bc0bd9ee188c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.987283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.987990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.988281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.988543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.989232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.991165 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.019286 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4415/8801] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:36:16.023523 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.034425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd57d79-08cf-4091-8001-7c493a2e1d2d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.092359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.093075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.093363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.093643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.094328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.096278 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.117321 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4387/8802] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:36:16 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:36:16.121554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.132299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0145026-b760-4322-989b-5a941b8a00b8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.137937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.138643 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.138930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.139208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.139936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.151454 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.162712 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4416/8803] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:36:16.167414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.177504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4caca1-763b-4318-a35b-fe0c6550ea5f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.182162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311fbbd-a42f-4765-a5ce-0dc54e20d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.182847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311fbbd-a42f-4765-a5ce-0dc54e20d9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.183140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311fbbd-a42f-4765-a5ce-0dc54e20d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.183422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311fbbd-a42f-4765-a5ce-0dc54e20d9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.184150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311fbbd-a42f-4765-a5ce-0dc54e20d9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.185752 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311fbbd-a42f-4765-a5ce-0dc54e20d9cf admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.195485 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4388/8804] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:36:16.199455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.209401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2d0f1-50fe-417f-afe6-3e2bfa39bed2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.214608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.215475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.215777 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.216056 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] PATH_INFO: `/v3/projects/22f37f5949154869a7e4f5e7499fdb9a/users/866627ae4b4c441ba15a277284fd8e71/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.231228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f37f5949154869a7e4f5e7499fdb9a, user_id=866627ae4b4c441ba15a277284fd8e71, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.233868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.246325 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4417/8805] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:36:16 2022] PUT /identity/v3/projects/22f37f5949154869a7e4f5e7499fdb9a/users/866627ae4b4c441ba15a277284fd8e71/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:16.251373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ecf9-b492-4925-9ee9-a48e86e88a5f None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.251675 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ecf9-b492-4925-9ee9-a48e86e88a5f None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.251963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ecf9-b492-4925-9ee9-a48e86e88a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.271132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-46f2ecf9-b492-4925-9ee9-a48e86e88a5f None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:16.272345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-46f2ecf9-b492-4925-9ee9-a48e86e88a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:16.330292 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4389/8806] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:16.340406 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.342397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:16.399821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33888-3473-4d76-b0ec-30e653c49d88 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.404211 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5355c82-16f6-47c0-9678-418388fb14e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.404773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5355c82-16f6-47c0-9678-418388fb14e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.405060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5355c82-16f6-47c0-9678-418388fb14e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.405338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5355c82-16f6-47c0-9678-418388fb14e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.414348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5355c82-16f6-47c0-9678-418388fb14e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.415807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5355c82-16f6-47c0-9678-418388fb14e9 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.425283 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4418/8807] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:20.394247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.394767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.394913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.423133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] MFA Rules not processed for user `866627ae4b4c441ba15a277284fd8e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:20.424970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.475592 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.500545 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4390/8808] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:36:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:20.513710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b979-245d-4257-8634-dba7e4029084 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.514258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b979-245d-4257-8634-dba7e4029084 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.514258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b979-245d-4257-8634-dba7e4029084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.532951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b825b979-245d-4257-8634-dba7e4029084 None None] MFA Rules not processed for user `866627ae4b4c441ba15a277284fd8e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:20.534209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b825b979-245d-4257-8634-dba7e4029084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.541618 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4419/8809] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:36:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:20.554790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.556487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.636841 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70c8bf-f412-4321-9390-a409e17e2eb3 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.643712 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.644367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.644649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.644926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.654402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:20.656034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:20.667378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4391/8810] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:20.703629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f8fc-06a0-4f4f-945d-eb2ef2c7caec None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.703927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f8fc-06a0-4f4f-945d-eb2ef2c7caec None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.704213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f8fc-06a0-4f4f-945d-eb2ef2c7caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.710166 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.774844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-0a16f8fc-06a0-4f4f-945d-eb2ef2c7caec None None] MFA Rules not processed for user `f2258fe4b6c14d378fcfdd1fb690f179`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:20.777299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0a16f8fc-06a0-4f4f-945d-eb2ef2c7caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.842270 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4420/8811] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Jul 11 15:36:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:20.848400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.858766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db19ff3-d6e9-4844-8594-c9e7cbd9aa06 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.862418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.863663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.863957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.864238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.866058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.886038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:20.887555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:20.902742 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4392/8812] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:21.440028 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.440453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.440837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.450586 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.452136 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:21.459748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:21.460945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:21.464402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81617bb3-77b2-42fc-973a-d83b005d5faa service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.468502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.469043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.469364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.469796 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.471661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:21.489319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.490923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.505660 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4393/8813] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:36:21.539323 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4421/8814] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:36:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:21.550996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.552471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:21.569299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64c289-c78d-46ec-9d5d-5aaf1a2fdf10 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.574958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb5c12-95ed-4113-8fa3-b8803b9751f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.575605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5c12-95ed-4113-8fa3-b8803b9751f9 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.575900 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5c12-95ed-4113-8fa3-b8803b9751f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.576179 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5c12-95ed-4113-8fa3-b8803b9751f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.585084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb5c12-95ed-4113-8fa3-b8803b9751f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.586731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb5c12-95ed-4113-8fa3-b8803b9751f9 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.597711 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4394/8815] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:31.530457 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=66 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:31.593469 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=58 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.341447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.350966 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85c21a-6de0-4287-8166-eb861238b4cd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.354591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.355238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.355524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.355803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.357596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:32.370772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.372223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc7bc1-2d78-49de-ba25-6af5825e2e9a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.383913 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4422/8816] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:32.489839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c255f9-5bee-4f82-800a-828f846640ad None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.490125 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c255f9-5bee-4f82-800a-828f846640ad None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.490412 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c255f9-5bee-4f82-800a-828f846640ad None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.491860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4395/8817] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:32.497878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.498196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.498478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.517293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:32.518558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:32.527141 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4423/8818] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:36:32.547158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c255f9-5bee-4f82-800a-828f846640ad None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.548945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4c255f9-5bee-4f82-800a-828f846640ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:32.568493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c255f9-5bee-4f82-800a-828f846640ad None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.574187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.574859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.575145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.575428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.583695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.585325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.595152 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4396/8819] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:32.754754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.765268 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5cafc-ee70-45c9-816f-f85e6c72082a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.769111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.769764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.770162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.770470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.772324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:32.788713 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.790177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.804175 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4424/8820] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:36:42.590867 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:42.796729 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=15 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.580737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.592215 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76f14-b71f-4343-b68b-4aa0af98f176 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.601075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.601968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.602260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.602576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] PATH_INFO: `/v3/users/866627ae4b4c441ba15a277284fd8e71` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.603807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866627ae4b4c441ba15a277284fd8e71)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.605746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.660225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866627ae4b4c441ba15a277284fd8e71'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:12.672345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866627ae4b4c441ba15a277284fd8e71'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:12.679156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866627ae4b4c441ba15a277284fd8e71'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:12.694177 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866627ae4b4c441ba15a277284fd8e71'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:12.694897 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-c2edce99-6070-4cfc-97ce-5b1778d70e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866627ae4b4c441ba15a277284fd8e71'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:12.701383 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4397/8821] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:37:12 2022] DELETE /identity/v3/users/866627ae4b4c441ba15a277284fd8e71 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:12.880276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.891248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7639c8-a74f-41c5-ad5f-7740c5c3e951 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.947961 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.948817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.949106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.949388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] PATH_INFO: `/v3/projects/22f37f5949154869a7e4f5e7499fdb9a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.950674 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f37f5949154869a7e4f5e7499fdb9a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.952583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.000067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f37f5949154869a7e4f5e7499fdb9a', 'request_id': 'req-d05d8ed9-5862-4365-9ca6-704b184234b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:13.007078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f37f5949154869a7e4f5e7499fdb9a', 'request_id': 'req-d05d8ed9-5862-4365-9ca6-704b184234b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:13.013327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f37f5949154869a7e4f5e7499fdb9a', 'request_id': 'req-d05d8ed9-5862-4365-9ca6-704b184234b4'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:13.024421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] The token cache is being invalidate because project 22f37f5949154869a7e4f5e7499fdb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:37:13.024707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:13.025330 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d05d8ed9-5862-4365-9ca6-704b184234b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:37:13.026942 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4425/8822] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:37:12 2022] DELETE /identity/v3/projects/22f37f5949154869a7e4f5e7499fdb9a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:13.032438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.032741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.033055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.051951 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:13.053169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:13.112386 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4398/8823] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:37:13.119951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.120239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.120605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.139745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:13.140883 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:13.148805 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4426/8824] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:37:13.152884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.162575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aff0-3def-4af0-968d-ce4d801f03f0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.167056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.167696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.167979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.168253 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.168967 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:13.169300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.170906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.182374 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4399/8825] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.187010 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.196331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec9abd-e17c-464b-b791-c4e32286b676 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.201609 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.202260 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.202579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.202861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.203547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.205443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.239923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4427/8826] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:37:13 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:13.244173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.254913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae67e0-d7e9-4329-bb1c-8d2ad0c82cf2 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.311701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.312369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.312658 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.312938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.313621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.315587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.322085 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.337842 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4400/8827] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:37:13 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:13.341897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.352599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c230ebf-a29f-444a-ab2b-65d35331c6d2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.357767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.358426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.358748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.359033 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.359780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.361360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.371165 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4428/8828] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:37:13.375659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.386110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5376d1c-a5c4-41db-861f-f784e5b5546f admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.391408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d0e3-654e-4f23-baa4-bccd99fe206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.392002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d0e3-654e-4f23-baa4-bccd99fe206d admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.392295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d0e3-654e-4f23-baa4-bccd99fe206d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.392584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d0e3-654e-4f23-baa4-bccd99fe206d admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.393350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d0e3-654e-4f23-baa4-bccd99fe206d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.395033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d0e3-654e-4f23-baa4-bccd99fe206d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.405280 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4401/8829] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:37:13.409413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.419989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45a44-b5a1-474e-8502-7af31335874e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.424718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.425592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.425881 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.426163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] PATH_INFO: `/v3/projects/bf3515cde26f44a89af4c6c47844f8f3/users/ad4d44e780a94459aef404829badbe2b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.441583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3515cde26f44a89af4c6c47844f8f3, user_id=ad4d44e780a94459aef404829badbe2b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.444289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.456783 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4429/8830] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:37:13 2022] PUT /identity/v3/projects/bf3515cde26f44a89af4c6c47844f8f3/users/ad4d44e780a94459aef404829badbe2b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:13.461941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115399-ff48-4016-b4c6-fad836459569 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.462241 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115399-ff48-4016-b4c6-fad836459569 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.462563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115399-ff48-4016-b4c6-fad836459569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.480255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7d115399-ff48-4016-b4c6-fad836459569 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:13.481953 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7d115399-ff48-4016-b4c6-fad836459569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:13.539713 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4402/8831] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:37:13.549930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.551677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:13.572247 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.612382 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b0cc-1e1f-4011-9528-bf66d664bb0a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.616054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957af8e-18af-4725-bc6b-5a0ec655da9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.616705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957af8e-18af-4725-bc6b-5a0ec655da9c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.616996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957af8e-18af-4725-bc6b-5a0ec655da9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.617279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957af8e-18af-4725-bc6b-5a0ec655da9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.626242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957af8e-18af-4725-bc6b-5a0ec655da9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.627710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957af8e-18af-4725-bc6b-5a0ec655da9c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.637138 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4430/8832] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:17.616571 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.617098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.617239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.652649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] MFA Rules not processed for user `ad4d44e780a94459aef404829badbe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:17.654066 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:17.734549 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4403/8833] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:37:17.742776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.743367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.743703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.784894 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] MFA Rules not processed for user `ad4d44e780a94459aef404829badbe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:17.787348 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:17.799332 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4431/8834] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:37:17.811695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:17.813133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:17.902904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe321a7-4918-4a92-91f6-d5dcac90f229 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:17.909002 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9f4d-7d9c-445c-8532-cecdcf369d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.909668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9f4d-7d9c-445c-8532-cecdcf369d75 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.909954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9f4d-7d9c-445c-8532-cecdcf369d75 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.910230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9f4d-7d9c-445c-8532-cecdcf369d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.915305 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:17.919805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9f4d-7d9c-445c-8532-cecdcf369d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.922519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9f4d-7d9c-445c-8532-cecdcf369d75 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.932836 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4404/8835] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:37:21.107523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.134460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc8d7-c9c9-489c-ad5f-5bbad98cf2b7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.153349 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.154184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.154592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.154882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.157090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:21.177947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.186055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38fdd6-249a-4de2-b6e5-a9597ad2a57b service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.234178 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4432/8836] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:27.928236 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.184317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ce71-67aa-4063-bd60-62d35fa7d2b0 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.185576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ce71-67aa-4063-bd60-62d35fa7d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.185576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ce71-67aa-4063-bd60-62d35fa7d2b0 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.186875 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4405/8837] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:29.191830 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.192314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.192632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.211190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:29.212511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:29.277354 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4433/8838] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:37:29.297500 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ce71-67aa-4063-bd60-62d35fa7d2b0 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.299188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f6a5ce71-67aa-4063-bd60-62d35fa7d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:29.318588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ce71-67aa-4063-bd60-62d35fa7d2b0 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.323552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.324184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.324473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.324755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.333335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.334941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.345613 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4406/8839] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:39.268045 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=56 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:39.340614 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.962525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.972680 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec3f00-9d48-4023-a897-253c28128994 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.976331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.976971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.977258 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.977539 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.979355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:57.992012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.993431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.003847 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4434/8840] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:37:58.410402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.425901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86142bfe-3c1d-4c79-9e20-4be9ebc7f49b service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.431541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.432195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.432486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.432772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.434591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:58.450222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.453083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeded47-0f01-4de5-96cb-eddf36aa2611 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.471239 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4407/8841] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:38:00.636146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.637675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:00.648930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e843b3-661e-465e-a790-ed4f870fc448 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.652719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.653368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.653657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.653940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.655746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:00.668077 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.669572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f878f-4a22-4673-9069-7814c5000f63 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.680513 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4435/8842] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:05.458871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f57f8-11d3-4b54-bf67-6ae8ebe6d6cb None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:05.459386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f57f8-11d3-4b54-bf67-6ae8ebe6d6cb None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:05.459519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f57f8-11d3-4b54-bf67-6ae8ebe6d6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:05.478519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2f1f57f8-11d3-4b54-bf67-6ae8ebe6d6cb None None] MFA Rules not processed for user `ad4d44e780a94459aef404829badbe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:05.479724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2f1f57f8-11d3-4b54-bf67-6ae8ebe6d6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:05.487527 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4408/8843] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:10.674099 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=12 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:15.473111 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:15.810352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd62afe-18f4-4684-aa4c-bb51eda219be None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.810896 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd62afe-18f4-4684-aa4c-bb51eda219be None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.811086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd62afe-18f4-4684-aa4c-bb51eda219be None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.812603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4436/8844] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:15.819041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.819337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.819645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.848569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:15.849782 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:15.858381 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4409/8845] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:15.880086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd62afe-18f4-4684-aa4c-bb51eda219be None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:15.881820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-5dd62afe-18f4-4684-aa4c-bb51eda219be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:15.902861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd62afe-18f4-4684-aa4c-bb51eda219be None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:15.908121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8524-270f-4738-9c45-f746b633730b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:15.909017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8524-270f-4738-9c45-f746b633730b service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.909518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8524-270f-4738-9c45-f746b633730b service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.909789 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8524-270f-4738-9c45-f746b633730b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.918502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8524-270f-4738-9c45-f746b633730b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:15.920126 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8524-270f-4738-9c45-f746b633730b service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:15.932194 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4437/8846] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:25.843347 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=7 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:25.927016 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:56.802621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:56.817040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebbf6c-7a82-4580-a5df-bae2552211c1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:56.823257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:56.824039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:56.824331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:56.824612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:56.826642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:56.842759 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:56.844373 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:56.861305 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4410/8847] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:38:56.872263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8524-270f-4738-9c45-f746b633730b service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:56.886893 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8524-270f-4738-9c45-f746b633730b service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:56.891671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:56.892787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:56.893020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:56.893302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] PATH_INFO: `/v3/users/ad4d44e780a94459aef404829badbe2b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:56.894591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4d44e780a94459aef404829badbe2b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:56.896578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:56.946412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4d44e780a94459aef404829badbe2b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:56.947065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4d44e780a94459aef404829badbe2b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:56.959577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4d44e780a94459aef404829badbe2b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:56.960208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4d44e780a94459aef404829badbe2b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:56.966995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d12b210f-21cb-435b-b225-1c689faf9163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4d44e780a94459aef404829badbe2b'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:56.980035 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4438/8848] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:38:56 2022] DELETE /identity/v3/users/ad4d44e780a94459aef404829badbe2b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:57.148632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.160184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cead91-af9a-4c6d-9c12-98f11dc58307 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.215214 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.216019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.216304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.216580 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] PATH_INFO: `/v3/projects/bf3515cde26f44a89af4c6c47844f8f3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.217806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3515cde26f44a89af4c6c47844f8f3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.219743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.265893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3515cde26f44a89af4c6c47844f8f3', 'request_id': 'req-95e8a655-5da2-48ff-8d8a-12eef17d3c11'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:57.271883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3515cde26f44a89af4c6c47844f8f3', 'request_id': 'req-95e8a655-5da2-48ff-8d8a-12eef17d3c11'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:57.279180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3515cde26f44a89af4c6c47844f8f3', 'request_id': 'req-95e8a655-5da2-48ff-8d8a-12eef17d3c11'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:57.290546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] The token cache is being invalidate because project bf3515cde26f44a89af4c6c47844f8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:38:57.290835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:57.291461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-95e8a655-5da2-48ff-8d8a-12eef17d3c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:38:57.292993 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4411/8849] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:38:57 2022] DELETE /identity/v3/projects/bf3515cde26f44a89af4c6c47844f8f3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:57.298093 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.298381 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.298703 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.317162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:57.318432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:57.375972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4439/8850] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:57.384352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.384647 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.384929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.403331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:57.404525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:57.412622 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4412/8851] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:57.416745 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.426378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a29db-76eb-44f8-9d09-5ab539eb6bb9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.431110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.431765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.432053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.432332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.433074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:57.433384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.435015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.446937 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4440/8852] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:57.451082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.460922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e632b-fb7b-46dc-8170-6dd0378f2897 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.465669 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.466258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.466587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.466871 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.467561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.469461 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.494784 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4413/8853] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:38:57 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:57.498987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.509486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392486-1fa5-4677-89c2-ee55d8021d22 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.564532 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.565716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.566013 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.566291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.566999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.568915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.575473 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:57.592212 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4441/8854] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:38:57 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:57.594705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.605310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31b5f-ad8f-4d9b-8159-0b50373ecc33 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.610102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.610806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.611092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.611372 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.612127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.613719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.625348 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4414/8855] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:38:57.629810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.639748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d7846-46ef-443b-b7e1-209b2eb4d750 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.645022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4a8db-ed90-4bf9-b016-7a2bc5eff929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.645675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a8db-ed90-4bf9-b016-7a2bc5eff929 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.645962 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a8db-ed90-4bf9-b016-7a2bc5eff929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.646241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a8db-ed90-4bf9-b016-7a2bc5eff929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.646994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4a8db-ed90-4bf9-b016-7a2bc5eff929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.648572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4a8db-ed90-4bf9-b016-7a2bc5eff929 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.658280 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4442/8856] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:38:57.662338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.672114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24989-5232-4df2-b327-e6e08b3b7cc7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.677338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.678203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.678488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.678788 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] PATH_INFO: `/v3/projects/b8b6878bf34b4096a11df12ccab2c1a3/users/f2b7bc99f1604a35b33df0bdb8713099/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.693984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b6878bf34b4096a11df12ccab2c1a3, user_id=f2b7bc99f1604a35b33df0bdb8713099, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.696690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.709024 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4415/8857] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:38:57 2022] PUT /identity/v3/projects/b8b6878bf34b4096a11df12ccab2c1a3/users/f2b7bc99f1604a35b33df0bdb8713099/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:38:57.714114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15e4f-fbbc-46bb-ad1a-3f6b418cdeec None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.714412 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15e4f-fbbc-46bb-ad1a-3f6b418cdeec None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.714724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15e4f-fbbc-46bb-ad1a-3f6b418cdeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.732583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-17e15e4f-fbbc-46bb-ad1a-3f6b418cdeec None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:57.733723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17e15e4f-fbbc-46bb-ad1a-3f6b418cdeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:57.791087 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4443/8858] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:38:57.801057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:57.802862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:57.817595 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:57.861026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff4f6-07d4-4b91-a99d-f487d32acf60 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:57.865235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:57.865876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:57.866162 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:57.866441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:57.875327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:57.876761 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:57.886717 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4416/8859] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:39:01.960815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceb27d-ebce-4df2-87c7-5bac2297176c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:01.961288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceb27d-ebce-4df2-87c7-5bac2297176c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:01.961376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceb27d-ebce-4df2-87c7-5bac2297176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:01.991889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-79ceb27d-ebce-4df2-87c7-5bac2297176c None None] MFA Rules not processed for user `f2b7bc99f1604a35b33df0bdb8713099`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:01.993124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-79ceb27d-ebce-4df2-87c7-5bac2297176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:02.069048 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4444/8860] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:39:02.083382 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:02.084823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:02.164929 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cbfb4-8c24-44c1-83d0-0465e5f5c3f9 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:02.170402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:02.171081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:02.171369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:02.171650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:02.180171 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:02.181767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:02.190811 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4417/8861] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:39:03.473665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60498714-a9f9-44e5-9fbe-79da38ba36c2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:03.474212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60498714-a9f9-44e5-9fbe-79da38ba36c2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:03.474212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60498714-a9f9-44e5-9fbe-79da38ba36c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:03.491428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-60498714-a9f9-44e5-9fbe-79da38ba36c2 None None] MFA Rules not processed for user `f2b7bc99f1604a35b33df0bdb8713099`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:03.492627 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-60498714-a9f9-44e5-9fbe-79da38ba36c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:03.499524 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4445/8862] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:39:12.186654 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=54 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:12.730236 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:12.731750 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:12.749644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba27d-6ca5-4d94-9fc2-543e7e13a97d service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:12.755859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:12.756851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:12.756851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:12.757053 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:12.758870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:12.780358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:12.781952 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490947db-4cbf-4b9b-a709-dfc78a241670 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:12.795543 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4418/8863] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:39:13.486203 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:22.788198 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:52.975257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc8e6-ee30-4cb5-b5cb-4f55f044a02e None None] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:52.975834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc8e6-ee30-4cb5-b5cb-4f55f044a02e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:52.975942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc8e6-ee30-4cb5-b5cb-4f55f044a02e None None] PATH_INFO: `/` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:52.977282 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4446/8864] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:39:52.982323 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:52.982850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:52.982998 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:53.005083 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:53.006872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:53.076309 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4419/8865] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:39:53.097047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dc8e6-ee30-4cb5-b5cb-4f55f044a02e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:53.099104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ff2dc8e6-ee30-4cb5-b5cb-4f55f044a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:53.118724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dc8e6-ee30-4cb5-b5cb-4f55f044a02e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:53.123809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f92a-ec76-40b5-af81-9a5717b8c77d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:53.124449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f92a-ec76-40b5-af81-9a5717b8c77d service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:53.124738 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f92a-ec76-40b5-af81-9a5717b8c77d service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:53.125020 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f92a-ec76-40b5-af81-9a5717b8c77d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:53.134038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f92a-ec76-40b5-af81-9a5717b8c77d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:53.135656 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f92a-ec76-40b5-af81-9a5717b8c77d service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:53.145362 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4447/8866] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:39:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:40:03.066343 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=29 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:03.141201 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:14.333598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:14.335098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:14.350760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020a1e-8e5c-4970-a6da-937f85b144da None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:14.355692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:14.356329 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:14.356616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:14.356895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:14.358657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:14.373206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:14.374818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:14.388339 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4420/8867] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:40:16.390723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:16.391199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:16.391410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:16.410614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] MFA Rules not processed for user `f2b7bc99f1604a35b33df0bdb8713099`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:16.412393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:16.419715 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4448/8868] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:40:17.724249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:17.738068 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a32e-c921-4c86-b784-5c08f6dca396 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:17.743686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:17.744314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:17.744599 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:17.744876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:17.746635 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:17.760433 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:17.762280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4a6e9-1214-4ef4-80f6-5c37c006d44c service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:17.774418 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4421/8869] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:40:26.405733 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:27.767988 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=12 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:21.731390 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:21.740927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a505e-04ce-4a45-9f9b-c6ae2b275c8c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:21.744577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:21.745214 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:21.745498 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:21.745776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:21.747577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:21.763270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:21.764672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c3e9-991d-4989-9111-cc9d9fae2810 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:21.778648 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4449/8870] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:22.171005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19b15-e11c-4513-9baa-33c4e7fac61c None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:22.171519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19b15-e11c-4513-9baa-33c4e7fac61c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:22.171630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19b15-e11c-4513-9baa-33c4e7fac61c None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:22.173238 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4422/8871] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:22.178233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:22.178577 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:22.178903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:22.198109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:22.199354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:22.208044 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4450/8872] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:22.230206 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e19b15-e11c-4513-9baa-33c4e7fac61c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:22.252905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e19b15-e11c-4513-9baa-33c4e7fac61c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:22.258892 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:22.259537 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:22.259828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:22.260104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:22.268679 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:22.270244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:22.280524 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4423/8873] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:22.490567 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:22.504289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f2f27-c6e8-4cee-bc2a-bfd715fcb2bd None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:22.510001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:22.510677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:22.510967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:22.511247 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:22.512993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:22.524111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:22.525704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef6eb-ef62-43fc-acad-10487947a9e7 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:22.535434 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4451/8874] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:23.270338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:23.271885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:23.284850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508e8ca-5ac6-41b5-a02b-61d618800177 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:23.288779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:23.289417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:23.289704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:23.289981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:23.291727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:23.308234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:23.309653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:23.324882 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4424/8875] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:27.441667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3fca-37cb-486c-9d34-b0fe32140ea8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.442201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3fca-37cb-486c-9d34-b0fe32140ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.442305 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3fca-37cb-486c-9d34-b0fe32140ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.460340 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-305c3fca-37cb-486c-9d34-b0fe32140ea8 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:27.461613 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-305c3fca-37cb-486c-9d34-b0fe32140ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:27.470675 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4452/8876] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Jul 11 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:27.483144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:27.497516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269247ef-134e-4342-b79f-625a46f1fb37 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:27.502520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:27.503170 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.503465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.503748 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.512261 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:27.513837 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:27.524139 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4425/8877] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:30.699303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcac87-8f9d-4af7-b13b-89c96ec4dda7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.699889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcac87-8f9d-4af7-b13b-89c96ec4dda7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.699981 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcac87-8f9d-4af7-b13b-89c96ec4dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.718322 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-10bcac87-8f9d-4af7-b13b-89c96ec4dda7 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:30.719704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-10bcac87-8f9d-4af7-b13b-89c96ec4dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:30.729398 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4453/8878] 10.222.0.84 () {58 vars in 1015 bytes} [Mon Jul 11 15:41:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:30.742622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:30.755547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d3bad-3cf9-4400-808e-40e3df20a1b4 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:30.761235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:30.761876 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.762168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.762454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.771287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:30.773403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:30.783872 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4426/8879] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:36.188040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7846e3a-882c-4838-915b-273738574e05 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:36.188484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7846e3a-882c-4838-915b-273738574e05 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:36.188588 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7846e3a-882c-4838-915b-273738574e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:36.205862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c7846e3a-882c-4838-915b-273738574e05 None None] MFA Rules not processed for user `f2b7bc99f1604a35b33df0bdb8713099`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:36.207104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c7846e3a-882c-4838-915b-273738574e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:36.213965 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4454/8880] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:36.515544 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:36.526524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ac40-7653-4603-a7df-d3063dfe48f1 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:36.530127 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:36.530807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:36.531096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:36.531375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:36.533145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:36.545785 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:36.547231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:36.557720 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4427/8881] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:36.879994 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52431-043b-4541-a384-97d6670d482e None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:36.880311 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52431-043b-4541-a384-97d6670d482e None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:36.880622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52431-043b-4541-a384-97d6670d482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:36.900672 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-02d52431-043b-4541-a384-97d6670d482e None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:36.901892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-02d52431-043b-4541-a384-97d6670d482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:36.910754 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4455/8882] 10.222.0.77 () {58 vars in 1057 bytes} [Mon Jul 11 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:36.916739 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:36.928726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6704a38-7f20-4257-aaa9-77fbd2bf80a1 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:36.933722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:36.934386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:36.934716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:36.935022 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:36.936805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:36.948923 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:36.950547 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de169a-a353-4c29-9d5a-e8f102c25788 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:36.960899 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4428/8883] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:46.894695 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=27 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:46.956114 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=36 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:20.584495 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52431-043b-4541-a384-97d6670d482e None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:20.596287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52431-043b-4541-a384-97d6670d482e None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:20.601000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:20.601921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:20.601921 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:20.602209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:20.604170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:20.618262 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:20.619748 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfb95c-c3c8-45bf-b27c-3394539ec70b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:20.632669 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4456/8884] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:20.712807 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c609b43-2233-40e9-ad2b-b93a24ea2981 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:20.713733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c609b43-2233-40e9-ad2b-b93a24ea2981 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:20.714239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c609b43-2233-40e9-ad2b-b93a24ea2981 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:20.715969 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4429/8885] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:20.721128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:20.721424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:20.721704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:20.743271 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:20.745244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:20.754741 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4457/8886] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:20.782649 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c609b43-2233-40e9-ad2b-b93a24ea2981 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:20.795879 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c609b43-2233-40e9-ad2b-b93a24ea2981 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:20.801176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:20.801820 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:20.802104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:20.802383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:20.813109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:20.814893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:20.826082 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4430/8887] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:21.001263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:21.011695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363c10-27f1-4e20-85d8-a4e49d1936f9 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:21.015711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:21.016460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:21.016860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:21.017125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:21.019436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:21.036986 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:21.039049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd3e2d-0f22-4d8d-841b-1c07203d5c4a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:21.055581 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4458/8888] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:30.820967 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:31.049249 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=15 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:40.206199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:40.222779 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13999e2d-ab1c-49b8-8c0b-49e4123b7ead service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:40.230074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:40.230766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:40.231055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:40.231332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:40.233363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:40.248839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:40.251430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:40.265998 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4431/8889] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:50.257896 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:54.346605 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:54.347074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:54.347169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:54.365184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] MFA Rules not processed for user `f2b7bc99f1604a35b33df0bdb8713099`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:54.366387 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:54.373882 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4459/8890] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:42:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:54.676735 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:54.686391 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d0d5-be49-4324-b2f3-9b237733b090 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:54.689984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:54.690670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:54.690961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:54.691243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:54.693028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:54.705504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:54.706969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:54.717416 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4432/8891] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:01.949345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:01.959405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a86c9b-7861-4074-9e36-567083152f11 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:01.963073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:01.963717 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:01.964006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:01.964285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:01.968059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:01.981614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:01.983267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be749777-1eae-497a-8417-1b437c11d0ab service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:01.994727 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4460/8892] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:04.711374 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:05.524490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:05.541154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2241fc9-b2c9-4a6b-9504-4b8dda64a81a service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:05.547597 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:05.548542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:05.549020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:05.549502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:05.551846 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:05.570047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:05.571931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eccb2e-d53e-4362-b63a-5e3e2580847b service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:05.585693 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4433/8893] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:11.988156 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:15.578520 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:48.468355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bdf87-9702-4052-890d-f752e44cfca8 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.468954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bdf87-9702-4052-890d-f752e44cfca8 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.468954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bdf87-9702-4052-890d-f752e44cfca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.507051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-797bdf87-9702-4052-890d-f752e44cfca8 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:48.508286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-797bdf87-9702-4052-890d-f752e44cfca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:48.518644 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4461/8894] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Jul 11 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:43:48.528036 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fc56-9e84-4f5b-9786-de78fad9490d None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.528538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fc56-9e84-4f5b-9786-de78fad9490d None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.528638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fc56-9e84-4f5b-9786-de78fad9490d None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.529966 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4434/8895] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:48.534927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.535223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.535506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.553531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:48.554799 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:48.564652 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4462/8896] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:48.585219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c98bce-4367-4472-bec1-310b115d11ec None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.585516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c98bce-4367-4472-bec1-310b115d11ec None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.585801 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c98bce-4367-4472-bec1-310b115d11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.604558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-f2c98bce-4367-4472-bec1-310b115d11ec None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:48.605811 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f2c98bce-4367-4472-bec1-310b115d11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:48.614589 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4435/8897] 10.222.0.77 () {58 vars in 1057 bytes} [Mon Jul 11 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:48.620579 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:48.631780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241471ce-ff6f-4ab3-8b3d-5bfdf2ba8310 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:48.637826 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8846f6-e78b-4cea-ba31-66411df60ba3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:48.638477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8846f6-e78b-4cea-ba31-66411df60ba3 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.638798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8846f6-e78b-4cea-ba31-66411df60ba3 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.639078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8846f6-e78b-4cea-ba31-66411df60ba3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.647768 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8846f6-e78b-4cea-ba31-66411df60ba3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:48.649357 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8846f6-e78b-4cea-ba31-66411df60ba3 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:48.659142 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4463/8898] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:43:49.697784 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.698355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.698579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.716862 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:49.718084 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:49.728855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4436/8899] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Jul 11 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:52.074354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ed72-06d6-4084-9035-aa27a0e100f3 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.074815 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ed72-06d6-4084-9035-aa27a0e100f3 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.074971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ed72-06d6-4084-9035-aa27a0e100f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.092858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c2f3ed72-06d6-4084-9035-aa27a0e100f3 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:52.094038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c2f3ed72-06d6-4084-9035-aa27a0e100f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:52.103405 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4464/8900] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:52.115075 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.133857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3893c-8d89-476f-82fd-9c6ff342cf00 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.137396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.138033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.138322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.138643 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.148591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.150010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.161213 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4437/8901] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:53.325467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.326523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.326622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.345537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:53.346751 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:53.356108 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4465/8902] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:53.366518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:53.375006 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4316c-1754-4454-8ba9-d1b89321f4e5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:53.378989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3943c8-b01d-4f0f-b7e4-1c8158b63973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:53.379629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3943c8-b01d-4f0f-b7e4-1c8158b63973 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.379918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3943c8-b01d-4f0f-b7e4-1c8158b63973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.380201 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3943c8-b01d-4f0f-b7e4-1c8158b63973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.391090 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3943c8-b01d-4f0f-b7e4-1c8158b63973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:53.392516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3943c8-b01d-4f0f-b7e4-1c8158b63973 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:53.403538 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4438/8903] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:01.566691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.576527 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63338e-aeff-4d0b-ad4c-3e71c9dd6515 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.580191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.580833 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.581123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.581402 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.589902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.591352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.600858 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4466/8904] 10.222.0.77 () {60 vars in 1396 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:03.398631 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=22 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.185079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.185644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.185644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.203663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:09.204858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:09.211425 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4439/8905] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Jul 11 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:09.223556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.232384 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe2e4-e62e-4eaa-8b2e-99ead1760e2b service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.235995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570468e2-3018-4bf8-9824-c8491c8ef9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.236630 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570468e2-3018-4bf8-9824-c8491c8ef9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.236917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570468e2-3018-4bf8-9824-c8491c8ef9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.237197 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570468e2-3018-4bf8-9824-c8491c8ef9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.244317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570468e2-3018-4bf8-9824-c8491c8ef9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.245765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570468e2-3018-4bf8-9824-c8491c8ef9e6 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.253563 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4467/8906] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:09.474289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.483306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1546bb-e048-47e3-b1ef-5db626cff941 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.487234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.487963 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.488252 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.488533 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.490330 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:09.503246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.504703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.515879 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4440/8907] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:19.250168 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=36 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.509173 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.995118 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1d843-48c4-4031-bc4e-efc217285db5 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.995677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1d843-48c4-4031-bc4e-efc217285db5 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.995677 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1d843-48c4-4031-bc4e-efc217285db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.014369 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c8c1d843-48c4-4031-bc4e-efc217285db5 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:23.015293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c8c1d843-48c4-4031-bc4e-efc217285db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:23.021996 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4468/8908] 10.222.0.84 () {58 vars in 1015 bytes} [Mon Jul 11 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:23.034763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.043540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b165-5ef7-4461-a93b-f8114669184c service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.047934 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.048642 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.049010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.049364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.057745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.059502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.067865 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4441/8909] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:24.793632 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a3bc-ef37-40fc-932e-eb26794b3801 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.794683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a3bc-ef37-40fc-932e-eb26794b3801 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.794760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a3bc-ef37-40fc-932e-eb26794b3801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.815031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bea0a3bc-ef37-40fc-932e-eb26794b3801 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:24.816261 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bea0a3bc-ef37-40fc-932e-eb26794b3801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:24.826141 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4469/8910] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:24.839970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.855142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99a076-d4f6-40bd-8b6f-b04da247ef94 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.862134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.862823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.863108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.863383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.873672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.875413 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.886855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4442/8911] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:44:28.913645 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.914087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.914087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.935373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:28.936608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:28.946355 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4470/8912] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:28.974519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.989386 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc968c-b01d-4564-a9e0-7868b4dd5b78 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.995768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.996713 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.997700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.998082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.008212 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.010065 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.023808 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4443/8913] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:38.927656 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=9 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.018083 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=18 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.184695 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.193984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d214057-ee98-4934-9f54-4e196c3bb172 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.197555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.198193 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.198483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.198788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.207919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.209354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.229445 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4471/8914] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:58.317997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.329775 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b620b2b-1cde-441e-ab27-cce51493ad40 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.335080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.335757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.336049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.336328 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.338133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:58.354180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.356477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.374378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4444/8915] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:58.375564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.386770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d3f1-89ee-4fb9-8e87-fb38ee3929d1 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.392556 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.393702 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.394218 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.394706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] PATH_INFO: `/v3/users/f2b7bc99f1604a35b33df0bdb8713099` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.396266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b7bc99f1604a35b33df0bdb8713099)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.398693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.454059 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b7bc99f1604a35b33df0bdb8713099'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.454888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b7bc99f1604a35b33df0bdb8713099'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.468848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b7bc99f1604a35b33df0bdb8713099'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.469541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b7bc99f1604a35b33df0bdb8713099'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.476543 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-7a161db5-2bc7-449c-ad89-72c44d7f5d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b7bc99f1604a35b33df0bdb8713099'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.489600 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4472/8916] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:44:58 2022] DELETE /identity/v3/users/f2b7bc99f1604a35b33df0bdb8713099 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:58.666885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.677659 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340ec0-6567-462f-bdf7-ba76df9cbe92 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.735365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.736167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.736454 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.736733 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] PATH_INFO: `/v3/projects/b8b6878bf34b4096a11df12ccab2c1a3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.737911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b6878bf34b4096a11df12ccab2c1a3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.739848 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.785025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b6878bf34b4096a11df12ccab2c1a3', 'request_id': 'req-8613c79f-289f-4a73-8af5-2abcf004062e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.790509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b6878bf34b4096a11df12ccab2c1a3', 'request_id': 'req-8613c79f-289f-4a73-8af5-2abcf004062e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.797488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b6878bf34b4096a11df12ccab2c1a3', 'request_id': 'req-8613c79f-289f-4a73-8af5-2abcf004062e'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.808199 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] The token cache is being invalidate because project b8b6878bf34b4096a11df12ccab2c1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:44:58.808492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.809703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-8613c79f-289f-4a73-8af5-2abcf004062e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:44:58.811257 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4445/8917] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:44:58 2022] DELETE /identity/v3/projects/b8b6878bf34b4096a11df12ccab2c1a3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:58.816183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.816481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.816769 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.835316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:58.836530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:58.895277 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4473/8918] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:58.903293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.903591 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.903875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.921986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:58.923238 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:58.931225 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4446/8919] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:58.935842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.945732 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe078-7202-43a9-9c65-a2da66120626 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.951465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.952128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.952425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.952709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.953499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:58.953821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.955489 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.968239 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4474/8920] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:58.972741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.983133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4789fa3-9e92-4b5b-8025-ada9a4c68ab7 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.987885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.988539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.988831 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.989142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.990012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.991808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.021086 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4447/8921] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:44:58 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:59.025536 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.035764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646320fc-5ca6-4a1b-8d30-49a3600d95cc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.077195 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.105163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.105863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.106153 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.106430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.107173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.109130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.131125 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4475/8922] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:44:59 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:59.135428 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.147255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac903e40-70e5-40ac-94b4-daf5a680f997 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.151993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.152720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.153016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.153299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.154081 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.155757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.167308 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4448/8923] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:44:59.172296 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.183191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7bb33-ca6d-4682-a137-462348ee291d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.188533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e220-135b-41e4-a97c-1e9acc18dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.189203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e220-135b-41e4-a97c-1e9acc18dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.189492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e220-135b-41e4-a97c-1e9acc18dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.189772 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e220-135b-41e4-a97c-1e9acc18dd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.190515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e220-135b-41e4-a97c-1e9acc18dd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.192142 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e220-135b-41e4-a97c-1e9acc18dd62 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.206686 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4476/8924] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:44:59.207893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.219044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c3092-6591-4662-b5f5-e92c0c8cdf84 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.224118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.225071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.225279 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.225560 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] PATH_INFO: `/v3/projects/d57e591a622849d0b67d0358f8c3feb8/users/62f83de1d9dd4c029caa2c719d9f4645/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.241983 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57e591a622849d0b67d0358f8c3feb8, user_id=62f83de1d9dd4c029caa2c719d9f4645, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.244725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.257469 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4449/8925] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:44:59 2022] PUT /identity/v3/projects/d57e591a622849d0b67d0358f8c3feb8/users/62f83de1d9dd4c029caa2c719d9f4645/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:59.263238 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a591-c6cf-4c1b-90bb-80edad53a088 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.263570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a591-c6cf-4c1b-90bb-80edad53a088 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.263902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a591-c6cf-4c1b-90bb-80edad53a088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.281900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-eaf7a591-c6cf-4c1b-90bb-80edad53a088 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:59.283143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-eaf7a591-c6cf-4c1b-90bb-80edad53a088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:59.341398 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4477/8926] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:44:59.351109 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.353126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:59.366925 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.410541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03639fb1-cbd9-4d01-8cef-79636aa52534 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.414224 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fad67-99e2-45be-ad82-1c935e7a7fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.414912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fad67-99e2-45be-ad82-1c935e7a7fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.415202 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fad67-99e2-45be-ad82-1c935e7a7fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.415486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fad67-99e2-45be-ad82-1c935e7a7fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.424641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fad67-99e2-45be-ad82-1c935e7a7fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.426063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fad67-99e2-45be-ad82-1c935e7a7fb3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.435911 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4450/8927] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:03.503283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.503837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.503837 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.535397 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] MFA Rules not processed for user `62f83de1d9dd4c029caa2c719d9f4645`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:03.536558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:03.615953 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4478/8928] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:03.625744 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160452-e90c-48ff-b58f-425292294a39 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.626276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160452-e90c-48ff-b58f-425292294a39 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.626276 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160452-e90c-48ff-b58f-425292294a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.646207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ae160452-e90c-48ff-b58f-425292294a39 None None] MFA Rules not processed for user `62f83de1d9dd4c029caa2c719d9f4645`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:03.647798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae160452-e90c-48ff-b58f-425292294a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:03.655846 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4451/8929] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:03.667849 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.670404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:03.724965 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:03.751467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba506e0-2e13-4e80-974b-13937e6dcc09 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:03.756996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.757654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.757942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.758222 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.767476 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:03.769144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:03.779504 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4479/8930] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:04.034416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff50e7-fd26-41a2-be2f-aa42267d4fd9 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.034754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff50e7-fd26-41a2-be2f-aa42267d4fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.035039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff50e7-fd26-41a2-be2f-aa42267d4fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.053094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9fff50e7-fd26-41a2-be2f-aa42267d4fd9 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:04.054213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9fff50e7-fd26-41a2-be2f-aa42267d4fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:04.061308 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4452/8931] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:04.072958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.075143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:04.086956 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1980-30e1-47db-9eed-c9deefe88e2a service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.090597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.091236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.091522 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.091803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.099099 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.100513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.108652 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4480/8932] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:07.328366 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cbae-f7ef-4eef-bd92-051987b4e1af None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.328875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cbae-f7ef-4eef-bd92-051987b4e1af None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.328961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cbae-f7ef-4eef-bd92-051987b4e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.357648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3186cbae-f7ef-4eef-bd92-051987b4e1af None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:07.359249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3186cbae-f7ef-4eef-bd92-051987b4e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:07.375680 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4453/8933] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:07.383821 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:07.397583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eac049-65aa-4d82-9d3c-d62f06e0dd41 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:07.405082 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b782ca-b020-453c-8045-7cc89b1f06ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:07.405764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b782ca-b020-453c-8045-7cc89b1f06ef service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.406053 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b782ca-b020-453c-8045-7cc89b1f06ef service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.408756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b782ca-b020-453c-8045-7cc89b1f06ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.419917 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b782ca-b020-453c-8045-7cc89b1f06ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:07.421841 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b782ca-b020-453c-8045-7cc89b1f06ef service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:07.435234 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4481/8934] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:12.694115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.694615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.694724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.711698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] MFA Rules not processed for user `62f83de1d9dd4c029caa2c719d9f4645`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:12.712893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:12.736533 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4454/8935] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:12.976088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.976560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.976650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.995416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:12.997279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:13.003783 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4482/8936] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:45:13.014941 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:13.024288 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a623-093a-42e5-9842-a646d16e9472 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:13.028420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:13.029059 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:13.029347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:13.029627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:13.036665 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:13.038042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:13.046338 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4455/8937] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:22.990172 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=28 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.042323 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=46 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:34.287376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:34.311564 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd316-9aee-426a-a63d-e446b240976b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:34.316354 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:34.317184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.317465 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.317734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] PATH_INFO: `/v3/users/62f83de1d9dd4c029caa2c719d9f4645` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.318982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f83de1d9dd4c029caa2c719d9f4645)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:34.321042 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:34.372705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f83de1d9dd4c029caa2c719d9f4645'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.373368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f83de1d9dd4c029caa2c719d9f4645'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.385239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f83de1d9dd4c029caa2c719d9f4645'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.385840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f83de1d9dd4c029caa2c719d9f4645'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.393798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-b9dbb405-289e-4dbe-8194-da62f355bf60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f83de1d9dd4c029caa2c719d9f4645'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.408399 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4483/8938] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:45:34 2022] DELETE /identity/v3/users/62f83de1d9dd4c029caa2c719d9f4645 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:34.587728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:34.603269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0334c-805f-4b39-9ee5-564e48732cd7 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:34.664805 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:34.665700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.665986 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.666269 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] PATH_INFO: `/v3/projects/d57e591a622849d0b67d0358f8c3feb8` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.667596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57e591a622849d0b67d0358f8c3feb8)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:34.669543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:34.721166 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57e591a622849d0b67d0358f8c3feb8', 'request_id': 'req-cf20fc18-709d-47d7-99dd-6823bbf551e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.727023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57e591a622849d0b67d0358f8c3feb8', 'request_id': 'req-cf20fc18-709d-47d7-99dd-6823bbf551e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.735058 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57e591a622849d0b67d0358f8c3feb8', 'request_id': 'req-cf20fc18-709d-47d7-99dd-6823bbf551e0'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.747041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] The token cache is being invalidate because project d57e591a622849d0b67d0358f8c3feb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:45:34.747334 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.748017 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-cf20fc18-709d-47d7-99dd-6823bbf551e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:34.749575 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4456/8939] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:45:34 2022] DELETE /identity/v3/projects/d57e591a622849d0b67d0358f8c3feb8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:34.754844 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.755198 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.755555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.785310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:34.786558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:34.845823 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4484/8940] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:45:34.853757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.854074 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.854352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.873484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:34.874737 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:34.883342 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4457/8941] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:34.888145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:34.897970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64514d3d-d0c5-4ea9-8fd3-cdef8991daee None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:34.902635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:34.903294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.903585 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.903868 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.904592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:34.904904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:34.906510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:34.917929 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4485/8942] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:34.922210 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:34.931525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8170fc5-7d78-4e1b-9373-2722a4236eba None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:34.936771 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:34.937426 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.937716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.938000 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.938741 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:34.940653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:34.966888 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4458/8943] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:45:34 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:34.971309 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:34.982364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479c78f-26f7-4a93-a20e-f9d2ed2b2e07 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.025968 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:35.043481 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.044237 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.044596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.044947 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.045711 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.047886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.073152 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4486/8944] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:45:34 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:35.074901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.086683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700606e-853f-4b3f-82f9-eba6bfdc486d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.091777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.092448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.092740 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.093024 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.093753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.095405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.106544 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4459/8945] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:45:35.110755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.121443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1914e3-7df8-4e04-8a0c-7b473f40f2db admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.126276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e87386-c99f-48ed-b76a-dcbd6fc272bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.126997 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87386-c99f-48ed-b76a-dcbd6fc272bb admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.127289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87386-c99f-48ed-b76a-dcbd6fc272bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.127571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87386-c99f-48ed-b76a-dcbd6fc272bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.128299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e87386-c99f-48ed-b76a-dcbd6fc272bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.129892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e87386-c99f-48ed-b76a-dcbd6fc272bb admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.140520 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4487/8946] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:35.144401 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.154541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85f24-ea6c-41e1-91f2-cdf071203a96 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.159234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.160107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.160404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.160683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] PATH_INFO: `/v3/projects/26ae513b72ff45a5a0bc3108ab9392ca/users/c4770c8232054acc922dee5283971920/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.175682 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ae513b72ff45a5a0bc3108ab9392ca, user_id=c4770c8232054acc922dee5283971920, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.178263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.191753 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4460/8947] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:45:35 2022] PUT /identity/v3/projects/26ae513b72ff45a5a0bc3108ab9392ca/users/c4770c8232054acc922dee5283971920/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:35.201813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0722d53-2782-41dc-90c1-baf6be2a9297 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.202114 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0722d53-2782-41dc-90c1-baf6be2a9297 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.202401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0722d53-2782-41dc-90c1-baf6be2a9297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.231787 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b0722d53-2782-41dc-90c1-baf6be2a9297 None None] MFA Rules not processed for user `c4770c8232054acc922dee5283971920`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:35.233012 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b0722d53-2782-41dc-90c1-baf6be2a9297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:35.298940 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4488/8948] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:35.310139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.311931 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:35.341018 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:35.385414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068718e-f510-4f1f-8d9c-c74dca55bddd admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.389232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.389993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.390286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.390603 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.398991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.400512 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.409320 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4461/8949] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:45:40.415351 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6de7b-3236-4c7e-b942-165cd90aa7e6 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:40.415842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6de7b-3236-4c7e-b942-165cd90aa7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:40.415922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6de7b-3236-4c7e-b942-165cd90aa7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:40.482054 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-23d6de7b-3236-4c7e-b942-165cd90aa7e6 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:40.483316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-23d6de7b-3236-4c7e-b942-165cd90aa7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:40.603742 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4489/8950] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:40.616540 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:40.618072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:40.634067 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b2706-47e3-42a4-af73-e71f19de02b8 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:40.639474 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:40.640129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:40.640416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:40.640703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:40.650543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:40.652411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:40.662525 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4462/8951] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:43.784436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:43.784919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:43.785163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:43.803474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:43.804706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:43.814592 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4490/8952] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:43.843039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:43.856422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340dd8-3563-44b4-bc65-94eb08390344 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:43.862005 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b729d-dc2a-4e93-9976-890fb2a56f28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:43.862632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b729d-dc2a-4e93-9976-890fb2a56f28 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:43.862917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b729d-dc2a-4e93-9976-890fb2a56f28 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:43.863193 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b729d-dc2a-4e93-9976-890fb2a56f28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:43.873623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b729d-dc2a-4e93-9976-890fb2a56f28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:43.875264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b729d-dc2a-4e93-9976-890fb2a56f28 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:43.886901 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4463/8953] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:46.076290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.094785 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:46.156637 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3bf9-0922-4241-86c2-beee53b31c63 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.161400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.162276 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.162595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.162879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] PATH_INFO: `/v3/users/c4770c8232054acc922dee5283971920` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.164076 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4770c8232054acc922dee5283971920)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.165998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.211500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4770c8232054acc922dee5283971920'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.212102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4770c8232054acc922dee5283971920'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.224022 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4770c8232054acc922dee5283971920'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.224675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4770c8232054acc922dee5283971920'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.231950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4770c8232054acc922dee5283971920'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.244340 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4491/8954] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:45:46 2022] DELETE /identity/v3/users/c4770c8232054acc922dee5283971920 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:46.249416 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.249878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.249996 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.279186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:46.280392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:46.340243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4464/8955] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:46.349780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.351246 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:46.418996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5100-9d3f-4d3b-80f1-892405fe9a66 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.422651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d473c31-2d75-4ac4-8f80-fa36eb3d80c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.423288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d473c31-2d75-4ac4-8f80-fa36eb3d80c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.423571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d473c31-2d75-4ac4-8f80-fa36eb3d80c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.423846 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d473c31-2d75-4ac4-8f80-fa36eb3d80c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.432990 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d473c31-2d75-4ac4-8f80-fa36eb3d80c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.434455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d473c31-2d75-4ac4-8f80-fa36eb3d80c2 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.444148 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4492/8956] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:46.609060 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.610513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:46.622763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99ca3-f236-4011-8a6a-86ad22bd3516 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.627350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.628203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.628482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.628754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] PATH_INFO: `/v3/projects/26ae513b72ff45a5a0bc3108ab9392ca` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.629933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ae513b72ff45a5a0bc3108ab9392ca)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.631910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.679610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ae513b72ff45a5a0bc3108ab9392ca', 'request_id': 'req-1e4c15df-e561-488d-b260-551b39d62f02'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.685188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ae513b72ff45a5a0bc3108ab9392ca', 'request_id': 'req-1e4c15df-e561-488d-b260-551b39d62f02'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.692562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ae513b72ff45a5a0bc3108ab9392ca', 'request_id': 'req-1e4c15df-e561-488d-b260-551b39d62f02'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.700739 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:46.704944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] The token cache is being invalidate because project 26ae513b72ff45a5a0bc3108ab9392ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:45:46.705245 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.706257 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1e4c15df-e561-488d-b260-551b39d62f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:46.707968 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4465/8957] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:45:46 2022] DELETE /identity/v3/projects/26ae513b72ff45a5a0bc3108ab9392ca => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:46.713141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.713437 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.713746 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.732774 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:46.733988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:46.743328 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:46.795814 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4493/8958] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:46.803359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.803657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.803939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.822518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:46.824390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:46.832359 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4466/8959] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:46.836358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.845856 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663133-1f19-478f-ac8f-9f4313a69d30 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.850373 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.851107 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.851339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.851614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.852323 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:46.852628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.854463 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.865603 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4494/8960] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:46.869695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.879394 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781388-30a4-485c-94c7-61bec355f2ba None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.884047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.884688 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.884977 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.885254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.886624 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.888509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.916197 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4467/8961] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:46.917398 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.927342 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c001f-ce1b-43dc-8aaf-431b1da18d68 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.986614 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.987325 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.987617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.987900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.988610 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.990550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:47.010915 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4495/8962] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:47.015161 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:47.026264 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a04acd-4de9-4d6f-a31e-06f3f0e1f301 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:47.031725 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:47.032404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:47.032691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:47.032973 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:47.033710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:47.035352 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:47.051140 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4468/8963] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:47.055638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:47.066248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0e3b4-dd31-48ab-af80-f0fd0c56f8c0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:47.071176 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21034a-c7d3-4194-8a79-d6e86c432962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:47.071840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21034a-c7d3-4194-8a79-d6e86c432962 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:47.072131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21034a-c7d3-4194-8a79-d6e86c432962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:47.072415 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21034a-c7d3-4194-8a79-d6e86c432962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:47.073145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21034a-c7d3-4194-8a79-d6e86c432962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:47.074776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21034a-c7d3-4194-8a79-d6e86c432962 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:47.084832 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4496/8964] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:47.089525 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:47.101622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd70d95-877f-4a94-8a54-fe904ed28064 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:47.107183 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:47.108064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:47.108379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:47.108657 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] PATH_INFO: `/v3/projects/751e12a8dbf84feab859cddf5912f0d3/users/09b5667cf33642a3b37576ed58d01a9a/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:47.124078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=751e12a8dbf84feab859cddf5912f0d3, user_id=09b5667cf33642a3b37576ed58d01a9a, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:47.126808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:47.139296 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4469/8965] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:45:47 2022] PUT /identity/v3/projects/751e12a8dbf84feab859cddf5912f0d3/users/09b5667cf33642a3b37576ed58d01a9a/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:47.150045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:47.150404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:47.150723 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:47.178555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] MFA Rules not processed for user `09b5667cf33642a3b37576ed58d01a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:47.179792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:47.244516 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4497/8966] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:47.254612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:47.256332 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:47.313497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3715ef-de35-4e6f-9093-7c32b7acb4de admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:47.317216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd77ee5-79b0-412f-8fb2-da69d85c6178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:47.317864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd77ee5-79b0-412f-8fb2-da69d85c6178 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:47.318154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd77ee5-79b0-412f-8fb2-da69d85c6178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:47.318438 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd77ee5-79b0-412f-8fb2-da69d85c6178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:47.327260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd77ee5-79b0-412f-8fb2-da69d85c6178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:47.328690 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd77ee5-79b0-412f-8fb2-da69d85c6178 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:47.337421 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4470/8967] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:50.910722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:50.923922 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:50.984507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bb546-9dee-403e-8dc1-83220ab9b752 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:50.989070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:50.989935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:50.990219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:50.990533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] PATH_INFO: `/v3/users/09b5667cf33642a3b37576ed58d01a9a` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:50.991718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b5667cf33642a3b37576ed58d01a9a)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:50.993631 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.038284 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b5667cf33642a3b37576ed58d01a9a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.038995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b5667cf33642a3b37576ed58d01a9a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.051869 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b5667cf33642a3b37576ed58d01a9a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.052580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b5667cf33642a3b37576ed58d01a9a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.060275 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b5667cf33642a3b37576ed58d01a9a'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.072858 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4498/8968] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:45:50 2022] DELETE /identity/v3/users/09b5667cf33642a3b37576ed58d01a9a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:51.077450 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.077914 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.078040 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.094661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:51.095850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:51.153446 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4471/8969] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:51.163252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.164679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:51.221378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434091a4-0d9d-4fd5-96a1-6b88ed801eb8 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.225108 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2708e2-f66b-4046-a449-4359396887c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.225749 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2708e2-f66b-4046-a449-4359396887c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.226038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2708e2-f66b-4046-a449-4359396887c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.226318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2708e2-f66b-4046-a449-4359396887c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.236232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2708e2-f66b-4046-a449-4359396887c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.237657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2708e2-f66b-4046-a449-4359396887c3 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.247662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4499/8970] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:51.418791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.420550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:51.435573 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f4927-24bf-4ccb-8289-45acfa6b5f99 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.441362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.442294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.442464 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.442856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] PATH_INFO: `/v3/projects/751e12a8dbf84feab859cddf5912f0d3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.444114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] RBAC: Authorizing `identity:delete_project(project_id=751e12a8dbf84feab859cddf5912f0d3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.446013 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.485130 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:51.496063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751e12a8dbf84feab859cddf5912f0d3', 'request_id': 'req-7a65419c-2207-4d8f-a98a-82f98f8283be'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.501872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751e12a8dbf84feab859cddf5912f0d3', 'request_id': 'req-7a65419c-2207-4d8f-a98a-82f98f8283be'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.508993 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751e12a8dbf84feab859cddf5912f0d3', 'request_id': 'req-7a65419c-2207-4d8f-a98a-82f98f8283be'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.519988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] The token cache is being invalidate because project 751e12a8dbf84feab859cddf5912f0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:45:51.520285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.520926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-7a65419c-2207-4d8f-a98a-82f98f8283be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:51.522475 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4472/8971] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:45:51 2022] DELETE /identity/v3/projects/751e12a8dbf84feab859cddf5912f0d3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:51.528201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.528490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.528767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.548132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:51.549326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:51.577139 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:51.610720 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4500/8972] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:51.618326 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.618646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.618935 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.637277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:51.638484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:51.646799 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4473/8973] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:51.650937 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.661264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67068b79-7095-4951-aa18-531ad55c3013 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.665721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.666370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.666690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.667550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.668295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:51.668600 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.670191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.681483 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4501/8974] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:51.685738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.694958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc916c-9fd0-4dc8-86e6-7f0ce7349e20 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.700164 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.700816 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.701104 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.701385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.702105 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.704043 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.730102 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4474/8975] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:51.733905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.743842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2697d-e2c2-430f-87c1-9d3506b1999c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.798559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.799219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.799506 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.799784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.800471 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.802640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.825515 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4502/8976] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:45:51 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:45:51.829421 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.840405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee117b-b1df-49bc-8b8f-1ceb14f9e439 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.845452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.846110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.846400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.846723 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.847449 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.849320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.860085 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4475/8977] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:51.863862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.873615 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ddfc7-649b-4037-a23a-674a0cbb0606 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.878183 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233e7f-10ac-453e-906b-3d6f590bcfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.878862 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233e7f-10ac-453e-906b-3d6f590bcfda admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.879151 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233e7f-10ac-453e-906b-3d6f590bcfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.879422 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233e7f-10ac-453e-906b-3d6f590bcfda admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.880158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233e7f-10ac-453e-906b-3d6f590bcfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.881718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233e7f-10ac-453e-906b-3d6f590bcfda admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.891950 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4503/8978] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:51.895839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:51.906280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a25aa-e922-4f92-9c66-fa4b87343c97 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:51.911054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:51.911969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.912231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.912516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] PATH_INFO: `/v3/projects/7afa4b319f134a24bd6e427bb76618c4/users/a017eb7233534a38ab1fab8927693582/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.926970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afa4b319f134a24bd6e427bb76618c4, user_id=a017eb7233534a38ab1fab8927693582, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:51.929648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:51.942437 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4476/8979] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:45:51 2022] PUT /identity/v3/projects/7afa4b319f134a24bd6e427bb76618c4/users/a017eb7233534a38ab1fab8927693582/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:51.947521 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbb883-1629-4d6e-a40f-2bacedfded3d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:51.947976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbb883-1629-4d6e-a40f-2bacedfded3d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:51.948622 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbb883-1629-4d6e-a40f-2bacedfded3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:51.966409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-65fbb883-1629-4d6e-a40f-2bacedfded3d None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:51.967657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-65fbb883-1629-4d6e-a40f-2bacedfded3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:52.025422 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4504/8980] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:52.035776 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:52.037522 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:52.093627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9b1b-f719-4600-a403-747192f752b8 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:52.097260 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:52.097902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.098188 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.098465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.107706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:52.109129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:52.118763 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4477/8981] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:55.795018 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:55.795541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:55.795541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:55.829824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] MFA Rules not processed for user `a017eb7233534a38ab1fab8927693582`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:55.831136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:55.865881 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:55.907623 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4505/8982] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:55.912289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:55.922265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec721ae-de15-4af1-9409-c44fd0b1868f service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:55.926902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:55.927558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:55.927844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:55.928121 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:55.928809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:55.930743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:55.962317 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4478/8983] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:45:55 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:55.963822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:55.975317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7212e2-c73e-4394-b2df-3f966b00e293 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.035941 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.036885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.037196 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.037474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.038182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.040143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.067521 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4506/8984] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:45:55 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:56.071864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:56.083273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b2816-3468-496e-be55-52ec42102d5c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.087907 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.088583 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.088904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.089181 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.089912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.091561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.104177 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4479/8985] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:56.108754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:56.119582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8c8f7-7a3c-473e-a72c-c3ec51c4f46b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.125289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.126212 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.126524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.126824 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] PATH_INFO: `/v3/projects/6bfbe6a0990d4c35b4b0e2f9a332a313/users/e7133fca415f4fd89b84dbed65c7675c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.144332 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfbe6a0990d4c35b4b0e2f9a332a313, user_id=e7133fca415f4fd89b84dbed65c7675c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.147047 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.161034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4507/8986] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:45:56 2022] PUT /identity/v3/projects/6bfbe6a0990d4c35b4b0e2f9a332a313/users/e7133fca415f4fd89b84dbed65c7675c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:56.164789 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:56.175822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be1d4-0e3a-475b-a961-fca8d1f95800 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.201900 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:56.235751 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172609b-b91d-442a-a9e3-5337a6219841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.236439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172609b-b91d-442a-a9e3-5337a6219841 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.236722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172609b-b91d-442a-a9e3-5337a6219841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.237001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172609b-b91d-442a-a9e3-5337a6219841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.237731 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172609b-b91d-442a-a9e3-5337a6219841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.239363 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172609b-b91d-442a-a9e3-5337a6219841 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.250855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4480/8987] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:56.254858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:56.265943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414154-d81c-4943-bbae-76505dd7f4b6 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.270599 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.271485 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.271773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.272064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] PATH_INFO: `/v3/projects/6bfbe6a0990d4c35b4b0e2f9a332a313/users/e7133fca415f4fd89b84dbed65c7675c/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.274055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfbe6a0990d4c35b4b0e2f9a332a313, user_id=e7133fca415f4fd89b84dbed65c7675c, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.276741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.287303 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4508/8988] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:45:56 2022] PUT /identity/v3/projects/6bfbe6a0990d4c35b4b0e2f9a332a313/users/e7133fca415f4fd89b84dbed65c7675c/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:46:01.312913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33be0f-ad26-4da8-9163-6caad39bb8e6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:01.313460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33be0f-ad26-4da8-9163-6caad39bb8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:01.313594 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33be0f-ad26-4da8-9163-6caad39bb8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:01.345853 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-0f33be0f-ad26-4da8-9163-6caad39bb8e6 None None] MFA Rules not processed for user `e7133fca415f4fd89b84dbed65c7675c`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:01.347823 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0f33be0f-ad26-4da8-9163-6caad39bb8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:01.445929 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4481/8989] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:46:01.461664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:01.465500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:01.567492 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:01.592462 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727ad7c-6d9c-42a4-8073-c1b40ed611fd admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:01.598352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f653f6-8a36-4a45-9308-9837ccf9b5af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:01.600026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f653f6-8a36-4a45-9308-9837ccf9b5af service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:01.600320 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f653f6-8a36-4a45-9308-9837ccf9b5af service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:01.600606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f653f6-8a36-4a45-9308-9837ccf9b5af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:01.668474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f653f6-8a36-4a45-9308-9837ccf9b5af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:01.670084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f653f6-8a36-4a45-9308-9837ccf9b5af service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:01.686682 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4509/8990] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:01.753303 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:01.753546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:01.753834 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:01.771763 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] MFA Rules not processed for user `a017eb7233534a38ab1fab8927693582`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:01.772970 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:01.780515 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4482/8991] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:46:11.675947 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=31 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:11.766360 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=53 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:13.152683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:13.153090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:13.153231 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:13.201044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] MFA Rules not processed for user `66a3753891494abd84fa3c9c17c1b455`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:13.202263 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:13.261188 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4510/8992] 10.222.0.77 () {58 vars in 1060 bytes} [Mon Jul 11 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:46:13.267760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:13.277129 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b4d8-3c93-4fca-912c-07f681a56933 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:13.280698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e90b9c-8b06-48b4-9d35-651289441246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a3753891494abd84fa3c9c17c1b455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:13.281360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e90b9c-8b06-48b4-9d35-651289441246 service cinder] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:13.281646 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e90b9c-8b06-48b4-9d35-651289441246 service cinder] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:13.281922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e90b9c-8b06-48b4-9d35-651289441246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:13.290772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e90b9c-8b06-48b4-9d35-651289441246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:13.292196 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e90b9c-8b06-48b4-9d35-651289441246 service cinder] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:13.301687 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4483/8993] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:23.258287 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=38 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:23.297283 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:38.292718 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:38.294266 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:38.364818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1f76-2d82-426b-957e-b643b17b6cb1 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:38.369834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:38.370486 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:38.370915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:38.371201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:38.372982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:38.384726 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:38.386293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:38.396707 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4511/8994] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:39.343282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:39.343777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:39.343869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:39.361306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] MFA Rules not processed for user `a017eb7233534a38ab1fab8927693582`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:39.362538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:39.369669 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4484/8995] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:46:39.917992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:39.919505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:39.932922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac477-364f-410d-94ad-63edba2194e0 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:39.938090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:39.938771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:39.939110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:39.939393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:39.941139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:39.953358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:39.954954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:39.965264 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4512/8996] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:40.435153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:40.447666 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec951c56-7d9d-4584-b6b3-172033989169 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:40.453291 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:40.453930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:40.454218 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:40.454520 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:40.456268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:40.467392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:40.468969 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:40.479318 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4485/8997] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:46:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:49.960879 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=38 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:50.475274 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=9 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:23.383836 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:23.449102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efc53-9945-40fb-b5d5-80b76a831d72 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:23.453646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:23.454537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.454825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.455100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] PATH_INFO: `/v3/users/a017eb7233534a38ab1fab8927693582` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.456286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a017eb7233534a38ab1fab8927693582)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:23.458228 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:23.503518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a017eb7233534a38ab1fab8927693582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.504173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a017eb7233534a38ab1fab8927693582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.515802 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a017eb7233534a38ab1fab8927693582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.516440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a017eb7233534a38ab1fab8927693582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.523446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a017eb7233534a38ab1fab8927693582'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.535780 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4513/8998] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:47:23 2022] DELETE /identity/v3/users/a017eb7233534a38ab1fab8927693582 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:23.710402 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:23.723466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1505496-6c27-46ab-9ca4-421d7c3e1031 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:23.781387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:23.782254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.782572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.782858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] PATH_INFO: `/v3/projects/7afa4b319f134a24bd6e427bb76618c4` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.784046 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afa4b319f134a24bd6e427bb76618c4)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:23.785949 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:23.830966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afa4b319f134a24bd6e427bb76618c4', 'request_id': 'req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.836490 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afa4b319f134a24bd6e427bb76618c4', 'request_id': 'req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.844510 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afa4b319f134a24bd6e427bb76618c4', 'request_id': 'req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.855718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] The token cache is being invalidate because project 7afa4b319f134a24bd6e427bb76618c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:47:23.856007 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.856652 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.858225 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4486/8999] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:47:23 2022] DELETE /identity/v3/projects/7afa4b319f134a24bd6e427bb76618c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:23.862448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:23.863958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:23.877642 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022f7e-3ace-490f-909c-03c9c92742d2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:23.933057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:23.933867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.934149 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.934435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] PATH_INFO: `/v3/users/e7133fca415f4fd89b84dbed65c7675c` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.935668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7133fca415f4fd89b84dbed65c7675c)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:23.938124 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:23.959841 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:23.982930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7133fca415f4fd89b84dbed65c7675c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.983582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7133fca415f4fd89b84dbed65c7675c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.995195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7133fca415f4fd89b84dbed65c7675c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:23.995825 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7133fca415f4fd89b84dbed65c7675c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.003156 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-10535ec5-0629-4174-a1b0-920bffc5b23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7133fca415f4fd89b84dbed65c7675c'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.015604 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4514/9000] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:47:23 2022] DELETE /identity/v3/users/e7133fca415f4fd89b84dbed65c7675c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:24.188211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.189835 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:24.204483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dd81e-caa8-472d-a92f-69943e9bfe8c admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.261757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.262653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.262946 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.263228 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] PATH_INFO: `/v3/projects/6bfbe6a0990d4c35b4b0e2f9a332a313` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.264429 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfbe6a0990d4c35b4b0e2f9a332a313)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.266350 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.300141 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:24.314145 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfbe6a0990d4c35b4b0e2f9a332a313', 'request_id': 'req-f3620ff4-83f2-463e-9629-4b854211f1ca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.320335 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfbe6a0990d4c35b4b0e2f9a332a313', 'request_id': 'req-f3620ff4-83f2-463e-9629-4b854211f1ca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.327567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfbe6a0990d4c35b4b0e2f9a332a313', 'request_id': 'req-f3620ff4-83f2-463e-9629-4b854211f1ca'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.338662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] The token cache is being invalidate because project 6bfbe6a0990d4c35b4b0e2f9a332a313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:47:24.338954 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.339584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-f3620ff4-83f2-463e-9629-4b854211f1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:47:24.341134 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4487/9001] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:47:24 2022] DELETE /identity/v3/projects/6bfbe6a0990d4c35b4b0e2f9a332a313 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:24.346223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.346549 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.346840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.393803 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:24.395067 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:24.452915 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4515/9002] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:24.460704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.460999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.461302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.486094 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:24.487356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:24.495587 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4488/9003] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:24.500691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.510374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adce0a-b85e-4b54-8c97-1fecc09683b7 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.515051 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.515707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.515995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.516277 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.516998 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:24.517310 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.518954 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.531057 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4516/9004] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:24.535072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.544295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0371-2460-4fdb-9ef5-c7c19ceabb1e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.549822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.550471 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.550821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.551154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.551874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.553766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.588643 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4489/9005] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:47:24 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:47:24.593306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.603366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d05c-3085-418a-9da3-29b9870e504a admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.661167 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.661858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.662144 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.662447 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.663161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.665064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.674050 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:24.687369 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4517/9006] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:47:24 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:47:24.691509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.701893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca470bf-15f4-4482-912b-e039d9409a62 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.706621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.707221 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.707513 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.707793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.708557 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.710185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.721491 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4490/9007] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:47:24.725665 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.736691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ea04a-29ea-4b7d-8076-51428b24eb4c admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.741334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e9e1-66b7-4e0e-a387-d33365e51e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.741985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e9e1-66b7-4e0e-a387-d33365e51e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.742269 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e9e1-66b7-4e0e-a387-d33365e51e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.742575 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e9e1-66b7-4e0e-a387-d33365e51e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.743290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e9e1-66b7-4e0e-a387-d33365e51e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.744895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e9e1-66b7-4e0e-a387-d33365e51e0f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.754763 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4518/9008] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:47:24.758726 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.768680 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14100-406b-4e72-b160-3dd182bf3249 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.773209 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.774071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.774355 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.774668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] PATH_INFO: `/v3/projects/521c2948ceb94fe7b5463ec15b2e89d7/users/3dd0431d03f240089491c8d139048ff5/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.790714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521c2948ceb94fe7b5463ec15b2e89d7, user_id=3dd0431d03f240089491c8d139048ff5, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.793390 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.807270 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4491/9009] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:47:24 2022] PUT /identity/v3/projects/521c2948ceb94fe7b5463ec15b2e89d7/users/3dd0431d03f240089491c8d139048ff5/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:24.812295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcefb5-db72-4833-b663-e6e584058d00 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.812583 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcefb5-db72-4833-b663-e6e584058d00 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.812860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcefb5-db72-4833-b663-e6e584058d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.830729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-05fcefb5-db72-4833-b663-e6e584058d00 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:24.831922 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-05fcefb5-db72-4833-b663-e6e584058d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:24.890419 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4519/9010] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:24.899958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.901651 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:24.958009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce1d57-eef4-416b-9782-c7887c7113d1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.961640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.962282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.962609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.962893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.972448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.973878 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.983559 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4492/9011] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:28.703432 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.703908 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.704000 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.732233 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] MFA Rules not processed for user `3dd0431d03f240089491c8d139048ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:28.734005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:28.805985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4520/9012] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:28.810578 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.821468 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42996d8a-84ee-42e6-9dd2-8a0972ed97ee service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.826342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.827089 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.827379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.827662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.828376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.830299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:28.858476 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4493/9013] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:47:28 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:47:28.862792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.875116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606d8d-62eb-4535-bbc7-d3f2cc795bad None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.934102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.934809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.935091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.935368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.936102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.938569 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:28.963096 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4521/9014] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:47:28 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:47:28.964736 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.977219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3054411-1152-4bf7-acbe-5e4f57f9a4b6 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.982282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.983564 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.984543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.984543 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.984836 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.986446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:28.998210 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4494/9015] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:47:29.003003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.008235 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:29.015130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df4130-d18c-4c57-ae7b-4062c7c4baed admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.020455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.021608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.021895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.022240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] PATH_INFO: `/v3/projects/06520d58b52748be9c19644ff3931785/users/bdb08a49007a4246b319640877bbd2b8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.041490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06520d58b52748be9c19644ff3931785, user_id=bdb08a49007a4246b319640877bbd2b8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.044634 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.068150 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4522/9016] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:47:29 2022] PUT /identity/v3/projects/06520d58b52748be9c19644ff3931785/users/bdb08a49007a4246b319640877bbd2b8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:29.069375 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.080605 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833ed3a-21d4-457c-88be-0482f28068b7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.101095 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:29.153708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea892fd5-d65c-4e17-8564-e44463ec66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.154383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892fd5-d65c-4e17-8564-e44463ec66b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.154701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892fd5-d65c-4e17-8564-e44463ec66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.155516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892fd5-d65c-4e17-8564-e44463ec66b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.156247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea892fd5-d65c-4e17-8564-e44463ec66b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.157849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea892fd5-d65c-4e17-8564-e44463ec66b5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.171748 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4495/9017] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:47:29.172878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.185338 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0ef3-1e84-44bb-85c3-97a98ce2922d admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.190312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.191236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.191524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.191818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] PATH_INFO: `/v3/projects/06520d58b52748be9c19644ff3931785/users/bdb08a49007a4246b319640877bbd2b8/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.193792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06520d58b52748be9c19644ff3931785, user_id=bdb08a49007a4246b319640877bbd2b8, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.196475 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.208153 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4523/9018] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:47:29 2022] PUT /identity/v3/projects/06520d58b52748be9c19644ff3931785/users/bdb08a49007a4246b319640877bbd2b8/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:47:33.573799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129734-e610-4376-a9ab-7192bf056dbd None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.574267 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129734-e610-4376-a9ab-7192bf056dbd None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.575037 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129734-e610-4376-a9ab-7192bf056dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.620904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-28129734-e610-4376-a9ab-7192bf056dbd None None] MFA Rules not processed for user `bdb08a49007a4246b319640877bbd2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:33.622273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-28129734-e610-4376-a9ab-7192bf056dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:33.714114 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4496/9019] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:33.753136 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:33.754988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:33.861641 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278531c6-effd-42d8-bf36-00a3eb93099f admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:33.867551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e2b87-bb5a-46b5-8558-f9bca8452ef4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:33.868414 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e2b87-bb5a-46b5-8558-f9bca8452ef4 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.868882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e2b87-bb5a-46b5-8558-f9bca8452ef4 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.869172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e2b87-bb5a-46b5-8558-f9bca8452ef4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.933823 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e2b87-bb5a-46b5-8558-f9bca8452ef4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:33.935434 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e2b87-bb5a-46b5-8558-f9bca8452ef4 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:33.946005 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4524/9020] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:34.072795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.073146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.073482 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.125630 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:34.126932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:34.202567 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4497/9021] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:34.248546 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a672-77c8-4939-836c-5d52bdcf8062 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.248965 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a672-77c8-4939-836c-5d52bdcf8062 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.249377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a672-77c8-4939-836c-5d52bdcf8062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.300299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c736a672-77c8-4939-836c-5d52bdcf8062 None None] MFA Rules not processed for user `fb9dad5761444d1a8f096c6c2c1cbf19`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:34.301520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c736a672-77c8-4939-836c-5d52bdcf8062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:34.334525 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:34.376864 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4525/9022] 10.222.0.77 () {58 vars in 1039 bytes} [Mon Jul 11 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:34.382987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:34.397369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5f68f-7946-4b86-8c1e-ab63161b27e8 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:34.402728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:34.403396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.403753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.404096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.412924 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:34.414548 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:34.417992 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:34.423626 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4498/9023] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:47:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:47:43.181003 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68b57-fceb-4d49-8f79-7de619850722 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:43.181429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68b57-fceb-4d49-8f79-7de619850722 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:43.181722 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68b57-fceb-4d49-8f79-7de619850722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:43.199786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-00a68b57-fceb-4d49-8f79-7de619850722 None None] MFA Rules not processed for user `3dd0431d03f240089491c8d139048ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:43.201177 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-00a68b57-fceb-4d49-8f79-7de619850722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:43.208380 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4526/9024] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:43.776901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:43.778368 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:43.848794 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3453d-375c-4dc3-9bbd-775d918c61f4 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:43.853692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:43.854333 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:43.854906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:43.855187 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:43.856945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:43.868498 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:43.870055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:43.879807 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4499/9025] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:45.076885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:45.077378 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:45.077472 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:45.096168 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:45.097399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:45.105047 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4527/9026] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:45.118473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:45.131092 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b30a3-7bc4-4865-9f0b-80edb85a6f36 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:45.136345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:45.137015 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:45.137305 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:45.137588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:45.146828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:45.148475 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:45.157595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4500/9027] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:47:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:47:55.090321 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=23 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:55.153818 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=39 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:19.110049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:19.111507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:19.169404 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bc4bc-4df0-4423-9333-9672f18fc2ce None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:19.173146 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:19.173804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:19.174109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:19.174372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:19.184413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:19.185850 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:19.195662 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4528/9028] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:29.191232 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=26 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:15.455693 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:15.464968 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cf40e-62d3-4a18-9b34-2ea39c9b1a69 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:15.468536 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:15.469173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:15.469465 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:15.469749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:15.471567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:15.481052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:15.482561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:15.490855 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4501/9029] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:49:25.487415 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.155932 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.164831 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35771-7396-4a1f-927c-829c7e92a80f service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.168479 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.169150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.169501 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.169915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.172408 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.246784 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.248135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.260034 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4529/9030] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:02.451466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:02.460526 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a0a6-a91d-427d-bbbf-8ff0ce2ce6d6 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:02.464141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:02.464774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.465063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.465369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.467142 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:02.480701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:02.482379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:02.493017 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4502/9031] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:11.255077 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=34 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.488395 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:16.973312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.975503 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:17.000491 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927e0fc-99d7-4dbc-9971-735bca734697 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:17.012345 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:17.013044 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.013360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.013797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:17.016131 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:17.029945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:17.032091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874addd-602c-41cb-b20a-1703ca0da571 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:17.055214 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4530/9032] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:27.038636 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:29.190604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.193026 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:29.208325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32460-effe-4a87-8f0b-e499e2190882 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.214397 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.215128 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.215414 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.215686 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.217590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:29.230670 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.232621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.243413 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4503/9033] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:30.569356 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f527d-f4c2-421c-a202-60816c65b228 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:30.569820 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f527d-f4c2-421c-a202-60816c65b228 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:30.569942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f527d-f4c2-421c-a202-60816c65b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:30.597757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-6f3f527d-f4c2-421c-a202-60816c65b228 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:30.598992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-6f3f527d-f4c2-421c-a202-60816c65b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:30.606055 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4531/9034] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:51:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:30.646478 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:30.657563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc55c67-e850-4871-9551-92ace48e35de service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:30.662559 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:30.663195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:30.663483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:30.663762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:30.671911 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:30.673484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:30.681431 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4504/9035] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:31.113720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb76b1f-0970-494d-8f65-1eb432e71ae2 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:31.114023 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb76b1f-0970-494d-8f65-1eb432e71ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:31.114308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb76b1f-0970-494d-8f65-1eb432e71ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:31.132524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-fdb76b1f-0970-494d-8f65-1eb432e71ae2 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:31.133741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fdb76b1f-0970-494d-8f65-1eb432e71ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:31.141070 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4532/9036] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:31.152994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:31.163524 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c821efa-b6a4-4f85-870c-65b8b7e557d0 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:31.168958 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:31.169629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:31.169918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:31.170743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:31.179069 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:31.180640 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:31.189337 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4505/9037] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:39.263208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:39.264195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:39.264303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:39.282111 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] MFA Rules not processed for user `3dd0431d03f240089491c8d139048ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:39.283361 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:39.290273 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4533/9038] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:39.538393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:39.547451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10358-e25b-476b-acd5-f09284a38698 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:39.551008 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:39.551632 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:39.551916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:39.552192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:39.553945 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:39.563579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:39.564991 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:39.572797 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4506/9039] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:39.895104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:39.896770 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:39.911707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6c7c1-5360-4de8-acf0-ee27c0cd08cc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:39.916737 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:39.917430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:39.917721 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:39.918002 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:39.920333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:39.932137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:39.933714 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a9b3a-8f3a-4ca7-b95b-bebe25e6c568 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:39.944126 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4534/9040] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:41.420146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:41.432134 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ed2cc-d4ec-4af1-9e49-cd253acf4eff service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:41.437147 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:41.437787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:41.438078 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:41.438362 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:41.440167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:41.451803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:41.453374 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:41.463300 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4507/9041] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:42.194015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:42.194554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:42.194775 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:42.212771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:42.214159 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:42.221494 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4535/9042] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 15:51:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:42.235623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:42.249158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046e76-3915-47ad-8784-42571c61df3d service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:42.255344 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:42.256430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:42.256821 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:42.257178 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:42.266263 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:42.267899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:42.276577 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4508/9043] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:52.207689 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=22 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:52.272810 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=36 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:56.383445 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.396935 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1624a-6028-46a0-8ce0-59a92f36284c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.402863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.403520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.403806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.404084 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.405944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:56.419396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.421638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.433326 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4536/9044] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:06.429092 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:25.176588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:25.188456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394025f-15b8-429e-93e1-184f20afe556 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:25.193300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:25.193962 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:25.194255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:25.194563 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:25.196324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:25.208549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:25.210153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60471e3c-9a12-435c-ac6d-66ff85566946 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:25.220074 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4509/9045] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:34.191049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:34.205106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a37bd-7c33-4c95-bb3f-07eb5f13383f service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:34.210725 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:34.211377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:34.211666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:34.211945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:34.219974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:34.221551 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:34.230694 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4537/9046] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:35.215988 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:44.226438 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:29.381383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:29.381918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:29.382038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:29.400114 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:29.401302 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:29.408385 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4510/9047] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:53:29.447204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:29.458788 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587fb71-752b-492a-8645-627a4faec712 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:29.463759 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:29.464392 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:29.464699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:29.464969 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:29.472925 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:29.474488 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:29.482663 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4538/9048] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:53:29.825872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:29.835728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da009-0229-4090-aabb-4f09371b0911 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:29.839590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:29.840235 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:29.840518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:29.840790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:29.901481 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:29.902971 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:29.912597 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4511/9049] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:32.734391 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:32.745393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5024c7-d719-4a7b-a286-f40a06b8a8a5 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:32.750470 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:32.751138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:32.751425 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:32.751707 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:32.753502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:32.765137 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:32.767319 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:32.777427 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4539/9050] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:35.934250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:35.958546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d671-fdfe-4329-a44a-6eef4728d518 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:35.963810 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:35.964492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:35.964777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:35.965054 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:35.966851 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:35.980154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:35.982049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:35.994378 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4512/9051] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:35.999624 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:36.012313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac272-3734-4a74-900d-8c5ef35ba253 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:36.022982 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:36.024651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:36.025234 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:36.025855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] PATH_INFO: `/v3/users/3dd0431d03f240089491c8d139048ff5` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:36.027215 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd0431d03f240089491c8d139048ff5)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:36.029143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:36.082424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd0431d03f240089491c8d139048ff5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.083199 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd0431d03f240089491c8d139048ff5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.095158 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd0431d03f240089491c8d139048ff5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.095829 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd0431d03f240089491c8d139048ff5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.102934 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd0431d03f240089491c8d139048ff5'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.117074 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4540/9052] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:53:35 2022] DELETE /identity/v3/users/3dd0431d03f240089491c8d139048ff5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:36.302227 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:36.318466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bda8b-3cfe-468b-aa23-d37a37ad893e service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:36.376555 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:36.377411 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:36.377691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:36.377961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] PATH_INFO: `/v3/projects/521c2948ceb94fe7b5463ec15b2e89d7` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:36.379151 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521c2948ceb94fe7b5463ec15b2e89d7)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:36.381063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:36.428477 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521c2948ceb94fe7b5463ec15b2e89d7', 'request_id': 'req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.433933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521c2948ceb94fe7b5463ec15b2e89d7', 'request_id': 'req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.441562 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521c2948ceb94fe7b5463ec15b2e89d7', 'request_id': 'req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.452338 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] The token cache is being invalidate because project 521c2948ceb94fe7b5463ec15b2e89d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:53:36.452629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.453275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.454866 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4513/9053] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:53:36 2022] DELETE /identity/v3/projects/521c2948ceb94fe7b5463ec15b2e89d7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:36.458945 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:36.460308 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:36.473394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acfd1c-3cc8-4843-960c-377d4e49ebcc admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:36.530386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:36.531295 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:36.531584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:36.531866 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] PATH_INFO: `/v3/users/bdb08a49007a4246b319640877bbd2b8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:36.533073 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb08a49007a4246b319640877bbd2b8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:36.535040 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:36.580058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb08a49007a4246b319640877bbd2b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.580736 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb08a49007a4246b319640877bbd2b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.581889 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:36.594667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb08a49007a4246b319640877bbd2b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.595318 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb08a49007a4246b319640877bbd2b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.602201 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-d13a92da-7121-4d25-a3d0-c398228e9f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb08a49007a4246b319640877bbd2b8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.617626 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4541/9054] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 15:53:36 2022] DELETE /identity/v3/users/bdb08a49007a4246b319640877bbd2b8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:36.786446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:36.788106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:36.800281 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:36.804466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51a57-0f3e-45b9-aefe-fcfa76e6c200 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:36.866254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:36.867120 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:36.867403 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:36.867672 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] PATH_INFO: `/v3/projects/06520d58b52748be9c19644ff3931785` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:36.868875 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06520d58b52748be9c19644ff3931785)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:36.870849 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:36.915691 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06520d58b52748be9c19644ff3931785', 'request_id': 'req-a2120a98-2682-4d2a-acc3-6d52ac6db981'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.921156 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06520d58b52748be9c19644ff3931785', 'request_id': 'req-a2120a98-2682-4d2a-acc3-6d52ac6db981'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.929113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06520d58b52748be9c19644ff3931785', 'request_id': 'req-a2120a98-2682-4d2a-acc3-6d52ac6db981'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.939994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] The token cache is being invalidate because project 06520d58b52748be9c19644ff3931785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:53:36.940589 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.940939 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-a2120a98-2682-4d2a-acc3-6d52ac6db981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:36.942459 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4514/9055] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 15:53:36 2022] DELETE /identity/v3/projects/06520d58b52748be9c19644ff3931785 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:36.947597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:36.947886 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:36.948160 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:36.966863 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:36.968063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:37.027821 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4542/9056] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:37.036306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.036602 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.036882 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.055715 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:37.057070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:37.064860 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4515/9057] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:37.069189 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.078972 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e0b2-0917-4fd7-98d0-935dd9455efc None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.083616 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.084279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.084566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.084847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.085571 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:53:37.085880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.087499 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.099473 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4543/9058] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 15:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:53:37.103579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.113579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2947-c58d-40fd-b7a6-e1b7a55e5bae None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.118297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.118933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.119222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.119502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.120204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.122096 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.147734 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4516/9059] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:53:37.152068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.162786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43274b9e-078a-463d-b6f3-57b6e9ec0a59 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.217984 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.219283 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.219572 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.219853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.220550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.222468 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.243649 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4544/9060] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:53:37.248031 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.258367 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33ef7-c3c4-4cf9-a64a-a65d8977f10a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.263085 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.263749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.264038 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.264319 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.265051 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.267184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.277749 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4517/9061] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:53:37.282368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.292810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ec8c-286f-4a5d-9750-6301ececb600 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.297648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6912350-0e9b-4682-acce-7a87ef0450d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.298326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912350-0e9b-4682-acce-7a87ef0450d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.298648 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912350-0e9b-4682-acce-7a87ef0450d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.298929 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912350-0e9b-4682-acce-7a87ef0450d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.299658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6912350-0e9b-4682-acce-7a87ef0450d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.301289 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6912350-0e9b-4682-acce-7a87ef0450d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.314804 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4545/9062] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:53:37.316001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.326110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690208-c4a1-448d-b91b-f7e84daed9be admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.331364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.332258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.332551 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.332828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] PATH_INFO: `/v3/projects/1817303b217e4befbb2708c32164eb5e/users/f569b1403e77462fb75cb854d6a52af2/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.349088 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1817303b217e4befbb2708c32164eb5e, user_id=f569b1403e77462fb75cb854d6a52af2, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.351806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.364408 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4518/9063] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:53:37 2022] PUT /identity/v3/projects/1817303b217e4befbb2708c32164eb5e/users/f569b1403e77462fb75cb854d6a52af2/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:37.374326 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.374628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.374942 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.401386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] MFA Rules not processed for user `f569b1403e77462fb75cb854d6a52af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:37.402636 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:37.421096 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:37.467650 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4546/9064] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:37.472774 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.505394 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:37.536408 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b0868-4f7c-4547-a435-8b56647b508b admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.541195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.541850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.542168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.542452 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.543186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.545097 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.569532 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4519/9065] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:53:37.573582 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.584987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb14aa-af0e-42f6-9bbf-151cd091203a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.640050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.641178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.641469 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.641747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.642448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.644400 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.663344 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4547/9066] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:53:37.667327 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.677661 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec80c5-5d50-4eba-aa77-d9101fd3ffea admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.682226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.682994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.683284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.683567 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.684297 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.685903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.696908 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4520/9067] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:53:37.701050 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.711562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783fabc-7a8d-4363-ac78-586577574623 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.716229 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.717101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.717393 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.717676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] PATH_INFO: `/v3/projects/3318568a46084710b761965c54166eed/users/feedf3a935d745ae89d3313937e22115/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.732386 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3318568a46084710b761965c54166eed, user_id=feedf3a935d745ae89d3313937e22115, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.735329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.747923 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4548/9068] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:53:37 2022] PUT /identity/v3/projects/3318568a46084710b761965c54166eed/users/feedf3a935d745ae89d3313937e22115/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:37.752296 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.762336 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc680a-ef7c-4e83-91b4-5aafd6ebe292 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.817644 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02c95-8776-40dc-be65-2b22a97929a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.818304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02c95-8776-40dc-be65-2b22a97929a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.818627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02c95-8776-40dc-be65-2b22a97929a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.818909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02c95-8776-40dc-be65-2b22a97929a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.819629 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed02c95-8776-40dc-be65-2b22a97929a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.821231 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed02c95-8776-40dc-be65-2b22a97929a5 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.831411 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4521/9069] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 15:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:53:37.835818 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.846306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb0852-a67e-4570-94b0-1407c39413a3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:37.851021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:37.851901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.852191 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.852474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] PATH_INFO: `/v3/projects/3318568a46084710b761965c54166eed/users/feedf3a935d745ae89d3313937e22115/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.854483 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3318568a46084710b761965c54166eed, user_id=feedf3a935d745ae89d3313937e22115, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:37.857150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:37.867597 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4549/9070] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 15:53:37 2022] PUT /identity/v3/projects/3318568a46084710b761965c54166eed/users/feedf3a935d745ae89d3313937e22115/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:37.878903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:37.879203 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:37.879488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:37.906337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] MFA Rules not processed for user `feedf3a935d745ae89d3313937e22115`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:37.907588 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:37.974308 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4522/9071] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:37.990123 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:37.991910 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:38.067339 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7597b-4056-4de1-a103-a13127a566c3 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:38.073204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d0d76-2af6-4fae-b7d6-405bad822595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:38.073860 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d0d76-2af6-4fae-b7d6-405bad822595 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:38.074145 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d0d76-2af6-4fae-b7d6-405bad822595 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:38.074428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d0d76-2af6-4fae-b7d6-405bad822595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:38.082846 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:38.131312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d0d76-2af6-4fae-b7d6-405bad822595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:38.132889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d0d76-2af6-4fae-b7d6-405bad822595 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:38.142451 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4550/9072] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:41.051012 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:41.052596 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:41.085688 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:41.116442 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c625-0f43-4515-a7ee-a4db39f428c1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:41.120110 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:41.120768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:41.121057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:41.121337 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:41.130607 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:41.132041 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:41.142163 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4523/9073] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:43.696880 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:43.697371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:43.697640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:43.718735 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] MFA Rules not processed for user `f569b1403e77462fb75cb854d6a52af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:43.720135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:43.729101 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4551/9074] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:53:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:44.114947 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.116506 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.128930 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed11dc9-95ea-4d56-866f-91df4f99c4ab service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.132806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.133575 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.133979 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.134612 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.136895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.148314 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.149909 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.159621 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4524/9075] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:44.537903 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.539477 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.626890 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e09f43-b2b8-4d5b-82f4-401b76a1bd3c None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.632505 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.633162 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.633446 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.633720 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.635520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.647794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.649371 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af0464-f1c8-4a60-b965-a7732a43888f service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.659705 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4552/9076] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:46.678380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:46.688365 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7413478-7d6a-4c87-84aa-5df318776ff0 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:46.692423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:46.693415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:46.693893 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:46.694534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:46.696937 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:46.710943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:46.712880 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:46.724018 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4525/9077] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:54.654957 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=58 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:56.719324 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=26 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:48.269313 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:48.269813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:48.270064 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:48.294264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] MFA Rules not processed for user `f569b1403e77462fb75cb854d6a52af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:54:48.295534 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:48.309152 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4553/9078] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:54:51.007230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:54:51.028172 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae659d-5ad9-4977-b950-61feeb383d21 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:54:51.033014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:54:51.033681 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:51.034119 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:51.034270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:51.036057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:51.046361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:54:51.047891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:54:51.063436 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4526/9079] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:54:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:54:58.290561 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:01.053926 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=10 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:01.357344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:01.377299 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7acef6-20e1-4011-ad52-3b1941d4a68d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:01.391329 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:01.391999 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:01.392282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:01.392562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:01.394523 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:01.409526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:01.411060 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:01.424245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4554/9080] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:11.418627 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:31.459455 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:31.471705 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ae49-6c2e-49d9-8ba0-388526081fe5 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:31.475399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:31.476044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:31.476331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:31.476613 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:31.478392 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:31.506080 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:31.507558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf249766-ad37-4717-bf83-621e43efdcf2 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:31.519828 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4527/9081] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:41.513957 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=14 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:17.094597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:56:17.164490 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4c26-d983-49b1-80d8-c5bfaa8cf931 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:56:17.170900 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:56:17.171705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:17.171992 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:17.172395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:17.174845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:17.210376 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:56:17.212043 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:56:17.224523 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4555/9082] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:56:27.218604 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=39 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:27.277903 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e741-0217-49f6-9f1d-3c88e4b6ecd6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:27.278420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e741-0217-49f6-9f1d-3c88e4b6ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:27.278570 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e741-0217-49f6-9f1d-3c88e4b6ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:27.296916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-a629e741-0217-49f6-9f1d-3c88e4b6ecd6 None None] MFA Rules not processed for user `f569b1403e77462fb75cb854d6a52af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:56:27.298728 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-a629e741-0217-49f6-9f1d-3c88e4b6ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:27.307298 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4528/9083] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:56:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:56:37.292146 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:40.342808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:56:40.354898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12feb0-4b0b-4ff5-bdc4-cc4f16e96df9 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:56:40.361448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:56:40.362110 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:40.362394 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:40.362716 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:40.364694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:40.383370 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:56:40.384967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:56:40.396875 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4556/9084] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:56:50.391633 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:13.069772 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33b279-7e70-4ee1-b058-65ee3dfa14b4 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:13.070379 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33b279-7e70-4ee1-b058-65ee3dfa14b4 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:13.070487 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33b279-7e70-4ee1-b058-65ee3dfa14b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:13.130792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-9e33b279-7e70-4ee1-b058-65ee3dfa14b4 None None] MFA Rules not processed for user `afe1d2602f5d4180a9d52fbef485bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:13.131997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-9e33b279-7e70-4ee1-b058-65ee3dfa14b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:13.138658 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4529/9085] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:13.152291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:13.162257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666a6b-c3ac-46c7-b5fb-b7a47017735c service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:13.166065 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09687c94-51b8-4948-b9ba-3dbde40f21a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:13.166865 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687c94-51b8-4948-b9ba-3dbde40f21a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:13.167152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687c94-51b8-4948-b9ba-3dbde40f21a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:13.167428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687c94-51b8-4948-b9ba-3dbde40f21a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:13.175640 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09687c94-51b8-4948-b9ba-3dbde40f21a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:13.177087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09687c94-51b8-4948-b9ba-3dbde40f21a1 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:13.185900 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4557/9086] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:13.270950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea069-570a-4e21-928e-19ed0c6dce77 None None] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:13.271246 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea069-570a-4e21-928e-19ed0c6dce77 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:13.271528 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea069-570a-4e21-928e-19ed0c6dce77 None None] PATH_INFO: `/` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:13.272931 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4530/9087] 10.222.0.77 () {54 vars in 921 bytes} [Mon Jul 11 15:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:13.277541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c194ef-e455-43bf-a38b-6f9259b0f80a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:13.277840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c194ef-e455-43bf-a38b-6f9259b0f80a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:13.278132 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c194ef-e455-43bf-a38b-6f9259b0f80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:13.326182 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-74c194ef-e455-43bf-a38b-6f9259b0f80a None None] MFA Rules not processed for user `d54b9488fd1442f188054731e089bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:13.327421 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-74c194ef-e455-43bf-a38b-6f9259b0f80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:13.347958 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4558/9088] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:13.369497 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea069-570a-4e21-928e-19ed0c6dce77 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:13.371874 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7cdea069-570a-4e21-928e-19ed0c6dce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:13.390293 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea069-570a-4e21-928e-19ed0c6dce77 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:13.395346 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:13.395984 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:13.396275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:13.396566 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:13.405140 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:13.406762 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:13.417235 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4531/9089] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:14.580693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:14.581170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:14.581285 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:14.617988 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:14.619135 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:14.629091 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4559/9090] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:14.638902 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:14.648204 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56873-0142-4004-9bff-227b43f16805 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:14.651790 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:14.652415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:14.652700 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:14.652972 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:14.662850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:14.664258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:14.675245 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4532/9091] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:57:14.733884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:14.745987 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78859c2-37c2-46dd-82b1-eeeab5beec98 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:14.751080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:14.751780 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:14.752611 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:14.752895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:14.754686 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:14.765858 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:14.767456 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:14.777709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4560/9092] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:17.121710 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:17.133396 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0da476-c664-4e5b-a317-81765fa72ee0 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:17.138565 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:17.139233 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:17.139517 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:17.139793 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:17.141579 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:17.153857 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:17.155451 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:17.165108 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4533/9093] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:24.773059 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=39 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:27.160983 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=36 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:30.214764 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:30.225194 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e072cb-b9ee-4803-b5eb-3bd4f381d235 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:30.230344 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:30.231026 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:30.231314 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:30.231592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:30.233355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:30.245734 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:30.248021 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d67ce-e0ad-49e1-81da-caf90cd5ea84 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:30.259185 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4561/9094] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:38.078729 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.080749 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:38.097405 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aab944-2734-4378-bd81-64c5e86c6da1 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:38.102932 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:38.103581 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.103872 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.104160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.105918 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:38.118473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:38.120795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:38.132425 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4534/9095] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:40.254888 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:48.127873 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:18.247793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.248360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.248360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.266452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] MFA Rules not processed for user `f569b1403e77462fb75cb854d6a52af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:18.268253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:18.275920 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4562/9096] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:28.261422 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:53.971696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.982864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ab9ff-9594-45c3-ba20-5a0e3fc13e5d service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.989369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.990009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.990299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.990615 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.998270 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.999883 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:54.008662 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4535/9097] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:04.004635 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:51.098669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:51.109671 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff42e-bb35-444c-b7e0-212adca89c94 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:51.114287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:51.115589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:51.116259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:51.116578 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:51.124906 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:51.126548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:51.135692 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4563/9098] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:57.389641 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:57.400719 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8658-53c0-4758-8702-c50a36df161d service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:57.405745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:57.406380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:57.406819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:57.407098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:57.408850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:57.420987 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:57.422650 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c07956-e0ba-4480-a331-5f5f4ac1f43f service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:57.433259 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4536/9099] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:00:00.225440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:00.234152 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eb818-2b1f-4d3f-8026-83f437108b6c service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:00.238001 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a73ac-b9d5-4fdf-9aca-71e3746deb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:00.238678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a73ac-b9d5-4fdf-9aca-71e3746deb90 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:00.238967 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a73ac-b9d5-4fdf-9aca-71e3746deb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:00.239281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a73ac-b9d5-4fdf-9aca-71e3746deb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:00.248646 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a73ac-b9d5-4fdf-9aca-71e3746deb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:00.250148 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a73ac-b9d5-4fdf-9aca-71e3746deb90 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:00.260985 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4564/9100] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:03.149098 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:03.150444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:03.150777 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:03.176316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] MFA Rules not processed for user `f569b1403e77462fb75cb854d6a52af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:03.178444 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:03.189703 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4537/9101] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:03.226031 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:03.226460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:03.226750 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:03.285676 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] MFA Rules not processed for user `f2258fe4b6c14d378fcfdd1fb690f179`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:03.287154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:03.357430 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4565/9102] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Jul 11 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:03.364009 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:03.374799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e353fa-72e9-42a1-bde5-32f4b55bdf69 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:03.379460 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:03.381290 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:03.381855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:03.382356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:03.396865 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:03.398633 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:03.412583 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4538/9103] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:03.717154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:03.726530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7c23-00a0-40ae-a2ff-11262e9b289d None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:03.730058 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:03.730776 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:03.731037 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:03.731315 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:03.733081 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:03.743904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:03.745460 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:03.753834 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4566/9104] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:05.977192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:05.989757 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c9c33-1563-47be-bc2c-64cdf4235635 service glance] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:05.993703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:05.994653 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:05.995226 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:05.995859 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:06.004656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:06.006345 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:06.015913 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4539/9105] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:00:13.749986 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=56 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:16.012464 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=21 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:49.840919 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:49.849442 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a031d72-ef0b-401c-88bf-8eb9ccbdb908 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:49.853036 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:49.853666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:49.853951 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:49.854230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:49.865079 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:49.866484 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:49.877068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4567/9106] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:59.872407 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:01.537146 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:01.549795 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585a20-6e74-4945-94ac-c18cca27160b service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:01.554966 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:01.555601 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:01.555885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:01.556163 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:01.557906 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:01.570554 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:01.572213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb9632-9e9a-43cc-a785-c2ae6c3be4ea service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:01.590243 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4540/9107] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:01.796657 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:01.897428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e09a5-5afb-4e3d-9d97-831f9f4ddfe8 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:01.901960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:01.902855 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:01.903139 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:01.903413 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] PATH_INFO: `/v3/users/f569b1403e77462fb75cb854d6a52af2` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:01.904591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f569b1403e77462fb75cb854d6a52af2)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:01.906552 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:01.953401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f569b1403e77462fb75cb854d6a52af2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:01.953996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f569b1403e77462fb75cb854d6a52af2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:01.966525 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f569b1403e77462fb75cb854d6a52af2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:01.967169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f569b1403e77462fb75cb854d6a52af2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:01.974515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f569b1403e77462fb75cb854d6a52af2'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:01.987709 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4568/9108] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 16:01:01 2022] DELETE /identity/v3/users/f569b1403e77462fb75cb854d6a52af2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:01.992504 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:01.992800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:01.993082 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.030617 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:02.031844 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:02.089273 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4541/9109] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:02.099806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:02.101518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:02.157708 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f67e2-eb1b-42b1-b4cd-a9e4747db82e admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:02.162016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:02.162693 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:02.162983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:02.163286 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.172385 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:02.173813 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:02.183357 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4569/9110] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:02.354230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:02.355768 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:02.368850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1602a-af3e-4ed2-8dd3-c28b3508f96e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:02.373538 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:02.374406 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:02.374724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:02.375010 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] PATH_INFO: `/v3/projects/1817303b217e4befbb2708c32164eb5e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.376361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1817303b217e4befbb2708c32164eb5e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:02.378317 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:02.424999 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1817303b217e4befbb2708c32164eb5e', 'request_id': 'req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.431448 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1817303b217e4befbb2708c32164eb5e', 'request_id': 'req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.438753 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1817303b217e4befbb2708c32164eb5e', 'request_id': 'req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.450035 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] The token cache is being invalidate because project 1817303b217e4befbb2708c32164eb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:01:02.450324 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.450978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.452551 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4542/9111] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 16:01:02 2022] DELETE /identity/v3/projects/1817303b217e4befbb2708c32164eb5e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:02.456617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:02.462757 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:02.466757 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103413e-8312-4cbc-903e-ee23d0e62559 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:02.525911 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:02.526897 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:02.527184 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:02.527461 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] PATH_INFO: `/v3/users/feedf3a935d745ae89d3313937e22115` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.528675 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feedf3a935d745ae89d3313937e22115)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:02.530626 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:02.575236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feedf3a935d745ae89d3313937e22115'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.575902 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feedf3a935d745ae89d3313937e22115'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.587507 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feedf3a935d745ae89d3313937e22115'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.588203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feedf3a935d745ae89d3313937e22115'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.595178 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-39c0e793-a59a-48bf-9408-c96a1ffe7d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feedf3a935d745ae89d3313937e22115'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:02.608723 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4570/9112] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 16:01:02 2022] DELETE /identity/v3/users/feedf3a935d745ae89d3313937e22115 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:02.885860 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:02.887399 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:02.901534 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da146b4-b2d3-4c19-9a8e-ac1351fa6527 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:02.950122 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:02.961154 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:02.962056 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:02.962349 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:02.962687 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] PATH_INFO: `/v3/projects/3318568a46084710b761965c54166eed` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.963888 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3318568a46084710b761965c54166eed)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:02.965847 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.011760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3318568a46084710b761965c54166eed', 'request_id': 'req-d426a4be-e91f-4299-8a09-799dac931d6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:03.017095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3318568a46084710b761965c54166eed', 'request_id': 'req-d426a4be-e91f-4299-8a09-799dac931d6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:03.024940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3318568a46084710b761965c54166eed', 'request_id': 'req-d426a4be-e91f-4299-8a09-799dac931d6b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:03.035822 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] The token cache is being invalidate because project 3318568a46084710b761965c54166eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:01:03.036113 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:03.036745 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d426a4be-e91f-4299-8a09-799dac931d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:03.038316 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4543/9113] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 16:01:02 2022] DELETE /identity/v3/projects/3318568a46084710b761965c54166eed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:03.043654 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.044143 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.044253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.081810 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:03.083668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:03.142070 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4571/9114] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:03.151502 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.151800 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.152087 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.170369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:03.171622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:03.180048 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4544/9115] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:03.184105 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.194379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca054b4a-0119-43b5-b310-04ab613231af None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.199281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.199940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.200232 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.200517 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.201249 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80989) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:01:03.201558 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.203204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.205613 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:03.217820 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4572/9116] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 16:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:01:03.221922 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.231360 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83d6e3-5c3e-47a3-b546-072cac90de7c None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.236371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.237018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.237310 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.237593 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.238284 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.240216 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.276661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4545/9117] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 16:01:03 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:01:03.280771 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.290747 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f96cf-52c7-41d6-ba8d-85cc0773cd23 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.346755 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.347416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.347699 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.347976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.348659 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.350584 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.370609 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4573/9118] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 16:01:03 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:01:03.374699 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.386708 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d408e-4257-4efe-a540-2f5fab7998ae admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.391358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.392018 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.392309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.392590 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.393322 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.394957 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.404883 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4546/9119] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:01:03.409030 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.419416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5aa94-4a8d-48c9-bc4f-6eb8c19efe30 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.424169 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef64b03-aeb4-4c1e-94a4-b338861a92b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.424817 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef64b03-aeb4-4c1e-94a4-b338861a92b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.425100 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef64b03-aeb4-4c1e-94a4-b338861a92b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.425379 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef64b03-aeb4-4c1e-94a4-b338861a92b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.426094 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef64b03-aeb4-4c1e-94a4-b338861a92b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.428259 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef64b03-aeb4-4c1e-94a4-b338861a92b5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.438151 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4574/9120] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:01:03.441994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.452724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb6c50-2606-4817-904d-6aa113efacd7 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.457662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.458623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.458913 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.459192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] PATH_INFO: `/v3/projects/6ca75e4f2a414a8e8928f268ea5baf96/users/3f4e643c88534bd9b69f7b576215f87b/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.475827 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca75e4f2a414a8e8928f268ea5baf96, user_id=3f4e643c88534bd9b69f7b576215f87b, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.478546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.496065 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4547/9121] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 16:01:03 2022] PUT /identity/v3/projects/6ca75e4f2a414a8e8928f268ea5baf96/users/3f4e643c88534bd9b69f7b576215f87b/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:03.501366 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798398f3-1b05-4aac-9322-39a27a078298 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.501678 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798398f3-1b05-4aac-9322-39a27a078298 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.501957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798398f3-1b05-4aac-9322-39a27a078298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.520396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-798398f3-1b05-4aac-9322-39a27a078298 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:03.521608 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-798398f3-1b05-4aac-9322-39a27a078298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:03.580245 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4575/9122] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:03.590225 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:03.591994 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:03.648505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd601ae-3685-4f95-8780-adf4759334a1 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:03.652232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:03.652904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:03.653191 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:03.653469 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:03.662431 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:03.663884 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:03.673264 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4548/9123] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:01:07.693773 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:07.694236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:07.694343 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:07.732025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] MFA Rules not processed for user `3f4e643c88534bd9b69f7b576215f87b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:07.733288 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:07.814002 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4576/9124] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:07.819299 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:07.829673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3300e-e4ef-4612-a6e5-fa3fdd74e5d3 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:07.835243 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:07.836025 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:07.836424 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:07.836770 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] PATH_INFO: `/v3/projects` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:07.837550 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:07.839654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:07.850335 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:07.868306 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4549/9125] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 16:01:07 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:01:07.872629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:07.879426 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:07.884603 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeff22-0df1-4f49-8b41-b7ebc4ccf507 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:07.947976 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:07.948667 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:07.948957 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:07.949241 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:07.949940 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:07.951970 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:07.974539 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4577/9126] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 16:01:07 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:01:07.977122 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:07.988285 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9157-de0b-4c95-85fb-25f4a452d223 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:07.994320 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:07.995045 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:07.995340 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:07.995623 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:07.996361 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:07.998064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:08.009967 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4550/9127] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:01:08.014360 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:08.025892 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f65d6c-6526-48a6-917d-95ca8cfd43b9 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:08.031029 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:08.031944 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:08.032236 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:08.032515 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] PATH_INFO: `/v3/projects/2fca132d52c84d068289b05fa830d909/users/836146db20804d93939d39828a342c85/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:08.059333 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fca132d52c84d068289b05fa830d909, user_id=836146db20804d93939d39828a342c85, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:08.062104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:08.079159 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4578/9128] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 16:01:08 2022] PUT /identity/v3/projects/2fca132d52c84d068289b05fa830d909/users/836146db20804d93939d39828a342c85/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:01:08.083746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:08.094539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee29bf3-aa4c-4e1d-9474-dfdc88bf70c4 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:08.185155 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfb985-6724-40e8-9f08-f1bcacf1c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:08.185832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb985-6724-40e8-9f08-f1bcacf1c797 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:08.186115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb985-6724-40e8-9f08-f1bcacf1c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:08.186389 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb985-6724-40e8-9f08-f1bcacf1c797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:08.187152 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfb985-6724-40e8-9f08-f1bcacf1c797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:08.188754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfb985-6724-40e8-9f08-f1bcacf1c797 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:08.201994 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4551/9129] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:01:08.203350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:08.214358 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772e57-8dc4-48c7-bc57-6180c0f94b26 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:08.219101 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:08.219995 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:08.220274 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:08.220548 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] PATH_INFO: `/v3/projects/2fca132d52c84d068289b05fa830d909/users/836146db20804d93939d39828a342c85/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:08.222537 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fca132d52c84d068289b05fa830d909, user_id=836146db20804d93939d39828a342c85, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:08.225752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:08.241529 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4579/9130] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 16:01:08 2022] PUT /identity/v3/projects/2fca132d52c84d068289b05fa830d909/users/836146db20804d93939d39828a342c85/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:12.990989 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355426-b760-45a3-ba24-4eca2fd6b038 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:12.991527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355426-b760-45a3-ba24-4eca2fd6b038 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:12.991527 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355426-b760-45a3-ba24-4eca2fd6b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:13.019103 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-57355426-b760-45a3-ba24-4eca2fd6b038 None None] MFA Rules not processed for user `836146db20804d93939d39828a342c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:13.020265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-57355426-b760-45a3-ba24-4eca2fd6b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:13.097088 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4552/9131] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:13.115528 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:13.118514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:13.196930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6e10-e282-4e5b-a9dd-d4fcf74c05d2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:13.202767 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:13.203424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:13.203706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:13.203980 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:13.258004 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:13.262035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:13.264593 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:13.278068 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4580/9132] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:14.344052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:14.344518 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:14.344616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:14.363407 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] MFA Rules not processed for user `3f4e643c88534bd9b69f7b576215f87b`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:14.366167 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:14.373341 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4553/9133] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:15.002756 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:15.004192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:15.087661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0afc-5155-401e-8d6c-4e880e7ab4a1 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:15.092895 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:15.093560 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:15.093847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:15.094128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:15.096039 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:15.108592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:15.110208 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:15.120979 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4581/9134] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:24.357404 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:25.116489 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=35 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:25.762347 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:25.763792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:25.818928 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1d40-e462-4fda-b4d9-0578db6889ba None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:25.822519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:25.823158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:25.823441 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:25.823716 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:25.832639 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:25.834077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:25.843542 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4554/9135] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:35.839264 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=26 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:39.167633 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:39.178221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1bc5d-6b3d-476d-b515-b59bfa236fdd service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:39.183879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:39.184520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:39.184808 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:39.185087 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:39.186905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:39.198303 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:39.199912 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec422db-488a-4191-8e61-8e6e49557ba8 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:39.210352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4582/9136] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:02:40.720493 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:40.721908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:40.736230 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2c7a9-b30b-4fd0-ae1c-6f3d01b0abf1 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:40.741420 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:40.742047 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:40.742331 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:40.742645 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:40.744901 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:40.756621 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:40.758184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:40.768849 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4555/9137] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:49.205986 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:50.764395 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:36.263690 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.264778 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.265317 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.336091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:36.337435 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.412515 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4583/9138] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:36.459832 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.461250 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.549369 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8483-3d01-4d45-8ffe-c9ff1fafccbe service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.554383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0825-8058-483b-b664-50d6d887552b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.555064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0825-8058-483b-b664-50d6d887552b service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.555354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0825-8058-483b-b664-50d6d887552b service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.555638 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0825-8058-483b-b664-50d6d887552b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.563668 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0825-8058-483b-b664-50d6d887552b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.565244 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0825-8058-483b-b664-50d6d887552b service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.573332 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4556/9139] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:03:38.067038 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.086163 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d0d6e-a631-4e7a-b433-547dfbbb2204 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.095239 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.098035 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.098601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.098601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.101936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:38.118130 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.120045 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.133957 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4584/9140] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:46.570054 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=41 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:48.128320 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=50 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:49.469576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.470168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.470168 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.494039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] MFA Rules not processed for user `0522dc9e5943446fbaffdcd857728b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:49.497387 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.507055 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4557/9141] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Jul 11 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:49.518518 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.519952 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.578816 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4368-c40e-47e5-8c83-87d6486f1375 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:49.582449 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2258fe4b6c14d378fcfdd1fb690f179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:49.583157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.583443 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.583724 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.594061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:49.595524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:49.607140 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4585/9142] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:49.670294 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.680604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f1a3-d0dd-4d45-8438-f59e27a5e6da None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:49.684185 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:49.684819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.685102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.685376 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.687192 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.696423 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:49.697840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:49.705579 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4558/9143] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:49.779109 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.789071 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae863526-ae2d-441f-9a5e-5b28afdff716 service glance] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:49.792731 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:49.793374 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.793658 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.793936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.795741 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.808840 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:49.810255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:49.820944 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4586/9144] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:49.879809 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.891576 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec205b-7534-4880-bc9b-b0b41b2e77aa service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:49.897111 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:49.897738 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.898023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.898325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.900100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.911743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:49.913304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a69b2-a289-4ba5-bdf8-75e8ff448a07 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:49.922903 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4559/9145] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:51.508452 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.526074 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035fd4-feee-4e66-80a8-385623fd2b24 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.531888 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.532651 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.533006 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.533355 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.535294 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.549185 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.550884 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.573560 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4587/9146] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:52.196714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa31bbc-752b-4e4e-a48a-e2c0763ffb29 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.197251 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa31bbc-752b-4e4e-a48a-e2c0763ffb29 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.197531 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa31bbc-752b-4e4e-a48a-e2c0763ffb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.215546 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-ffa31bbc-752b-4e4e-a48a-e2c0763ffb29 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:52.216858 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-ffa31bbc-752b-4e4e-a48a-e2c0763ffb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:52.224155 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4560/9147] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:52.235964 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.248416 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2949f-0e11-40e8-a0d1-f19284a4c8cc service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.253436 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.254121 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.254409 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.255270 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.264063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.265647 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.274107 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4588/9148] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:03:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:04:02.210513 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=18 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:02.270571 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=44 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:05.609150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:05.609678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:05.609678 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:05.628476 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:05.629706 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:05.637487 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4561/9149] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:05.649867 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:05.660336 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc4d98-16f9-42b9-bf0f-4569a9bfc248 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:05.666512 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:05.667346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:05.667666 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:05.667974 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:05.676927 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:05.678638 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:05.686851 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4589/9150] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:04:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:04:15.623124 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=3 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:15.683472 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:18.215818 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.217813 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.234542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91333a8f-ea7b-4376-86c6-44a938d8e444 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.243384 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.244052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.244938 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.245234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.247116 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.260908 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.262572 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.273924 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4562/9151] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:18.373265 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.397160 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.398596 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047910-d9ee-48e0-ac2c-d2089514e60b service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.402661 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.403684 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.404017 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.404444 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.407505 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe515-ef00-438b-84dd-67524923d513 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.407754 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.411295 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.412118 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.412404 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.412684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.414730 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.418547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.420049 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575262c-a212-4ad4-85f7-ff139406fd27 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.430248 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4590/9152] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:18.430415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.431940 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.444991 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4563/9153] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:05:23.057453 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:23.057848 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:23.058015 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:23.076264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] MFA Rules not processed for user `3f4e643c88534bd9b69f7b576215f87b`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:23.077514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:23.084481 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4591/9154] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:28.439479 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=12 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:33.070853 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=13 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:38.523703 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:38.532254 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91516d3e-f99d-4b58-a0aa-350899cfb569 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:38.535910 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:38.537195 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:38.537483 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:38.537760 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:38.539552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:38.548720 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:38.550135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:38.557845 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4564/9155] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:40.683949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:40.695859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3621173-68b8-4ae7-84f2-e3cbfc5c5cce None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:40.699879 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:40.700597 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:40.700889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:40.701170 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:40.703368 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:40.722574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:40.724244 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:40.733903 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4592/9156] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:48.554420 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:50.729711 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=6 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:50.732702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:50.741803 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb8608-3c5e-435e-9887-e9601c695003 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:50.745724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:50.746371 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:50.746746 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:50.747141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:50.749049 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:50.762577 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:50.763988 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:50.775595 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4565/9157] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:06:00.770395 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:43.678248 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:43.738798 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54908-ad38-4cb3-8aa6-5b157b9a4b92 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:43.744253 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:43.744905 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:43.745195 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:43.745478 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:43.754555 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:43.756072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:43.765981 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4593/9158] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:07:44.146057 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:44.188698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb12b-3105-4a9a-90ad-a1b2eb691e38 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:44.193933 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:44.194604 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:44.194891 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:44.195174 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:44.203667 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:44.205286 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:44.214983 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4566/9159] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:07:53.761718 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=27 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:54.210905 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=20 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:54.288681 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:54.318061 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9bfb1-307c-4fef-9dd7-ebee10899c3a service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:54.323566 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:54.324217 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:54.324511 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:54.324792 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:54.333141 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:54.334797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:54.343770 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4594/9160] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:07:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:08:04.339657 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=13 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:47.394806 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:09:47.415217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc99ac5-ea8b-462e-8949-e00ca819f086 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:09:47.420869 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:09:47.421529 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:09:47.421819 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:09:47.422132 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:09:47.432885 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:09:47.434514 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:09:47.445956 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4567/9161] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:09:54.949668 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:09:54.959635 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0945-057f-4026-94d7-9c0e1aa18dba service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:09:54.963264 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:09:54.963898 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:09:54.964192 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:09:54.964467 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:09:55.027960 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:09:55.029430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:09:55.040120 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4595/9162] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:09:57.441257 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:58.293385 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:09:58.305503 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9082aa-f6b5-4965-8e30-1b2190fd3a2a service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:09:58.311608 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:09:58.312282 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:09:58.312569 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:09:58.312912 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:09:58.314845 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:09:58.349445 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:09:58.351100 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:09:58.370159 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4568/9163] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:01.173426 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:01.194562 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee588704-6ddd-4ee1-be00-bcb5891fc006 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:01.201252 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:01.201915 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:01.202203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:01.202482 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:01.204316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:01.217027 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:01.218701 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:01.229448 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4596/9164] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:01.243824 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:01.256106 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134c7f1-93e0-4d1e-a637-8b335ca4342e service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:01.262364 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:01.263139 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:01.263425 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:01.263702 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] PATH_INFO: `/v3/users/3f4e643c88534bd9b69f7b576215f87b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:01.272558 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4e643c88534bd9b69f7b576215f87b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:01.274698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:01.328180 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4e643c88534bd9b69f7b576215f87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.340654 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4e643c88534bd9b69f7b576215f87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.347950 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4e643c88534bd9b69f7b576215f87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.356695 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4e643c88534bd9b69f7b576215f87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.357714 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4e643c88534bd9b69f7b576215f87b'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.364458 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4569/9165] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 16:10:01 2022] DELETE /identity/v3/users/3f4e643c88534bd9b69f7b576215f87b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:10:01.542679 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:01.553704 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddd180-78ec-4b1b-a1c5-e7c49f745d6b service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:01.616996 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:01.617853 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:01.618138 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:01.618411 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] PATH_INFO: `/v3/projects/6ca75e4f2a414a8e8928f268ea5baf96` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:01.619628 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca75e4f2a414a8e8928f268ea5baf96)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:01.621889 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:01.667950 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca75e4f2a414a8e8928f268ea5baf96', 'request_id': 'req-fb37ef14-b7a7-4048-bed3-60814c9617ae'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.674936 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca75e4f2a414a8e8928f268ea5baf96', 'request_id': 'req-fb37ef14-b7a7-4048-bed3-60814c9617ae'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.681078 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca75e4f2a414a8e8928f268ea5baf96', 'request_id': 'req-fb37ef14-b7a7-4048-bed3-60814c9617ae'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.691878 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] The token cache is being invalidate because project 6ca75e4f2a414a8e8928f268ea5baf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:10:01.692161 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.692782 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.694293 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4597/9166] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 16:10:01 2022] DELETE /identity/v3/projects/6ca75e4f2a414a8e8928f268ea5baf96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:10:01.698447 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:01.699926 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:01.712915 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186e4d-6620-4fa0-986c-e032c7d8cc59 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:01.772427 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:01.773223 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:01.773508 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:01.774014 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] PATH_INFO: `/v3/users/836146db20804d93939d39828a342c85` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:01.775232 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] RBAC: Authorizing `identity:delete_user(user_id=836146db20804d93939d39828a342c85)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:01.777175 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:01.821419 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:01.828044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836146db20804d93939d39828a342c85'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.842839 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836146db20804d93939d39828a342c85'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.850123 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836146db20804d93939d39828a342c85'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.858634 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836146db20804d93939d39828a342c85'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.859287 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-b214296d-35c9-4259-b767-5bf895c8055d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836146db20804d93939d39828a342c85'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:01.865603 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4570/9167] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 16:10:01 2022] DELETE /identity/v3/users/836146db20804d93939d39828a342c85 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:10:02.037235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.038709 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:02.058327 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ef14-b7a7-4048-bed3-60814c9617ae admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.067114 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:02.117547 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.118410 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.118727 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.119008 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] PATH_INFO: `/v3/projects/2fca132d52c84d068289b05fa830d909` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.120209 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fca132d52c84d068289b05fa830d909)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.122125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.167691 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fca132d52c84d068289b05fa830d909', 'request_id': 'req-84fc6133-f2a8-40ad-91a3-6874511e5a5f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:02.174580 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fca132d52c84d068289b05fa830d909', 'request_id': 'req-84fc6133-f2a8-40ad-91a3-6874511e5a5f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:02.180589 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fca132d52c84d068289b05fa830d909', 'request_id': 'req-84fc6133-f2a8-40ad-91a3-6874511e5a5f'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:02.191529 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] The token cache is being invalidate because project 2fca132d52c84d068289b05fa830d909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80989) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:10:02.191809 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:02.192431 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-84fc6133-f2a8-40ad-91a3-6874511e5a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:10:02.193942 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4598/9168] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 16:10:02 2022] DELETE /identity/v3/projects/2fca132d52c84d068289b05fa830d909 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:10:02.199812 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.200144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.200410 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.228275 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:10:02.229494 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:02.287154 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4571/9169] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:10:02.295455 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.295742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.296016 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.315213 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:10:02.316401 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:02.324658 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4599/9170] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:10:02.328791 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.338584 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6e631-63ad-4b56-b61b-fa6231b8a14e None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.343306 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.343982 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.344271 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.344552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.345304 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80990) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:10:02.345616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.347265 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.359472 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4572/9171] 10.222.0.77 () {58 vars in 1152 bytes} [Mon Jul 11 16:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:10:02.363293 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.373842 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f98dc-eb5e-4a0d-98e8-793fdecced7b None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.378591 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.379242 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.379530 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.379807 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.380502 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.382457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.406972 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4600/9172] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 16:10:02 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:10:02.410955 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.421542 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e5b55-5ac8-45eb-b3c2-24e0f5e8ef6e admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.477357 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.478020 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.478309 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.478627 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.479316 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.481255 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.501426 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4573/9173] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 16:10:02 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:10:02.505474 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.515870 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed34a-188c-44c5-b752-e4b7a3e44d53 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.520669 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.521331 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.521619 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.521901 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.522719 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.524350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.534774 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4601/9174] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:10:02.539115 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.548981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9ba1-1d8b-4127-8a0f-d51fd6c2940a admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.553616 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28e763-7aca-4ba2-8484-44cff0d52772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.554840 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28e763-7aca-4ba2-8484-44cff0d52772 admin admin] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.555133 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28e763-7aca-4ba2-8484-44cff0d52772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.555415 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28e763-7aca-4ba2-8484-44cff0d52772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.556143 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28e763-7aca-4ba2-8484-44cff0d52772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.557727 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28e763-7aca-4ba2-8484-44cff0d52772 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.567511 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4574/9175] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:10:02.571568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.581533 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ded55c-19a9-4b08-883e-a43e64ece130 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.586822 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.587694 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.587983 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.588267 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] PATH_INFO: `/v3/projects/043681f48f60450f95e7ef3d78175a5e/users/cb7ed90a9d35448db6fe7f1528fd9df8/roles/26950413237349fdbc8f22b4a35296e3` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.603601 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043681f48f60450f95e7ef3d78175a5e, user_id=cb7ed90a9d35448db6fe7f1528fd9df8, role_id=26950413237349fdbc8f22b4a35296e3)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.606235 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.620514 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4602/9176] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 16:10:02 2022] PUT /identity/v3/projects/043681f48f60450f95e7ef3d78175a5e/users/cb7ed90a9d35448db6fe7f1528fd9df8/roles/26950413237349fdbc8f22b4a35296e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:10:02.625916 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f3b1-6409-4299-8d0c-354f14c492f1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.626213 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f3b1-6409-4299-8d0c-354f14c492f1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.626549 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f3b1-6409-4299-8d0c-354f14c492f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.643944 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-c178f3b1-6409-4299-8d0c-354f14c492f1 None None] MFA Rules not processed for user `99da4aa360e0445583e1621d96997686`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:10:02.645141 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-c178f3b1-6409-4299-8d0c-354f14c492f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:02.654711 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:02.705231 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4575/9177] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:10:02.715364 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:02.717070 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:02.759616 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:02.787797 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214fa4-64b8-4a58-8805-f894dcf610b0 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:02.792204 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:02.792794 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:02.793083 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:02.793395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:02.802367 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:02.803834 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:02.813391 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4603/9178] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:06.448273 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.448797 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.448920 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.476249 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] MFA Rules not processed for user `cb7ed90a9d35448db6fe7f1528fd9df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:10:06.477443 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:06.551114 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4576/9179] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:10:06.555290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:06.566347 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37c67-146a-4d43-b493-82e030118d04 service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:06.571399 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:06.572005 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.572290 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.572570 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.573278 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:06.575255 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:06.602791 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4604/9180] 10.222.0.77 () {60 vars in 1152 bytes} [Mon Jul 11 16:10:06 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:10:06.606904 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:06.618219 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55c41-3161-4738-b554-2f169e2cceb1 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:06.677697 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:06.678380 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.678732 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.679016 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.679718 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:06.681648 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:06.703581 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4577/9181] 10.222.0.77 () {60 vars in 1143 bytes} [Mon Jul 11 16:10:06 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:10:06.708150 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:06.724429 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25165-bb4b-4184-9d6a-e8d82a9c85e7 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:06.734887 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:06.735742 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.736041 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.736388 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.737230 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:06.738861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:06.750305 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4605/9182] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:10:06.754484 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:06.765978 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62192a-b48d-4909-98ef-ffba01883e88 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:06.772158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:06.773829 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.774176 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.774539 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] PATH_INFO: `/v3/projects/e982438c6be241ca868a110b5af224b1/users/20f6899f964149688cb70d82603989f1/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.791486 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982438c6be241ca868a110b5af224b1, user_id=20f6899f964149688cb70d82603989f1, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:06.794247 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:06.808375 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4578/9183] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 16:10:06 2022] PUT /identity/v3/projects/e982438c6be241ca868a110b5af224b1/users/20f6899f964149688cb70d82603989f1/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:10:06.812706 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:06.824104 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0c157-3e03-408f-b5bc-5436d3878e4b admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:06.889128 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6689-4471-4c05-b20b-9b755d13da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:06.889806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6689-4471-4c05-b20b-9b755d13da80 admin admin] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.890120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6689-4471-4c05-b20b-9b755d13da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.890395 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6689-4471-4c05-b20b-9b755d13da80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.891203 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6689-4471-4c05-b20b-9b755d13da80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:06.894090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6689-4471-4c05-b20b-9b755d13da80 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:06.905872 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4606/9184] 10.222.0.77 () {58 vars in 1121 bytes} [Mon Jul 11 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:10:06.909855 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:06.922905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192e60-ba6e-4a99-a13e-2cd4bfd1dbba admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:06.928767 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:06.929673 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] REQUEST_METHOD: `PUT` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:06.929961 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:06.930239 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] PATH_INFO: `/v3/projects/e982438c6be241ca868a110b5af224b1/users/20f6899f964149688cb70d82603989f1/roles/70eee5d669654151b878064c431c4f7b` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:06.933063 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982438c6be241ca868a110b5af224b1, user_id=20f6899f964149688cb70d82603989f1, role_id=70eee5d669654151b878064c431c4f7b)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:06.936541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:06.945300 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:06.950441 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4579/9185] 10.222.0.77 () {60 vars in 1482 bytes} [Mon Jul 11 16:10:06 2022] PUT /identity/v3/projects/e982438c6be241ca868a110b5af224b1/users/20f6899f964149688cb70d82603989f1/roles/70eee5d669654151b878064c431c4f7b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:10:11.577173 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24854-4f67-46e5-b81c-4cffe9362894 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:11.578068 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24854-4f67-46e5-b81c-4cffe9362894 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:11.578531 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24854-4f67-46e5-b81c-4cffe9362894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:11.611752 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-d3a24854-4f67-46e5-b81c-4cffe9362894 None None] MFA Rules not processed for user `20f6899f964149688cb70d82603989f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:10:11.612985 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-d3a24854-4f67-46e5-b81c-4cffe9362894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:11.698352 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4607/9186] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:10:11.713079 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:11.715359 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:11.847509 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a987a-6772-4bbc-95c9-9bf0973348df admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:11.857102 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:11.857894 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:11.858073 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:11.858351 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:11.920050 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:11.921722 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:11.932414 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4580/9187] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:13.966223 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:13.967120 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:13.967405 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:13.987581 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] MFA Rules not processed for user `cb7ed90a9d35448db6fe7f1528fd9df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:10:13.988791 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:13.996520 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4608/9188] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:10:14.313190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:14.370107 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f4b6-8665-4e73-976c-3842e828fe15 service nova] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:14.374552 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:14.375381 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:14.375808 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:14.376186 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:14.378234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:14.389905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:14.391519 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:14.401367 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4581/9189] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:14.732091 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:14.733705 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:14.750305 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:14.820080 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a1e2-df08-4397-a48d-9f572e04e129 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:14.825287 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:14.826257 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:14.826574 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:14.826859 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:14.828664 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:14.841316 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:14.842943 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:14.854285 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4609/9190] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:19.304437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:19.313034 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de205-bac2-4fec-8ac2-5ff134dd45c6 service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:19.316684 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:19.317325 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:19.317610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:19.317887 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:19.320266 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:19.333683 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:19.335205 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:19.346294 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4582/9191] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:22.055650 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:22.057221 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:22.072729 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b497-1ca1-482c-adcf-e6fed5766df0 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:22.078282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:22.078958 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:22.079243 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:22.079526 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:22.081302 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:22.094504 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:22.096102 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:22.107910 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4610/9192] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:24.757070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:24.765798 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd896d-1ecb-4318-8d2d-67f1163b376e service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:24.769724 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:24.770430 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:24.770799 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:24.771076 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:24.781126 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:24.782609 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:24.788410 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=100 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:24.793509 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4583/9193] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:26.355520 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:26.367514 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efac3d-4a1b-4a41-bb81-a58ff8398816 service nova] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:26.373346 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0522dc9e5943446fbaffdcd857728b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:26.373993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:26.374281 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:26.374595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:26.376396 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:26.389190 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:26.390786 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d671cb-4dfa-45fc-a15e-957a3e0640f7 service nova] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:26.401919 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4611/9194] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:36.396809 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=39 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:34.394211 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:34.403453 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1295303-1171-4734-8f78-229c8218e14c service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:34.407101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:34.407743 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:34.408033 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:34.408313 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:34.410086 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:34.420042 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:34.421492 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:34.429294 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4584/9195] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:11:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:44.425879 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:27.755989 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aad46a-fd66-43f9-8dc1-13f29f550a2d None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:27.756524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aad46a-fd66-43f9-8dc1-13f29f550a2d None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:27.756785 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aad46a-fd66-43f9-8dc1-13f29f550a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:27.774804 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-b2aad46a-fd66-43f9-8dc1-13f29f550a2d None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:12:27.775949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-b2aad46a-fd66-43f9-8dc1-13f29f550a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:27.831802 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4612/9196] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 16:12:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:12:27.876755 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:27.878217 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:27.946055 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb5f1a-7bdc-4bd4-bad9-93ffa481fbaa service neutron] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:27.951052 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:27.951698 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:27.951980 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:27.952754 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:27.960864 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:27.962466 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:27.971066 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4585/9197] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:12:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:12:37.064125 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:37.064510 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:37.064606 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:37.083088 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] MFA Rules not processed for user `cb7ed90a9d35448db6fe7f1528fd9df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:12:37.084306 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:37.091559 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4613/9198] 10.222.0.77 () {58 vars in 957 bytes} [Mon Jul 11 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:12:37.719262 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:37.730280 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c21adc-bd1f-4f7e-8f9c-89f7c72fd9f1 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:37.735383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:37.736021 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:37.736417 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:37.736704 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:37.739169 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:37.744430 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:37.745710 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:37.751781 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:37.753358 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5397e-437f-41d8-af8c-c04b1ecca1db service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:37.757350 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58bb42-ac74-4f4c-b5ef-7e3ee4782e6a None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:37.760973 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:37.761617 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:37.761904 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:37.762188 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:37.763535 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4586/9199] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:12:37.763971 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:37.778055 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:37.779513 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:37.790975 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4614/9200] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:12:38.966418 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] REQUEST_METHOD: `POST` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:38.966898 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:38.967153 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:38.985636 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.auth.core [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80990) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:12:38.986974 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:38.995391 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4587/9201] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:12:39.008063 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:39.019440 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afea100-ac12-43ce-8880-199061e6f04a service neutron] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:39.024689 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:39.025375 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:39.025783 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:39.026004 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:39.035324 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:39.037106 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:39.047534 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4615/9202] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:12:45.711393 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:45.731071 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08fda-0e56-444e-be7e-4a73164e07d6 None None] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:45.737144 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:45.737792 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:45.738150 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:45.738437 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:45.740711 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:45.755222 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:45.756828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:45.767380 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4588/9203] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:12:47.313352 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:47.322561 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e310-9200-48f6-bbf4-ce2e45eb7530 service swift] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:47.326172 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afe1d2602f5d4180a9d52fbef485bcd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:47.327500 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:47.327779 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:47.328052 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:47.329806 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:47.339086 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:47.340492 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63136b-39b4-4194-a9fa-1d7841f1c205 service neutron] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:47.348769 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4616/9204] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:12:47.659388 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:47.661044 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:47.674072 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98db34-74de-43d9-82b9-13737d501086 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:47.679248 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:47.679895 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:47.680207 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:47.680488 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:47.682234 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:47.694696 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:47.696311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:47.707699 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4589/9205] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:12:57.345357 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=46 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:57.702731 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=53 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:26.918931 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a760a9-4943-40cd-8efd-2b8853e11754 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:26.919424 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a760a9-4943-40cd-8efd-2b8853e11754 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:26.919524 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a760a9-4943-40cd-8efd-2b8853e11754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:26.977219 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-18a760a9-4943-40cd-8efd-2b8853e11754 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:14:26.978464 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-18a760a9-4943-40cd-8efd-2b8853e11754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:26.997499 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4617/9206] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Jul 11 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:14:27.038587 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:27.059870 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2e29-5ac9-4cec-955d-242bc9afe670 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:27.065258 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:27.065917 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:27.066356 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:27.066689 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:27.075300 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:27.077610 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:27.086235 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4590/9207] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:14:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:14:36.378457 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef567954-807b-4e39-9bfc-d7faee6dec54 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:36.378993 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef567954-807b-4e39-9bfc-d7faee6dec54 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:36.379090 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef567954-807b-4e39-9bfc-d7faee6dec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:36.397559 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-ef567954-807b-4e39-9bfc-d7faee6dec54 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:14:36.398805 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-ef567954-807b-4e39-9bfc-d7faee6dec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:36.406031 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4618/9208] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 16:14:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:14:36.417766 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:36.428664 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3bcc-258b-4e6c-af95-373b8f91ad93 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:36.434541 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:36.435354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:36.436135 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:36.436422 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:36.444701 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:36.446277 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:36.455696 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4591/9209] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:14:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:14:41.501812 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] REQUEST_METHOD: `POST` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:41.502282 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:41.502377 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:41.520096 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.auth.core [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] MFA Rules not processed for user `8399c431392046719f704ff154c9f729`. Rule list: `[]` (Enabled: `True`). {{(pid=80989) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:14:41.521298 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:41.528448 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4619/9210] 10.222.0.77 () {58 vars in 967 bytes} [Mon Jul 11 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:14:41.540289 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:41.551095 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e461-fa06-4253-b61d-4a6ea0d4817b service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:41.555997 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb9dad5761444d1a8f096c6c2c1cbf19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:41.556622 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:41.556905 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:41.557184 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:41.565899 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:41.567480 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:41.575368 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4592/9211] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Jul 11 16:14:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:14:51.514949 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=28 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:51.572225 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=22 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:53.002765 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:53.087538 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7cc2c-56b1-498f-bbe1-0c8838ae6605 None None] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:53.092157 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:53.093025 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:53.093312 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:53.093592 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] PATH_INFO: `/v3/users/cb7ed90a9d35448db6fe7f1528fd9df8` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:53.094847 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7ed90a9d35448db6fe7f1528fd9df8)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:53.096760 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:53.143930 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7ed90a9d35448db6fe7f1528fd9df8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.144595 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7ed90a9d35448db6fe7f1528fd9df8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.156291 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7ed90a9d35448db6fe7f1528fd9df8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.156928 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7ed90a9d35448db6fe7f1528fd9df8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.163793 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7ed90a9d35448db6fe7f1528fd9df8'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.176517 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4620/9212] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 16:14:53 2022] DELETE /identity/v3/users/cb7ed90a9d35448db6fe7f1528fd9df8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:14:53.350108 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:53.366028 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fd4d-a02e-490c-b34f-b70f8fefb531 service swift] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:53.422927 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:53.423787 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:53.424070 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:53.424354 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] PATH_INFO: `/v3/projects/043681f48f60450f95e7ef3d78175a5e` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:53.425516 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=043681f48f60450f95e7ef3d78175a5e)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:53.427456 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:53.473828 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043681f48f60450f95e7ef3d78175a5e', 'request_id': 'req-1580f3bb-5a77-45bb-886b-cdf82d684d1d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.479400 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043681f48f60450f95e7ef3d78175a5e', 'request_id': 'req-1580f3bb-5a77-45bb-886b-cdf82d684d1d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.487039 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043681f48f60450f95e7ef3d78175a5e', 'request_id': 'req-1580f3bb-5a77-45bb-886b-cdf82d684d1d'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.511182 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] The token cache is being invalidate because project 043681f48f60450f95e7ef3d78175a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:14:53.511473 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.512101 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.513661 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4593/9213] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 16:14:53 2022] DELETE /identity/v3/projects/043681f48f60450f95e7ef3d78175a5e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:14:53.517914 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:53.521372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:53.534554 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08b287-10ff-43f7-8d86-4b542d1dc9b5 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:53.590441 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:53.591341 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:53.591629 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:53.591913 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] PATH_INFO: `/v3/users/20f6899f964149688cb70d82603989f1` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:53.593116 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f6899f964149688cb70d82603989f1)` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:53.595072 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:53.597286 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:53.642876 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f6899f964149688cb70d82603989f1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.643550 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f6899f964149688cb70d82603989f1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.655800 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f6899f964149688cb70d82603989f1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.656428 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f6899f964149688cb70d82603989f1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.663240 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.notifications [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f6899f964149688cb70d82603989f1'} {{(pid=80989) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.676271 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4621/9214] 10.222.0.77 () {58 vars in 1223 bytes} [Mon Jul 11 16:14:53 2022] DELETE /identity/v3/users/20f6899f964149688cb70d82603989f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:14:53.844850 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:53.846383 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:53.862311 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f3bb-5a77-45bb-886b-cdf82d684d1d admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:53.921662 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99da4aa360e0445583e1621d96997686', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ef8c4b1c0304eae9ff050142c12cb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:53.922561 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:53.922856 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:53.923131 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] PATH_INFO: `/v3/projects/e982438c6be241ca868a110b5af224b1` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:53.925077 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e982438c6be241ca868a110b5af224b1)` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:53.927019 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:53.949516 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:53.975001 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e982438c6be241ca868a110b5af224b1', 'request_id': 'req-abb4319b-e102-4bf3-9fa9-8d35d18ce294'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.980439 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e982438c6be241ca868a110b5af224b1', 'request_id': 'req-abb4319b-e102-4bf3-9fa9-8d35d18ce294'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:53.988886 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e982438c6be241ca868a110b5af224b1', 'request_id': 'req-abb4319b-e102-4bf3-9fa9-8d35d18ce294'} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:54.000656 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] The token cache is being invalidate because project e982438c6be241ca868a110b5af224b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80990) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:14:54.000981 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:54.001598 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.notifications [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80990) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:14:54.003198 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4594/9215] 10.222.0.77 () {58 vars in 1232 bytes} [Mon Jul 11 16:14:53 2022] DELETE /identity/v3/projects/e982438c6be241ca868a110b5af224b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:15:03.672696 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:03.997337 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:48.690057 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:48.691497 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:48.809279 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c031b1-66a7-40b8-94cf-08e7bbb453b2 admin admin] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:48.867372 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:48.868273 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:48.868568 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:48.868845 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:48.870683 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:48.881541 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:48.883154 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:48.892891 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4622/9216] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:53.192023 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.193446 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:53.233165 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4319b-e102-4bf3-9fa9-8d35d18ce294 admin admin] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.238190 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.238868 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.239158 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.239434 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.241173 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.fernet_utils [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80990) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:53.253064 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.254677 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.264902 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4595/9217] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:58.888738 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=80 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:18:03.260237 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=17 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:54.698448 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] Authenticating user token {{(pid=80989) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:54.699882 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.fernet_utils [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80989) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:54.734861 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57435cc-a127-4740-b6bb-172ada872f84 service placement] Validating token access rules against request {{(pid=80989) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:54.739949 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60197-1e50-4fe8-8309-2fa203f1e541 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80989) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:54.740594 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60197-1e50-4fe8-8309-2fa203f1e541 service placement] REQUEST_METHOD: `GET` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:54.740885 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60197-1e50-4fe8-8309-2fa203f1e541 service placement] SCRIPT_NAME: `/identity` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:54.741166 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60197-1e50-4fe8-8309-2fa203f1e541 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80989) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:54.750334 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60197-1e50-4fe8-8309-2fa203f1e541 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:54.751977 n-d-master-1 devstack@keystone.service[80989]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60197-1e50-4fe8-8309-2fa203f1e541 service placement] RBAC: Authorization granted {{(pid=80989) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:54.761737 n-d-master-1 devstack@keystone.service[80989]: [pid: 80989|app: 0|req: 4623/9218] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:58.145268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] Authenticating user token {{(pid=80990) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:58.155694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab91d3-832e-4e91-9f8b-0126fd1fed54 service placement] Validating token access rules against request {{(pid=80990) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:58.161692 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb71e9-9339-4e22-a083-66fce2d88d00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54b9488fd1442f188054731e089bfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c300f7d942c043228fb3ede5022dd568', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80990) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:58.162342 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb71e9-9339-4e22-a083-66fce2d88d00 service placement] REQUEST_METHOD: `GET` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:58.162663 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb71e9-9339-4e22-a083-66fce2d88d00 service placement] SCRIPT_NAME: `/identity` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:58.162943 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb71e9-9339-4e22-a083-66fce2d88d00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80990) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:58.171694 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb71e9-9339-4e22-a083-66fce2d88d00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:58.173268 n-d-master-1 devstack@keystone.service[80990]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb71e9-9339-4e22-a083-66fce2d88d00 service placement] RBAC: Authorization granted {{(pid=80990) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:58.183220 n-d-master-1 devstack@keystone.service[80990]: [pid: 80990|app: 0|req: 4596/9219] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:23:04.757615 n-d-master-1 devstack@keystone.service[80989]: DEBUG dbcounter [-] [80989] Writing DB stats keystone:SELECT=15 {{(pid=80989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:23:08.178951 n-d-master-1 devstack@keystone.service[80990]: DEBUG dbcounter [-] [80990] Writing DB stats keystone:SELECT=6 {{(pid=80990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}